Sep 09 20:45:29.979324 ip-10-0-140-70 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 09 20:45:29.979340 ip-10-0-140-70 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 09 20:45:29.979349 ip-10-0-140-70 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 09 20:45:29.979825 ip-10-0-140-70 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 09 20:45:40.228624 ip-10-0-140-70 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 09 20:45:40.228641 ip-10-0-140-70 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot c4ae262b58f44515a2715586213b6a48 --
Sep 09 20:47:14.332953 ip-10-0-140-70 systemd[1]: Starting Kubernetes Kubelet...
Sep 09 20:47:14.751111 ip-10-0-140-70 kubenswrapper[2560]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 09 20:47:14.751111 ip-10-0-140-70 kubenswrapper[2560]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 09 20:47:14.751111 ip-10-0-140-70 kubenswrapper[2560]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 09 20:47:14.751111 ip-10-0-140-70 kubenswrapper[2560]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 09 20:47:14.751111 ip-10-0-140-70 kubenswrapper[2560]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 09 20:47:14.753813 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.753724    2560 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 09 20:47:14.758389 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.758374    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 20:47:14.758389 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.758388    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 20:47:14.758464 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.758394    2560 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 20:47:14.758464 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.758397    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 20:47:14.758464 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.758401    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 20:47:14.758464 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.758404    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 20:47:14.758464 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.758407    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 20:47:14.758464 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.758410    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 20:47:14.758464 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.758413    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 20:47:14.758464 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.758416    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 20:47:14.758464 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.758419    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 20:47:14.758464 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.758422    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 20:47:14.758464 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.758425    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 20:47:14.758464 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.758429    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 20:47:14.758464 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.758432    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 20:47:14.758464 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.758434    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 20:47:14.758464 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.758437    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 20:47:14.758464 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.758440    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 20:47:14.758464 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.758443    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 20:47:14.758464 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.758446    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 20:47:14.758464 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.758449    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 20:47:14.758464 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.758451    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 20:47:14.759054 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.758454    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 20:47:14.759054 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.758457    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 20:47:14.759054 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.758460    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 20:47:14.759054 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.758462    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 20:47:14.759054 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.758465    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 20:47:14.759054 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.758468    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 20:47:14.759054 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.758470    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 20:47:14.759054 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.758473    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 20:47:14.759054 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.758476    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 20:47:14.759054 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.758479    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 20:47:14.759054 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.758482    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 20:47:14.759054 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.758485    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 20:47:14.759054 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.758487    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 20:47:14.759054 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.758490    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 20:47:14.759054 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.758493    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 20:47:14.759054 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.758495    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 20:47:14.759054 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.758498    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 20:47:14.759054 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.758500    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 20:47:14.759054 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.758503    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 20:47:14.759054 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.758505    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 20:47:14.759536 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.758508    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 20:47:14.759536 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.758510    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 20:47:14.759536 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.758513    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 20:47:14.759536 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.758516    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 20:47:14.759536 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.758519    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 20:47:14.759536 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.758521    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 20:47:14.759536 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.758524    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 20:47:14.759536 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.758526    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 20:47:14.759536 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.758529    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 20:47:14.759536 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.758532    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 20:47:14.759536 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.758535    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 20:47:14.759536 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.758538    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 20:47:14.759536 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.758540    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 20:47:14.759536 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.758543    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 20:47:14.759536 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.758546    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 20:47:14.759536 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.758548    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 20:47:14.759536 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.758551    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 20:47:14.759536 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.758553    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 20:47:14.759536 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.758556    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 20:47:14.759536 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.758558    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 20:47:14.760050 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.758561    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 20:47:14.760050 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.758564    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 20:47:14.760050 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.758566    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 20:47:14.760050 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.758569    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 20:47:14.760050 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.758571    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 20:47:14.760050 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.758574    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 20:47:14.760050 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.758577    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 20:47:14.760050 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.758580    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 20:47:14.760050 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.758582    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 20:47:14.760050 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.758585    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 20:47:14.760050 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.758587    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 20:47:14.760050 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.758590    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 20:47:14.760050 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.758592    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 20:47:14.760050 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.758595    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 20:47:14.760050 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.758597    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 20:47:14.760050 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.758600    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 20:47:14.760050 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.758603    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 20:47:14.760050 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.758605    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 20:47:14.760050 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.758608    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 20:47:14.760500 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.758610    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 20:47:14.760500 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.758615    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 20:47:14.760500 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.758619    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 20:47:14.760500 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.758623    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 20:47:14.760500 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.758626    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 20:47:14.760500 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.758629    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 20:47:14.760500 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.758635    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 20:47:14.760500 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.758637    2560 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 20:47:14.760500 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.758640    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 20:47:14.760500 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.758643    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 20:47:14.760500 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.758647    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 20:47:14.760500 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.758651    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 20:47:14.760500 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.758668    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 20:47:14.760500 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.758671    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 20:47:14.760500 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.758674    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 20:47:14.760500 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.758677    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 20:47:14.760500 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.758679    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 20:47:14.760500 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.758682    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 20:47:14.760500 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.759371    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 20:47:14.760979 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.759378    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 20:47:14.760979 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.759381    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 20:47:14.760979 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.759384    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 20:47:14.760979 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.759387    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 20:47:14.760979 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.759390    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 20:47:14.760979 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.759393    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 20:47:14.760979 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.759396    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 20:47:14.760979 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.759398    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 20:47:14.760979 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.759401    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 20:47:14.760979 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.759404    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 20:47:14.760979 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.759407    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 20:47:14.760979 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.759410    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 20:47:14.760979 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.759412    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 20:47:14.760979 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.759415    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 20:47:14.760979 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.759418    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 20:47:14.760979 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.759421    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 20:47:14.760979 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.759423    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 20:47:14.760979 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.759426    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 20:47:14.760979 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.759429    2560 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 20:47:14.760979 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.759433    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 20:47:14.761504 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.759437    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 20:47:14.761504 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.759440    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 20:47:14.761504 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.759443    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 20:47:14.761504 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.759446    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 20:47:14.761504 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.759448    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 20:47:14.761504 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.759451    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 20:47:14.761504 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.759454    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 20:47:14.761504 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.759457    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 20:47:14.761504 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.759459    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 20:47:14.761504 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.759462    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 20:47:14.761504 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.759464    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 20:47:14.761504 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.759467    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 20:47:14.761504 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.759469    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 20:47:14.761504 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.759472    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 20:47:14.761504 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.759474    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 20:47:14.761504 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.759477    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 20:47:14.761504 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.759479    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 20:47:14.761504 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.759482    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 20:47:14.761504 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.759484    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 20:47:14.761504 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.759487    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 20:47:14.762010 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.759489    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 20:47:14.762010 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.759492    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 20:47:14.762010 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.759494    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 20:47:14.762010 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.759497    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 20:47:14.762010 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.759500    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 20:47:14.762010 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.759502    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 20:47:14.762010 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.759505    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 20:47:14.762010 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.759508    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 20:47:14.762010 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.759511    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 20:47:14.762010 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.759513    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 20:47:14.762010 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.759516    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 20:47:14.762010 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.759519    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 20:47:14.762010 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.759521    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 20:47:14.762010 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.759524    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 20:47:14.762010 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.759526    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 20:47:14.762010 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.759529    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 20:47:14.762010 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.759531    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 20:47:14.762010 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.759534    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 20:47:14.762010 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.759537    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 20:47:14.762010 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.759540    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 20:47:14.762500 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.759543    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 20:47:14.762500 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.759545    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 20:47:14.762500 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.759550    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 20:47:14.762500 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.759553    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 20:47:14.762500 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.759556    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 20:47:14.762500 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.759559    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 20:47:14.762500 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.759562    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 20:47:14.762500 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.759565    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 20:47:14.762500 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.759569    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 20:47:14.762500 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.759572    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 20:47:14.762500 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.759575    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 20:47:14.762500 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.759578    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 20:47:14.762500 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.759581    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 20:47:14.762500 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.759584    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 20:47:14.762500 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.759586    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 20:47:14.762500 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.759589    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 20:47:14.762500 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.759592    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 20:47:14.762500 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.759595    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 20:47:14.762500 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.759598    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 20:47:14.762987 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.759600    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 20:47:14.762987 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.759603    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 20:47:14.762987 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.759605    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 20:47:14.762987 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.759608    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 20:47:14.762987 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.759613    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 20:47:14.762987 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.759615    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 20:47:14.762987 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.759618    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 20:47:14.762987 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.759620    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 20:47:14.762987 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.759623    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 20:47:14.762987 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.759625    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 20:47:14.762987 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.759628    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 20:47:14.762987 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.759631    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 20:47:14.762987 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.759633    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 20:47:14.762987 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.759635    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 20:47:14.762987 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.759638    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 20:47:14.762987 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.759641    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 20:47:14.762987 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.759643    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 20:47:14.762987 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.759646    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 20:47:14.762987 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.759648    2560 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 20:47:14.762987 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.760090    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 20:47:14.763480 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.760096    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 20:47:14.763480 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.760099    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 20:47:14.763480 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.760103    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 20:47:14.763480 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.760106    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 20:47:14.763480 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.760109    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 20:47:14.763480 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.760111    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 20:47:14.763480 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.760114    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 20:47:14.763480 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.760117    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 20:47:14.763480 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.760120    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 20:47:14.763480 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.760123    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 20:47:14.763480 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.760127    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 20:47:14.763480 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.760131    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 20:47:14.763480 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.760133    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 20:47:14.763480 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.760136    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 20:47:14.763480 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.760139    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 20:47:14.763480 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.760141    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 20:47:14.763480 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.760144    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 20:47:14.763480 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.760148    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 20:47:14.763480 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.760150    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 20:47:14.763968 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.760153    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 20:47:14.763968 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.760155    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 20:47:14.763968 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.760158    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 20:47:14.763968 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.760160    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 20:47:14.763968 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.760163    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 20:47:14.763968 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.760166    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 20:47:14.763968 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.760168    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 20:47:14.763968 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.760171    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 20:47:14.763968 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.760174    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 20:47:14.763968 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.760176    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 20:47:14.763968 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.760178    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 20:47:14.763968 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.760183    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 20:47:14.763968 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.760186    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 20:47:14.763968 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.760189    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 20:47:14.763968 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.760191    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 20:47:14.763968 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.760194    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 20:47:14.763968 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.760198    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 20:47:14.763968 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.760201    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 20:47:14.763968 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.760204    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 20:47:14.764424 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.760207    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 20:47:14.764424 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.760210    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 20:47:14.764424 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.760213    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 20:47:14.764424 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.760216    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 20:47:14.764424 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.760219    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 20:47:14.764424 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.760222    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 20:47:14.764424 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.760225    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 20:47:14.764424 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.760228    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 20:47:14.764424 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.760230    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 20:47:14.764424 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.760233    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 20:47:14.764424 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.760236    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 20:47:14.764424 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.760239    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 20:47:14.764424 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.760241    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 20:47:14.764424 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.760244    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 20:47:14.764424 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.760246    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 20:47:14.764424 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.760249    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 20:47:14.764424 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.760251    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 20:47:14.764424 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.760254    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 20:47:14.764424 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.760256    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 20:47:14.764424 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.760259    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 20:47:14.764925 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.760262    2560 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 20:47:14.764925 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.760265    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 20:47:14.764925 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.760267    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 20:47:14.764925 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.760270    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 20:47:14.764925 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.760274    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 20:47:14.764925 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.760278    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 20:47:14.764925 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.760281    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 20:47:14.764925 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.760284    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 20:47:14.764925 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.760286    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 20:47:14.764925 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.760289    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 20:47:14.764925 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.760291    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 20:47:14.764925 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.760294    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 20:47:14.764925 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.760297    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 20:47:14.764925 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.760299    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 20:47:14.764925 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.760303    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 20:47:14.764925 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.760306    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 20:47:14.764925 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.760309    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 20:47:14.764925 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.760312    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 20:47:14.764925 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.760314    2560 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 20:47:14.764925 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.760317    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 20:47:14.765417 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.760319    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 20:47:14.765417 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.760322    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 20:47:14.765417 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.760324    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 20:47:14.765417 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.760327    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 20:47:14.765417 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.760329    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 20:47:14.765417 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.760332    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 20:47:14.765417 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.760334    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 20:47:14.765417 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.760337    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 20:47:14.765417 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.760339    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 20:47:14.765417 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.760342    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 20:47:14.765417 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.760344    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 20:47:14.765417 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.760347    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 20:47:14.765417 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.760349    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 20:47:14.765417 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.760352    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 20:47:14.765417 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.760354    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 20:47:14.765417 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.760357    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 20:47:14.765417 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.760360    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 20:47:14.765417 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.760363    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 20:47:14.765417 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.760365    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 20:47:14.765417 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.760368    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 20:47:14.765909 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760430    2560 flags.go:64] FLAG: --address="0.0.0.0"
Sep 09 20:47:14.765909 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760460    2560 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 09 20:47:14.765909 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760467    2560 flags.go:64] FLAG: --anonymous-auth="true"
Sep 09 20:47:14.765909 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760472    2560 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 09 20:47:14.765909 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760476    2560 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 09 20:47:14.765909 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760479    2560 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 09 20:47:14.765909 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760484    2560 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 09 20:47:14.765909 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760488    2560 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 09 20:47:14.765909 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760492    2560 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 09 20:47:14.765909 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760495    2560 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 09 20:47:14.765909 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760499    2560 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 09 20:47:14.765909 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760503    2560 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 09 20:47:14.765909 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760506    2560 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 09 20:47:14.765909 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760509    2560 flags.go:64] FLAG: --cgroup-root=""
Sep 09 20:47:14.765909 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760512    2560 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 09 20:47:14.765909 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760515    2560 flags.go:64] FLAG: --client-ca-file=""
Sep 09 20:47:14.765909 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760518    2560 flags.go:64] FLAG: --cloud-provider="external"
Sep 09 20:47:14.765909 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760521    2560 flags.go:64] FLAG: --cluster-dns="[]"
Sep 09 20:47:14.765909 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760525    2560 flags.go:64] FLAG: --cluster-domain=""
Sep 09 20:47:14.765909 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760528    2560 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 09 20:47:14.765909 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760531    2560 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 09 20:47:14.765909 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760534    2560 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 09 20:47:14.765909 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760537    2560 flags.go:64] FLAG: --container-log-max-files="5"
Sep 09 20:47:14.765909 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760541    2560 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 09 20:47:14.766508 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760544    2560 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 09 20:47:14.766508 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760547    2560 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 09 20:47:14.766508 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760551    2560 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 09 20:47:14.766508 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760554    2560 flags.go:64] FLAG: --contention-profiling="false"
Sep 09 20:47:14.766508 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760558    2560 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 09 20:47:14.766508 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760561    2560 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 09 20:47:14.766508 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760564    2560 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 09 20:47:14.766508 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760567    2560 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 09 20:47:14.766508 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760571    2560 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 09 20:47:14.766508 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760574    2560 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 09 20:47:14.766508 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760577    2560 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 09 20:47:14.766508 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760579    2560 flags.go:64] FLAG: --enable-load-reader="false"
Sep 09 20:47:14.766508 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760582    2560 flags.go:64] FLAG: --enable-server="true"
Sep 09 20:47:14.766508 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760585    2560 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 09 20:47:14.766508 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760590    2560 flags.go:64] FLAG: --event-burst="100"
Sep 09 20:47:14.766508 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760593    2560 flags.go:64] FLAG: --event-qps="50"
Sep 09 20:47:14.766508 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760596    2560 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 09 20:47:14.766508 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760599    2560 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 09 20:47:14.766508 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760601    2560 flags.go:64] FLAG: --eviction-hard=""
Sep 09 20:47:14.766508 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760606    2560 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 09 20:47:14.766508 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760609    2560 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 09 20:47:14.766508 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760612    2560 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 09 20:47:14.766508 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760615    2560 flags.go:64] FLAG: --eviction-soft=""
Sep 09 20:47:14.766508 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760617    2560 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 09 20:47:14.766508 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760620    2560 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 09 20:47:14.767165 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760623    2560 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 09 20:47:14.767165 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760626    2560 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 09 20:47:14.767165 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760629    2560 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 09 20:47:14.767165 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760632    2560 flags.go:64] FLAG: --fail-swap-on="true"
Sep 09 20:47:14.767165 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760635    2560 flags.go:64] FLAG: --feature-gates=""
Sep 09 20:47:14.767165 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760639    2560 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 09 20:47:14.767165 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760642    2560 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 09 20:47:14.767165 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760645    2560 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 09 20:47:14.767165 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760648    2560 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 09 20:47:14.767165 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760651    2560 flags.go:64] FLAG: --healthz-port="10248"
Sep 09 20:47:14.767165 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760668    2560 flags.go:64] FLAG: --help="false"
Sep 09 20:47:14.767165 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760671    2560 flags.go:64] FLAG: --hostname-override="ip-10-0-140-70.ec2.internal"
Sep 09 20:47:14.767165 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760675    2560 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 09 20:47:14.767165 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760678    2560 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 09 20:47:14.767165 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760681    2560 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 09 20:47:14.767165 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760684    2560 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 09 20:47:14.767165 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760688    2560 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 09 20:47:14.767165 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760691    2560 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 09 20:47:14.767165 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760694    2560 flags.go:64] FLAG: --image-service-endpoint=""
Sep 09 20:47:14.767165 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760697    2560 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 09 20:47:14.767165 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760700    2560 flags.go:64] FLAG: --kube-api-burst="100"
Sep 09 20:47:14.767165 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760703    2560 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 09 20:47:14.767165 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760707    2560 flags.go:64] FLAG: --kube-api-qps="50"
Sep 09 20:47:14.767165 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760710    2560 flags.go:64] FLAG: --kube-reserved=""
Sep 09 20:47:14.767779 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760713    2560 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 09 20:47:14.767779 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760715    2560 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 09 20:47:14.767779 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760719    2560 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 09 20:47:14.767779 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760729    2560 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 09 20:47:14.767779 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760732    2560 flags.go:64] FLAG: --lock-file=""
Sep 09 20:47:14.767779 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760735    2560 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 09 20:47:14.767779 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760738    2560 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 09 20:47:14.767779 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760741    2560 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 09 20:47:14.767779 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760746    2560 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 09 20:47:14.767779 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760749    2560 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 09 20:47:14.767779 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760752    2560 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 09 20:47:14.767779 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760755    2560 flags.go:64] FLAG: --logging-format="text"
Sep 09 20:47:14.767779 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760758    2560 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 09 20:47:14.767779 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760761    2560 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 09 20:47:14.767779 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760764    2560 flags.go:64] FLAG: --manifest-url=""
Sep 09 20:47:14.767779 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760767    2560 flags.go:64] FLAG: --manifest-url-header=""
Sep 09 20:47:14.767779 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760774    2560 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 09 20:47:14.767779 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760777    2560 flags.go:64] FLAG: --max-open-files="1000000"
Sep 09 20:47:14.767779 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760782    2560 flags.go:64] FLAG: --max-pods="110"
Sep 09 20:47:14.767779 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760785    2560 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 09 20:47:14.767779 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760788    2560 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 09 20:47:14.767779 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760791    2560 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 09 20:47:14.767779 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760794    2560 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 09 20:47:14.767779 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760798    2560 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 09 20:47:14.767779 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760801    2560 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 09 20:47:14.768647 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760803    2560 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 09 20:47:14.768647 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760810    2560 flags.go:64] FLAG: --node-status-max-images="50"
Sep 09 20:47:14.768647 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760813    2560 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 09 20:47:14.768647 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760816    2560 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 09 20:47:14.768647 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760820    2560 flags.go:64] FLAG: --pod-cidr=""
Sep 09 20:47:14.768647 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760822    2560 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1"
Sep 09 20:47:14.768647 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760828    2560 flags.go:64] FLAG: --pod-manifest-path=""
Sep 09 20:47:14.768647 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760831    2560 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 09 20:47:14.768647 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760838    2560 flags.go:64] FLAG: --pods-per-core="0"
Sep 09 20:47:14.768647 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760841    2560 flags.go:64] FLAG: --port="10250"
Sep 09 20:47:14.768647 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760849    2560 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 09 20:47:14.768647 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760852    2560 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0365ac7796366fac5"
Sep 09 20:47:14.768647 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760856    2560 flags.go:64] FLAG: --qos-reserved=""
Sep 09 20:47:14.768647 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760859    2560 flags.go:64] FLAG: --read-only-port="10255"
Sep 09 20:47:14.768647 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760862    2560 flags.go:64] FLAG: --register-node="true"
Sep 09 20:47:14.768647 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760865    2560 flags.go:64] FLAG: --register-with-taints=""
Sep 09 20:47:14.768647 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760869    2560 flags.go:64] FLAG: --registry-burst="10"
Sep 09 20:47:14.768647 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760872    2560 flags.go:64] FLAG: --registry-qps="5"
Sep 09 20:47:14.768647 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760875    2560 flags.go:64] FLAG: --reserved-cpus=""
Sep 09 20:47:14.768647 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760878    2560 flags.go:64] FLAG: --reserved-memory=""
Sep 09 20:47:14.768647 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760881    2560 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 09 20:47:14.768647 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760884    2560 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 09 20:47:14.768647 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760887    2560 flags.go:64] FLAG: --rotate-certificates="false"
Sep 09 20:47:14.768647 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760890    2560 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 09 20:47:14.768647 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760893    2560 flags.go:64] FLAG: --runonce="false"
Sep 09 20:47:14.769284 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760897    2560 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 09 20:47:14.769284 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760900    2560 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 09 20:47:14.769284 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760903    2560 flags.go:64] FLAG: --seccomp-default="false"
Sep 09 20:47:14.769284 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760906    2560 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 09 20:47:14.769284 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760909    2560 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 09 20:47:14.769284 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760912    2560 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 09 20:47:14.769284 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760915    2560 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 09 20:47:14.769284 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760918    2560 flags.go:64] FLAG: --storage-driver-password="root"
Sep 09 20:47:14.769284 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760921    2560 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 09 20:47:14.769284 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760924    2560 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 09 20:47:14.769284 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760927    2560 flags.go:64] FLAG: --storage-driver-user="root"
Sep 09 20:47:14.769284 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760930    2560 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 09 20:47:14.769284 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760933    2560 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 09 20:47:14.769284 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760936    2560 flags.go:64] FLAG: --system-cgroups=""
Sep 09 20:47:14.769284 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760939    2560 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 09 20:47:14.769284 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760944    2560 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 09 20:47:14.769284 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760947    2560 flags.go:64] FLAG: --tls-cert-file=""
Sep 09 20:47:14.769284 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760949    2560 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 09 20:47:14.769284 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760953    2560 flags.go:64] FLAG: --tls-min-version=""
Sep 09 20:47:14.769284 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760959    2560 flags.go:64] FLAG: --tls-private-key-file=""
Sep 09 20:47:14.769284 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760962    2560 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 09 20:47:14.769284 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760965    2560 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 09 20:47:14.769284 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760968    2560 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 09 20:47:14.769284 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760971    2560 flags.go:64] FLAG: --v="2"
Sep 09 20:47:14.769284 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760975    2560 flags.go:64] FLAG: --version="false"
Sep 09 20:47:14.770099 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760979    2560 flags.go:64] FLAG: --vmodule=""
Sep 09 20:47:14.770099 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760983    2560 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 09 20:47:14.770099 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.760987    2560 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 09 20:47:14.770099 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.761095    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 20:47:14.770099 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.761100    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 20:47:14.770099 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.761106    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 20:47:14.770099 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.761109    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 20:47:14.770099 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.761113    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 20:47:14.770099 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.761116    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 20:47:14.770099 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.761119    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 20:47:14.770099 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.761122    2560 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 20:47:14.770099 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.761125    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 20:47:14.770099 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.761129    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 20:47:14.770099 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.761133    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 20:47:14.770099 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.761135    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 20:47:14.770099 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.761138    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 20:47:14.770099 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.761141    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 20:47:14.770099 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.761144    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 20:47:14.770099 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.761147    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 20:47:14.770099 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.761150    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 20:47:14.770633 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.761152    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 20:47:14.770633 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.761155    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 20:47:14.770633 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.761157    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 20:47:14.770633 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.761160    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 20:47:14.770633 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.761162    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 20:47:14.770633 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.761165    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 20:47:14.770633 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.761167    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 20:47:14.770633 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.761171    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 20:47:14.770633 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.761174    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 20:47:14.770633 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.761176    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 20:47:14.770633 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.761179    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 20:47:14.770633 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.761182    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 20:47:14.770633 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.761184    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 20:47:14.770633 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.761187    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 20:47:14.770633 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.761190    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 20:47:14.770633 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.761193    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 20:47:14.770633 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.761195    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 20:47:14.770633 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.761199    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 20:47:14.770633 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.761202    2560 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 20:47:14.770633 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.761206    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 20:47:14.771154 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.761208    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 20:47:14.771154 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.761211    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 20:47:14.771154 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.761213    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 20:47:14.771154 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.761216    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 20:47:14.771154 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.761218    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 20:47:14.771154 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.761221    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 20:47:14.771154 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.761224    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 20:47:14.771154 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.761226    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 20:47:14.771154 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.761229    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 20:47:14.771154 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.761231    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 20:47:14.771154 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.761234    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 20:47:14.771154 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.761237    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 20:47:14.771154 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.761239    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 20:47:14.771154 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.761242    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 20:47:14.771154 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.761244    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 20:47:14.771154 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.761247    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 20:47:14.771154 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.761249    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 20:47:14.771154 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.761252    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 20:47:14.771154 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.761254    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 20:47:14.771154 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.761257    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 20:47:14.771642 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.761260    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 20:47:14.771642 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.761262    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 20:47:14.771642 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.761265    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 20:47:14.771642 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.761268    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 20:47:14.771642 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.761272    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 20:47:14.771642 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.761275    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 20:47:14.771642 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.761278    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 20:47:14.771642 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.761281    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 20:47:14.771642 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.761284    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 20:47:14.771642 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.761288    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 20:47:14.771642 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.761291    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 20:47:14.771642 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.761295    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 20:47:14.771642 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.761299    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 20:47:14.771642 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.761301    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 20:47:14.771642 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.761304    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 20:47:14.771642 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.761306    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 20:47:14.771642 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.761309    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 20:47:14.771642 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.761312    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 20:47:14.771642 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.761314    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 20:47:14.772124 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.761317    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 20:47:14.772124 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.761319    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 20:47:14.772124 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.761322    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 20:47:14.772124 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.761324    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 20:47:14.772124 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.761327    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 20:47:14.772124 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.761330    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 20:47:14.772124 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.761332    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 20:47:14.772124 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.761335    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 20:47:14.772124 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.761337    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 20:47:14.772124 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.761340    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 20:47:14.772124 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.761343    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 20:47:14.772124 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.761346    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 20:47:14.772124 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.761348    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 20:47:14.772124 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.761351    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 20:47:14.772124 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.761354    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 20:47:14.772124 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.761357    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 20:47:14.772124 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.761360    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 20:47:14.772124 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.761367    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 20:47:14.772124 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.761370    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 20:47:14.772124 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.761372    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 20:47:14.772621 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.761375    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 20:47:14.772621 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.761377    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 20:47:14.772621 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.761381    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 20:47:14.772621 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.762250    2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 09 20:47:14.772621 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.771128    2560 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 09 20:47:14.772621 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.771144    2560 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 09 20:47:14.772621 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.771961    2560 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 09 20:47:14.772621 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.771968    2560 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 09 20:47:14.772621 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772023    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 20:47:14.772621 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772028    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 20:47:14.772621 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772031    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 20:47:14.772621 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772034    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 20:47:14.772621 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772037    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 20:47:14.772621 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772040    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 20:47:14.772621 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772043    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 20:47:14.773016 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772046    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 20:47:14.773016 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772049    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 20:47:14.773016 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772051    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 20:47:14.773016 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772055    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 20:47:14.773016 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772058    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 20:47:14.773016 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772060    2560 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 20:47:14.773016 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772063    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 20:47:14.773016 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772066    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 20:47:14.773016 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772068    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 20:47:14.773016 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772071    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 20:47:14.773016 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772074    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 20:47:14.773016 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772076    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 20:47:14.773016 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772079    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 20:47:14.773016 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772083    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 20:47:14.773016 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772087    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 20:47:14.773016 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772091    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 20:47:14.773016 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772094    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 20:47:14.773016 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772097    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 20:47:14.773016 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772100    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 20:47:14.773489 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772103    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 20:47:14.773489 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772105    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 20:47:14.773489 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772109    2560 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 20:47:14.773489 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772112    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 20:47:14.773489 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772115    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 20:47:14.773489 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772118    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 20:47:14.773489 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772120    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 20:47:14.773489 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772123    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 20:47:14.773489 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772126    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 20:47:14.773489 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772129    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 20:47:14.773489 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772132    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 20:47:14.773489 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772135    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 20:47:14.773489 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772138    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 20:47:14.773489 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772141    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 20:47:14.773489 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772144    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 20:47:14.773489 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772146    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 20:47:14.773489 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772150    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 20:47:14.773489 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772152    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 20:47:14.773489 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772155    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 20:47:14.773489 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772158    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 20:47:14.774086 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772160    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 20:47:14.774086 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772163    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 20:47:14.774086 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772166    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 20:47:14.774086 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772168    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 20:47:14.774086 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772172    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 20:47:14.774086 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772175    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 20:47:14.774086 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772179    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 20:47:14.774086 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772182    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 20:47:14.774086 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772185    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 20:47:14.774086 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772188    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 20:47:14.774086 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772190    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 20:47:14.774086 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772193    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 20:47:14.774086 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772196    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 20:47:14.774086 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772199    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 20:47:14.774086 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772202    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 20:47:14.774086 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772205    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 20:47:14.774086 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772208    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 20:47:14.774086 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772211    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 20:47:14.774086 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772214    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 20:47:14.774543 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772217    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 20:47:14.774543 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772219    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 20:47:14.774543 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772222    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 20:47:14.774543 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772225    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 20:47:14.774543 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772227    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 20:47:14.774543 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772230    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 20:47:14.774543 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772232    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 20:47:14.774543 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772235    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 20:47:14.774543 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772237    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 20:47:14.774543 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772240    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 20:47:14.774543 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772243    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 20:47:14.774543 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772245    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 20:47:14.774543 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772248    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 20:47:14.774543 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772251    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 20:47:14.774543 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772254    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 20:47:14.774543 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772257    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 20:47:14.774543 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772260    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 20:47:14.774543 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772262    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 20:47:14.774543 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772265    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 20:47:14.774543 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772267    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 20:47:14.775050 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772270    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 20:47:14.775050 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772273    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 20:47:14.775050 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772275    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 20:47:14.775050 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772278    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 20:47:14.775050 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772280    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 20:47:14.775050 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772284    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 20:47:14.775050 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772288    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 20:47:14.775050 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772292    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 20:47:14.775050 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772294    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 20:47:14.775050 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772297    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 20:47:14.775050 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772300    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 20:47:14.775050 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772303    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 20:47:14.775050 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772306    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 20:47:14.775050 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772308    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 20:47:14.775050 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.772313    2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 09 20:47:14.775462 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772426    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 20:47:14.775462 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772431    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 20:47:14.775462 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772434    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 20:47:14.775462 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772437    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 20:47:14.775462 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772439    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 20:47:14.775462 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772442    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 20:47:14.775462 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772445    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 20:47:14.775462 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772448    2560 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 20:47:14.775462 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772451    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 20:47:14.775462 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772453    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 20:47:14.775462 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772456    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 20:47:14.775462 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772459    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 20:47:14.775462 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772462    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 20:47:14.775462 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772465    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 20:47:14.775462 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772469    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 20:47:14.775462 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772473    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 20:47:14.775462 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772476    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 20:47:14.775462 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772479    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 20:47:14.775462 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772482    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 20:47:14.775462 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772485    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 20:47:14.775972 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772487    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 20:47:14.775972 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772490    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 20:47:14.775972 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772493    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 20:47:14.775972 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772495    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 20:47:14.775972 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772498    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 20:47:14.775972 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772501    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 20:47:14.775972 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772504    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 20:47:14.775972 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772507    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 20:47:14.775972 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772510    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 20:47:14.775972 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772512    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 20:47:14.775972 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772515    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 20:47:14.775972 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772518    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 20:47:14.775972 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772520    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 20:47:14.775972 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772523    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 20:47:14.775972 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772525    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 20:47:14.775972 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772527    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 20:47:14.775972 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772530    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 20:47:14.775972 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772533    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 20:47:14.775972 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772535    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 20:47:14.775972 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772538    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 20:47:14.776502 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772540    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 20:47:14.776502 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772543    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 20:47:14.776502 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772545    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 20:47:14.776502 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772548    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 20:47:14.776502 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772551    2560 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 20:47:14.776502 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772554    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 20:47:14.776502 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772556    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 20:47:14.776502 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772559    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 20:47:14.776502 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772562    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 20:47:14.776502 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772564    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 20:47:14.776502 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772567    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 20:47:14.776502 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772569    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 20:47:14.776502 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772572    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 20:47:14.776502 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772574    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 20:47:14.776502 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772577    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 20:47:14.776502 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772580    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 20:47:14.776502 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772582    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 20:47:14.776502 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772585    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 20:47:14.776502 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772587    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 20:47:14.776502 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772590    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 20:47:14.777016 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772593    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 20:47:14.777016 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772595    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 20:47:14.777016 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772598    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 20:47:14.777016 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772600    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 20:47:14.777016 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772603    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 20:47:14.777016 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772605    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 20:47:14.777016 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772608    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 20:47:14.777016 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772610    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 20:47:14.777016 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772613    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 20:47:14.777016 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772616    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 20:47:14.777016 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772618    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 20:47:14.777016 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772621    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 20:47:14.777016 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772623    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 20:47:14.777016 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772626    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 20:47:14.777016 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772630    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 20:47:14.777016 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772634    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 20:47:14.777016 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772637    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 20:47:14.777016 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772639    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 20:47:14.777016 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772643    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 20:47:14.777016 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772646    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 20:47:14.777491 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772649    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 20:47:14.777491 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772652    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 20:47:14.777491 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772668    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 20:47:14.777491 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772671    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 20:47:14.777491 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772673    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 20:47:14.777491 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772676    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 20:47:14.777491 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772679    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 20:47:14.777491 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772681    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 20:47:14.777491 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772684    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 20:47:14.777491 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772687    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 20:47:14.777491 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772690    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 20:47:14.777491 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772692    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 20:47:14.777491 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772695    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 20:47:14.777491 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772698    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 20:47:14.777491 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772701    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 20:47:14.777491 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772705    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 20:47:14.777491 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772708    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 20:47:14.777491 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772710    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 20:47:14.777491 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:14.772713    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 20:47:14.778037 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.772718    2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 09 20:47:14.778037 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.772816    2560 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 09 20:47:14.778037 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.775140    2560 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 09 20:47:14.778037 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.776231    2560 server.go:1019] "Starting client certificate rotation"
Sep 09 20:47:14.778037 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.776324    2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 09 20:47:14.778037 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.776361    2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 09 20:47:14.779096 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.779082    2560 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 09 20:47:14.780201 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.780184    2560 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 09 20:47:14.791921 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.791899    2560 log.go:25] "Validated CRI v1 runtime API"
Sep 09 20:47:14.795731 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.795715    2560 log.go:25] "Validated CRI v1 image API"
Sep 09 20:47:14.796535 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.796521    2560 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 09 20:47:14.800692 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.800645    2560 fs.go:135] Filesystem UUIDs: map[79e01d72-a5ea-4ede-aaed-40765c236ce3:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 940cddf8-3d74-411d-b17a-9894c233073a:/dev/nvme0n1p4]
Sep 09 20:47:14.800774 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.800692    2560 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 09 20:47:14.805315 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.805296    2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 09 20:47:14.806690 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.806556    2560 manager.go:216] Machine: {Timestamp:2026-09-09 20:47:14.805178609 +0000 UTC m=+0.357984774 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3096664 MemoryCapacity:33164484608 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec22cef07fbe862d8cd94bb05c46ac5f SystemUUID:ec22cef0-7fbe-862d-8cd9-4bb05c46ac5f BootID:c4ae262b-58f4-4515-a271-5586213b6a48 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:a3:92:da:f4:4d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:a3:92:da:f4:4d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:4e:ea:e9:ac:ef:1d Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164484608 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 09 20:47:14.806690 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.806689    2560 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 09 20:47:14.806809 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.806785    2560 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 09 20:47:14.810422 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.810395    2560 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 09 20:47:14.810595 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.810425    2560 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-70.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 09 20:47:14.811212 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.811201    2560 topology_manager.go:138] "Creating topology manager with none policy"
Sep 09 20:47:14.811253 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.811215    2560 container_manager_linux.go:309] "Creating device plugin manager"
Sep 09 20:47:14.811253 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.811223    2560 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 09 20:47:14.812013 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.812003    2560 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 09 20:47:14.813101 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.813092    2560 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 09 20:47:14.817098 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.817087    2560 state_mem.go:36] "Initialized new in-memory state store"
Sep 09 20:47:14.817207 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.817198    2560 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 09 20:47:14.817243 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.817227    2560 kubelet.go:486] "Attempting to sync node with API server"
Sep 09 20:47:14.817243 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.817237    2560 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 09 20:47:14.817302 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.817250    2560 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 09 20:47:14.817302 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.817259    2560 kubelet.go:398] "Adding apiserver pod source"
Sep 09 20:47:14.817302 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.817267    2560 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 09 20:47:14.817614 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.817600    2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 09 20:47:14.817703 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.817619    2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 09 20:47:14.821075 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.821057    2560 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 09 20:47:14.823827 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.823813    2560 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 09 20:47:14.823874 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.823845    2560 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 09 20:47:14.825237 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.825223    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 09 20:47:14.825237 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.825239    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 09 20:47:14.825329 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.825245    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 09 20:47:14.825329 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.825251    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 09 20:47:14.825329 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.825260    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 09 20:47:14.825329 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.825266    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 09 20:47:14.825329 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.825280    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 09 20:47:14.825329 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.825285    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 09 20:47:14.825329 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.825291    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 09 20:47:14.825329 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.825297    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 09 20:47:14.825329 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.825311    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 09 20:47:14.825329 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.825317    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 09 20:47:14.826180 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.826166    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 09 20:47:14.826180 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.826179    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 09 20:47:14.826922 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:14.826901    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 09 20:47:14.826922 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:14.826902    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-70.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 09 20:47:14.829891 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.829879    2560 server.go:1268] "Started kubelet"
Sep 09 20:47:14.829993 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.829967    2560 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 09 20:47:14.830128 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.829956    2560 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 09 20:47:14.830180 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.830151    2560 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 09 20:47:14.830904 ip-10-0-140-70 systemd[1]: Started Kubernetes Kubelet.
Sep 09 20:47:14.831966 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.831685    2560 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 09 20:47:14.834884 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.834869    2560 server.go:310] "Adding debug handlers to kubelet server"
Sep 09 20:47:14.835197 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:14.835070    2560 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 09 20:47:14.839409 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.839392    2560 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 09 20:47:14.839478 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.839404    2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 09 20:47:14.839478 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:14.839466    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-70.ec2.internal\" not found"
Sep 09 20:47:14.840247 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.840216    2560 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 09 20:47:14.840337 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.840327    2560 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 09 20:47:14.840398 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.840391    2560 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 09 20:47:14.840553 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.840535    2560 reconstruct.go:97] "Volume reconstruction finished"
Sep 09 20:47:14.840553 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.840553    2560 reconciler.go:29] "Reconciler: start to sync state"
Sep 09 20:47:14.841352 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.841330    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-70.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 09 20:47:14.841450 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.841379    2560 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 09 20:47:14.841450 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.841392    2560 factory.go:55] Registering systemd factory
Sep 09 20:47:14.841450 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.841402    2560 factory.go:223] Registration of the systemd container factory successfully
Sep 09 20:47:14.841643 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.841632    2560 factory.go:153] Registering CRI-O factory
Sep 09 20:47:14.841713 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.841647    2560 factory.go:223] Registration of the crio container factory successfully
Sep 09 20:47:14.841713 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.841686    2560 factory.go:103] Registering Raw factory
Sep 09 20:47:14.841713 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.841701    2560 manager.go:1196] Started watching for new ooms in manager
Sep 09 20:47:14.842092 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.842072    2560 manager.go:349] Starting recovery of all containers
Sep 09 20:47:14.842403 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:14.841205    2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-70.ec2.internal.18d3c20c3de242e9  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-70.ec2.internal,UID:ip-10-0-140-70.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-70.ec2.internal,},FirstTimestamp:2026-09-09 20:47:14.829853417 +0000 UTC m=+0.382659580,LastTimestamp:2026-09-09 20:47:14.829853417 +0000 UTC m=+0.382659580,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-70.ec2.internal,}"
Sep 09 20:47:14.851677 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:14.851624    2560 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-70.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 09 20:47:14.851863 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:14.851834    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 09 20:47:14.852817 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.852628    2560 manager.go:354] Recovery completed
Sep 09 20:47:14.856501 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.856484    2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6kv97"
Sep 09 20:47:14.857791 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.857779    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 20:47:14.860177 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.860163    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-70.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 20:47:14.860236 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.860195    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-70.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 20:47:14.860236 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.860209    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-70.ec2.internal" event="NodeHasSufficientPID"
Sep 09 20:47:14.860785 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.860773    2560 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 09 20:47:14.860862 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.860786    2560 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 09 20:47:14.860862 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.860803    2560 state_mem.go:36] "Initialized new in-memory state store"
Sep 09 20:47:14.861197 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.861184    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 20:47:14.861990 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.861968    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-70.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 20:47:14.862062 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.862001    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-70.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 20:47:14.862062 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.862013    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-70.ec2.internal" event="NodeHasSufficientPID"
Sep 09 20:47:14.862689 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:14.862603    2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-70.ec2.internal.18d3c20c3fb0fe75  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-70.ec2.internal,UID:ip-10-0-140-70.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-70.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-70.ec2.internal,},FirstTimestamp:2026-09-09 20:47:14.860179061 +0000 UTC m=+0.412985228,LastTimestamp:2026-09-09 20:47:14.860179061 +0000 UTC m=+0.412985228,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-70.ec2.internal,}"
Sep 09 20:47:14.863110 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.863098    2560 policy_none.go:49] "None policy: Start"
Sep 09 20:47:14.863177 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.863117    2560 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 09 20:47:14.863177 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.863131    2560 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 09 20:47:14.864971 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.864956    2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6kv97"
Sep 09 20:47:14.866283 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.866271    2560 policy_none.go:47] "Start"
Sep 09 20:47:14.899226 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.899211    2560 manager.go:337] "Starting Device Plugin manager"
Sep 09 20:47:14.915735 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:14.899253    2560 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 09 20:47:14.915735 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.899266    2560 server.go:87] "Starting device plugin registration server"
Sep 09 20:47:14.915735 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.899606    2560 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 09 20:47:14.915735 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.899619    2560 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 09 20:47:14.915735 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.899722    2560 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 09 20:47:14.915735 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.899804    2560 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 09 20:47:14.915735 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.899811    2560 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 09 20:47:14.915735 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:14.900332    2560 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 09 20:47:14.915735 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:14.900384    2560 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-70.ec2.internal\" not found"
Sep 09 20:47:14.938983 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.938945    2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 09 20:47:14.940142 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.940112    2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 09 20:47:14.940242 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.940168    2560 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 09 20:47:14.940242 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.940194    2560 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 09 20:47:14.940341 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:14.940288    2560 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 09 20:47:14.943224 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:14.943203    2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 20:47:15.000570 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:15.000535    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 20:47:15.001721 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:15.001583    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-70.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 20:47:15.001721 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:15.001619    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-70.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 20:47:15.001721 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:15.001633    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-70.ec2.internal" event="NodeHasSufficientPID"
Sep 09 20:47:15.001721 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:15.001680    2560 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-70.ec2.internal"
Sep 09 20:47:15.011048 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:15.011029    2560 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-70.ec2.internal"
Sep 09 20:47:15.011167 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:15.011056    2560 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-70.ec2.internal\": node \"ip-10-0-140-70.ec2.internal\" not found"
Sep 09 20:47:15.036241 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:15.036215    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-70.ec2.internal\" not found"
Sep 09 20:47:15.041022 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:15.040376    2560 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-70.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-70.ec2.internal"]
Sep 09 20:47:15.041116 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:15.041082    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 20:47:15.042056 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:15.042039    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-70.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 20:47:15.042150 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:15.042073    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-70.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 20:47:15.042150 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:15.042088    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-70.ec2.internal" event="NodeHasSufficientPID"
Sep 09 20:47:15.044442 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:15.044427    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 20:47:15.044574 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:15.044560    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-70.ec2.internal"
Sep 09 20:47:15.044622 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:15.044588    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 20:47:15.045172 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:15.045157    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-70.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 20:47:15.045240 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:15.045183    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-70.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 20:47:15.045240 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:15.045193    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-70.ec2.internal" event="NodeHasSufficientPID"
Sep 09 20:47:15.045240 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:15.045157    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-70.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 20:47:15.045355 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:15.045259    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-70.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 20:47:15.045355 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:15.045270    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-70.ec2.internal" event="NodeHasSufficientPID"
Sep 09 20:47:15.047480 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:15.047463    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-70.ec2.internal"
Sep 09 20:47:15.047568 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:15.047489    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 20:47:15.048196 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:15.048181    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-70.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 20:47:15.048281 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:15.048205    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-70.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 20:47:15.048281 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:15.048215    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-70.ec2.internal" event="NodeHasSufficientPID"
Sep 09 20:47:15.062255 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:15.062234    2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-70.ec2.internal\" not found" node="ip-10-0-140-70.ec2.internal"
Sep 09 20:47:15.066307 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:15.066290    2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-70.ec2.internal\" not found" node="ip-10-0-140-70.ec2.internal"
Sep 09 20:47:15.137069 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:15.137030    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-70.ec2.internal\" not found"
Sep 09 20:47:15.237394 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:15.237352    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-70.ec2.internal\" not found"
Sep 09 20:47:15.241696 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:15.241676    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/eb343637b0e213fe1edad67234a3debb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-70.ec2.internal\" (UID: \"eb343637b0e213fe1edad67234a3debb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-70.ec2.internal"
Sep 09 20:47:15.241803 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:15.241712    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e0ddac653a796266e178e69d3c0547bd-config\") pod \"kube-apiserver-proxy-ip-10-0-140-70.ec2.internal\" (UID: \"e0ddac653a796266e178e69d3c0547bd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-70.ec2.internal"
Sep 09 20:47:15.241803 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:15.241736    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/eb343637b0e213fe1edad67234a3debb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-70.ec2.internal\" (UID: \"eb343637b0e213fe1edad67234a3debb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-70.ec2.internal"
Sep 09 20:47:15.338142 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:15.338058    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-70.ec2.internal\" not found"
Sep 09 20:47:15.342404 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:15.342383    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/eb343637b0e213fe1edad67234a3debb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-70.ec2.internal\" (UID: \"eb343637b0e213fe1edad67234a3debb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-70.ec2.internal"
Sep 09 20:47:15.342496 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:15.342418    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e0ddac653a796266e178e69d3c0547bd-config\") pod \"kube-apiserver-proxy-ip-10-0-140-70.ec2.internal\" (UID: \"e0ddac653a796266e178e69d3c0547bd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-70.ec2.internal"
Sep 09 20:47:15.342496 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:15.342442    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/eb343637b0e213fe1edad67234a3debb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-70.ec2.internal\" (UID: \"eb343637b0e213fe1edad67234a3debb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-70.ec2.internal"
Sep 09 20:47:15.342496 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:15.342484    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/eb343637b0e213fe1edad67234a3debb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-70.ec2.internal\" (UID: \"eb343637b0e213fe1edad67234a3debb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-70.ec2.internal"
Sep 09 20:47:15.342608 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:15.342494    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/eb343637b0e213fe1edad67234a3debb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-70.ec2.internal\" (UID: \"eb343637b0e213fe1edad67234a3debb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-70.ec2.internal"
Sep 09 20:47:15.342608 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:15.342502    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e0ddac653a796266e178e69d3c0547bd-config\") pod \"kube-apiserver-proxy-ip-10-0-140-70.ec2.internal\" (UID: \"e0ddac653a796266e178e69d3c0547bd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-70.ec2.internal"
Sep 09 20:47:15.364553 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:15.364522    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-70.ec2.internal"
Sep 09 20:47:15.369595 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:15.369449    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-70.ec2.internal"
Sep 09 20:47:15.439178 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:15.439132    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-70.ec2.internal\" not found"
Sep 09 20:47:16.640645 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:16.640621    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-70.ec2.internal\" not found"
Sep 09 20:47:16.741115 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:16.741051    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-70.ec2.internal\" not found"
Sep 09 20:47:16.841524 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:16.841493    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-70.ec2.internal\" not found"
Sep 09 20:47:16.876932 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:16.876900    2560 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 09 20:47:16.877379 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:16.877035    2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 09 20:47:16.942547 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:16.942506    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-70.ec2.internal\" not found"
Sep 09 20:47:16.962839 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:16.962810    2560 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 20:47:16.971364 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:16.971321    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-08 20:42:15 +0000 UTC" deadline="2028-06-27 12:22:26.305477076 +0000 UTC"
Sep 09 20:47:16.971364 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:16.971361    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15759h35m9.334119684s"
Sep 09 20:47:17.041573 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:17.041507    2560 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 20:47:17.041738 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:17.041594    2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-70.ec2.internal"
Sep 09 20:47:17.060038 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:17.060014    2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 09 20:47:17.061788 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:17.061774    2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-70.ec2.internal"
Sep 09 20:47:17.073798 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:17.073769    2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 09 20:47:17.216895 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:17.216858    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb343637b0e213fe1edad67234a3debb.slice/crio-b63bf21c44001e187928ed26ae4991d3fc62cfb4de2cae3723c019d82c6c56ad WatchSource:0}: Error finding container b63bf21c44001e187928ed26ae4991d3fc62cfb4de2cae3723c019d82c6c56ad: Status 404 returned error can't find the container with id b63bf21c44001e187928ed26ae4991d3fc62cfb4de2cae3723c019d82c6c56ad
Sep 09 20:47:17.217134 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:17.217107    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0ddac653a796266e178e69d3c0547bd.slice/crio-127b3b182af7b98cf8fbbf60ba7c433170f815573da32e70343ddaa9ec3bb859 WatchSource:0}: Error finding container 127b3b182af7b98cf8fbbf60ba7c433170f815573da32e70343ddaa9ec3bb859: Status 404 returned error can't find the container with id 127b3b182af7b98cf8fbbf60ba7c433170f815573da32e70343ddaa9ec3bb859
Sep 09 20:47:17.220857 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:17.220841    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 20:47:17.354256 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:17.354177    2560 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 20:47:17.799013 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:17.798932    2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 20:47:17.919483 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:17.919442    2560 apiserver.go:52] "Watching apiserver"
Sep 09 20:47:17.925867 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:17.925839    2560 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 09 20:47:17.928034 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:17.928009    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-kn9rn","openshift-multus/network-metrics-daemon-48bqr","openshift-network-diagnostics/network-check-target-ft6x6","kube-system/konnectivity-agent-jsj9x","kube-system/kube-apiserver-proxy-ip-10-0-140-70.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nnrzh","openshift-dns/node-resolver-rcqv7","openshift-image-registry/node-ca-t84p6","openshift-network-operator/iptables-alerter-thc8z","openshift-ovn-kubernetes/ovnkube-node-2thgv","kube-system/global-pull-secret-syncer-n276l","openshift-cluster-node-tuning-operator/tuned-ll5js","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-70.ec2.internal","openshift-multus/multus-additional-cni-plugins-tc4lg"]
Sep 09 20:47:17.930818 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:17.930796    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rcqv7"
Sep 09 20:47:17.932902 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:17.932863    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-t84p6"
Sep 09 20:47:17.933113 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:17.933092    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 09 20:47:17.933487 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:17.933290    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 09 20:47:17.933487 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:17.933348    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-b65vl\""
Sep 09 20:47:17.935228 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:17.935072    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-rsct6\""
Sep 09 20:47:17.935228 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:17.935084    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 09 20:47:17.935228 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:17.935132    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 09 20:47:17.935429 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:17.935403    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 09 20:47:17.935657 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:17.935643    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ft6x6"
Sep 09 20:47:17.935757 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:17.935734    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ft6x6" podUID="9586d9e2-2e7a-4b4b-bc48-5cadd9a9dc49"
Sep 09 20:47:17.938062 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:17.937884    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jsj9x"
Sep 09 20:47:17.940107 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:17.939963    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-glpps\""
Sep 09 20:47:17.940107 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:17.939994    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 09 20:47:17.940107 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:17.940104    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-kn9rn"
Sep 09 20:47:17.940266 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:17.940190    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 09 20:47:17.941652 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:17.941585    2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 09 20:47:17.942229 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:17.942209    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 09 20:47:17.942332 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:17.942216    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 09 20:47:17.942449 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:17.942428    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 09 20:47:17.942532 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:17.942494    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 09 20:47:17.942621 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:17.942599    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-54c4s\""
Sep 09 20:47:17.943024 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:17.942741    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nnrzh"
Sep 09 20:47:17.944766 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:17.944745    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 09 20:47:17.945109 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:17.944890    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 09 20:47:17.945109 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:17.944952    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 09 20:47:17.945109 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:17.945001    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-xw5fb\""
Sep 09 20:47:17.945303 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:17.945180    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-thc8z"
Sep 09 20:47:17.947396 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:17.947379    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tc4lg"
Sep 09 20:47:17.948063 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:17.948042    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-vb7gd\""
Sep 09 20:47:17.948153 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:17.948084    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 09 20:47:17.948153 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:17.948143    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 09 20:47:17.948957 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:17.948941    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 09 20:47:17.949592 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:17.949575    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 09 20:47:17.949934 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:17.949911    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-48bqr"
Sep 09 20:47:17.950026 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:17.949981    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-48bqr" podUID="e3794c68-57f8-4bf6-9a86-b564da84a425"
Sep 09 20:47:17.950084 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:17.950024    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 09 20:47:17.950084 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:17.950041    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e788234a-a38c-4b9f-bcd3-a2fa9642b26c-cnibin\") pod \"multus-kn9rn\" (UID: \"e788234a-a38c-4b9f-bcd3-a2fa9642b26c\") " pod="openshift-multus/multus-kn9rn"
Sep 09 20:47:17.950084 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:17.950066    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e788234a-a38c-4b9f-bcd3-a2fa9642b26c-multus-conf-dir\") pod \"multus-kn9rn\" (UID: \"e788234a-a38c-4b9f-bcd3-a2fa9642b26c\") " pod="openshift-multus/multus-kn9rn"
Sep 09 20:47:17.950213 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:17.950202    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-wvgpm\""
Sep 09 20:47:17.950530 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:17.950512    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7838e3a3-6b10-4a81-812c-c9b95e546534-device-dir\") pod \"aws-ebs-csi-driver-node-nnrzh\" (UID: \"7838e3a3-6b10-4a81-812c-c9b95e546534\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nnrzh"
Sep 09 20:47:17.950616 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:17.950545    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e788234a-a38c-4b9f-bcd3-a2fa9642b26c-hostroot\") pod \"multus-kn9rn\" (UID: \"e788234a-a38c-4b9f-bcd3-a2fa9642b26c\") " pod="openshift-multus/multus-kn9rn"
Sep 09 20:47:17.950616 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:17.950568    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wzkp\" (UniqueName: \"kubernetes.io/projected/9586d9e2-2e7a-4b4b-bc48-5cadd9a9dc49-kube-api-access-5wzkp\") pod \"network-check-target-ft6x6\" (UID: \"9586d9e2-2e7a-4b4b-bc48-5cadd9a9dc49\") " pod="openshift-network-diagnostics/network-check-target-ft6x6"
Sep 09 20:47:17.950616 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:17.950593    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e788234a-a38c-4b9f-bcd3-a2fa9642b26c-cni-binary-copy\") pod \"multus-kn9rn\" (UID: \"e788234a-a38c-4b9f-bcd3-a2fa9642b26c\") " pod="openshift-multus/multus-kn9rn"
Sep 09 20:47:17.950839 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:17.950615    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7838e3a3-6b10-4a81-812c-c9b95e546534-etc-selinux\") pod \"aws-ebs-csi-driver-node-nnrzh\" (UID: \"7838e3a3-6b10-4a81-812c-c9b95e546534\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nnrzh"
Sep 09 20:47:17.950839 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:17.950637    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7838e3a3-6b10-4a81-812c-c9b95e546534-sys-fs\") pod \"aws-ebs-csi-driver-node-nnrzh\" (UID: \"7838e3a3-6b10-4a81-812c-c9b95e546534\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nnrzh"
Sep 09 20:47:17.950839 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:17.950684    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/23e34008-d8bb-4baf-beef-dc0c8f67e8a8-hosts-file\") pod \"node-resolver-rcqv7\" (UID: \"23e34008-d8bb-4baf-beef-dc0c8f67e8a8\") " pod="openshift-dns/node-resolver-rcqv7"
Sep 09 20:47:17.950839 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:17.950717    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23e34008-d8bb-4baf-beef-dc0c8f67e8a8-tmp-dir\") pod \"node-resolver-rcqv7\" (UID: \"23e34008-d8bb-4baf-beef-dc0c8f67e8a8\") " pod="openshift-dns/node-resolver-rcqv7"
Sep 09 20:47:17.950839 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:17.950735    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e788234a-a38c-4b9f-bcd3-a2fa9642b26c-host-var-lib-kubelet\") pod \"multus-kn9rn\" (UID: \"e788234a-a38c-4b9f-bcd3-a2fa9642b26c\") " pod="openshift-multus/multus-kn9rn"
Sep 09 20:47:17.950839 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:17.950750    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8z8xt\" (UniqueName: \"kubernetes.io/projected/e788234a-a38c-4b9f-bcd3-a2fa9642b26c-kube-api-access-8z8xt\") pod \"multus-kn9rn\" (UID: \"e788234a-a38c-4b9f-bcd3-a2fa9642b26c\") " pod="openshift-multus/multus-kn9rn"
Sep 09 20:47:17.950839 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:17.950765    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7838e3a3-6b10-4a81-812c-c9b95e546534-registration-dir\") pod \"aws-ebs-csi-driver-node-nnrzh\" (UID: \"7838e3a3-6b10-4a81-812c-c9b95e546534\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nnrzh"
Sep 09 20:47:17.950839 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:17.950789    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4rts\" (UniqueName: \"kubernetes.io/projected/7838e3a3-6b10-4a81-812c-c9b95e546534-kube-api-access-z4rts\") pod \"aws-ebs-csi-driver-node-nnrzh\" (UID: \"7838e3a3-6b10-4a81-812c-c9b95e546534\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nnrzh"
Sep 09 20:47:17.950839 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:17.950808    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/372edd34-17d7-4bc8-8038-65a02776d964-konnectivity-ca\") pod \"konnectivity-agent-jsj9x\" (UID: \"372edd34-17d7-4bc8-8038-65a02776d964\") " pod="kube-system/konnectivity-agent-jsj9x"
Sep 09 20:47:17.950839 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:17.950822    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e788234a-a38c-4b9f-bcd3-a2fa9642b26c-multus-socket-dir-parent\") pod \"multus-kn9rn\" (UID: \"e788234a-a38c-4b9f-bcd3-a2fa9642b26c\") " pod="openshift-multus/multus-kn9rn"
Sep 09 20:47:17.950839 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:17.950835    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e788234a-a38c-4b9f-bcd3-a2fa9642b26c-host-run-k8s-cni-cncf-io\") pod \"multus-kn9rn\" (UID: \"e788234a-a38c-4b9f-bcd3-a2fa9642b26c\") " pod="openshift-multus/multus-kn9rn"
Sep 09 20:47:17.951299 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:17.950855    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7838e3a3-6b10-4a81-812c-c9b95e546534-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nnrzh\" (UID: \"7838e3a3-6b10-4a81-812c-c9b95e546534\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nnrzh"
Sep 09 20:47:17.951299 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:17.950891    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g24q6\" (UniqueName: \"kubernetes.io/projected/a7237351-1190-42ae-9092-b049a203cadc-kube-api-access-g24q6\") pod \"node-ca-t84p6\" (UID: \"a7237351-1190-42ae-9092-b049a203cadc\") " pod="openshift-image-registry/node-ca-t84p6"
Sep 09 20:47:17.951299 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:17.950912    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e788234a-a38c-4b9f-bcd3-a2fa9642b26c-host-var-lib-cni-bin\") pod \"multus-kn9rn\" (UID: \"e788234a-a38c-4b9f-bcd3-a2fa9642b26c\") " pod="openshift-multus/multus-kn9rn"
Sep 09 20:47:17.951299 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:17.950925    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e788234a-a38c-4b9f-bcd3-a2fa9642b26c-host-run-multus-certs\") pod \"multus-kn9rn\" (UID: \"e788234a-a38c-4b9f-bcd3-a2fa9642b26c\") " pod="openshift-multus/multus-kn9rn"
Sep 09 20:47:17.951299 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:17.950939    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjmhm\" (UniqueName: \"kubernetes.io/projected/23e34008-d8bb-4baf-beef-dc0c8f67e8a8-kube-api-access-cjmhm\") pod \"node-resolver-rcqv7\" (UID: \"23e34008-d8bb-4baf-beef-dc0c8f67e8a8\") " pod="openshift-dns/node-resolver-rcqv7"
Sep 09 20:47:17.951299 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:17.950958    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e788234a-a38c-4b9f-bcd3-a2fa9642b26c-multus-cni-dir\") pod \"multus-kn9rn\" (UID: \"e788234a-a38c-4b9f-bcd3-a2fa9642b26c\") " pod="openshift-multus/multus-kn9rn"
Sep 09 20:47:17.951299 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:17.950984    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e788234a-a38c-4b9f-bcd3-a2fa9642b26c-host-run-netns\") pod \"multus-kn9rn\" (UID: \"e788234a-a38c-4b9f-bcd3-a2fa9642b26c\") " pod="openshift-multus/multus-kn9rn"
Sep 09 20:47:17.951299 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:17.951005    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e788234a-a38c-4b9f-bcd3-a2fa9642b26c-multus-daemon-config\") pod \"multus-kn9rn\" (UID: \"e788234a-a38c-4b9f-bcd3-a2fa9642b26c\") " pod="openshift-multus/multus-kn9rn"
Sep 09 20:47:17.951299 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:17.951029    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/372edd34-17d7-4bc8-8038-65a02776d964-agent-certs\") pod \"konnectivity-agent-jsj9x\" (UID: \"372edd34-17d7-4bc8-8038-65a02776d964\") " pod="kube-system/konnectivity-agent-jsj9x"
Sep 09 20:47:17.951299 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:17.951050    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e788234a-a38c-4b9f-bcd3-a2fa9642b26c-host-var-lib-cni-multus\") pod \"multus-kn9rn\" (UID: \"e788234a-a38c-4b9f-bcd3-a2fa9642b26c\") " pod="openshift-multus/multus-kn9rn"
Sep 09 20:47:17.951299 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:17.951071    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e788234a-a38c-4b9f-bcd3-a2fa9642b26c-etc-kubernetes\") pod \"multus-kn9rn\" (UID: \"e788234a-a38c-4b9f-bcd3-a2fa9642b26c\") " pod="openshift-multus/multus-kn9rn"
Sep 09 20:47:17.951299 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:17.951088    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7838e3a3-6b10-4a81-812c-c9b95e546534-socket-dir\") pod \"aws-ebs-csi-driver-node-nnrzh\" (UID: \"7838e3a3-6b10-4a81-812c-c9b95e546534\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nnrzh"
Sep 09 20:47:17.951299 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:17.951129    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a7237351-1190-42ae-9092-b049a203cadc-host\") pod \"node-ca-t84p6\" (UID: \"a7237351-1190-42ae-9092-b049a203cadc\") " pod="openshift-image-registry/node-ca-t84p6"
Sep 09 20:47:17.951299 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:17.951153    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a7237351-1190-42ae-9092-b049a203cadc-serviceca\") pod \"node-ca-t84p6\" (UID: \"a7237351-1190-42ae-9092-b049a203cadc\") " pod="openshift-image-registry/node-ca-t84p6"
Sep 09 20:47:17.951299 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:17.951176    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e788234a-a38c-4b9f-bcd3-a2fa9642b26c-system-cni-dir\") pod \"multus-kn9rn\" (UID: \"e788234a-a38c-4b9f-bcd3-a2fa9642b26c\") " pod="openshift-multus/multus-kn9rn"
Sep 09 20:47:17.951299 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:17.951278    2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 09 20:47:17.952361 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:17.952343    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2thgv"
Sep 09 20:47:17.954946 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:17.954930    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n276l"
Sep 09 20:47:17.955024 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:17.954994    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n276l" podUID="34f7d128-9c82-4497-9766-0b314e3badce"
Sep 09 20:47:17.955508 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:17.955482    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 09 20:47:17.957399 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:17.957374    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ll5js"
Sep 09 20:47:17.959034 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:17.958955    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 09 20:47:17.959238 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:17.959213    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 09 20:47:17.959359 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:17.959263    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 09 20:47:17.959545 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:17.959519    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-ghr7z\""
Sep 09 20:47:17.959964 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:17.959626    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 09 20:47:17.959964 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:17.959694    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 09 20:47:17.959964 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:17.959729    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 09 20:47:17.959964 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:17.959731    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-nwg47\""
Sep 09 20:47:17.959964 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:17.959834    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 09 20:47:17.991860 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:17.991835    2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-s7b92"
Sep 09 20:47:18.007682 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.007646    2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-s7b92"
Sep 09 20:47:18.042423 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.042394    2560 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 09 20:47:18.047348 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.047289    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-70.ec2.internal" event={"ID":"e0ddac653a796266e178e69d3c0547bd","Type":"ContainerStarted","Data":"127b3b182af7b98cf8fbbf60ba7c433170f815573da32e70343ddaa9ec3bb859"}
Sep 09 20:47:18.048857 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.048800    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-70.ec2.internal" event={"ID":"eb343637b0e213fe1edad67234a3debb","Type":"ContainerStarted","Data":"b63bf21c44001e187928ed26ae4991d3fc62cfb4de2cae3723c019d82c6c56ad"}
Sep 09 20:47:18.052372 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.052306    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e788234a-a38c-4b9f-bcd3-a2fa9642b26c-multus-socket-dir-parent\") pod \"multus-kn9rn\" (UID: \"e788234a-a38c-4b9f-bcd3-a2fa9642b26c\") " pod="openshift-multus/multus-kn9rn"
Sep 09 20:47:18.052372 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.052345    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g24q6\" (UniqueName: \"kubernetes.io/projected/a7237351-1190-42ae-9092-b049a203cadc-kube-api-access-g24q6\") pod \"node-ca-t84p6\" (UID: \"a7237351-1190-42ae-9092-b049a203cadc\") " pod="openshift-image-registry/node-ca-t84p6"
Sep 09 20:47:18.052518 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.052375    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/25e8b7cb-d3ab-4da2-bcfe-c061509f457b-etc-openvswitch\") pod \"ovnkube-node-2thgv\" (UID: \"25e8b7cb-d3ab-4da2-bcfe-c061509f457b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2thgv"
Sep 09 20:47:18.052518 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.052399    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/25e8b7cb-d3ab-4da2-bcfe-c061509f457b-host-run-ovn-kubernetes\") pod \"ovnkube-node-2thgv\" (UID: \"25e8b7cb-d3ab-4da2-bcfe-c061509f457b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2thgv"
Sep 09 20:47:18.052518 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.052428    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/25e8b7cb-d3ab-4da2-bcfe-c061509f457b-ovnkube-config\") pod \"ovnkube-node-2thgv\" (UID: \"25e8b7cb-d3ab-4da2-bcfe-c061509f457b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2thgv"
Sep 09 20:47:18.052518 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.052445    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e788234a-a38c-4b9f-bcd3-a2fa9642b26c-multus-socket-dir-parent\") pod \"multus-kn9rn\" (UID: \"e788234a-a38c-4b9f-bcd3-a2fa9642b26c\") " pod="openshift-multus/multus-kn9rn"
Sep 09 20:47:18.052518 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.052451    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/25e8b7cb-d3ab-4da2-bcfe-c061509f457b-ovnkube-script-lib\") pod \"ovnkube-node-2thgv\" (UID: \"25e8b7cb-d3ab-4da2-bcfe-c061509f457b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2thgv"
Sep 09 20:47:18.052518 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.052497    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/587e1d46-bc7a-4cf8-be79-e09a04d6d3f5-host\") pod \"tuned-ll5js\" (UID: \"587e1d46-bc7a-4cf8-be79-e09a04d6d3f5\") " pod="openshift-cluster-node-tuning-operator/tuned-ll5js"
Sep 09 20:47:18.052810 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.052586    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/587e1d46-bc7a-4cf8-be79-e09a04d6d3f5-tmp\") pod \"tuned-ll5js\" (UID: \"587e1d46-bc7a-4cf8-be79-e09a04d6d3f5\") " pod="openshift-cluster-node-tuning-operator/tuned-ll5js"
Sep 09 20:47:18.052810 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.052632    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e788234a-a38c-4b9f-bcd3-a2fa9642b26c-host-run-multus-certs\") pod \"multus-kn9rn\" (UID: \"e788234a-a38c-4b9f-bcd3-a2fa9642b26c\") " pod="openshift-multus/multus-kn9rn"
Sep 09 20:47:18.052810 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.052720    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e788234a-a38c-4b9f-bcd3-a2fa9642b26c-host-run-multus-certs\") pod \"multus-kn9rn\" (UID: \"e788234a-a38c-4b9f-bcd3-a2fa9642b26c\") " pod="openshift-multus/multus-kn9rn"
Sep 09 20:47:18.052810 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.052771    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjmhm\" (UniqueName: \"kubernetes.io/projected/23e34008-d8bb-4baf-beef-dc0c8f67e8a8-kube-api-access-cjmhm\") pod \"node-resolver-rcqv7\" (UID: \"23e34008-d8bb-4baf-beef-dc0c8f67e8a8\") " pod="openshift-dns/node-resolver-rcqv7"
Sep 09 20:47:18.052810 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.052797    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/25e8b7cb-d3ab-4da2-bcfe-c061509f457b-run-openvswitch\") pod \"ovnkube-node-2thgv\" (UID: \"25e8b7cb-d3ab-4da2-bcfe-c061509f457b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2thgv"
Sep 09 20:47:18.053093 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.052821    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/587e1d46-bc7a-4cf8-be79-e09a04d6d3f5-etc-sysconfig\") pod \"tuned-ll5js\" (UID: \"587e1d46-bc7a-4cf8-be79-e09a04d6d3f5\") " pod="openshift-cluster-node-tuning-operator/tuned-ll5js"
Sep 09 20:47:18.053093 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.052844    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kb7gj\" (UniqueName: \"kubernetes.io/projected/b0a2a693-cb2a-40be-ad01-e26c3bb5e4fb-kube-api-access-kb7gj\") pod \"multus-additional-cni-plugins-tc4lg\" (UID: \"b0a2a693-cb2a-40be-ad01-e26c3bb5e4fb\") " pod="openshift-multus/multus-additional-cni-plugins-tc4lg"
Sep 09 20:47:18.053093 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.052866    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/25e8b7cb-d3ab-4da2-bcfe-c061509f457b-run-ovn\") pod \"ovnkube-node-2thgv\" (UID: \"25e8b7cb-d3ab-4da2-bcfe-c061509f457b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2thgv"
Sep 09 20:47:18.053093 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.052888    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/25e8b7cb-d3ab-4da2-bcfe-c061509f457b-host-cni-bin\") pod \"ovnkube-node-2thgv\" (UID: \"25e8b7cb-d3ab-4da2-bcfe-c061509f457b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2thgv"
Sep 09 20:47:18.053093 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.052907    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/587e1d46-bc7a-4cf8-be79-e09a04d6d3f5-var-lib-kubelet\") pod \"tuned-ll5js\" (UID: \"587e1d46-bc7a-4cf8-be79-e09a04d6d3f5\") " pod="openshift-cluster-node-tuning-operator/tuned-ll5js"
Sep 09 20:47:18.053093 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.052946    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/34f7d128-9c82-4497-9766-0b314e3badce-dbus\") pod \"global-pull-secret-syncer-n276l\" (UID: \"34f7d128-9c82-4497-9766-0b314e3badce\") " pod="kube-system/global-pull-secret-syncer-n276l"
Sep 09 20:47:18.053093 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.052982    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/372edd34-17d7-4bc8-8038-65a02776d964-agent-certs\") pod \"konnectivity-agent-jsj9x\" (UID: \"372edd34-17d7-4bc8-8038-65a02776d964\") " pod="kube-system/konnectivity-agent-jsj9x"
Sep 09 20:47:18.053093 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.053006    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e788234a-a38c-4b9f-bcd3-a2fa9642b26c-host-var-lib-cni-multus\") pod \"multus-kn9rn\" (UID: \"e788234a-a38c-4b9f-bcd3-a2fa9642b26c\") " pod="openshift-multus/multus-kn9rn"
Sep 09 20:47:18.053093 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.053028    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e788234a-a38c-4b9f-bcd3-a2fa9642b26c-etc-kubernetes\") pod \"multus-kn9rn\" (UID: \"e788234a-a38c-4b9f-bcd3-a2fa9642b26c\") " pod="openshift-multus/multus-kn9rn"
Sep 09 20:47:18.053093 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.053051    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7838e3a3-6b10-4a81-812c-c9b95e546534-socket-dir\") pod \"aws-ebs-csi-driver-node-nnrzh\" (UID: \"7838e3a3-6b10-4a81-812c-c9b95e546534\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nnrzh"
Sep 09 20:47:18.053093 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.053073    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a7237351-1190-42ae-9092-b049a203cadc-serviceca\") pod \"node-ca-t84p6\" (UID: \"a7237351-1190-42ae-9092-b049a203cadc\") " pod="openshift-image-registry/node-ca-t84p6"
Sep 09 20:47:18.053093 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.053094    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e788234a-a38c-4b9f-bcd3-a2fa9642b26c-system-cni-dir\") pod \"multus-kn9rn\" (UID: \"e788234a-a38c-4b9f-bcd3-a2fa9642b26c\") " pod="openshift-multus/multus-kn9rn"
Sep 09 20:47:18.053612 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.053116    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e788234a-a38c-4b9f-bcd3-a2fa9642b26c-multus-conf-dir\") pod \"multus-kn9rn\" (UID: \"e788234a-a38c-4b9f-bcd3-a2fa9642b26c\") " pod="openshift-multus/multus-kn9rn"
Sep 09 20:47:18.053612 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.053138    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7838e3a3-6b10-4a81-812c-c9b95e546534-device-dir\") pod \"aws-ebs-csi-driver-node-nnrzh\" (UID: \"7838e3a3-6b10-4a81-812c-c9b95e546534\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nnrzh"
Sep 09 20:47:18.053612 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.053169    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/25e8b7cb-d3ab-4da2-bcfe-c061509f457b-run-systemd\") pod \"ovnkube-node-2thgv\" (UID: \"25e8b7cb-d3ab-4da2-bcfe-c061509f457b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2thgv"
Sep 09 20:47:18.053612 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.053220    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e788234a-a38c-4b9f-bcd3-a2fa9642b26c-etc-kubernetes\") pod \"multus-kn9rn\" (UID: \"e788234a-a38c-4b9f-bcd3-a2fa9642b26c\") " pod="openshift-multus/multus-kn9rn"
Sep 09 20:47:18.053612 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.053233    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7838e3a3-6b10-4a81-812c-c9b95e546534-device-dir\") pod \"aws-ebs-csi-driver-node-nnrzh\" (UID: \"7838e3a3-6b10-4a81-812c-c9b95e546534\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nnrzh"
Sep 09 20:47:18.053612 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.053269    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/587e1d46-bc7a-4cf8-be79-e09a04d6d3f5-etc-kubernetes\") pod \"tuned-ll5js\" (UID: \"587e1d46-bc7a-4cf8-be79-e09a04d6d3f5\") " pod="openshift-cluster-node-tuning-operator/tuned-ll5js"
Sep 09 20:47:18.053612 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.053294    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/587e1d46-bc7a-4cf8-be79-e09a04d6d3f5-lib-modules\") pod \"tuned-ll5js\" (UID: \"587e1d46-bc7a-4cf8-be79-e09a04d6d3f5\") " pod="openshift-cluster-node-tuning-operator/tuned-ll5js"
Sep 09 20:47:18.053612 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.053320    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b0a2a693-cb2a-40be-ad01-e26c3bb5e4fb-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tc4lg\" (UID: \"b0a2a693-cb2a-40be-ad01-e26c3bb5e4fb\") " pod="openshift-multus/multus-additional-cni-plugins-tc4lg"
Sep 09 20:47:18.053612 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.053334    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7838e3a3-6b10-4a81-812c-c9b95e546534-socket-dir\") pod \"aws-ebs-csi-driver-node-nnrzh\" (UID: \"7838e3a3-6b10-4a81-812c-c9b95e546534\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nnrzh"
Sep 09 20:47:18.053612 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.053347    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sf4dz\" (UniqueName: \"kubernetes.io/projected/e3794c68-57f8-4bf6-9a86-b564da84a425-kube-api-access-sf4dz\") pod \"network-metrics-daemon-48bqr\" (UID: \"e3794c68-57f8-4bf6-9a86-b564da84a425\") " pod="openshift-multus/network-metrics-daemon-48bqr"
Sep 09 20:47:18.053612 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.053394    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/587e1d46-bc7a-4cf8-be79-e09a04d6d3f5-run\") pod \"tuned-ll5js\" (UID: \"587e1d46-bc7a-4cf8-be79-e09a04d6d3f5\") " pod="openshift-cluster-node-tuning-operator/tuned-ll5js"
Sep 09 20:47:18.053612 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.053404    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e788234a-a38c-4b9f-bcd3-a2fa9642b26c-host-var-lib-cni-multus\") pod \"multus-kn9rn\" (UID: \"e788234a-a38c-4b9f-bcd3-a2fa9642b26c\") " pod="openshift-multus/multus-kn9rn"
Sep 09 20:47:18.053612 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.053420    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b0a2a693-cb2a-40be-ad01-e26c3bb5e4fb-cni-binary-copy\") pod \"multus-additional-cni-plugins-tc4lg\" (UID: \"b0a2a693-cb2a-40be-ad01-e26c3bb5e4fb\") " pod="openshift-multus/multus-additional-cni-plugins-tc4lg"
Sep 09 20:47:18.053612 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.053442    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/34f7d128-9c82-4497-9766-0b314e3badce-kubelet-config\") pod \"global-pull-secret-syncer-n276l\" (UID: \"34f7d128-9c82-4497-9766-0b314e3badce\") " pod="kube-system/global-pull-secret-syncer-n276l"
Sep 09 20:47:18.053612 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.053465    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ds8dt\" (UniqueName: \"kubernetes.io/projected/25e8b7cb-d3ab-4da2-bcfe-c061509f457b-kube-api-access-ds8dt\") pod \"ovnkube-node-2thgv\" (UID: \"25e8b7cb-d3ab-4da2-bcfe-c061509f457b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2thgv"
Sep 09 20:47:18.053612 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.053491    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7838e3a3-6b10-4a81-812c-c9b95e546534-sys-fs\") pod \"aws-ebs-csi-driver-node-nnrzh\" (UID: \"7838e3a3-6b10-4a81-812c-c9b95e546534\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nnrzh"
Sep 09 20:47:18.053612 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.053522    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23e34008-d8bb-4baf-beef-dc0c8f67e8a8-tmp-dir\") pod \"node-resolver-rcqv7\" (UID: \"23e34008-d8bb-4baf-beef-dc0c8f67e8a8\") " pod="openshift-dns/node-resolver-rcqv7"
Sep 09 20:47:18.054427 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.053561    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/25e8b7cb-d3ab-4da2-bcfe-c061509f457b-log-socket\") pod \"ovnkube-node-2thgv\" (UID: \"25e8b7cb-d3ab-4da2-bcfe-c061509f457b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2thgv"
Sep 09 20:47:18.054427 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.053594    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/587e1d46-bc7a-4cf8-be79-e09a04d6d3f5-etc-sysctl-conf\") pod \"tuned-ll5js\" (UID: \"587e1d46-bc7a-4cf8-be79-e09a04d6d3f5\") " pod="openshift-cluster-node-tuning-operator/tuned-ll5js"
Sep 09 20:47:18.054427 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.053617    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/587e1d46-bc7a-4cf8-be79-e09a04d6d3f5-etc-tuned\") pod \"tuned-ll5js\" (UID: \"587e1d46-bc7a-4cf8-be79-e09a04d6d3f5\") " pod="openshift-cluster-node-tuning-operator/tuned-ll5js"
Sep 09 20:47:18.054427 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.053718    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8942m\" (UniqueName: \"kubernetes.io/projected/587e1d46-bc7a-4cf8-be79-e09a04d6d3f5-kube-api-access-8942m\") pod \"tuned-ll5js\" (UID: \"587e1d46-bc7a-4cf8-be79-e09a04d6d3f5\") " pod="openshift-cluster-node-tuning-operator/tuned-ll5js"
Sep 09 20:47:18.054427 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.053744    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7be027cd-cbd6-487e-a63c-e8c7e1e05d9a-iptables-alerter-script\") pod \"iptables-alerter-thc8z\" (UID: \"7be027cd-cbd6-487e-a63c-e8c7e1e05d9a\") " pod="openshift-network-operator/iptables-alerter-thc8z"
Sep 09 20:47:18.054427 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.053773    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e788234a-a38c-4b9f-bcd3-a2fa9642b26c-host-var-lib-kubelet\") pod \"multus-kn9rn\" (UID: \"e788234a-a38c-4b9f-bcd3-a2fa9642b26c\") " pod="openshift-multus/multus-kn9rn"
Sep 09 20:47:18.054427 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.053801    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8z8xt\" (UniqueName: \"kubernetes.io/projected/e788234a-a38c-4b9f-bcd3-a2fa9642b26c-kube-api-access-8z8xt\") pod \"multus-kn9rn\" (UID: \"e788234a-a38c-4b9f-bcd3-a2fa9642b26c\") " pod="openshift-multus/multus-kn9rn"
Sep 09 20:47:18.054427 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.053825    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4rts\" (UniqueName: \"kubernetes.io/projected/7838e3a3-6b10-4a81-812c-c9b95e546534-kube-api-access-z4rts\") pod \"aws-ebs-csi-driver-node-nnrzh\" (UID: \"7838e3a3-6b10-4a81-812c-c9b95e546534\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nnrzh"
Sep 09 20:47:18.054427 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.053828    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a7237351-1190-42ae-9092-b049a203cadc-serviceca\") pod \"node-ca-t84p6\" (UID: \"a7237351-1190-42ae-9092-b049a203cadc\") " pod="openshift-image-registry/node-ca-t84p6"
Sep 09 20:47:18.054427 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.053849    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/25e8b7cb-d3ab-4da2-bcfe-c061509f457b-ovn-node-metrics-cert\") pod \"ovnkube-node-2thgv\" (UID: \"25e8b7cb-d3ab-4da2-bcfe-c061509f457b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2thgv"
Sep 09 20:47:18.054427 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.053885    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/34f7d128-9c82-4497-9766-0b314e3badce-original-pull-secret\") pod \"global-pull-secret-syncer-n276l\" (UID: \"34f7d128-9c82-4497-9766-0b314e3badce\") " pod="kube-system/global-pull-secret-syncer-n276l"
Sep 09 20:47:18.054427 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.053928    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/372edd34-17d7-4bc8-8038-65a02776d964-konnectivity-ca\") pod \"konnectivity-agent-jsj9x\" (UID: \"372edd34-17d7-4bc8-8038-65a02776d964\") " pod="kube-system/konnectivity-agent-jsj9x"
Sep 09 20:47:18.054427 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.053951    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e788234a-a38c-4b9f-bcd3-a2fa9642b26c-host-run-k8s-cni-cncf-io\") pod \"multus-kn9rn\" (UID: \"e788234a-a38c-4b9f-bcd3-a2fa9642b26c\") " pod="openshift-multus/multus-kn9rn"
Sep 09 20:47:18.054427 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.053976    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7838e3a3-6b10-4a81-812c-c9b95e546534-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nnrzh\" (UID: \"7838e3a3-6b10-4a81-812c-c9b95e546534\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nnrzh"
Sep 09 20:47:18.054427 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.054013    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e788234a-a38c-4b9f-bcd3-a2fa9642b26c-multus-conf-dir\") pod \"multus-kn9rn\" (UID: \"e788234a-a38c-4b9f-bcd3-a2fa9642b26c\") " pod="openshift-multus/multus-kn9rn"
Sep 09 20:47:18.054427 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.053978    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e788234a-a38c-4b9f-bcd3-a2fa9642b26c-system-cni-dir\") pod \"multus-kn9rn\" (UID: \"e788234a-a38c-4b9f-bcd3-a2fa9642b26c\") " pod="openshift-multus/multus-kn9rn"
Sep 09 20:47:18.054427 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.054013    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/587e1d46-bc7a-4cf8-be79-e09a04d6d3f5-etc-systemd\") pod \"tuned-ll5js\" (UID: \"587e1d46-bc7a-4cf8-be79-e09a04d6d3f5\") " pod="openshift-cluster-node-tuning-operator/tuned-ll5js"
Sep 09 20:47:18.055196 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.054072    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e788234a-a38c-4b9f-bcd3-a2fa9642b26c-host-var-lib-cni-bin\") pod \"multus-kn9rn\" (UID: \"e788234a-a38c-4b9f-bcd3-a2fa9642b26c\") " pod="openshift-multus/multus-kn9rn"
Sep 09 20:47:18.055196 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.054098    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e788234a-a38c-4b9f-bcd3-a2fa9642b26c-multus-cni-dir\") pod \"multus-kn9rn\" (UID: \"e788234a-a38c-4b9f-bcd3-a2fa9642b26c\") " pod="openshift-multus/multus-kn9rn"
Sep 09 20:47:18.055196 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.054121    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e788234a-a38c-4b9f-bcd3-a2fa9642b26c-host-run-netns\") pod \"multus-kn9rn\" (UID: \"e788234a-a38c-4b9f-bcd3-a2fa9642b26c\") " pod="openshift-multus/multus-kn9rn"
Sep 09 20:47:18.055196 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.054144    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e788234a-a38c-4b9f-bcd3-a2fa9642b26c-multus-daemon-config\") pod \"multus-kn9rn\" (UID: \"e788234a-a38c-4b9f-bcd3-a2fa9642b26c\") " pod="openshift-multus/multus-kn9rn"
Sep 09 20:47:18.055196 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.054185    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/25e8b7cb-d3ab-4da2-bcfe-c061509f457b-host-kubelet\") pod \"ovnkube-node-2thgv\" (UID: \"25e8b7cb-d3ab-4da2-bcfe-c061509f457b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2thgv"
Sep 09 20:47:18.055196 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.054192    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e788234a-a38c-4b9f-bcd3-a2fa9642b26c-host-var-lib-kubelet\") pod \"multus-kn9rn\" (UID: \"e788234a-a38c-4b9f-bcd3-a2fa9642b26c\") " pod="openshift-multus/multus-kn9rn"
Sep 09 20:47:18.055196 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.054210    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7be027cd-cbd6-487e-a63c-e8c7e1e05d9a-host-slash\") pod \"iptables-alerter-thc8z\" (UID: \"7be027cd-cbd6-487e-a63c-e8c7e1e05d9a\") " pod="openshift-network-operator/iptables-alerter-thc8z"
Sep 09 20:47:18.055196 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.054234    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b0a2a693-cb2a-40be-ad01-e26c3bb5e4fb-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tc4lg\" (UID: \"b0a2a693-cb2a-40be-ad01-e26c3bb5e4fb\") " pod="openshift-multus/multus-additional-cni-plugins-tc4lg"
Sep 09 20:47:18.055196 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.054262    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a7237351-1190-42ae-9092-b049a203cadc-host\") pod \"node-ca-t84p6\" (UID: \"a7237351-1190-42ae-9092-b049a203cadc\") " pod="openshift-image-registry/node-ca-t84p6"
Sep 09 20:47:18.055196 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.054287    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/25e8b7cb-d3ab-4da2-bcfe-c061509f457b-host-run-netns\") pod \"ovnkube-node-2thgv\" (UID: \"25e8b7cb-d3ab-4da2-bcfe-c061509f457b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2thgv"
Sep 09 20:47:18.055196 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.054311    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/25e8b7cb-d3ab-4da2-bcfe-c061509f457b-env-overrides\") pod \"ovnkube-node-2thgv\" (UID: \"25e8b7cb-d3ab-4da2-bcfe-c061509f457b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2thgv"
Sep 09 20:47:18.055196 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.054339    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e788234a-a38c-4b9f-bcd3-a2fa9642b26c-host-run-k8s-cni-cncf-io\") pod \"multus-kn9rn\" (UID: \"e788234a-a38c-4b9f-bcd3-a2fa9642b26c\") " pod="openshift-multus/multus-kn9rn"
Sep 09 20:47:18.055196 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.054335    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/587e1d46-bc7a-4cf8-be79-e09a04d6d3f5-sys\") pod \"tuned-ll5js\" (UID: \"587e1d46-bc7a-4cf8-be79-e09a04d6d3f5\") " pod="openshift-cluster-node-tuning-operator/tuned-ll5js"
Sep 09 20:47:18.055196 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.054375    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxcfm\" (UniqueName: \"kubernetes.io/projected/7be027cd-cbd6-487e-a63c-e8c7e1e05d9a-kube-api-access-sxcfm\") pod \"iptables-alerter-thc8z\" (UID: \"7be027cd-cbd6-487e-a63c-e8c7e1e05d9a\") " pod="openshift-network-operator/iptables-alerter-thc8z"
Sep 09 20:47:18.055196 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.054387    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7838e3a3-6b10-4a81-812c-c9b95e546534-sys-fs\") pod \"aws-ebs-csi-driver-node-nnrzh\" (UID: \"7838e3a3-6b10-4a81-812c-c9b95e546534\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nnrzh"
Sep 09 20:47:18.055196 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.054402    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3794c68-57f8-4bf6-9a86-b564da84a425-metrics-certs\") pod \"network-metrics-daemon-48bqr\" (UID: \"e3794c68-57f8-4bf6-9a86-b564da84a425\") " pod="openshift-multus/network-metrics-daemon-48bqr"
Sep 09 20:47:18.055196 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.054428    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e788234a-a38c-4b9f-bcd3-a2fa9642b26c-cnibin\") pod \"multus-kn9rn\" (UID: \"e788234a-a38c-4b9f-bcd3-a2fa9642b26c\") " pod="openshift-multus/multus-kn9rn"
Sep 09 20:47:18.056060 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.054453    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/25e8b7cb-d3ab-4da2-bcfe-c061509f457b-host-cni-netd\") pod \"ovnkube-node-2thgv\" (UID: \"25e8b7cb-d3ab-4da2-bcfe-c061509f457b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2thgv"
Sep 09 20:47:18.056060 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.054476    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b0a2a693-cb2a-40be-ad01-e26c3bb5e4fb-system-cni-dir\") pod \"multus-additional-cni-plugins-tc4lg\" (UID: \"b0a2a693-cb2a-40be-ad01-e26c3bb5e4fb\") " pod="openshift-multus/multus-additional-cni-plugins-tc4lg"
Sep 09 20:47:18.056060 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.054503    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b0a2a693-cb2a-40be-ad01-e26c3bb5e4fb-cnibin\") pod \"multus-additional-cni-plugins-tc4lg\" (UID: \"b0a2a693-cb2a-40be-ad01-e26c3bb5e4fb\") " pod="openshift-multus/multus-additional-cni-plugins-tc4lg"
Sep 09 20:47:18.056060 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.054530    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b0a2a693-cb2a-40be-ad01-e26c3bb5e4fb-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tc4lg\" (UID: \"b0a2a693-cb2a-40be-ad01-e26c3bb5e4fb\") " pod="openshift-multus/multus-additional-cni-plugins-tc4lg"
Sep 09 20:47:18.056060 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.054593    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e788234a-a38c-4b9f-bcd3-a2fa9642b26c-hostroot\") pod \"multus-kn9rn\" (UID: \"e788234a-a38c-4b9f-bcd3-a2fa9642b26c\") " pod="openshift-multus/multus-kn9rn"
Sep 09 20:47:18.056060 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.054621    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/25e8b7cb-d3ab-4da2-bcfe-c061509f457b-node-log\") pod \"ovnkube-node-2thgv\" (UID: \"25e8b7cb-d3ab-4da2-bcfe-c061509f457b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2thgv"
Sep 09 20:47:18.056060 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.054636    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23e34008-d8bb-4baf-beef-dc0c8f67e8a8-tmp-dir\") pod \"node-resolver-rcqv7\" (UID: \"23e34008-d8bb-4baf-beef-dc0c8f67e8a8\") " pod="openshift-dns/node-resolver-rcqv7"
Sep 09 20:47:18.056060 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.054647    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/25e8b7cb-d3ab-4da2-bcfe-c061509f457b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2thgv\" (UID: \"25e8b7cb-d3ab-4da2-bcfe-c061509f457b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2thgv"
Sep 09 20:47:18.056060 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.054697    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wzkp\" (UniqueName: \"kubernetes.io/projected/9586d9e2-2e7a-4b4b-bc48-5cadd9a9dc49-kube-api-access-5wzkp\") pod \"network-check-target-ft6x6\" (UID: \"9586d9e2-2e7a-4b4b-bc48-5cadd9a9dc49\") " pod="openshift-network-diagnostics/network-check-target-ft6x6"
Sep 09 20:47:18.056060 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.054725    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e788234a-a38c-4b9f-bcd3-a2fa9642b26c-cni-binary-copy\") pod \"multus-kn9rn\" (UID: \"e788234a-a38c-4b9f-bcd3-a2fa9642b26c\") " pod="openshift-multus/multus-kn9rn"
Sep 09 20:47:18.056060 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.054732    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e788234a-a38c-4b9f-bcd3-a2fa9642b26c-host-var-lib-cni-bin\") pod \"multus-kn9rn\" (UID: \"e788234a-a38c-4b9f-bcd3-a2fa9642b26c\") " pod="openshift-multus/multus-kn9rn"
Sep 09 20:47:18.056060 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.054750    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7838e3a3-6b10-4a81-812c-c9b95e546534-etc-selinux\") pod \"aws-ebs-csi-driver-node-nnrzh\" (UID: \"7838e3a3-6b10-4a81-812c-c9b95e546534\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nnrzh"
Sep 09 20:47:18.056060 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.054776    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/23e34008-d8bb-4baf-beef-dc0c8f67e8a8-hosts-file\") pod \"node-resolver-rcqv7\" (UID: \"23e34008-d8bb-4baf-beef-dc0c8f67e8a8\") " pod="openshift-dns/node-resolver-rcqv7"
Sep 09 20:47:18.056060 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.054792    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e788234a-a38c-4b9f-bcd3-a2fa9642b26c-multus-cni-dir\") pod \"multus-kn9rn\" (UID: \"e788234a-a38c-4b9f-bcd3-a2fa9642b26c\") " pod="openshift-multus/multus-kn9rn"
Sep 09 20:47:18.056060 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.054802    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/25e8b7cb-d3ab-4da2-bcfe-c061509f457b-host-slash\") pod \"ovnkube-node-2thgv\" (UID: \"25e8b7cb-d3ab-4da2-bcfe-c061509f457b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2thgv"
Sep 09 20:47:18.056060 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.054829    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/25e8b7cb-d3ab-4da2-bcfe-c061509f457b-var-lib-openvswitch\") pod \"ovnkube-node-2thgv\" (UID: \"25e8b7cb-d3ab-4da2-bcfe-c061509f457b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2thgv"
Sep 09 20:47:18.056060 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.054856    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/587e1d46-bc7a-4cf8-be79-e09a04d6d3f5-etc-sysctl-d\") pod \"tuned-ll5js\" (UID: \"587e1d46-bc7a-4cf8-be79-e09a04d6d3f5\") " pod="openshift-cluster-node-tuning-operator/tuned-ll5js"
Sep 09 20:47:18.056874 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.054830    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e788234a-a38c-4b9f-bcd3-a2fa9642b26c-host-run-netns\") pod \"multus-kn9rn\" (UID: \"e788234a-a38c-4b9f-bcd3-a2fa9642b26c\") " pod="openshift-multus/multus-kn9rn"
Sep 09 20:47:18.056874 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.055271    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a7237351-1190-42ae-9092-b049a203cadc-host\") pod \"node-ca-t84p6\" (UID: \"a7237351-1190-42ae-9092-b049a203cadc\") " pod="openshift-image-registry/node-ca-t84p6"
Sep 09 20:47:18.056874 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.055319    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/587e1d46-bc7a-4cf8-be79-e09a04d6d3f5-etc-modprobe-d\") pod \"tuned-ll5js\" (UID: \"587e1d46-bc7a-4cf8-be79-e09a04d6d3f5\") " pod="openshift-cluster-node-tuning-operator/tuned-ll5js"
Sep 09 20:47:18.056874 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.055343    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7838e3a3-6b10-4a81-812c-c9b95e546534-registration-dir\") pod \"aws-ebs-csi-driver-node-nnrzh\" (UID: \"7838e3a3-6b10-4a81-812c-c9b95e546534\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nnrzh"
Sep 09 20:47:18.056874 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.055355    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e788234a-a38c-4b9f-bcd3-a2fa9642b26c-multus-daemon-config\") pod \"multus-kn9rn\" (UID: \"e788234a-a38c-4b9f-bcd3-a2fa9642b26c\") " pod="openshift-multus/multus-kn9rn"
Sep 09 20:47:18.056874 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.055361    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/25e8b7cb-d3ab-4da2-bcfe-c061509f457b-systemd-units\") pod \"ovnkube-node-2thgv\" (UID: \"25e8b7cb-d3ab-4da2-bcfe-c061509f457b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2thgv"
Sep 09 20:47:18.056874 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.055411    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e788234a-a38c-4b9f-bcd3-a2fa9642b26c-cnibin\") pod \"multus-kn9rn\" (UID: \"e788234a-a38c-4b9f-bcd3-a2fa9642b26c\") " pod="openshift-multus/multus-kn9rn"
Sep 09 20:47:18.056874 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.055447    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e788234a-a38c-4b9f-bcd3-a2fa9642b26c-hostroot\") pod \"multus-kn9rn\" (UID: \"e788234a-a38c-4b9f-bcd3-a2fa9642b26c\") " pod="openshift-multus/multus-kn9rn"
Sep 09 20:47:18.056874 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.055457    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7838e3a3-6b10-4a81-812c-c9b95e546534-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nnrzh\" (UID: \"7838e3a3-6b10-4a81-812c-c9b95e546534\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nnrzh"
Sep 09 20:47:18.056874 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.055491    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7838e3a3-6b10-4a81-812c-c9b95e546534-registration-dir\") pod \"aws-ebs-csi-driver-node-nnrzh\" (UID: \"7838e3a3-6b10-4a81-812c-c9b95e546534\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nnrzh"
Sep 09 20:47:18.056874 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.055529    2560 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 09 20:47:18.056874 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.055538    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/23e34008-d8bb-4baf-beef-dc0c8f67e8a8-hosts-file\") pod \"node-resolver-rcqv7\" (UID: \"23e34008-d8bb-4baf-beef-dc0c8f67e8a8\") " pod="openshift-dns/node-resolver-rcqv7"
Sep 09 20:47:18.056874 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.055545    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7838e3a3-6b10-4a81-812c-c9b95e546534-etc-selinux\") pod \"aws-ebs-csi-driver-node-nnrzh\" (UID: \"7838e3a3-6b10-4a81-812c-c9b95e546534\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nnrzh"
Sep 09 20:47:18.056874 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.055971    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/372edd34-17d7-4bc8-8038-65a02776d964-konnectivity-ca\") pod \"konnectivity-agent-jsj9x\" (UID: \"372edd34-17d7-4bc8-8038-65a02776d964\") " pod="kube-system/konnectivity-agent-jsj9x"
Sep 09 20:47:18.056874 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.056191    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e788234a-a38c-4b9f-bcd3-a2fa9642b26c-cni-binary-copy\") pod \"multus-kn9rn\" (UID: \"e788234a-a38c-4b9f-bcd3-a2fa9642b26c\") " pod="openshift-multus/multus-kn9rn"
Sep 09 20:47:18.061725 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.061656    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/372edd34-17d7-4bc8-8038-65a02776d964-agent-certs\") pod \"konnectivity-agent-jsj9x\" (UID: \"372edd34-17d7-4bc8-8038-65a02776d964\") " pod="kube-system/konnectivity-agent-jsj9x"
Sep 09 20:47:18.079893 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:18.079863    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 20:47:18.080051 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:18.079901    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 20:47:18.080051 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:18.079918    2560 projected.go:196] Error preparing data for projected volume kube-api-access-5wzkp for pod openshift-network-diagnostics/network-check-target-ft6x6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 20:47:18.080051 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:18.079991    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9586d9e2-2e7a-4b4b-bc48-5cadd9a9dc49-kube-api-access-5wzkp podName:9586d9e2-2e7a-4b4b-bc48-5cadd9a9dc49 nodeName:}" failed. No retries permitted until 2026-09-09 20:47:18.579968784 +0000 UTC m=+3.031760296 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-5wzkp" (UniqueName: "kubernetes.io/projected/9586d9e2-2e7a-4b4b-bc48-5cadd9a9dc49-kube-api-access-5wzkp") pod "network-check-target-ft6x6" (UID: "9586d9e2-2e7a-4b4b-bc48-5cadd9a9dc49") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 20:47:18.083134 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.083098    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjmhm\" (UniqueName: \"kubernetes.io/projected/23e34008-d8bb-4baf-beef-dc0c8f67e8a8-kube-api-access-cjmhm\") pod \"node-resolver-rcqv7\" (UID: \"23e34008-d8bb-4baf-beef-dc0c8f67e8a8\") " pod="openshift-dns/node-resolver-rcqv7"
Sep 09 20:47:18.084348 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.084321    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4rts\" (UniqueName: \"kubernetes.io/projected/7838e3a3-6b10-4a81-812c-c9b95e546534-kube-api-access-z4rts\") pod \"aws-ebs-csi-driver-node-nnrzh\" (UID: \"7838e3a3-6b10-4a81-812c-c9b95e546534\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nnrzh"
Sep 09 20:47:18.084660 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.084636    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8z8xt\" (UniqueName: \"kubernetes.io/projected/e788234a-a38c-4b9f-bcd3-a2fa9642b26c-kube-api-access-8z8xt\") pod \"multus-kn9rn\" (UID: \"e788234a-a38c-4b9f-bcd3-a2fa9642b26c\") " pod="openshift-multus/multus-kn9rn"
Sep 09 20:47:18.086342 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.086303    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g24q6\" (UniqueName: \"kubernetes.io/projected/a7237351-1190-42ae-9092-b049a203cadc-kube-api-access-g24q6\") pod \"node-ca-t84p6\" (UID: \"a7237351-1190-42ae-9092-b049a203cadc\") " pod="openshift-image-registry/node-ca-t84p6"
Sep 09 20:47:18.156410 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.156303    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/25e8b7cb-d3ab-4da2-bcfe-c061509f457b-ovn-node-metrics-cert\") pod \"ovnkube-node-2thgv\" (UID: \"25e8b7cb-d3ab-4da2-bcfe-c061509f457b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2thgv"
Sep 09 20:47:18.156410 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.156382    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/34f7d128-9c82-4497-9766-0b314e3badce-original-pull-secret\") pod \"global-pull-secret-syncer-n276l\" (UID: \"34f7d128-9c82-4497-9766-0b314e3badce\") " pod="kube-system/global-pull-secret-syncer-n276l"
Sep 09 20:47:18.156410 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.156410    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/587e1d46-bc7a-4cf8-be79-e09a04d6d3f5-etc-systemd\") pod \"tuned-ll5js\" (UID: \"587e1d46-bc7a-4cf8-be79-e09a04d6d3f5\") " pod="openshift-cluster-node-tuning-operator/tuned-ll5js"
Sep 09 20:47:18.156716 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.156438    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/25e8b7cb-d3ab-4da2-bcfe-c061509f457b-host-kubelet\") pod \"ovnkube-node-2thgv\" (UID: \"25e8b7cb-d3ab-4da2-bcfe-c061509f457b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2thgv"
Sep 09 20:47:18.156716 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.156462    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7be027cd-cbd6-487e-a63c-e8c7e1e05d9a-host-slash\") pod \"iptables-alerter-thc8z\" (UID: \"7be027cd-cbd6-487e-a63c-e8c7e1e05d9a\") " pod="openshift-network-operator/iptables-alerter-thc8z"
Sep 09 20:47:18.156716 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.156488    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b0a2a693-cb2a-40be-ad01-e26c3bb5e4fb-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tc4lg\" (UID: \"b0a2a693-cb2a-40be-ad01-e26c3bb5e4fb\") " pod="openshift-multus/multus-additional-cni-plugins-tc4lg"
Sep 09 20:47:18.156716 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.156516    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/25e8b7cb-d3ab-4da2-bcfe-c061509f457b-host-run-netns\") pod \"ovnkube-node-2thgv\" (UID: \"25e8b7cb-d3ab-4da2-bcfe-c061509f457b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2thgv"
Sep 09 20:47:18.156716 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.156532    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/587e1d46-bc7a-4cf8-be79-e09a04d6d3f5-etc-systemd\") pod \"tuned-ll5js\" (UID: \"587e1d46-bc7a-4cf8-be79-e09a04d6d3f5\") " pod="openshift-cluster-node-tuning-operator/tuned-ll5js"
Sep 09 20:47:18.156716 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.156580    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/25e8b7cb-d3ab-4da2-bcfe-c061509f457b-host-kubelet\") pod \"ovnkube-node-2thgv\" (UID: \"25e8b7cb-d3ab-4da2-bcfe-c061509f457b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2thgv"
Sep 09 20:47:18.156716 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.156540    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/25e8b7cb-d3ab-4da2-bcfe-c061509f457b-env-overrides\") pod \"ovnkube-node-2thgv\" (UID: \"25e8b7cb-d3ab-4da2-bcfe-c061509f457b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2thgv"
Sep 09 20:47:18.156716 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.156625    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/587e1d46-bc7a-4cf8-be79-e09a04d6d3f5-sys\") pod \"tuned-ll5js\" (UID: \"587e1d46-bc7a-4cf8-be79-e09a04d6d3f5\") " pod="openshift-cluster-node-tuning-operator/tuned-ll5js"
Sep 09 20:47:18.156716 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.156654    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxcfm\" (UniqueName: \"kubernetes.io/projected/7be027cd-cbd6-487e-a63c-e8c7e1e05d9a-kube-api-access-sxcfm\") pod \"iptables-alerter-thc8z\" (UID: \"7be027cd-cbd6-487e-a63c-e8c7e1e05d9a\") " pod="openshift-network-operator/iptables-alerter-thc8z"
Sep 09 20:47:18.156716 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.156697    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3794c68-57f8-4bf6-9a86-b564da84a425-metrics-certs\") pod \"network-metrics-daemon-48bqr\" (UID: \"e3794c68-57f8-4bf6-9a86-b564da84a425\") " pod="openshift-multus/network-metrics-daemon-48bqr"
Sep 09 20:47:18.156716 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.156724    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/25e8b7cb-d3ab-4da2-bcfe-c061509f457b-host-cni-netd\") pod \"ovnkube-node-2thgv\" (UID: \"25e8b7cb-d3ab-4da2-bcfe-c061509f457b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2thgv"
Sep 09 20:47:18.157229 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.156748    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b0a2a693-cb2a-40be-ad01-e26c3bb5e4fb-system-cni-dir\") pod \"multus-additional-cni-plugins-tc4lg\" (UID: \"b0a2a693-cb2a-40be-ad01-e26c3bb5e4fb\") " pod="openshift-multus/multus-additional-cni-plugins-tc4lg"
Sep 09 20:47:18.157229 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.156771    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b0a2a693-cb2a-40be-ad01-e26c3bb5e4fb-cnibin\") pod \"multus-additional-cni-plugins-tc4lg\" (UID: \"b0a2a693-cb2a-40be-ad01-e26c3bb5e4fb\") " pod="openshift-multus/multus-additional-cni-plugins-tc4lg"
Sep 09 20:47:18.157229 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.156792    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b0a2a693-cb2a-40be-ad01-e26c3bb5e4fb-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tc4lg\" (UID: \"b0a2a693-cb2a-40be-ad01-e26c3bb5e4fb\") " pod="openshift-multus/multus-additional-cni-plugins-tc4lg"
Sep 09 20:47:18.157229 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.156815    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/25e8b7cb-d3ab-4da2-bcfe-c061509f457b-node-log\") pod \"ovnkube-node-2thgv\" (UID: \"25e8b7cb-d3ab-4da2-bcfe-c061509f457b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2thgv"
Sep 09 20:47:18.157229 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.156841    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/25e8b7cb-d3ab-4da2-bcfe-c061509f457b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2thgv\" (UID: \"25e8b7cb-d3ab-4da2-bcfe-c061509f457b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2thgv"
Sep 09 20:47:18.157229 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.156884    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/25e8b7cb-d3ab-4da2-bcfe-c061509f457b-host-slash\") pod \"ovnkube-node-2thgv\" (UID: \"25e8b7cb-d3ab-4da2-bcfe-c061509f457b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2thgv"
Sep 09 20:47:18.157229 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.156588    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7be027cd-cbd6-487e-a63c-e8c7e1e05d9a-host-slash\") pod \"iptables-alerter-thc8z\" (UID: \"7be027cd-cbd6-487e-a63c-e8c7e1e05d9a\") " pod="openshift-network-operator/iptables-alerter-thc8z"
Sep 09 20:47:18.157229 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.156908    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/25e8b7cb-d3ab-4da2-bcfe-c061509f457b-var-lib-openvswitch\") pod \"ovnkube-node-2thgv\" (UID: \"25e8b7cb-d3ab-4da2-bcfe-c061509f457b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2thgv"
Sep 09 20:47:18.157229 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.156943    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/587e1d46-bc7a-4cf8-be79-e09a04d6d3f5-etc-sysctl-d\") pod \"tuned-ll5js\" (UID: \"587e1d46-bc7a-4cf8-be79-e09a04d6d3f5\") " pod="openshift-cluster-node-tuning-operator/tuned-ll5js"
Sep 09 20:47:18.157229 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.156950    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/25e8b7cb-d3ab-4da2-bcfe-c061509f457b-var-lib-openvswitch\") pod \"ovnkube-node-2thgv\" (UID: \"25e8b7cb-d3ab-4da2-bcfe-c061509f457b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2thgv"
Sep 09 20:47:18.157229 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.156970    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/587e1d46-bc7a-4cf8-be79-e09a04d6d3f5-etc-modprobe-d\") pod \"tuned-ll5js\" (UID: \"587e1d46-bc7a-4cf8-be79-e09a04d6d3f5\") " pod="openshift-cluster-node-tuning-operator/tuned-ll5js"
Sep 09 20:47:18.157229 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.156990    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/25e8b7cb-d3ab-4da2-bcfe-c061509f457b-host-cni-netd\") pod \"ovnkube-node-2thgv\" (UID: \"25e8b7cb-d3ab-4da2-bcfe-c061509f457b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2thgv"
Sep 09 20:47:18.157229 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.156995    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/25e8b7cb-d3ab-4da2-bcfe-c061509f457b-systemd-units\") pod \"ovnkube-node-2thgv\" (UID: \"25e8b7cb-d3ab-4da2-bcfe-c061509f457b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2thgv"
Sep 09 20:47:18.157229 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.157025    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b0a2a693-cb2a-40be-ad01-e26c3bb5e4fb-system-cni-dir\") pod \"multus-additional-cni-plugins-tc4lg\" (UID: \"b0a2a693-cb2a-40be-ad01-e26c3bb5e4fb\") " pod="openshift-multus/multus-additional-cni-plugins-tc4lg"
Sep 09 20:47:18.157229 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.157026    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/25e8b7cb-d3ab-4da2-bcfe-c061509f457b-etc-openvswitch\") pod \"ovnkube-node-2thgv\" (UID: \"25e8b7cb-d3ab-4da2-bcfe-c061509f457b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2thgv"
Sep 09 20:47:18.157229 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.157042    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/25e8b7cb-d3ab-4da2-bcfe-c061509f457b-env-overrides\") pod \"ovnkube-node-2thgv\" (UID: \"25e8b7cb-d3ab-4da2-bcfe-c061509f457b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2thgv"
Sep 09 20:47:18.157229 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.157058    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/25e8b7cb-d3ab-4da2-bcfe-c061509f457b-host-run-ovn-kubernetes\") pod \"ovnkube-node-2thgv\" (UID: \"25e8b7cb-d3ab-4da2-bcfe-c061509f457b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2thgv"
Sep 09 20:47:18.157229 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:18.156535    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 20:47:18.158077 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.157094    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/25e8b7cb-d3ab-4da2-bcfe-c061509f457b-ovnkube-config\") pod \"ovnkube-node-2thgv\" (UID: \"25e8b7cb-d3ab-4da2-bcfe-c061509f457b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2thgv"
Sep 09 20:47:18.158077 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.157100    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/587e1d46-bc7a-4cf8-be79-e09a04d6d3f5-sys\") pod \"tuned-ll5js\" (UID: \"587e1d46-bc7a-4cf8-be79-e09a04d6d3f5\") " pod="openshift-cluster-node-tuning-operator/tuned-ll5js"
Sep 09 20:47:18.158077 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.157106    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b0a2a693-cb2a-40be-ad01-e26c3bb5e4fb-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tc4lg\" (UID: \"b0a2a693-cb2a-40be-ad01-e26c3bb5e4fb\") " pod="openshift-multus/multus-additional-cni-plugins-tc4lg"
Sep 09 20:47:18.158077 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.157125    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/25e8b7cb-d3ab-4da2-bcfe-c061509f457b-ovnkube-script-lib\") pod \"ovnkube-node-2thgv\" (UID: \"25e8b7cb-d3ab-4da2-bcfe-c061509f457b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2thgv"
Sep 09 20:47:18.158077 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:18.157143    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34f7d128-9c82-4497-9766-0b314e3badce-original-pull-secret podName:34f7d128-9c82-4497-9766-0b314e3badce nodeName:}" failed. No retries permitted until 2026-09-09 20:47:18.657122959 +0000 UTC m=+3.108914485 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/34f7d128-9c82-4497-9766-0b314e3badce-original-pull-secret") pod "global-pull-secret-syncer-n276l" (UID: "34f7d128-9c82-4497-9766-0b314e3badce") : object "kube-system"/"original-pull-secret" not registered
Sep 09 20:47:18.158077 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:18.156900    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 20:47:18.158077 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.157231    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b0a2a693-cb2a-40be-ad01-e26c3bb5e4fb-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tc4lg\" (UID: \"b0a2a693-cb2a-40be-ad01-e26c3bb5e4fb\") " pod="openshift-multus/multus-additional-cni-plugins-tc4lg"
Sep 09 20:47:18.158077 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.157256    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/587e1d46-bc7a-4cf8-be79-e09a04d6d3f5-etc-sysctl-d\") pod \"tuned-ll5js\" (UID: \"587e1d46-bc7a-4cf8-be79-e09a04d6d3f5\") " pod="openshift-cluster-node-tuning-operator/tuned-ll5js"
Sep 09 20:47:18.158077 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.157274    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/25e8b7cb-d3ab-4da2-bcfe-c061509f457b-node-log\") pod \"ovnkube-node-2thgv\" (UID: \"25e8b7cb-d3ab-4da2-bcfe-c061509f457b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2thgv"
Sep 09 20:47:18.158077 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.157333    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/25e8b7cb-d3ab-4da2-bcfe-c061509f457b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2thgv\" (UID: \"25e8b7cb-d3ab-4da2-bcfe-c061509f457b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2thgv"
Sep 09 20:47:18.158077 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.157341    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/587e1d46-bc7a-4cf8-be79-e09a04d6d3f5-etc-modprobe-d\") pod \"tuned-ll5js\" (UID: \"587e1d46-bc7a-4cf8-be79-e09a04d6d3f5\") " pod="openshift-cluster-node-tuning-operator/tuned-ll5js"
Sep 09 20:47:18.158077 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.157379    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/25e8b7cb-d3ab-4da2-bcfe-c061509f457b-host-run-ovn-kubernetes\") pod \"ovnkube-node-2thgv\" (UID: \"25e8b7cb-d3ab-4da2-bcfe-c061509f457b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2thgv"
Sep 09 20:47:18.158077 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:18.157388    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3794c68-57f8-4bf6-9a86-b564da84a425-metrics-certs podName:e3794c68-57f8-4bf6-9a86-b564da84a425 nodeName:}" failed. No retries permitted until 2026-09-09 20:47:18.657373426 +0000 UTC m=+3.109164935 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3794c68-57f8-4bf6-9a86-b564da84a425-metrics-certs") pod "network-metrics-daemon-48bqr" (UID: "e3794c68-57f8-4bf6-9a86-b564da84a425") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 20:47:18.158077 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.157057    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/25e8b7cb-d3ab-4da2-bcfe-c061509f457b-etc-openvswitch\") pod \"ovnkube-node-2thgv\" (UID: \"25e8b7cb-d3ab-4da2-bcfe-c061509f457b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2thgv"
Sep 09 20:47:18.158077 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.157388    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/25e8b7cb-d3ab-4da2-bcfe-c061509f457b-systemd-units\") pod \"ovnkube-node-2thgv\" (UID: \"25e8b7cb-d3ab-4da2-bcfe-c061509f457b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2thgv"
Sep 09 20:47:18.158077 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.157414    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/25e8b7cb-d3ab-4da2-bcfe-c061509f457b-host-slash\") pod \"ovnkube-node-2thgv\" (UID: \"25e8b7cb-d3ab-4da2-bcfe-c061509f457b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2thgv"
Sep 09 20:47:18.158868 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.157418    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/587e1d46-bc7a-4cf8-be79-e09a04d6d3f5-host\") pod \"tuned-ll5js\" (UID: \"587e1d46-bc7a-4cf8-be79-e09a04d6d3f5\") " pod="openshift-cluster-node-tuning-operator/tuned-ll5js"
Sep 09 20:47:18.158868 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.157444    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/587e1d46-bc7a-4cf8-be79-e09a04d6d3f5-tmp\") pod \"tuned-ll5js\" (UID: \"587e1d46-bc7a-4cf8-be79-e09a04d6d3f5\") " pod="openshift-cluster-node-tuning-operator/tuned-ll5js"
Sep 09 20:47:18.158868 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.157456    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/587e1d46-bc7a-4cf8-be79-e09a04d6d3f5-host\") pod \"tuned-ll5js\" (UID: \"587e1d46-bc7a-4cf8-be79-e09a04d6d3f5\") " pod="openshift-cluster-node-tuning-operator/tuned-ll5js"
Sep 09 20:47:18.158868 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.157471    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/25e8b7cb-d3ab-4da2-bcfe-c061509f457b-run-openvswitch\") pod \"ovnkube-node-2thgv\" (UID: \"25e8b7cb-d3ab-4da2-bcfe-c061509f457b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2thgv"
Sep 09 20:47:18.158868 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.157488    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b0a2a693-cb2a-40be-ad01-e26c3bb5e4fb-cnibin\") pod \"multus-additional-cni-plugins-tc4lg\" (UID: \"b0a2a693-cb2a-40be-ad01-e26c3bb5e4fb\") " pod="openshift-multus/multus-additional-cni-plugins-tc4lg"
Sep 09 20:47:18.158868 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.157498    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/587e1d46-bc7a-4cf8-be79-e09a04d6d3f5-etc-sysconfig\") pod \"tuned-ll5js\" (UID: \"587e1d46-bc7a-4cf8-be79-e09a04d6d3f5\") " pod="openshift-cluster-node-tuning-operator/tuned-ll5js"
Sep 09 20:47:18.158868 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.157530    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/25e8b7cb-d3ab-4da2-bcfe-c061509f457b-host-run-netns\") pod \"ovnkube-node-2thgv\" (UID: \"25e8b7cb-d3ab-4da2-bcfe-c061509f457b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2thgv"
Sep 09 20:47:18.158868 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.157554    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/587e1d46-bc7a-4cf8-be79-e09a04d6d3f5-etc-sysconfig\") pod \"tuned-ll5js\" (UID: \"587e1d46-bc7a-4cf8-be79-e09a04d6d3f5\") " pod="openshift-cluster-node-tuning-operator/tuned-ll5js"
Sep 09 20:47:18.158868 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.157558    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kb7gj\" (UniqueName: \"kubernetes.io/projected/b0a2a693-cb2a-40be-ad01-e26c3bb5e4fb-kube-api-access-kb7gj\") pod \"multus-additional-cni-plugins-tc4lg\" (UID: \"b0a2a693-cb2a-40be-ad01-e26c3bb5e4fb\") " pod="openshift-multus/multus-additional-cni-plugins-tc4lg"
Sep 09 20:47:18.158868 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.157592    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/25e8b7cb-d3ab-4da2-bcfe-c061509f457b-run-ovn\") pod \"ovnkube-node-2thgv\" (UID: \"25e8b7cb-d3ab-4da2-bcfe-c061509f457b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2thgv"
Sep 09 20:47:18.158868 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.157593    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/25e8b7cb-d3ab-4da2-bcfe-c061509f457b-ovnkube-script-lib\") pod \"ovnkube-node-2thgv\" (UID: \"25e8b7cb-d3ab-4da2-bcfe-c061509f457b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2thgv"
Sep 09 20:47:18.158868 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.157617    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/25e8b7cb-d3ab-4da2-bcfe-c061509f457b-host-cni-bin\") pod \"ovnkube-node-2thgv\" (UID: \"25e8b7cb-d3ab-4da2-bcfe-c061509f457b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2thgv"
Sep 09 20:47:18.158868 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.157644    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/587e1d46-bc7a-4cf8-be79-e09a04d6d3f5-var-lib-kubelet\") pod \"tuned-ll5js\" (UID: \"587e1d46-bc7a-4cf8-be79-e09a04d6d3f5\") " pod="openshift-cluster-node-tuning-operator/tuned-ll5js"
Sep 09 20:47:18.158868 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.157667    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/34f7d128-9c82-4497-9766-0b314e3badce-dbus\") pod \"global-pull-secret-syncer-n276l\" (UID: \"34f7d128-9c82-4497-9766-0b314e3badce\") " pod="kube-system/global-pull-secret-syncer-n276l"
Sep 09 20:47:18.158868 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.157721    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/25e8b7cb-d3ab-4da2-bcfe-c061509f457b-run-systemd\") pod \"ovnkube-node-2thgv\" (UID: \"25e8b7cb-d3ab-4da2-bcfe-c061509f457b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2thgv"
Sep 09 20:47:18.158868 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.157744    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/587e1d46-bc7a-4cf8-be79-e09a04d6d3f5-etc-kubernetes\") pod \"tuned-ll5js\" (UID: \"587e1d46-bc7a-4cf8-be79-e09a04d6d3f5\") " pod="openshift-cluster-node-tuning-operator/tuned-ll5js"
Sep 09 20:47:18.158868 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.157767    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/587e1d46-bc7a-4cf8-be79-e09a04d6d3f5-lib-modules\") pod \"tuned-ll5js\" (UID: \"587e1d46-bc7a-4cf8-be79-e09a04d6d3f5\") " pod="openshift-cluster-node-tuning-operator/tuned-ll5js"
Sep 09 20:47:18.158868 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.157793    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/25e8b7cb-d3ab-4da2-bcfe-c061509f457b-run-ovn\") pod \"ovnkube-node-2thgv\" (UID: \"25e8b7cb-d3ab-4da2-bcfe-c061509f457b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2thgv"
Sep 09 20:47:18.159706 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.157793    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b0a2a693-cb2a-40be-ad01-e26c3bb5e4fb-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tc4lg\" (UID: \"b0a2a693-cb2a-40be-ad01-e26c3bb5e4fb\") " pod="openshift-multus/multus-additional-cni-plugins-tc4lg"
Sep 09 20:47:18.159706 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.157839    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sf4dz\" (UniqueName: \"kubernetes.io/projected/e3794c68-57f8-4bf6-9a86-b564da84a425-kube-api-access-sf4dz\") pod \"network-metrics-daemon-48bqr\" (UID: \"e3794c68-57f8-4bf6-9a86-b564da84a425\") " pod="openshift-multus/network-metrics-daemon-48bqr"
Sep 09 20:47:18.159706 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.157866    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/587e1d46-bc7a-4cf8-be79-e09a04d6d3f5-run\") pod \"tuned-ll5js\" (UID: \"587e1d46-bc7a-4cf8-be79-e09a04d6d3f5\") " pod="openshift-cluster-node-tuning-operator/tuned-ll5js"
Sep 09 20:47:18.159706 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.157884    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/25e8b7cb-d3ab-4da2-bcfe-c061509f457b-ovnkube-config\") pod \"ovnkube-node-2thgv\" (UID: \"25e8b7cb-d3ab-4da2-bcfe-c061509f457b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2thgv"
Sep 09 20:47:18.159706 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.157922    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/587e1d46-bc7a-4cf8-be79-e09a04d6d3f5-run\") pod \"tuned-ll5js\" (UID: \"587e1d46-bc7a-4cf8-be79-e09a04d6d3f5\") " pod="openshift-cluster-node-tuning-operator/tuned-ll5js"
Sep 09 20:47:18.159706 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.157939    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/25e8b7cb-d3ab-4da2-bcfe-c061509f457b-run-openvswitch\") pod \"ovnkube-node-2thgv\" (UID: \"25e8b7cb-d3ab-4da2-bcfe-c061509f457b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2thgv"
Sep 09 20:47:18.159706 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.157994    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/34f7d128-9c82-4497-9766-0b314e3badce-dbus\") pod \"global-pull-secret-syncer-n276l\" (UID: \"34f7d128-9c82-4497-9766-0b314e3badce\") " pod="kube-system/global-pull-secret-syncer-n276l"
Sep 09 20:47:18.159706 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.158039    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/25e8b7cb-d3ab-4da2-bcfe-c061509f457b-host-cni-bin\") pod \"ovnkube-node-2thgv\" (UID: \"25e8b7cb-d3ab-4da2-bcfe-c061509f457b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2thgv"
Sep 09 20:47:18.159706 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.158086    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/587e1d46-bc7a-4cf8-be79-e09a04d6d3f5-var-lib-kubelet\") pod \"tuned-ll5js\" (UID: \"587e1d46-bc7a-4cf8-be79-e09a04d6d3f5\") " pod="openshift-cluster-node-tuning-operator/tuned-ll5js"
Sep 09 20:47:18.159706 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.158130    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/587e1d46-bc7a-4cf8-be79-e09a04d6d3f5-etc-kubernetes\") pod \"tuned-ll5js\" (UID: \"587e1d46-bc7a-4cf8-be79-e09a04d6d3f5\") " pod="openshift-cluster-node-tuning-operator/tuned-ll5js"
Sep 09 20:47:18.159706 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.158137    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/25e8b7cb-d3ab-4da2-bcfe-c061509f457b-run-systemd\") pod \"ovnkube-node-2thgv\" (UID: \"25e8b7cb-d3ab-4da2-bcfe-c061509f457b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2thgv"
Sep 09 20:47:18.159706 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.158220    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/587e1d46-bc7a-4cf8-be79-e09a04d6d3f5-lib-modules\") pod \"tuned-ll5js\" (UID: \"587e1d46-bc7a-4cf8-be79-e09a04d6d3f5\") " pod="openshift-cluster-node-tuning-operator/tuned-ll5js"
Sep 09 20:47:18.159706 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.158224    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b0a2a693-cb2a-40be-ad01-e26c3bb5e4fb-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tc4lg\" (UID: \"b0a2a693-cb2a-40be-ad01-e26c3bb5e4fb\") " pod="openshift-multus/multus-additional-cni-plugins-tc4lg"
Sep 09 20:47:18.159706 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.158244    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b0a2a693-cb2a-40be-ad01-e26c3bb5e4fb-cni-binary-copy\") pod \"multus-additional-cni-plugins-tc4lg\" (UID: \"b0a2a693-cb2a-40be-ad01-e26c3bb5e4fb\") " pod="openshift-multus/multus-additional-cni-plugins-tc4lg"
Sep 09 20:47:18.159706 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.158286    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/34f7d128-9c82-4497-9766-0b314e3badce-kubelet-config\") pod \"global-pull-secret-syncer-n276l\" (UID: \"34f7d128-9c82-4497-9766-0b314e3badce\") " pod="kube-system/global-pull-secret-syncer-n276l"
Sep 09 20:47:18.159706 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.158313    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ds8dt\" (UniqueName: \"kubernetes.io/projected/25e8b7cb-d3ab-4da2-bcfe-c061509f457b-kube-api-access-ds8dt\") pod \"ovnkube-node-2thgv\" (UID: \"25e8b7cb-d3ab-4da2-bcfe-c061509f457b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2thgv"
Sep 09 20:47:18.159706 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.158340    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/25e8b7cb-d3ab-4da2-bcfe-c061509f457b-log-socket\") pod \"ovnkube-node-2thgv\" (UID: \"25e8b7cb-d3ab-4da2-bcfe-c061509f457b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2thgv"
Sep 09 20:47:18.160515 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.158364    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/587e1d46-bc7a-4cf8-be79-e09a04d6d3f5-etc-sysctl-conf\") pod \"tuned-ll5js\" (UID: \"587e1d46-bc7a-4cf8-be79-e09a04d6d3f5\") " pod="openshift-cluster-node-tuning-operator/tuned-ll5js"
Sep 09 20:47:18.160515 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.158388    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/587e1d46-bc7a-4cf8-be79-e09a04d6d3f5-etc-tuned\") pod \"tuned-ll5js\" (UID: \"587e1d46-bc7a-4cf8-be79-e09a04d6d3f5\") " pod="openshift-cluster-node-tuning-operator/tuned-ll5js"
Sep 09 20:47:18.160515 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.158407    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/25e8b7cb-d3ab-4da2-bcfe-c061509f457b-log-socket\") pod \"ovnkube-node-2thgv\" (UID: \"25e8b7cb-d3ab-4da2-bcfe-c061509f457b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2thgv"
Sep 09 20:47:18.160515 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.158414    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8942m\" (UniqueName: \"kubernetes.io/projected/587e1d46-bc7a-4cf8-be79-e09a04d6d3f5-kube-api-access-8942m\") pod \"tuned-ll5js\" (UID: \"587e1d46-bc7a-4cf8-be79-e09a04d6d3f5\") " pod="openshift-cluster-node-tuning-operator/tuned-ll5js"
Sep 09 20:47:18.160515 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.158438    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7be027cd-cbd6-487e-a63c-e8c7e1e05d9a-iptables-alerter-script\") pod \"iptables-alerter-thc8z\" (UID: \"7be027cd-cbd6-487e-a63c-e8c7e1e05d9a\") " pod="openshift-network-operator/iptables-alerter-thc8z"
Sep 09 20:47:18.160515 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.158527    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/587e1d46-bc7a-4cf8-be79-e09a04d6d3f5-etc-sysctl-conf\") pod \"tuned-ll5js\" (UID: \"587e1d46-bc7a-4cf8-be79-e09a04d6d3f5\") " pod="openshift-cluster-node-tuning-operator/tuned-ll5js"
Sep 09 20:47:18.160515 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.158362    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/34f7d128-9c82-4497-9766-0b314e3badce-kubelet-config\") pod \"global-pull-secret-syncer-n276l\" (UID: \"34f7d128-9c82-4497-9766-0b314e3badce\") " pod="kube-system/global-pull-secret-syncer-n276l"
Sep 09 20:47:18.160515 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.158831    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b0a2a693-cb2a-40be-ad01-e26c3bb5e4fb-cni-binary-copy\") pod \"multus-additional-cni-plugins-tc4lg\" (UID: \"b0a2a693-cb2a-40be-ad01-e26c3bb5e4fb\") " pod="openshift-multus/multus-additional-cni-plugins-tc4lg"
Sep 09 20:47:18.160515 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.159009    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7be027cd-cbd6-487e-a63c-e8c7e1e05d9a-iptables-alerter-script\") pod \"iptables-alerter-thc8z\" (UID: \"7be027cd-cbd6-487e-a63c-e8c7e1e05d9a\") " pod="openshift-network-operator/iptables-alerter-thc8z"
Sep 09 20:47:18.160515 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.159012    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/25e8b7cb-d3ab-4da2-bcfe-c061509f457b-ovn-node-metrics-cert\") pod \"ovnkube-node-2thgv\" (UID: \"25e8b7cb-d3ab-4da2-bcfe-c061509f457b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2thgv"
Sep 09 20:47:18.161284 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.161262    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/587e1d46-bc7a-4cf8-be79-e09a04d6d3f5-tmp\") pod \"tuned-ll5js\" (UID: \"587e1d46-bc7a-4cf8-be79-e09a04d6d3f5\") " pod="openshift-cluster-node-tuning-operator/tuned-ll5js"
Sep 09 20:47:18.162221 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.162171    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/587e1d46-bc7a-4cf8-be79-e09a04d6d3f5-etc-tuned\") pod \"tuned-ll5js\" (UID: \"587e1d46-bc7a-4cf8-be79-e09a04d6d3f5\") " pod="openshift-cluster-node-tuning-operator/tuned-ll5js"
Sep 09 20:47:18.175761 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.175724    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sf4dz\" (UniqueName: \"kubernetes.io/projected/e3794c68-57f8-4bf6-9a86-b564da84a425-kube-api-access-sf4dz\") pod \"network-metrics-daemon-48bqr\" (UID: \"e3794c68-57f8-4bf6-9a86-b564da84a425\") " pod="openshift-multus/network-metrics-daemon-48bqr"
Sep 09 20:47:18.177917 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.177894    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ds8dt\" (UniqueName: \"kubernetes.io/projected/25e8b7cb-d3ab-4da2-bcfe-c061509f457b-kube-api-access-ds8dt\") pod \"ovnkube-node-2thgv\" (UID: \"25e8b7cb-d3ab-4da2-bcfe-c061509f457b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2thgv"
Sep 09 20:47:18.180131 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.180108    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxcfm\" (UniqueName: \"kubernetes.io/projected/7be027cd-cbd6-487e-a63c-e8c7e1e05d9a-kube-api-access-sxcfm\") pod \"iptables-alerter-thc8z\" (UID: \"7be027cd-cbd6-487e-a63c-e8c7e1e05d9a\") " pod="openshift-network-operator/iptables-alerter-thc8z"
Sep 09 20:47:18.182537 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.182516    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kb7gj\" (UniqueName: \"kubernetes.io/projected/b0a2a693-cb2a-40be-ad01-e26c3bb5e4fb-kube-api-access-kb7gj\") pod \"multus-additional-cni-plugins-tc4lg\" (UID: \"b0a2a693-cb2a-40be-ad01-e26c3bb5e4fb\") " pod="openshift-multus/multus-additional-cni-plugins-tc4lg"
Sep 09 20:47:18.185191 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.185145    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8942m\" (UniqueName: \"kubernetes.io/projected/587e1d46-bc7a-4cf8-be79-e09a04d6d3f5-kube-api-access-8942m\") pod \"tuned-ll5js\" (UID: \"587e1d46-bc7a-4cf8-be79-e09a04d6d3f5\") " pod="openshift-cluster-node-tuning-operator/tuned-ll5js"
Sep 09 20:47:18.242742 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.242705    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rcqv7"
Sep 09 20:47:18.249505 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.249291    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-t84p6"
Sep 09 20:47:18.258974 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.258949    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jsj9x"
Sep 09 20:47:18.264246 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.264102    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-kn9rn"
Sep 09 20:47:18.272261 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.272239    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ll5js"
Sep 09 20:47:18.272769 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:18.272741    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod372edd34_17d7_4bc8_8038_65a02776d964.slice/crio-4ab2383ceb6c5acc9e6be307a2807b5cddbb7c2c79c0322454d0b68dbb40bd0d WatchSource:0}: Error finding container 4ab2383ceb6c5acc9e6be307a2807b5cddbb7c2c79c0322454d0b68dbb40bd0d: Status 404 returned error can't find the container with id 4ab2383ceb6c5acc9e6be307a2807b5cddbb7c2c79c0322454d0b68dbb40bd0d
Sep 09 20:47:18.279135 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.279111    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nnrzh"
Sep 09 20:47:18.279712 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:18.279686    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode788234a_a38c_4b9f_bcd3_a2fa9642b26c.slice/crio-63d7fd8f29dcec7e1b4f73d3b44253b7fd5aaf10099ed7660564172571e96bc2 WatchSource:0}: Error finding container 63d7fd8f29dcec7e1b4f73d3b44253b7fd5aaf10099ed7660564172571e96bc2: Status 404 returned error can't find the container with id 63d7fd8f29dcec7e1b4f73d3b44253b7fd5aaf10099ed7660564172571e96bc2
Sep 09 20:47:18.285713 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.285658    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-thc8z"
Sep 09 20:47:18.286941 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:18.286918    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod587e1d46_bc7a_4cf8_be79_e09a04d6d3f5.slice/crio-7d3de8f27c8205ee3b162acd886dedf08f416fb3355e2d8d235608070b154ff5 WatchSource:0}: Error finding container 7d3de8f27c8205ee3b162acd886dedf08f416fb3355e2d8d235608070b154ff5: Status 404 returned error can't find the container with id 7d3de8f27c8205ee3b162acd886dedf08f416fb3355e2d8d235608070b154ff5
Sep 09 20:47:18.292438 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.292417    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tc4lg"
Sep 09 20:47:18.296062 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.296036    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2thgv"
Sep 09 20:47:18.311948 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:18.311923    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25e8b7cb_d3ab_4da2_bcfe_c061509f457b.slice/crio-57881ef8a6bccf478d83a3d899be1b22f40e212cae91911f666a8fd6d8b43888 WatchSource:0}: Error finding container 57881ef8a6bccf478d83a3d899be1b22f40e212cae91911f666a8fd6d8b43888: Status 404 returned error can't find the container with id 57881ef8a6bccf478d83a3d899be1b22f40e212cae91911f666a8fd6d8b43888
Sep 09 20:47:18.314088 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:18.314062    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0a2a693_cb2a_40be_ad01_e26c3bb5e4fb.slice/crio-aa773935b0295feeabd26b401e37e09ad04f7afa78eb7b7168b91564722dde23 WatchSource:0}: Error finding container aa773935b0295feeabd26b401e37e09ad04f7afa78eb7b7168b91564722dde23: Status 404 returned error can't find the container with id aa773935b0295feeabd26b401e37e09ad04f7afa78eb7b7168b91564722dde23
Sep 09 20:47:18.662388 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.662301    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/34f7d128-9c82-4497-9766-0b314e3badce-original-pull-secret\") pod \"global-pull-secret-syncer-n276l\" (UID: \"34f7d128-9c82-4497-9766-0b314e3badce\") " pod="kube-system/global-pull-secret-syncer-n276l"
Sep 09 20:47:18.662388 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.662353    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3794c68-57f8-4bf6-9a86-b564da84a425-metrics-certs\") pod \"network-metrics-daemon-48bqr\" (UID: \"e3794c68-57f8-4bf6-9a86-b564da84a425\") " pod="openshift-multus/network-metrics-daemon-48bqr"
Sep 09 20:47:18.662388 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:18.662386    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wzkp\" (UniqueName: \"kubernetes.io/projected/9586d9e2-2e7a-4b4b-bc48-5cadd9a9dc49-kube-api-access-5wzkp\") pod \"network-check-target-ft6x6\" (UID: \"9586d9e2-2e7a-4b4b-bc48-5cadd9a9dc49\") " pod="openshift-network-diagnostics/network-check-target-ft6x6"
Sep 09 20:47:18.662651 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:18.662455    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 20:47:18.662651 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:18.662504    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 20:47:18.662651 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:18.662534    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34f7d128-9c82-4497-9766-0b314e3badce-original-pull-secret podName:34f7d128-9c82-4497-9766-0b314e3badce nodeName:}" failed. No retries permitted until 2026-09-09 20:47:19.66251005 +0000 UTC m=+4.114301569 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/34f7d128-9c82-4497-9766-0b314e3badce-original-pull-secret") pod "global-pull-secret-syncer-n276l" (UID: "34f7d128-9c82-4497-9766-0b314e3badce") : object "kube-system"/"original-pull-secret" not registered
Sep 09 20:47:18.662651 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:18.662560    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3794c68-57f8-4bf6-9a86-b564da84a425-metrics-certs podName:e3794c68-57f8-4bf6-9a86-b564da84a425 nodeName:}" failed. No retries permitted until 2026-09-09 20:47:19.662547483 +0000 UTC m=+4.114338989 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3794c68-57f8-4bf6-9a86-b564da84a425-metrics-certs") pod "network-metrics-daemon-48bqr" (UID: "e3794c68-57f8-4bf6-9a86-b564da84a425") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 20:47:18.662651 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:18.662508    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 20:47:18.662651 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:18.662591    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 20:47:18.662651 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:18.662605    2560 projected.go:196] Error preparing data for projected volume kube-api-access-5wzkp for pod openshift-network-diagnostics/network-check-target-ft6x6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 20:47:18.662651 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:18.662646    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9586d9e2-2e7a-4b4b-bc48-5cadd9a9dc49-kube-api-access-5wzkp podName:9586d9e2-2e7a-4b4b-bc48-5cadd9a9dc49 nodeName:}" failed. No retries permitted until 2026-09-09 20:47:19.662634876 +0000 UTC m=+4.114426384 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-5wzkp" (UniqueName: "kubernetes.io/projected/9586d9e2-2e7a-4b4b-bc48-5cadd9a9dc49-kube-api-access-5wzkp") pod "network-check-target-ft6x6" (UID: "9586d9e2-2e7a-4b4b-bc48-5cadd9a9dc49") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 20:47:19.010769 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:19.010650    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-08 20:42:17 +0000 UTC" deadline="2028-06-07 04:34:21.017055932 +0000 UTC"
Sep 09 20:47:19.010769 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:19.010706    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15271h47m2.006355735s"
Sep 09 20:47:19.051815 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:19.051785    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nnrzh" event={"ID":"7838e3a3-6b10-4a81-812c-c9b95e546534","Type":"ContainerStarted","Data":"1143e05139c6547f2e5e77b8052292708fe9f357bfd2398ca92be3fc4cb4b3c8"}
Sep 09 20:47:19.053065 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:19.053035    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ll5js" event={"ID":"587e1d46-bc7a-4cf8-be79-e09a04d6d3f5","Type":"ContainerStarted","Data":"7d3de8f27c8205ee3b162acd886dedf08f416fb3355e2d8d235608070b154ff5"}
Sep 09 20:47:19.054170 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:19.054146    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-kn9rn" event={"ID":"e788234a-a38c-4b9f-bcd3-a2fa9642b26c","Type":"ContainerStarted","Data":"63d7fd8f29dcec7e1b4f73d3b44253b7fd5aaf10099ed7660564172571e96bc2"}
Sep 09 20:47:19.055263 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:19.055236    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jsj9x" event={"ID":"372edd34-17d7-4bc8-8038-65a02776d964","Type":"ContainerStarted","Data":"4ab2383ceb6c5acc9e6be307a2807b5cddbb7c2c79c0322454d0b68dbb40bd0d"}
Sep 09 20:47:19.056447 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:19.056426    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-t84p6" event={"ID":"a7237351-1190-42ae-9092-b049a203cadc","Type":"ContainerStarted","Data":"dbb30584105eb3455faeac61e36cc3c5470cd85016fbb185054d91c6d698da3a"}
Sep 09 20:47:19.057897 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:19.057875    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2thgv" event={"ID":"25e8b7cb-d3ab-4da2-bcfe-c061509f457b","Type":"ContainerStarted","Data":"57881ef8a6bccf478d83a3d899be1b22f40e212cae91911f666a8fd6d8b43888"}
Sep 09 20:47:19.059176 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:19.059156    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tc4lg" event={"ID":"b0a2a693-cb2a-40be-ad01-e26c3bb5e4fb","Type":"ContainerStarted","Data":"aa773935b0295feeabd26b401e37e09ad04f7afa78eb7b7168b91564722dde23"}
Sep 09 20:47:19.060289 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:19.060271    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-thc8z" event={"ID":"7be027cd-cbd6-487e-a63c-e8c7e1e05d9a","Type":"ContainerStarted","Data":"aefbb880dda66eaa23f9063b64f64cdb6c74af214ec971dcaefe796dd40b9bb0"}
Sep 09 20:47:19.061323 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:19.061303    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rcqv7" event={"ID":"23e34008-d8bb-4baf-beef-dc0c8f67e8a8","Type":"ContainerStarted","Data":"cb79773638b5b37433e14a64e9ea53a31a040c803f385b1186cf45cf01df0724"}
Sep 09 20:47:19.674734 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:19.670745    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/34f7d128-9c82-4497-9766-0b314e3badce-original-pull-secret\") pod \"global-pull-secret-syncer-n276l\" (UID: \"34f7d128-9c82-4497-9766-0b314e3badce\") " pod="kube-system/global-pull-secret-syncer-n276l"
Sep 09 20:47:19.674734 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:19.670813    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3794c68-57f8-4bf6-9a86-b564da84a425-metrics-certs\") pod \"network-metrics-daemon-48bqr\" (UID: \"e3794c68-57f8-4bf6-9a86-b564da84a425\") " pod="openshift-multus/network-metrics-daemon-48bqr"
Sep 09 20:47:19.674734 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:19.670846    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wzkp\" (UniqueName: \"kubernetes.io/projected/9586d9e2-2e7a-4b4b-bc48-5cadd9a9dc49-kube-api-access-5wzkp\") pod \"network-check-target-ft6x6\" (UID: \"9586d9e2-2e7a-4b4b-bc48-5cadd9a9dc49\") " pod="openshift-network-diagnostics/network-check-target-ft6x6"
Sep 09 20:47:19.674734 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:19.670998    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 20:47:19.674734 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:19.671063    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34f7d128-9c82-4497-9766-0b314e3badce-original-pull-secret podName:34f7d128-9c82-4497-9766-0b314e3badce nodeName:}" failed. No retries permitted until 2026-09-09 20:47:21.671044644 +0000 UTC m=+6.122836154 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/34f7d128-9c82-4497-9766-0b314e3badce-original-pull-secret") pod "global-pull-secret-syncer-n276l" (UID: "34f7d128-9c82-4497-9766-0b314e3badce") : object "kube-system"/"original-pull-secret" not registered
Sep 09 20:47:19.674734 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:19.671446    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 20:47:19.674734 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:19.671495    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3794c68-57f8-4bf6-9a86-b564da84a425-metrics-certs podName:e3794c68-57f8-4bf6-9a86-b564da84a425 nodeName:}" failed. No retries permitted until 2026-09-09 20:47:21.671481373 +0000 UTC m=+6.123272882 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3794c68-57f8-4bf6-9a86-b564da84a425-metrics-certs") pod "network-metrics-daemon-48bqr" (UID: "e3794c68-57f8-4bf6-9a86-b564da84a425") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 20:47:19.674734 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:19.671659    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 20:47:19.674734 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:19.671687    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 20:47:19.674734 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:19.671701    2560 projected.go:196] Error preparing data for projected volume kube-api-access-5wzkp for pod openshift-network-diagnostics/network-check-target-ft6x6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 20:47:19.674734 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:19.671745    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9586d9e2-2e7a-4b4b-bc48-5cadd9a9dc49-kube-api-access-5wzkp podName:9586d9e2-2e7a-4b4b-bc48-5cadd9a9dc49 nodeName:}" failed. No retries permitted until 2026-09-09 20:47:21.671731626 +0000 UTC m=+6.123523137 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-5wzkp" (UniqueName: "kubernetes.io/projected/9586d9e2-2e7a-4b4b-bc48-5cadd9a9dc49-kube-api-access-5wzkp") pod "network-check-target-ft6x6" (UID: "9586d9e2-2e7a-4b4b-bc48-5cadd9a9dc49") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 20:47:20.011223 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:20.011164    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-08 20:42:17 +0000 UTC" deadline="2028-04-11 23:42:57.390278357 +0000 UTC"
Sep 09 20:47:20.011223 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:20.011221    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13922h55m37.379060963s"
Sep 09 20:47:20.044007 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:20.043975    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-48bqr"
Sep 09 20:47:20.044157 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:20.044120    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-48bqr" podUID="e3794c68-57f8-4bf6-9a86-b564da84a425"
Sep 09 20:47:20.044216 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:20.044198    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n276l"
Sep 09 20:47:20.044386 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:20.044272    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n276l" podUID="34f7d128-9c82-4497-9766-0b314e3badce"
Sep 09 20:47:20.044386 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:20.044335    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ft6x6"
Sep 09 20:47:20.044507 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:20.044399    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ft6x6" podUID="9586d9e2-2e7a-4b4b-bc48-5cadd9a9dc49"
Sep 09 20:47:20.101089 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:20.101044    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-70.ec2.internal" event={"ID":"e0ddac653a796266e178e69d3c0547bd","Type":"ContainerStarted","Data":"255dca111079149f2c72ab5ceb7b7669981de5eebf396b91de4bd1616ee26835"}
Sep 09 20:47:20.117204 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:20.117143    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-70.ec2.internal" podStartSLOduration=3.117123185 podStartE2EDuration="3.117123185s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 20:47:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:47:20.116781668 +0000 UTC m=+4.568573198" watchObservedRunningTime="2026-09-09 20:47:20.117123185 +0000 UTC m=+4.568914714"
Sep 09 20:47:20.119686 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:20.119637    2560 generic.go:356] "Generic (PLEG): container finished" podID="eb343637b0e213fe1edad67234a3debb" containerID="a84da0f6f64a86a82b9fe85831d94baf63ee2bfe660198f7170fa4882a21fa7d" exitCode=0
Sep 09 20:47:20.119829 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:20.119705    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-70.ec2.internal" event={"ID":"eb343637b0e213fe1edad67234a3debb","Type":"ContainerDied","Data":"a84da0f6f64a86a82b9fe85831d94baf63ee2bfe660198f7170fa4882a21fa7d"}
Sep 09 20:47:21.142825 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:21.142735    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-70.ec2.internal" event={"ID":"eb343637b0e213fe1edad67234a3debb","Type":"ContainerStarted","Data":"d66b5cceffa30261f608105862b424633938f2b05abcc85f6ca38d911f518eb4"}
Sep 09 20:47:21.689794 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:21.688526    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/34f7d128-9c82-4497-9766-0b314e3badce-original-pull-secret\") pod \"global-pull-secret-syncer-n276l\" (UID: \"34f7d128-9c82-4497-9766-0b314e3badce\") " pod="kube-system/global-pull-secret-syncer-n276l"
Sep 09 20:47:21.689794 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:21.688592    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3794c68-57f8-4bf6-9a86-b564da84a425-metrics-certs\") pod \"network-metrics-daemon-48bqr\" (UID: \"e3794c68-57f8-4bf6-9a86-b564da84a425\") " pod="openshift-multus/network-metrics-daemon-48bqr"
Sep 09 20:47:21.689794 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:21.688659    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wzkp\" (UniqueName: \"kubernetes.io/projected/9586d9e2-2e7a-4b4b-bc48-5cadd9a9dc49-kube-api-access-5wzkp\") pod \"network-check-target-ft6x6\" (UID: \"9586d9e2-2e7a-4b4b-bc48-5cadd9a9dc49\") " pod="openshift-network-diagnostics/network-check-target-ft6x6"
Sep 09 20:47:21.689794 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:21.688850    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 20:47:21.689794 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:21.688870    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 20:47:21.689794 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:21.688883    2560 projected.go:196] Error preparing data for projected volume kube-api-access-5wzkp for pod openshift-network-diagnostics/network-check-target-ft6x6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 20:47:21.689794 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:21.688939    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9586d9e2-2e7a-4b4b-bc48-5cadd9a9dc49-kube-api-access-5wzkp podName:9586d9e2-2e7a-4b4b-bc48-5cadd9a9dc49 nodeName:}" failed. No retries permitted until 2026-09-09 20:47:25.688921767 +0000 UTC m=+10.140713278 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-5wzkp" (UniqueName: "kubernetes.io/projected/9586d9e2-2e7a-4b4b-bc48-5cadd9a9dc49-kube-api-access-5wzkp") pod "network-check-target-ft6x6" (UID: "9586d9e2-2e7a-4b4b-bc48-5cadd9a9dc49") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 20:47:21.689794 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:21.689328    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 20:47:21.689794 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:21.689378    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34f7d128-9c82-4497-9766-0b314e3badce-original-pull-secret podName:34f7d128-9c82-4497-9766-0b314e3badce nodeName:}" failed. No retries permitted until 2026-09-09 20:47:25.689363138 +0000 UTC m=+10.141154647 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/34f7d128-9c82-4497-9766-0b314e3badce-original-pull-secret") pod "global-pull-secret-syncer-n276l" (UID: "34f7d128-9c82-4497-9766-0b314e3badce") : object "kube-system"/"original-pull-secret" not registered
Sep 09 20:47:21.689794 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:21.689436    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 20:47:21.689794 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:21.689466    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3794c68-57f8-4bf6-9a86-b564da84a425-metrics-certs podName:e3794c68-57f8-4bf6-9a86-b564da84a425 nodeName:}" failed. No retries permitted until 2026-09-09 20:47:25.689456013 +0000 UTC m=+10.141247522 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3794c68-57f8-4bf6-9a86-b564da84a425-metrics-certs") pod "network-metrics-daemon-48bqr" (UID: "e3794c68-57f8-4bf6-9a86-b564da84a425") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 20:47:22.045005 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:22.044229    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-48bqr"
Sep 09 20:47:22.045005 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:22.044371    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-48bqr" podUID="e3794c68-57f8-4bf6-9a86-b564da84a425"
Sep 09 20:47:22.045005 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:22.044430    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n276l"
Sep 09 20:47:22.045005 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:22.044499    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n276l" podUID="34f7d128-9c82-4497-9766-0b314e3badce"
Sep 09 20:47:22.045005 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:22.044536    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ft6x6"
Sep 09 20:47:22.045005 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:22.044597    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ft6x6" podUID="9586d9e2-2e7a-4b4b-bc48-5cadd9a9dc49"
Sep 09 20:47:24.041791 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:24.041756    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-48bqr"
Sep 09 20:47:24.042154 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:24.041758    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n276l"
Sep 09 20:47:24.042154 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:24.041904    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-48bqr" podUID="e3794c68-57f8-4bf6-9a86-b564da84a425"
Sep 09 20:47:24.042154 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:24.041760    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ft6x6"
Sep 09 20:47:24.042154 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:24.041948    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n276l" podUID="34f7d128-9c82-4497-9766-0b314e3badce"
Sep 09 20:47:24.042154 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:24.042013    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ft6x6" podUID="9586d9e2-2e7a-4b4b-bc48-5cadd9a9dc49"
Sep 09 20:47:25.719252 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:25.719219    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3794c68-57f8-4bf6-9a86-b564da84a425-metrics-certs\") pod \"network-metrics-daemon-48bqr\" (UID: \"e3794c68-57f8-4bf6-9a86-b564da84a425\") " pod="openshift-multus/network-metrics-daemon-48bqr"
Sep 09 20:47:25.719718 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:25.719267    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wzkp\" (UniqueName: \"kubernetes.io/projected/9586d9e2-2e7a-4b4b-bc48-5cadd9a9dc49-kube-api-access-5wzkp\") pod \"network-check-target-ft6x6\" (UID: \"9586d9e2-2e7a-4b4b-bc48-5cadd9a9dc49\") " pod="openshift-network-diagnostics/network-check-target-ft6x6"
Sep 09 20:47:25.719718 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:25.719319    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/34f7d128-9c82-4497-9766-0b314e3badce-original-pull-secret\") pod \"global-pull-secret-syncer-n276l\" (UID: \"34f7d128-9c82-4497-9766-0b314e3badce\") " pod="kube-system/global-pull-secret-syncer-n276l"
Sep 09 20:47:25.719718 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:25.719485    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 20:47:25.719718 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:25.719551    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34f7d128-9c82-4497-9766-0b314e3badce-original-pull-secret podName:34f7d128-9c82-4497-9766-0b314e3badce nodeName:}" failed. No retries permitted until 2026-09-09 20:47:33.719530744 +0000 UTC m=+18.171322266 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/34f7d128-9c82-4497-9766-0b314e3badce-original-pull-secret") pod "global-pull-secret-syncer-n276l" (UID: "34f7d128-9c82-4497-9766-0b314e3badce") : object "kube-system"/"original-pull-secret" not registered
Sep 09 20:47:25.720032 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:25.720008    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 20:47:25.720129 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:25.720031    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 20:47:25.720129 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:25.720053    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 20:47:25.720129 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:25.720067    2560 projected.go:196] Error preparing data for projected volume kube-api-access-5wzkp for pod openshift-network-diagnostics/network-check-target-ft6x6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 20:47:25.720129 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:25.720068    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3794c68-57f8-4bf6-9a86-b564da84a425-metrics-certs podName:e3794c68-57f8-4bf6-9a86-b564da84a425 nodeName:}" failed. No retries permitted until 2026-09-09 20:47:33.72005323 +0000 UTC m=+18.171844739 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3794c68-57f8-4bf6-9a86-b564da84a425-metrics-certs") pod "network-metrics-daemon-48bqr" (UID: "e3794c68-57f8-4bf6-9a86-b564da84a425") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 20:47:25.720129 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:25.720110    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9586d9e2-2e7a-4b4b-bc48-5cadd9a9dc49-kube-api-access-5wzkp podName:9586d9e2-2e7a-4b4b-bc48-5cadd9a9dc49 nodeName:}" failed. No retries permitted until 2026-09-09 20:47:33.720101914 +0000 UTC m=+18.171893423 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-5wzkp" (UniqueName: "kubernetes.io/projected/9586d9e2-2e7a-4b4b-bc48-5cadd9a9dc49-kube-api-access-5wzkp") pod "network-check-target-ft6x6" (UID: "9586d9e2-2e7a-4b4b-bc48-5cadd9a9dc49") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 20:47:26.044130 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:26.043245    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ft6x6"
Sep 09 20:47:26.044130 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:26.043555    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ft6x6" podUID="9586d9e2-2e7a-4b4b-bc48-5cadd9a9dc49"
Sep 09 20:47:26.044130 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:26.043369    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n276l"
Sep 09 20:47:26.044130 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:26.043652    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n276l" podUID="34f7d128-9c82-4497-9766-0b314e3badce"
Sep 09 20:47:26.044130 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:26.043343    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-48bqr"
Sep 09 20:47:26.044130 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:26.043763    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-48bqr" podUID="e3794c68-57f8-4bf6-9a86-b564da84a425"
Sep 09 20:47:28.042314 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:28.042273    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-48bqr"
Sep 09 20:47:28.042809 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:28.042282    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ft6x6"
Sep 09 20:47:28.042809 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:28.042418    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-48bqr" podUID="e3794c68-57f8-4bf6-9a86-b564da84a425"
Sep 09 20:47:28.042809 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:28.042511    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ft6x6" podUID="9586d9e2-2e7a-4b4b-bc48-5cadd9a9dc49"
Sep 09 20:47:28.042809 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:28.042273    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n276l"
Sep 09 20:47:28.042809 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:28.042615    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n276l" podUID="34f7d128-9c82-4497-9766-0b314e3badce"
Sep 09 20:47:30.041460 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:30.041425    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-48bqr"
Sep 09 20:47:30.041961 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:30.041425    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n276l"
Sep 09 20:47:30.041961 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:30.041579    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-48bqr" podUID="e3794c68-57f8-4bf6-9a86-b564da84a425"
Sep 09 20:47:30.041961 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:30.041425    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ft6x6"
Sep 09 20:47:30.041961 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:30.041608    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n276l" podUID="34f7d128-9c82-4497-9766-0b314e3badce"
Sep 09 20:47:30.041961 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:30.041739    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ft6x6" podUID="9586d9e2-2e7a-4b4b-bc48-5cadd9a9dc49"
Sep 09 20:47:32.041998 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:32.041961    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-48bqr"
Sep 09 20:47:32.042379 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:32.042004    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ft6x6"
Sep 09 20:47:32.042379 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:32.041966    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n276l"
Sep 09 20:47:32.042379 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:32.042101    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-48bqr" podUID="e3794c68-57f8-4bf6-9a86-b564da84a425"
Sep 09 20:47:32.042379 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:32.042166    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n276l" podUID="34f7d128-9c82-4497-9766-0b314e3badce"
Sep 09 20:47:32.042379 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:32.042216    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ft6x6" podUID="9586d9e2-2e7a-4b4b-bc48-5cadd9a9dc49"
Sep 09 20:47:33.775954 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:33.775908    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wzkp\" (UniqueName: \"kubernetes.io/projected/9586d9e2-2e7a-4b4b-bc48-5cadd9a9dc49-kube-api-access-5wzkp\") pod \"network-check-target-ft6x6\" (UID: \"9586d9e2-2e7a-4b4b-bc48-5cadd9a9dc49\") " pod="openshift-network-diagnostics/network-check-target-ft6x6"
Sep 09 20:47:33.776442 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:33.776018    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/34f7d128-9c82-4497-9766-0b314e3badce-original-pull-secret\") pod \"global-pull-secret-syncer-n276l\" (UID: \"34f7d128-9c82-4497-9766-0b314e3badce\") " pod="kube-system/global-pull-secret-syncer-n276l"
Sep 09 20:47:33.776442 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:33.776054    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3794c68-57f8-4bf6-9a86-b564da84a425-metrics-certs\") pod \"network-metrics-daemon-48bqr\" (UID: \"e3794c68-57f8-4bf6-9a86-b564da84a425\") " pod="openshift-multus/network-metrics-daemon-48bqr"
Sep 09 20:47:33.776442 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:33.776101    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 20:47:33.776442 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:33.776130    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 20:47:33.776442 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:33.776144    2560 projected.go:196] Error preparing data for projected volume kube-api-access-5wzkp for pod openshift-network-diagnostics/network-check-target-ft6x6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 20:47:33.776442 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:33.776154    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 20:47:33.776442 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:33.776154    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 20:47:33.776442 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:33.776204    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9586d9e2-2e7a-4b4b-bc48-5cadd9a9dc49-kube-api-access-5wzkp podName:9586d9e2-2e7a-4b4b-bc48-5cadd9a9dc49 nodeName:}" failed. No retries permitted until 2026-09-09 20:47:49.776183777 +0000 UTC m=+34.227975286 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-5wzkp" (UniqueName: "kubernetes.io/projected/9586d9e2-2e7a-4b4b-bc48-5cadd9a9dc49-kube-api-access-5wzkp") pod "network-check-target-ft6x6" (UID: "9586d9e2-2e7a-4b4b-bc48-5cadd9a9dc49") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 20:47:33.776442 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:33.776224    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34f7d128-9c82-4497-9766-0b314e3badce-original-pull-secret podName:34f7d128-9c82-4497-9766-0b314e3badce nodeName:}" failed. No retries permitted until 2026-09-09 20:47:49.776213921 +0000 UTC m=+34.228005429 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/34f7d128-9c82-4497-9766-0b314e3badce-original-pull-secret") pod "global-pull-secret-syncer-n276l" (UID: "34f7d128-9c82-4497-9766-0b314e3badce") : object "kube-system"/"original-pull-secret" not registered
Sep 09 20:47:33.776442 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:33.776242    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3794c68-57f8-4bf6-9a86-b564da84a425-metrics-certs podName:e3794c68-57f8-4bf6-9a86-b564da84a425 nodeName:}" failed. No retries permitted until 2026-09-09 20:47:49.776231008 +0000 UTC m=+34.228022519 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3794c68-57f8-4bf6-9a86-b564da84a425-metrics-certs") pod "network-metrics-daemon-48bqr" (UID: "e3794c68-57f8-4bf6-9a86-b564da84a425") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 20:47:34.041741 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:34.041647    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ft6x6"
Sep 09 20:47:34.041900 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:34.041648    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n276l"
Sep 09 20:47:34.041900 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:34.041789    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ft6x6" podUID="9586d9e2-2e7a-4b4b-bc48-5cadd9a9dc49"
Sep 09 20:47:34.041900 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:34.041839    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n276l" podUID="34f7d128-9c82-4497-9766-0b314e3badce"
Sep 09 20:47:34.041900 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:34.041656    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-48bqr"
Sep 09 20:47:34.042103 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:34.041931    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-48bqr" podUID="e3794c68-57f8-4bf6-9a86-b564da84a425"
Sep 09 20:47:36.042981 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:36.042948    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-48bqr"
Sep 09 20:47:36.042981 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:36.042970    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n276l"
Sep 09 20:47:36.043543 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:36.043073    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n276l" podUID="34f7d128-9c82-4497-9766-0b314e3badce"
Sep 09 20:47:36.043543 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:36.043142    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-48bqr" podUID="e3794c68-57f8-4bf6-9a86-b564da84a425"
Sep 09 20:47:36.043543 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:36.043210    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ft6x6"
Sep 09 20:47:36.043543 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:36.043362    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ft6x6" podUID="9586d9e2-2e7a-4b4b-bc48-5cadd9a9dc49"
Sep 09 20:47:37.189951 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:37.189627    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ll5js" event={"ID":"587e1d46-bc7a-4cf8-be79-e09a04d6d3f5","Type":"ContainerStarted","Data":"c0c38b4d28267c44eb7c481bb6d468001601632ab71fb545f2099fb164e1ed7c"}
Sep 09 20:47:37.191294 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:37.191260    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-kn9rn" event={"ID":"e788234a-a38c-4b9f-bcd3-a2fa9642b26c","Type":"ContainerStarted","Data":"e82758fe6f171afa18047a596dfa74aaa0ec40363192b0a79998be3b3144c6ad"}
Sep 09 20:47:37.192950 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:37.192917    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jsj9x" event={"ID":"372edd34-17d7-4bc8-8038-65a02776d964","Type":"ContainerStarted","Data":"9b003dc8e934aa89e0073759132135094448c748f3c897c60ebc943ad46ab5b9"}
Sep 09 20:47:37.194663 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:37.194634    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-t84p6" event={"ID":"a7237351-1190-42ae-9092-b049a203cadc","Type":"ContainerStarted","Data":"c6ec1838840afa36ec5c9dfecfe0d5ef994c626cdbf7f7a72523980dc632ed7b"}
Sep 09 20:47:37.197460 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:37.197441    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2thgv_25e8b7cb-d3ab-4da2-bcfe-c061509f457b/ovn-acl-logging/0.log"
Sep 09 20:47:37.197824 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:37.197803    2560 generic.go:356] "Generic (PLEG): container finished" podID="25e8b7cb-d3ab-4da2-bcfe-c061509f457b" containerID="47f25c2e8cbe46bdde6ebad56bdde55907e515d284129ca9c4bd924e1c9cf83f" exitCode=1
Sep 09 20:47:37.197909 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:37.197863    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2thgv" event={"ID":"25e8b7cb-d3ab-4da2-bcfe-c061509f457b","Type":"ContainerStarted","Data":"bae7aa465602620cd0e4afd63ff61e47a90f7c38c2e34d9740645309ef9d317c"}
Sep 09 20:47:37.197965 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:37.197918    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2thgv" event={"ID":"25e8b7cb-d3ab-4da2-bcfe-c061509f457b","Type":"ContainerStarted","Data":"f840632bb3aab47f564331c54405b1fbe1b278748eaf6c825e05acd3bf3c5c3d"}
Sep 09 20:47:37.198019 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:37.197968    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2thgv" event={"ID":"25e8b7cb-d3ab-4da2-bcfe-c061509f457b","Type":"ContainerDied","Data":"47f25c2e8cbe46bdde6ebad56bdde55907e515d284129ca9c4bd924e1c9cf83f"}
Sep 09 20:47:37.198019 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:37.198010    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2thgv" event={"ID":"25e8b7cb-d3ab-4da2-bcfe-c061509f457b","Type":"ContainerStarted","Data":"59eb961a5d7f56d28d1818e907aa2ae732dfbee48ad1129705c19a1aa7e94a4f"}
Sep 09 20:47:37.199717 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:37.199688    2560 generic.go:356] "Generic (PLEG): container finished" podID="b0a2a693-cb2a-40be-ad01-e26c3bb5e4fb" containerID="f7eb1d52a4d71f900457f948d70d1cc7ab03acf32e75549e533f4988a9b844d4" exitCode=0
Sep 09 20:47:37.199819 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:37.199782    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tc4lg" event={"ID":"b0a2a693-cb2a-40be-ad01-e26c3bb5e4fb","Type":"ContainerDied","Data":"f7eb1d52a4d71f900457f948d70d1cc7ab03acf32e75549e533f4988a9b844d4"}
Sep 09 20:47:37.201583 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:37.201559    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rcqv7" event={"ID":"23e34008-d8bb-4baf-beef-dc0c8f67e8a8","Type":"ContainerStarted","Data":"5bc4d0ae5ff3286f3251868b923c640b3a89df87fafc0344d12b4896ec9eca75"}
Sep 09 20:47:37.203480 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:37.203458    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nnrzh" event={"ID":"7838e3a3-6b10-4a81-812c-c9b95e546534","Type":"ContainerStarted","Data":"1fa5c67f6a851cbca471f8d9d1c3ae8750b01393a6e7f144e29ad6cf23f90c0d"}
Sep 09 20:47:37.212806 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:37.212761    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-70.ec2.internal" podStartSLOduration=20.212746891 podStartE2EDuration="20.212746891s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 20:47:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:47:21.157884999 +0000 UTC m=+5.609676547" watchObservedRunningTime="2026-09-09 20:47:37.212746891 +0000 UTC m=+21.664538419"
Sep 09 20:47:37.230976 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:37.230927    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-ll5js" podStartSLOduration=2.826350231 podStartE2EDuration="21.23090585s" totalImagesPullingTime="18.404555619s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 20:47:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:47:37.213635835 +0000 UTC m=+21.665427363" watchObservedRunningTime="2026-09-09 20:47:37.23090585 +0000 UTC m=+21.682697376"
Sep 09 20:47:37.231444 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:37.231419    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-rcqv7" podStartSLOduration=3.002836388 podStartE2EDuration="21.231408705s" totalImagesPullingTime="18.228572317s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 20:47:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:47:37.231044821 +0000 UTC m=+21.682836326" watchObservedRunningTime="2026-09-09 20:47:37.231408705 +0000 UTC m=+21.683200233"
Sep 09 20:47:37.259412 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:37.259356    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-t84p6" podStartSLOduration=2.828761566 podStartE2EDuration="21.259330065s" totalImagesPullingTime="18.430568499s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 20:47:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:47:37.258777577 +0000 UTC m=+21.710569115" watchObservedRunningTime="2026-09-09 20:47:37.259330065 +0000 UTC m=+21.711121595"
Sep 09 20:47:37.284522 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:37.284467    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-jsj9x" podStartSLOduration=6.415816377 podStartE2EDuration="21.2844492s" totalImagesPullingTime="14.868632823s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:47:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:47:37.284139277 +0000 UTC m=+21.735930810" watchObservedRunningTime="2026-09-09 20:47:37.2844492 +0000 UTC m=+21.736240727"
Sep 09 20:47:37.337993 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:37.337935    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-kn9rn" podStartSLOduration=2.567557024 podStartE2EDuration="21.337917549s" totalImagesPullingTime="18.770360525s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 20:47:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:47:37.313047639 +0000 UTC m=+21.764839168" watchObservedRunningTime="2026-09-09 20:47:37.337917549 +0000 UTC m=+21.789709077"
Sep 09 20:47:38.042340 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:38.042259    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n276l"
Sep 09 20:47:38.042340 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:38.042288    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ft6x6"
Sep 09 20:47:38.042588 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:38.042259    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-48bqr"
Sep 09 20:47:38.042588 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:38.042362    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n276l" podUID="34f7d128-9c82-4497-9766-0b314e3badce"
Sep 09 20:47:38.042588 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:38.042446    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ft6x6" podUID="9586d9e2-2e7a-4b4b-bc48-5cadd9a9dc49"
Sep 09 20:47:38.042588 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:38.042508    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-48bqr" podUID="e3794c68-57f8-4bf6-9a86-b564da84a425"
Sep 09 20:47:38.210134 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:38.210099    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2thgv_25e8b7cb-d3ab-4da2-bcfe-c061509f457b/ovn-acl-logging/0.log"
Sep 09 20:47:38.210735 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:38.210568    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2thgv" event={"ID":"25e8b7cb-d3ab-4da2-bcfe-c061509f457b","Type":"ContainerStarted","Data":"b5859ab6937601862e4850f6005977755a046df0a23a804719c8f74c7571877d"}
Sep 09 20:47:38.210735 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:38.210658    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2thgv" event={"ID":"25e8b7cb-d3ab-4da2-bcfe-c061509f457b","Type":"ContainerStarted","Data":"b566020fb7ea4a7536d8f8c5314f604cacd83392b00d35c5ad3b389eaaff4c62"}
Sep 09 20:47:38.217159 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:38.217124    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-thc8z" event={"ID":"7be027cd-cbd6-487e-a63c-e8c7e1e05d9a","Type":"ContainerStarted","Data":"43cce541fc4731d11925dbf1265bed983ce9e1b7997b32bedd5ec69452c48ead"}
Sep 09 20:47:38.244172 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:38.244108    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-thc8z" podStartSLOduration=7.403448917 podStartE2EDuration="22.244086218s" totalImagesPullingTime="14.840637301s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 20:47:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:47:38.24207601 +0000 UTC m=+22.693867538" watchObservedRunningTime="2026-09-09 20:47:38.244086218 +0000 UTC m=+22.695877750"
Sep 09 20:47:38.364990 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:38.364966    2560 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 09 20:47:39.015829 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:39.015717    2560 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-09T20:47:38.364987952Z","UUID":"105b178e-ffd9-449b-8567-a6926fb529e8","Handler":null,"Name":"","Endpoint":""}
Sep 09 20:47:39.017298 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:39.017276    2560 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 09 20:47:39.017412 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:39.017305    2560 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 09 20:47:39.221925 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:39.221884    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nnrzh" event={"ID":"7838e3a3-6b10-4a81-812c-c9b95e546534","Type":"ContainerStarted","Data":"87cd53bacb98c577f51bb8ccce26928a2dcd0663a122d2a9336bd030b6ba68ff"}
Sep 09 20:47:40.041492 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:40.041426    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ft6x6"
Sep 09 20:47:40.041631 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:40.041431    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-48bqr"
Sep 09 20:47:40.041631 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:40.041513    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ft6x6" podUID="9586d9e2-2e7a-4b4b-bc48-5cadd9a9dc49"
Sep 09 20:47:40.041631 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:40.041582    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-48bqr" podUID="e3794c68-57f8-4bf6-9a86-b564da84a425"
Sep 09 20:47:40.041631 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:40.041625    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n276l"
Sep 09 20:47:40.041804 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:40.041696    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n276l" podUID="34f7d128-9c82-4497-9766-0b314e3badce"
Sep 09 20:47:40.227200 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:40.227159    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nnrzh" event={"ID":"7838e3a3-6b10-4a81-812c-c9b95e546534","Type":"ContainerStarted","Data":"7ea58af8841c46742fdee13058095d7e851a37df33057a3ea7f538c5a5a690e9"}
Sep 09 20:47:40.230937 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:40.230909    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2thgv_25e8b7cb-d3ab-4da2-bcfe-c061509f457b/ovn-acl-logging/0.log"
Sep 09 20:47:40.231310 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:40.231285    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2thgv" event={"ID":"25e8b7cb-d3ab-4da2-bcfe-c061509f457b","Type":"ContainerStarted","Data":"8b8d84f53841a2d74adebdd91a10c336b5a7ae09bf5340af7f5aeb8ea4f5badc"}
Sep 09 20:47:40.247762 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:40.247721    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nnrzh" podStartSLOduration=3.498755246 podStartE2EDuration="24.247709005s" totalImagesPullingTime="20.748953759s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 20:47:16 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:47:40.246997844 +0000 UTC m=+24.698789373" watchObservedRunningTime="2026-09-09 20:47:40.247709005 +0000 UTC m=+24.699500533"
Sep 09 20:47:41.847184 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:41.847099    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-jsj9x"
Sep 09 20:47:41.847742 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:41.847723    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-jsj9x"
Sep 09 20:47:42.041715 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:42.041666    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ft6x6"
Sep 09 20:47:42.041715 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:42.041708    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-48bqr"
Sep 09 20:47:42.041944 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:42.041715    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n276l"
Sep 09 20:47:42.041944 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:42.041799    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ft6x6" podUID="9586d9e2-2e7a-4b4b-bc48-5cadd9a9dc49"
Sep 09 20:47:42.041944 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:42.041909    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-48bqr" podUID="e3794c68-57f8-4bf6-9a86-b564da84a425"
Sep 09 20:47:42.042102 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:42.041976    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n276l" podUID="34f7d128-9c82-4497-9766-0b314e3badce"
Sep 09 20:47:43.215880 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:43.215689    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-jsj9x"
Sep 09 20:47:43.216269 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:43.216243    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-jsj9x"
Sep 09 20:47:43.242425 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:43.242403    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2thgv_25e8b7cb-d3ab-4da2-bcfe-c061509f457b/ovn-acl-logging/0.log"
Sep 09 20:47:43.242879 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:43.242808    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2thgv" event={"ID":"25e8b7cb-d3ab-4da2-bcfe-c061509f457b","Type":"ContainerStarted","Data":"8f932d44c28dcd79ee02327136d86c9f7815ac1cbe767e66240cdab661e50ebd"}
Sep 09 20:47:43.243318 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:43.243300    2560 scope.go:117] "RemoveContainer" containerID="47f25c2e8cbe46bdde6ebad56bdde55907e515d284129ca9c4bd924e1c9cf83f"
Sep 09 20:47:44.041842 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:44.041814    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-48bqr"
Sep 09 20:47:44.041842 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:44.041830    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ft6x6"
Sep 09 20:47:44.042127 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:44.041822    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n276l"
Sep 09 20:47:44.042127 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:44.041915    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-48bqr" podUID="e3794c68-57f8-4bf6-9a86-b564da84a425"
Sep 09 20:47:44.042127 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:44.041971    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ft6x6" podUID="9586d9e2-2e7a-4b4b-bc48-5cadd9a9dc49"
Sep 09 20:47:44.042127 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:44.042104    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n276l" podUID="34f7d128-9c82-4497-9766-0b314e3badce"
Sep 09 20:47:44.248564 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:44.248537    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2thgv_25e8b7cb-d3ab-4da2-bcfe-c061509f457b/ovn-acl-logging/0.log"
Sep 09 20:47:44.249135 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:44.249028    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2thgv" event={"ID":"25e8b7cb-d3ab-4da2-bcfe-c061509f457b","Type":"ContainerStarted","Data":"e7f1493ef263035ca74b689a21b87f0190d3090b960f1cfd06bf19ab1f3b9f40"}
Sep 09 20:47:44.249319 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:44.249292    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2thgv"
Sep 09 20:47:44.249420 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:44.249408    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2thgv"
Sep 09 20:47:44.249473 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:44.249462    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2thgv"
Sep 09 20:47:44.251539 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:44.251515    2560 generic.go:356] "Generic (PLEG): container finished" podID="b0a2a693-cb2a-40be-ad01-e26c3bb5e4fb" containerID="6755310b2afbd8140cf52f9f3b8d84311390bc27ec0594d4d725cd1536ddc379" exitCode=0
Sep 09 20:47:44.251680 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:44.251599    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tc4lg" event={"ID":"b0a2a693-cb2a-40be-ad01-e26c3bb5e4fb","Type":"ContainerDied","Data":"6755310b2afbd8140cf52f9f3b8d84311390bc27ec0594d4d725cd1536ddc379"}
Sep 09 20:47:44.265290 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:44.265266    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2thgv"
Sep 09 20:47:44.265903 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:44.265886    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2thgv"
Sep 09 20:47:44.278855 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:44.278805    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-2thgv" podStartSLOduration=9.841861445 podStartE2EDuration="28.27878708s" totalImagesPullingTime="18.436925635s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 20:47:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:47:44.277459633 +0000 UTC m=+28.729251161" watchObservedRunningTime="2026-09-09 20:47:44.27878708 +0000 UTC m=+28.730578609"
Sep 09 20:47:44.748295 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:44.748259    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-n276l"]
Sep 09 20:47:44.748467 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:44.748397    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n276l"
Sep 09 20:47:44.748562 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:44.748532    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n276l" podUID="34f7d128-9c82-4497-9766-0b314e3badce"
Sep 09 20:47:44.749102 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:44.749080    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ft6x6"]
Sep 09 20:47:44.749216 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:44.749169    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ft6x6"
Sep 09 20:47:44.749281 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:44.749261    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ft6x6" podUID="9586d9e2-2e7a-4b4b-bc48-5cadd9a9dc49"
Sep 09 20:47:44.749643 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:44.749611    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-48bqr"]
Sep 09 20:47:44.749764 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:44.749707    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-48bqr"
Sep 09 20:47:44.749859 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:44.749834    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-48bqr" podUID="e3794c68-57f8-4bf6-9a86-b564da84a425"
Sep 09 20:47:46.042266 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:46.042087    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-48bqr"
Sep 09 20:47:46.042787 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:46.042136    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n276l"
Sep 09 20:47:46.042787 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:46.042338    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-48bqr" podUID="e3794c68-57f8-4bf6-9a86-b564da84a425"
Sep 09 20:47:46.042787 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:46.042158    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ft6x6"
Sep 09 20:47:46.042787 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:46.042419    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n276l" podUID="34f7d128-9c82-4497-9766-0b314e3badce"
Sep 09 20:47:46.042787 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:46.042498    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ft6x6" podUID="9586d9e2-2e7a-4b4b-bc48-5cadd9a9dc49"
Sep 09 20:47:46.258819 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:46.258738    2560 generic.go:356] "Generic (PLEG): container finished" podID="b0a2a693-cb2a-40be-ad01-e26c3bb5e4fb" containerID="3c48e049add75b282c9fcbb3c1824533423af8902dbc812890801228bfc87810" exitCode=0
Sep 09 20:47:46.258952 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:46.258823    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tc4lg" event={"ID":"b0a2a693-cb2a-40be-ad01-e26c3bb5e4fb","Type":"ContainerDied","Data":"3c48e049add75b282c9fcbb3c1824533423af8902dbc812890801228bfc87810"}
Sep 09 20:47:47.262971 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:47.262939    2560 generic.go:356] "Generic (PLEG): container finished" podID="b0a2a693-cb2a-40be-ad01-e26c3bb5e4fb" containerID="00132e08d9231dda466f888e5a88342e33d698c8a70e09b517869df18f45a903" exitCode=0
Sep 09 20:47:47.263375 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:47.263020    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tc4lg" event={"ID":"b0a2a693-cb2a-40be-ad01-e26c3bb5e4fb","Type":"ContainerDied","Data":"00132e08d9231dda466f888e5a88342e33d698c8a70e09b517869df18f45a903"}
Sep 09 20:47:48.045473 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:48.045443    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ft6x6"
Sep 09 20:47:48.045660 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:48.045553    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n276l"
Sep 09 20:47:48.045660 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:48.045566    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ft6x6" podUID="9586d9e2-2e7a-4b4b-bc48-5cadd9a9dc49"
Sep 09 20:47:48.045660 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:48.045587    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-48bqr"
Sep 09 20:47:48.045821 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:48.045703    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n276l" podUID="34f7d128-9c82-4497-9766-0b314e3badce"
Sep 09 20:47:48.045821 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:48.045765    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-48bqr" podUID="e3794c68-57f8-4bf6-9a86-b564da84a425"
Sep 09 20:47:48.872935 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:48.872900    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-70.ec2.internal" event="NodeReady"
Sep 09 20:47:48.873357 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:48.873051    2560 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 09 20:47:48.917642 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:48.917608    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7cdff8874c-zhjsp"]
Sep 09 20:47:48.968050 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:48.968016    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-bjkpq"]
Sep 09 20:47:48.968222 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:48.968140    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7cdff8874c-zhjsp"
Sep 09 20:47:48.971241 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:48.971208    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 09 20:47:48.971454 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:48.971437    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 09 20:47:48.971533 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:48.971454    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-nwrwc\""
Sep 09 20:47:48.971533 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:48.971481    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 09 20:47:48.980749 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:48.980725    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 09 20:47:48.999952 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:48.999919    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7cdff8874c-zhjsp"]
Sep 09 20:47:49.000085 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:48.999966    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-bjkpq"]
Sep 09 20:47:49.000085 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:48.999989    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-p796n"]
Sep 09 20:47:49.000085 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:49.000024    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-bjkpq"
Sep 09 20:47:49.002825 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:49.002804    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-hrwrq\""
Sep 09 20:47:49.003191 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:49.003171    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Sep 09 20:47:49.003472 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:49.003451    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Sep 09 20:47:49.021914 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:49.021896    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-dg6rb"]
Sep 09 20:47:49.022042 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:49.022005    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-p796n"
Sep 09 20:47:49.027821 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:49.027792    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 09 20:47:49.027821 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:49.027792    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 09 20:47:49.027988 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:49.027896    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 09 20:47:49.028426 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:49.028409    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-bv8pc\""
Sep 09 20:47:49.042035 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:49.042018    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-p796n"]
Sep 09 20:47:49.042123 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:49.042043    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dg6rb"]
Sep 09 20:47:49.042181 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:49.042147    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dg6rb"
Sep 09 20:47:49.046727 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:49.046710    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 09 20:47:49.046863 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:49.046847    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 09 20:47:49.047017 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:49.047002    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5nprp\""
Sep 09 20:47:49.089427 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:49.089394    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/37b0d343-5d35-4d62-b3f4-929029b915f2-nginx-conf\") pod \"networking-console-plugin-79977f9844-bjkpq\" (UID: \"37b0d343-5d35-4d62-b3f4-929029b915f2\") " pod="openshift-network-console/networking-console-plugin-79977f9844-bjkpq"
Sep 09 20:47:49.089554 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:49.089434    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1170b545-bb37-4499-9a2f-c0d7e976854d-bound-sa-token\") pod \"image-registry-7cdff8874c-zhjsp\" (UID: \"1170b545-bb37-4499-9a2f-c0d7e976854d\") " pod="openshift-image-registry/image-registry-7cdff8874c-zhjsp"
Sep 09 20:47:49.089554 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:49.089519    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1170b545-bb37-4499-9a2f-c0d7e976854d-trusted-ca\") pod \"image-registry-7cdff8874c-zhjsp\" (UID: \"1170b545-bb37-4499-9a2f-c0d7e976854d\") " pod="openshift-image-registry/image-registry-7cdff8874c-zhjsp"
Sep 09 20:47:49.089667 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:49.089556    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cns8c\" (UniqueName: \"kubernetes.io/projected/1170b545-bb37-4499-9a2f-c0d7e976854d-kube-api-access-cns8c\") pod \"image-registry-7cdff8874c-zhjsp\" (UID: \"1170b545-bb37-4499-9a2f-c0d7e976854d\") " pod="openshift-image-registry/image-registry-7cdff8874c-zhjsp"
Sep 09 20:47:49.089667 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:49.089583    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/aebf38f1-b76f-4d9b-af1c-3144bb61c4e0-cert\") pod \"ingress-canary-p796n\" (UID: \"aebf38f1-b76f-4d9b-af1c-3144bb61c4e0\") " pod="openshift-ingress-canary/ingress-canary-p796n"
Sep 09 20:47:49.089667 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:49.089637    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1170b545-bb37-4499-9a2f-c0d7e976854d-installation-pull-secrets\") pod \"image-registry-7cdff8874c-zhjsp\" (UID: \"1170b545-bb37-4499-9a2f-c0d7e976854d\") " pod="openshift-image-registry/image-registry-7cdff8874c-zhjsp"
Sep 09 20:47:49.089667 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:49.089663    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68rpx\" (UniqueName: \"kubernetes.io/projected/aebf38f1-b76f-4d9b-af1c-3144bb61c4e0-kube-api-access-68rpx\") pod \"ingress-canary-p796n\" (UID: \"aebf38f1-b76f-4d9b-af1c-3144bb61c4e0\") " pod="openshift-ingress-canary/ingress-canary-p796n"
Sep 09 20:47:49.089873 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:49.089708    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1170b545-bb37-4499-9a2f-c0d7e976854d-ca-trust-extracted\") pod \"image-registry-7cdff8874c-zhjsp\" (UID: \"1170b545-bb37-4499-9a2f-c0d7e976854d\") " pod="openshift-image-registry/image-registry-7cdff8874c-zhjsp"
Sep 09 20:47:49.089873 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:49.089776    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1170b545-bb37-4499-9a2f-c0d7e976854d-image-registry-private-configuration\") pod \"image-registry-7cdff8874c-zhjsp\" (UID: \"1170b545-bb37-4499-9a2f-c0d7e976854d\") " pod="openshift-image-registry/image-registry-7cdff8874c-zhjsp"
Sep 09 20:47:49.089873 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:49.089803    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1170b545-bb37-4499-9a2f-c0d7e976854d-registry-certificates\") pod \"image-registry-7cdff8874c-zhjsp\" (UID: \"1170b545-bb37-4499-9a2f-c0d7e976854d\") " pod="openshift-image-registry/image-registry-7cdff8874c-zhjsp"
Sep 09 20:47:49.089873 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:49.089850    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1170b545-bb37-4499-9a2f-c0d7e976854d-registry-tls\") pod \"image-registry-7cdff8874c-zhjsp\" (UID: \"1170b545-bb37-4499-9a2f-c0d7e976854d\") " pod="openshift-image-registry/image-registry-7cdff8874c-zhjsp"
Sep 09 20:47:49.090039 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:49.089893    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/37b0d343-5d35-4d62-b3f4-929029b915f2-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-bjkpq\" (UID: \"37b0d343-5d35-4d62-b3f4-929029b915f2\") " pod="openshift-network-console/networking-console-plugin-79977f9844-bjkpq"
Sep 09 20:47:49.190781 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:49.190708    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1170b545-bb37-4499-9a2f-c0d7e976854d-trusted-ca\") pod \"image-registry-7cdff8874c-zhjsp\" (UID: \"1170b545-bb37-4499-9a2f-c0d7e976854d\") " pod="openshift-image-registry/image-registry-7cdff8874c-zhjsp"
Sep 09 20:47:49.190781 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:49.190742    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cns8c\" (UniqueName: \"kubernetes.io/projected/1170b545-bb37-4499-9a2f-c0d7e976854d-kube-api-access-cns8c\") pod \"image-registry-7cdff8874c-zhjsp\" (UID: \"1170b545-bb37-4499-9a2f-c0d7e976854d\") " pod="openshift-image-registry/image-registry-7cdff8874c-zhjsp"
Sep 09 20:47:49.190781 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:49.190771    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/aebf38f1-b76f-4d9b-af1c-3144bb61c4e0-cert\") pod \"ingress-canary-p796n\" (UID: \"aebf38f1-b76f-4d9b-af1c-3144bb61c4e0\") " pod="openshift-ingress-canary/ingress-canary-p796n"
Sep 09 20:47:49.191066 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:49.190804    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1170b545-bb37-4499-9a2f-c0d7e976854d-installation-pull-secrets\") pod \"image-registry-7cdff8874c-zhjsp\" (UID: \"1170b545-bb37-4499-9a2f-c0d7e976854d\") " pod="openshift-image-registry/image-registry-7cdff8874c-zhjsp"
Sep 09 20:47:49.191066 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:49.190942    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68rpx\" (UniqueName: \"kubernetes.io/projected/aebf38f1-b76f-4d9b-af1c-3144bb61c4e0-kube-api-access-68rpx\") pod \"ingress-canary-p796n\" (UID: \"aebf38f1-b76f-4d9b-af1c-3144bb61c4e0\") " pod="openshift-ingress-canary/ingress-canary-p796n"
Sep 09 20:47:49.191166 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:49.191090    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1170b545-bb37-4499-9a2f-c0d7e976854d-ca-trust-extracted\") pod \"image-registry-7cdff8874c-zhjsp\" (UID: \"1170b545-bb37-4499-9a2f-c0d7e976854d\") " pod="openshift-image-registry/image-registry-7cdff8874c-zhjsp"
Sep 09 20:47:49.191219 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:49.191159    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1170b545-bb37-4499-9a2f-c0d7e976854d-image-registry-private-configuration\") pod \"image-registry-7cdff8874c-zhjsp\" (UID: \"1170b545-bb37-4499-9a2f-c0d7e976854d\") " pod="openshift-image-registry/image-registry-7cdff8874c-zhjsp"
Sep 09 20:47:49.191219 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:49.191186    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1170b545-bb37-4499-9a2f-c0d7e976854d-registry-certificates\") pod \"image-registry-7cdff8874c-zhjsp\" (UID: \"1170b545-bb37-4499-9a2f-c0d7e976854d\") " pod="openshift-image-registry/image-registry-7cdff8874c-zhjsp"
Sep 09 20:47:49.191996 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:49.191324    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8d37bae7-db79-4322-9ba1-012a68918b86-metrics-tls\") pod \"dns-default-dg6rb\" (UID: \"8d37bae7-db79-4322-9ba1-012a68918b86\") " pod="openshift-dns/dns-default-dg6rb"
Sep 09 20:47:49.191996 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:49.191382    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1170b545-bb37-4499-9a2f-c0d7e976854d-ca-trust-extracted\") pod \"image-registry-7cdff8874c-zhjsp\" (UID: \"1170b545-bb37-4499-9a2f-c0d7e976854d\") " pod="openshift-image-registry/image-registry-7cdff8874c-zhjsp"
Sep 09 20:47:49.191996 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:49.191477    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1170b545-bb37-4499-9a2f-c0d7e976854d-registry-tls\") pod \"image-registry-7cdff8874c-zhjsp\" (UID: \"1170b545-bb37-4499-9a2f-c0d7e976854d\") " pod="openshift-image-registry/image-registry-7cdff8874c-zhjsp"
Sep 09 20:47:49.191996 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:49.191514    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/37b0d343-5d35-4d62-b3f4-929029b915f2-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-bjkpq\" (UID: \"37b0d343-5d35-4d62-b3f4-929029b915f2\") " pod="openshift-network-console/networking-console-plugin-79977f9844-bjkpq"
Sep 09 20:47:49.191996 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:49.191557    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxdmh\" (UniqueName: \"kubernetes.io/projected/8d37bae7-db79-4322-9ba1-012a68918b86-kube-api-access-zxdmh\") pod \"dns-default-dg6rb\" (UID: \"8d37bae7-db79-4322-9ba1-012a68918b86\") " pod="openshift-dns/dns-default-dg6rb"
Sep 09 20:47:49.191996 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:49.191598    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/37b0d343-5d35-4d62-b3f4-929029b915f2-nginx-conf\") pod \"networking-console-plugin-79977f9844-bjkpq\" (UID: \"37b0d343-5d35-4d62-b3f4-929029b915f2\") " pod="openshift-network-console/networking-console-plugin-79977f9844-bjkpq"
Sep 09 20:47:49.191996 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:49.191624    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8d37bae7-db79-4322-9ba1-012a68918b86-config-volume\") pod \"dns-default-dg6rb\" (UID: \"8d37bae7-db79-4322-9ba1-012a68918b86\") " pod="openshift-dns/dns-default-dg6rb"
Sep 09 20:47:49.191996 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:49.191647    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8d37bae7-db79-4322-9ba1-012a68918b86-tmp-dir\") pod \"dns-default-dg6rb\" (UID: \"8d37bae7-db79-4322-9ba1-012a68918b86\") " pod="openshift-dns/dns-default-dg6rb"
Sep 09 20:47:49.191996 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:49.191694    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1170b545-bb37-4499-9a2f-c0d7e976854d-bound-sa-token\") pod \"image-registry-7cdff8874c-zhjsp\" (UID: \"1170b545-bb37-4499-9a2f-c0d7e976854d\") " pod="openshift-image-registry/image-registry-7cdff8874c-zhjsp"
Sep 09 20:47:49.191996 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:49.191750    2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 09 20:47:49.191996 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:49.191815    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37b0d343-5d35-4d62-b3f4-929029b915f2-networking-console-plugin-cert podName:37b0d343-5d35-4d62-b3f4-929029b915f2 nodeName:}" failed. No retries permitted until 2026-09-09 20:47:49.691797084 +0000 UTC m=+34.143588596 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/37b0d343-5d35-4d62-b3f4-929029b915f2-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-bjkpq" (UID: "37b0d343-5d35-4d62-b3f4-929029b915f2") : secret "networking-console-plugin-cert" not found
Sep 09 20:47:49.191996 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:49.191862    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1170b545-bb37-4499-9a2f-c0d7e976854d-trusted-ca\") pod \"image-registry-7cdff8874c-zhjsp\" (UID: \"1170b545-bb37-4499-9a2f-c0d7e976854d\") " pod="openshift-image-registry/image-registry-7cdff8874c-zhjsp"
Sep 09 20:47:49.191996 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:49.191873    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1170b545-bb37-4499-9a2f-c0d7e976854d-registry-certificates\") pod \"image-registry-7cdff8874c-zhjsp\" (UID: \"1170b545-bb37-4499-9a2f-c0d7e976854d\") " pod="openshift-image-registry/image-registry-7cdff8874c-zhjsp"
Sep 09 20:47:49.191996 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:49.191963    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 20:47:49.191996 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:49.191976    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7cdff8874c-zhjsp: secret "image-registry-tls" not found
Sep 09 20:47:49.191996 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:49.192021    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1170b545-bb37-4499-9a2f-c0d7e976854d-registry-tls podName:1170b545-bb37-4499-9a2f-c0d7e976854d nodeName:}" failed. No retries permitted until 2026-09-09 20:47:49.692007946 +0000 UTC m=+34.143799473 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1170b545-bb37-4499-9a2f-c0d7e976854d-registry-tls") pod "image-registry-7cdff8874c-zhjsp" (UID: "1170b545-bb37-4499-9a2f-c0d7e976854d") : secret "image-registry-tls" not found
Sep 09 20:47:49.192781 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:49.192620    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/37b0d343-5d35-4d62-b3f4-929029b915f2-nginx-conf\") pod \"networking-console-plugin-79977f9844-bjkpq\" (UID: \"37b0d343-5d35-4d62-b3f4-929029b915f2\") " pod="openshift-network-console/networking-console-plugin-79977f9844-bjkpq"
Sep 09 20:47:49.195919 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:49.195897    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1170b545-bb37-4499-9a2f-c0d7e976854d-image-registry-private-configuration\") pod \"image-registry-7cdff8874c-zhjsp\" (UID: \"1170b545-bb37-4499-9a2f-c0d7e976854d\") " pod="openshift-image-registry/image-registry-7cdff8874c-zhjsp"
Sep 09 20:47:49.196028 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:49.195916    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1170b545-bb37-4499-9a2f-c0d7e976854d-installation-pull-secrets\") pod \"image-registry-7cdff8874c-zhjsp\" (UID: \"1170b545-bb37-4499-9a2f-c0d7e976854d\") " pod="openshift-image-registry/image-registry-7cdff8874c-zhjsp"
Sep 09 20:47:49.196028 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:49.195922    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/aebf38f1-b76f-4d9b-af1c-3144bb61c4e0-cert\") pod \"ingress-canary-p796n\" (UID: \"aebf38f1-b76f-4d9b-af1c-3144bb61c4e0\") " pod="openshift-ingress-canary/ingress-canary-p796n"
Sep 09 20:47:49.201323 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:49.201283    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-68rpx\" (UniqueName: \"kubernetes.io/projected/aebf38f1-b76f-4d9b-af1c-3144bb61c4e0-kube-api-access-68rpx\") pod \"ingress-canary-p796n\" (UID: \"aebf38f1-b76f-4d9b-af1c-3144bb61c4e0\") " pod="openshift-ingress-canary/ingress-canary-p796n"
Sep 09 20:47:49.202600 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:49.202562    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1170b545-bb37-4499-9a2f-c0d7e976854d-bound-sa-token\") pod \"image-registry-7cdff8874c-zhjsp\" (UID: \"1170b545-bb37-4499-9a2f-c0d7e976854d\") " pod="openshift-image-registry/image-registry-7cdff8874c-zhjsp"
Sep 09 20:47:49.202991 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:49.202972    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cns8c\" (UniqueName: \"kubernetes.io/projected/1170b545-bb37-4499-9a2f-c0d7e976854d-kube-api-access-cns8c\") pod \"image-registry-7cdff8874c-zhjsp\" (UID: \"1170b545-bb37-4499-9a2f-c0d7e976854d\") " pod="openshift-image-registry/image-registry-7cdff8874c-zhjsp"
Sep 09 20:47:49.217188 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:49.217152    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jsj9x_372edd34-17d7-4bc8-8038-65a02776d964/konnectivity-agent/0.log" limit=1024
Sep 09 20:47:49.292862 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:49.292831    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8d37bae7-db79-4322-9ba1-012a68918b86-metrics-tls\") pod \"dns-default-dg6rb\" (UID: \"8d37bae7-db79-4322-9ba1-012a68918b86\") " pod="openshift-dns/dns-default-dg6rb"
Sep 09 20:47:49.293012 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:49.292906    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxdmh\" (UniqueName: \"kubernetes.io/projected/8d37bae7-db79-4322-9ba1-012a68918b86-kube-api-access-zxdmh\") pod \"dns-default-dg6rb\" (UID: \"8d37bae7-db79-4322-9ba1-012a68918b86\") " pod="openshift-dns/dns-default-dg6rb"
Sep 09 20:47:49.293012 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:49.292945    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8d37bae7-db79-4322-9ba1-012a68918b86-config-volume\") pod \"dns-default-dg6rb\" (UID: \"8d37bae7-db79-4322-9ba1-012a68918b86\") " pod="openshift-dns/dns-default-dg6rb"
Sep 09 20:47:49.293012 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:49.292966    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8d37bae7-db79-4322-9ba1-012a68918b86-tmp-dir\") pod \"dns-default-dg6rb\" (UID: \"8d37bae7-db79-4322-9ba1-012a68918b86\") " pod="openshift-dns/dns-default-dg6rb"
Sep 09 20:47:49.293012 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:49.292986    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 20:47:49.293182 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:49.293059    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d37bae7-db79-4322-9ba1-012a68918b86-metrics-tls podName:8d37bae7-db79-4322-9ba1-012a68918b86 nodeName:}" failed. No retries permitted until 2026-09-09 20:47:49.793040797 +0000 UTC m=+34.244832308 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8d37bae7-db79-4322-9ba1-012a68918b86-metrics-tls") pod "dns-default-dg6rb" (UID: "8d37bae7-db79-4322-9ba1-012a68918b86") : secret "dns-default-metrics-tls" not found
Sep 09 20:47:49.293361 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:49.293338    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8d37bae7-db79-4322-9ba1-012a68918b86-tmp-dir\") pod \"dns-default-dg6rb\" (UID: \"8d37bae7-db79-4322-9ba1-012a68918b86\") " pod="openshift-dns/dns-default-dg6rb"
Sep 09 20:47:49.293438 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:49.293418    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8d37bae7-db79-4322-9ba1-012a68918b86-config-volume\") pod \"dns-default-dg6rb\" (UID: \"8d37bae7-db79-4322-9ba1-012a68918b86\") " pod="openshift-dns/dns-default-dg6rb"
Sep 09 20:47:49.301201 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:49.301176    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxdmh\" (UniqueName: \"kubernetes.io/projected/8d37bae7-db79-4322-9ba1-012a68918b86-kube-api-access-zxdmh\") pod \"dns-default-dg6rb\" (UID: \"8d37bae7-db79-4322-9ba1-012a68918b86\") " pod="openshift-dns/dns-default-dg6rb"
Sep 09 20:47:49.302028 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:49.301997    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jsj9x_372edd34-17d7-4bc8-8038-65a02776d964/konnectivity-agent/0.log" limit=1024
Sep 09 20:47:49.329982 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:49.329953    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-p796n"
Sep 09 20:47:49.668272 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:49.668068    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-p796n"]
Sep 09 20:47:49.671889 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:47:49.671864    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaebf38f1_b76f_4d9b_af1c_3144bb61c4e0.slice/crio-a26cd0d27f3609fc486ac23756892a12c135fecf88196863c5bb7deb04191a7d WatchSource:0}: Error finding container a26cd0d27f3609fc486ac23756892a12c135fecf88196863c5bb7deb04191a7d: Status 404 returned error can't find the container with id a26cd0d27f3609fc486ac23756892a12c135fecf88196863c5bb7deb04191a7d
Sep 09 20:47:49.696907 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:49.696879    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1170b545-bb37-4499-9a2f-c0d7e976854d-registry-tls\") pod \"image-registry-7cdff8874c-zhjsp\" (UID: \"1170b545-bb37-4499-9a2f-c0d7e976854d\") " pod="openshift-image-registry/image-registry-7cdff8874c-zhjsp"
Sep 09 20:47:49.697059 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:49.696925    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/37b0d343-5d35-4d62-b3f4-929029b915f2-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-bjkpq\" (UID: \"37b0d343-5d35-4d62-b3f4-929029b915f2\") " pod="openshift-network-console/networking-console-plugin-79977f9844-bjkpq"
Sep 09 20:47:49.697059 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:49.697025    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 20:47:49.697059 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:49.697045    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7cdff8874c-zhjsp: secret "image-registry-tls" not found
Sep 09 20:47:49.697277 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:49.697077    2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 09 20:47:49.697277 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:49.697111    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1170b545-bb37-4499-9a2f-c0d7e976854d-registry-tls podName:1170b545-bb37-4499-9a2f-c0d7e976854d nodeName:}" failed. No retries permitted until 2026-09-09 20:47:50.697095738 +0000 UTC m=+35.148887244 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1170b545-bb37-4499-9a2f-c0d7e976854d-registry-tls") pod "image-registry-7cdff8874c-zhjsp" (UID: "1170b545-bb37-4499-9a2f-c0d7e976854d") : secret "image-registry-tls" not found
Sep 09 20:47:49.697277 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:49.697139    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37b0d343-5d35-4d62-b3f4-929029b915f2-networking-console-plugin-cert podName:37b0d343-5d35-4d62-b3f4-929029b915f2 nodeName:}" failed. No retries permitted until 2026-09-09 20:47:50.697122562 +0000 UTC m=+35.148914071 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/37b0d343-5d35-4d62-b3f4-929029b915f2-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-bjkpq" (UID: "37b0d343-5d35-4d62-b3f4-929029b915f2") : secret "networking-console-plugin-cert" not found
Sep 09 20:47:49.797697 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:49.797648    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8d37bae7-db79-4322-9ba1-012a68918b86-metrics-tls\") pod \"dns-default-dg6rb\" (UID: \"8d37bae7-db79-4322-9ba1-012a68918b86\") " pod="openshift-dns/dns-default-dg6rb"
Sep 09 20:47:49.797884 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:49.797721    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/34f7d128-9c82-4497-9766-0b314e3badce-original-pull-secret\") pod \"global-pull-secret-syncer-n276l\" (UID: \"34f7d128-9c82-4497-9766-0b314e3badce\") " pod="kube-system/global-pull-secret-syncer-n276l"
Sep 09 20:47:49.797884 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:49.797778    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3794c68-57f8-4bf6-9a86-b564da84a425-metrics-certs\") pod \"network-metrics-daemon-48bqr\" (UID: \"e3794c68-57f8-4bf6-9a86-b564da84a425\") " pod="openshift-multus/network-metrics-daemon-48bqr"
Sep 09 20:47:49.797884 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:49.797802    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 20:47:49.797884 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:49.797853    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 20:47:49.797884 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:49.797864    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d37bae7-db79-4322-9ba1-012a68918b86-metrics-tls podName:8d37bae7-db79-4322-9ba1-012a68918b86 nodeName:}" failed. No retries permitted until 2026-09-09 20:47:50.797846482 +0000 UTC m=+35.249638005 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8d37bae7-db79-4322-9ba1-012a68918b86-metrics-tls") pod "dns-default-dg6rb" (UID: "8d37bae7-db79-4322-9ba1-012a68918b86") : secret "dns-default-metrics-tls" not found
Sep 09 20:47:49.797884 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:49.797872    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 20:47:49.797884 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:49.797887    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3794c68-57f8-4bf6-9a86-b564da84a425-metrics-certs podName:e3794c68-57f8-4bf6-9a86-b564da84a425 nodeName:}" failed. No retries permitted until 2026-09-09 20:48:21.797877322 +0000 UTC m=+66.249668832 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3794c68-57f8-4bf6-9a86-b564da84a425-metrics-certs") pod "network-metrics-daemon-48bqr" (UID: "e3794c68-57f8-4bf6-9a86-b564da84a425") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 20:47:49.798225 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:49.797933    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34f7d128-9c82-4497-9766-0b314e3badce-original-pull-secret podName:34f7d128-9c82-4497-9766-0b314e3badce nodeName:}" failed. No retries permitted until 2026-09-09 20:48:21.797916443 +0000 UTC m=+66.249707969 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/34f7d128-9c82-4497-9766-0b314e3badce-original-pull-secret") pod "global-pull-secret-syncer-n276l" (UID: "34f7d128-9c82-4497-9766-0b314e3badce") : object "kube-system"/"original-pull-secret" not registered
Sep 09 20:47:49.798225 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:49.797958    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wzkp\" (UniqueName: \"kubernetes.io/projected/9586d9e2-2e7a-4b4b-bc48-5cadd9a9dc49-kube-api-access-5wzkp\") pod \"network-check-target-ft6x6\" (UID: \"9586d9e2-2e7a-4b4b-bc48-5cadd9a9dc49\") " pod="openshift-network-diagnostics/network-check-target-ft6x6"
Sep 09 20:47:49.798225 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:49.798108    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 20:47:49.798225 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:49.798133    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 20:47:49.798225 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:49.798147    2560 projected.go:196] Error preparing data for projected volume kube-api-access-5wzkp for pod openshift-network-diagnostics/network-check-target-ft6x6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 20:47:49.798225 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:49.798195    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9586d9e2-2e7a-4b4b-bc48-5cadd9a9dc49-kube-api-access-5wzkp podName:9586d9e2-2e7a-4b4b-bc48-5cadd9a9dc49 nodeName:}" failed. No retries permitted until 2026-09-09 20:48:21.798180954 +0000 UTC m=+66.249972461 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-5wzkp" (UniqueName: "kubernetes.io/projected/9586d9e2-2e7a-4b4b-bc48-5cadd9a9dc49-kube-api-access-5wzkp") pod "network-check-target-ft6x6" (UID: "9586d9e2-2e7a-4b4b-bc48-5cadd9a9dc49") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 20:47:50.045908 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:50.045876    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n276l"
Sep 09 20:47:50.046357 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:50.045919    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ft6x6"
Sep 09 20:47:50.046357 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:50.045919    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-48bqr"
Sep 09 20:47:50.049533 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:50.049288    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 09 20:47:50.049533 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:50.049307    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-slrrp\""
Sep 09 20:47:50.049533 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:50.049325    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 09 20:47:50.049533 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:50.049307    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 09 20:47:50.049533 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:50.049307    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-kzsmd\""
Sep 09 20:47:50.049533 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:50.049401    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 09 20:47:50.272901 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:50.272831    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-p796n" event={"ID":"aebf38f1-b76f-4d9b-af1c-3144bb61c4e0","Type":"ContainerStarted","Data":"a26cd0d27f3609fc486ac23756892a12c135fecf88196863c5bb7deb04191a7d"}
Sep 09 20:47:50.704343 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:50.704303    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1170b545-bb37-4499-9a2f-c0d7e976854d-registry-tls\") pod \"image-registry-7cdff8874c-zhjsp\" (UID: \"1170b545-bb37-4499-9a2f-c0d7e976854d\") " pod="openshift-image-registry/image-registry-7cdff8874c-zhjsp"
Sep 09 20:47:50.704556 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:50.704352    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/37b0d343-5d35-4d62-b3f4-929029b915f2-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-bjkpq\" (UID: \"37b0d343-5d35-4d62-b3f4-929029b915f2\") " pod="openshift-network-console/networking-console-plugin-79977f9844-bjkpq"
Sep 09 20:47:50.704556 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:50.704471    2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 09 20:47:50.704556 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:50.704528    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37b0d343-5d35-4d62-b3f4-929029b915f2-networking-console-plugin-cert podName:37b0d343-5d35-4d62-b3f4-929029b915f2 nodeName:}" failed. No retries permitted until 2026-09-09 20:47:52.704514483 +0000 UTC m=+37.156305988 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/37b0d343-5d35-4d62-b3f4-929029b915f2-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-bjkpq" (UID: "37b0d343-5d35-4d62-b3f4-929029b915f2") : secret "networking-console-plugin-cert" not found
Sep 09 20:47:50.704556 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:50.704474    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 20:47:50.704762 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:50.704566    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7cdff8874c-zhjsp: secret "image-registry-tls" not found
Sep 09 20:47:50.704762 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:50.704601    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1170b545-bb37-4499-9a2f-c0d7e976854d-registry-tls podName:1170b545-bb37-4499-9a2f-c0d7e976854d nodeName:}" failed. No retries permitted until 2026-09-09 20:47:52.704591416 +0000 UTC m=+37.156382932 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1170b545-bb37-4499-9a2f-c0d7e976854d-registry-tls") pod "image-registry-7cdff8874c-zhjsp" (UID: "1170b545-bb37-4499-9a2f-c0d7e976854d") : secret "image-registry-tls" not found
Sep 09 20:47:50.805461 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:50.805425    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8d37bae7-db79-4322-9ba1-012a68918b86-metrics-tls\") pod \"dns-default-dg6rb\" (UID: \"8d37bae7-db79-4322-9ba1-012a68918b86\") " pod="openshift-dns/dns-default-dg6rb"
Sep 09 20:47:50.805643 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:50.805594    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 20:47:50.805731 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:50.805660    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d37bae7-db79-4322-9ba1-012a68918b86-metrics-tls podName:8d37bae7-db79-4322-9ba1-012a68918b86 nodeName:}" failed. No retries permitted until 2026-09-09 20:47:52.805644511 +0000 UTC m=+37.257436017 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8d37bae7-db79-4322-9ba1-012a68918b86-metrics-tls") pod "dns-default-dg6rb" (UID: "8d37bae7-db79-4322-9ba1-012a68918b86") : secret "dns-default-metrics-tls" not found
Sep 09 20:47:51.843545 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:51.843506    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jsj9x_372edd34-17d7-4bc8-8038-65a02776d964/konnectivity-agent/0.log" limit=1024
Sep 09 20:47:51.949132 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:51.949097    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jsj9x_372edd34-17d7-4bc8-8038-65a02776d964/konnectivity-agent/0.log" limit=1024
Sep 09 20:47:52.718448 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:52.718410    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1170b545-bb37-4499-9a2f-c0d7e976854d-registry-tls\") pod \"image-registry-7cdff8874c-zhjsp\" (UID: \"1170b545-bb37-4499-9a2f-c0d7e976854d\") " pod="openshift-image-registry/image-registry-7cdff8874c-zhjsp"
Sep 09 20:47:52.718641 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:52.718453    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/37b0d343-5d35-4d62-b3f4-929029b915f2-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-bjkpq\" (UID: \"37b0d343-5d35-4d62-b3f4-929029b915f2\") " pod="openshift-network-console/networking-console-plugin-79977f9844-bjkpq"
Sep 09 20:47:52.718641 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:52.718608    2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 09 20:47:52.718641 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:52.718617    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 20:47:52.718641 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:52.718641    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7cdff8874c-zhjsp: secret "image-registry-tls" not found
Sep 09 20:47:52.718829 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:52.718679    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37b0d343-5d35-4d62-b3f4-929029b915f2-networking-console-plugin-cert podName:37b0d343-5d35-4d62-b3f4-929029b915f2 nodeName:}" failed. No retries permitted until 2026-09-09 20:47:56.718653003 +0000 UTC m=+41.170444508 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/37b0d343-5d35-4d62-b3f4-929029b915f2-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-bjkpq" (UID: "37b0d343-5d35-4d62-b3f4-929029b915f2") : secret "networking-console-plugin-cert" not found
Sep 09 20:47:52.718829 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:52.718711    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1170b545-bb37-4499-9a2f-c0d7e976854d-registry-tls podName:1170b545-bb37-4499-9a2f-c0d7e976854d nodeName:}" failed. No retries permitted until 2026-09-09 20:47:56.718691567 +0000 UTC m=+41.170483075 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1170b545-bb37-4499-9a2f-c0d7e976854d-registry-tls") pod "image-registry-7cdff8874c-zhjsp" (UID: "1170b545-bb37-4499-9a2f-c0d7e976854d") : secret "image-registry-tls" not found
Sep 09 20:47:52.819323 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:52.819283    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8d37bae7-db79-4322-9ba1-012a68918b86-metrics-tls\") pod \"dns-default-dg6rb\" (UID: \"8d37bae7-db79-4322-9ba1-012a68918b86\") " pod="openshift-dns/dns-default-dg6rb"
Sep 09 20:47:52.819506 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:52.819459    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 20:47:52.819561 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:52.819541    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d37bae7-db79-4322-9ba1-012a68918b86-metrics-tls podName:8d37bae7-db79-4322-9ba1-012a68918b86 nodeName:}" failed. No retries permitted until 2026-09-09 20:47:56.819518512 +0000 UTC m=+41.271310038 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8d37bae7-db79-4322-9ba1-012a68918b86-metrics-tls") pod "dns-default-dg6rb" (UID: "8d37bae7-db79-4322-9ba1-012a68918b86") : secret "dns-default-metrics-tls" not found
Sep 09 20:47:53.285265 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:53.285230    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tc4lg" event={"ID":"b0a2a693-cb2a-40be-ad01-e26c3bb5e4fb","Type":"ContainerStarted","Data":"2429fa2aa9a9ff5b1aa2cd114be71927d79da0b191245de8a63495fe85cbe680"}
Sep 09 20:47:53.286873 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:53.286843    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-p796n" event={"ID":"aebf38f1-b76f-4d9b-af1c-3144bb61c4e0","Type":"ContainerStarted","Data":"c33573a8d08505a6c4fe66119370baa0a74b5106d152e965c241531150ab5b78"}
Sep 09 20:47:54.292138 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:54.292105    2560 generic.go:356] "Generic (PLEG): container finished" podID="b0a2a693-cb2a-40be-ad01-e26c3bb5e4fb" containerID="2429fa2aa9a9ff5b1aa2cd114be71927d79da0b191245de8a63495fe85cbe680" exitCode=0
Sep 09 20:47:54.292487 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:54.292184    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tc4lg" event={"ID":"b0a2a693-cb2a-40be-ad01-e26c3bb5e4fb","Type":"ContainerDied","Data":"2429fa2aa9a9ff5b1aa2cd114be71927d79da0b191245de8a63495fe85cbe680"}
Sep 09 20:47:54.308280 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:54.305449    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-p796n" podStartSLOduration=2.831892912 podStartE2EDuration="6.305435895s" totalImagesPullingTime="3.473542983s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:47:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:47:54.305290974 +0000 UTC m=+38.757082506" watchObservedRunningTime="2026-09-09 20:47:54.305435895 +0000 UTC m=+38.757227414"
Sep 09 20:47:54.800728 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:54.800691    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jsj9x_372edd34-17d7-4bc8-8038-65a02776d964/konnectivity-agent/0.log" limit=1024
Sep 09 20:47:54.901151 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:54.901115    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jsj9x_372edd34-17d7-4bc8-8038-65a02776d964/konnectivity-agent/0.log" limit=1024
Sep 09 20:47:55.211143 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:55.211061    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jsj9x_372edd34-17d7-4bc8-8038-65a02776d964/konnectivity-agent/0.log" limit=1024
Sep 09 20:47:55.268685 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:55.268633    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jsj9x_372edd34-17d7-4bc8-8038-65a02776d964/konnectivity-agent/0.log" limit=1024
Sep 09 20:47:55.297332 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:55.297304    2560 generic.go:356] "Generic (PLEG): container finished" podID="b0a2a693-cb2a-40be-ad01-e26c3bb5e4fb" containerID="1a71a2a0f6660a09472632be0e82bd64a5da8b3b947441b8990b06f764c810d3" exitCode=0
Sep 09 20:47:55.297696 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:55.297348    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tc4lg" event={"ID":"b0a2a693-cb2a-40be-ad01-e26c3bb5e4fb","Type":"ContainerDied","Data":"1a71a2a0f6660a09472632be0e82bd64a5da8b3b947441b8990b06f764c810d3"}
Sep 09 20:47:56.303103 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:56.303065    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tc4lg" event={"ID":"b0a2a693-cb2a-40be-ad01-e26c3bb5e4fb","Type":"ContainerStarted","Data":"f1f2040914caa9d6f3212e0d8e78f0dbc5d57eeff43b4ecaa27684489db3c67b"}
Sep 09 20:47:56.322481 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:56.322433    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-tc4lg" podStartSLOduration=8.822241083 podStartE2EDuration="40.322419986s" totalImagesPullingTime="31.500178903s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 20:47:16 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:47:56.320709687 +0000 UTC m=+40.772501216" watchObservedRunningTime="2026-09-09 20:47:56.322419986 +0000 UTC m=+40.774211515"
Sep 09 20:47:56.539565 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:56.539524    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jsj9x_372edd34-17d7-4bc8-8038-65a02776d964/konnectivity-agent/0.log" limit=1024
Sep 09 20:47:56.604223 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:56.604134    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jsj9x_372edd34-17d7-4bc8-8038-65a02776d964/konnectivity-agent/0.log" limit=1024
Sep 09 20:47:56.753036 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:56.752994    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1170b545-bb37-4499-9a2f-c0d7e976854d-registry-tls\") pod \"image-registry-7cdff8874c-zhjsp\" (UID: \"1170b545-bb37-4499-9a2f-c0d7e976854d\") " pod="openshift-image-registry/image-registry-7cdff8874c-zhjsp"
Sep 09 20:47:56.753036 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:56.753048    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/37b0d343-5d35-4d62-b3f4-929029b915f2-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-bjkpq\" (UID: \"37b0d343-5d35-4d62-b3f4-929029b915f2\") " pod="openshift-network-console/networking-console-plugin-79977f9844-bjkpq"
Sep 09 20:47:56.753294 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:56.753152    2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 09 20:47:56.753294 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:56.753155    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 20:47:56.753294 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:56.753178    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7cdff8874c-zhjsp: secret "image-registry-tls" not found
Sep 09 20:47:56.753294 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:56.753211    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37b0d343-5d35-4d62-b3f4-929029b915f2-networking-console-plugin-cert podName:37b0d343-5d35-4d62-b3f4-929029b915f2 nodeName:}" failed. No retries permitted until 2026-09-09 20:48:04.753193901 +0000 UTC m=+49.204985407 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/37b0d343-5d35-4d62-b3f4-929029b915f2-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-bjkpq" (UID: "37b0d343-5d35-4d62-b3f4-929029b915f2") : secret "networking-console-plugin-cert" not found
Sep 09 20:47:56.753294 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:56.753229    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1170b545-bb37-4499-9a2f-c0d7e976854d-registry-tls podName:1170b545-bb37-4499-9a2f-c0d7e976854d nodeName:}" failed. No retries permitted until 2026-09-09 20:48:04.753219786 +0000 UTC m=+49.205011292 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1170b545-bb37-4499-9a2f-c0d7e976854d-registry-tls") pod "image-registry-7cdff8874c-zhjsp" (UID: "1170b545-bb37-4499-9a2f-c0d7e976854d") : secret "image-registry-tls" not found
Sep 09 20:47:56.854378 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:56.854291    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8d37bae7-db79-4322-9ba1-012a68918b86-metrics-tls\") pod \"dns-default-dg6rb\" (UID: \"8d37bae7-db79-4322-9ba1-012a68918b86\") " pod="openshift-dns/dns-default-dg6rb"
Sep 09 20:47:56.854535 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:56.854467    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 20:47:56.854599 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:47:56.854540    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d37bae7-db79-4322-9ba1-012a68918b86-metrics-tls podName:8d37bae7-db79-4322-9ba1-012a68918b86 nodeName:}" failed. No retries permitted until 2026-09-09 20:48:04.854520832 +0000 UTC m=+49.306312338 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8d37bae7-db79-4322-9ba1-012a68918b86-metrics-tls") pod "dns-default-dg6rb" (UID: "8d37bae7-db79-4322-9ba1-012a68918b86") : secret "dns-default-metrics-tls" not found
Sep 09 20:47:56.996441 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:56.996409    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jsj9x_372edd34-17d7-4bc8-8038-65a02776d964/konnectivity-agent/0.log" limit=1024
Sep 09 20:47:57.097192 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:47:57.097155    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jsj9x_372edd34-17d7-4bc8-8038-65a02776d964/konnectivity-agent/0.log" limit=1024
Sep 09 20:48:04.814180 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:48:04.814134    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1170b545-bb37-4499-9a2f-c0d7e976854d-registry-tls\") pod \"image-registry-7cdff8874c-zhjsp\" (UID: \"1170b545-bb37-4499-9a2f-c0d7e976854d\") " pod="openshift-image-registry/image-registry-7cdff8874c-zhjsp"
Sep 09 20:48:04.814180 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:48:04.814179    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/37b0d343-5d35-4d62-b3f4-929029b915f2-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-bjkpq\" (UID: \"37b0d343-5d35-4d62-b3f4-929029b915f2\") " pod="openshift-network-console/networking-console-plugin-79977f9844-bjkpq"
Sep 09 20:48:04.814707 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:48:04.814286    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 20:48:04.814707 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:48:04.814310    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7cdff8874c-zhjsp: secret "image-registry-tls" not found
Sep 09 20:48:04.814707 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:48:04.814293    2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 09 20:48:04.814707 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:48:04.814370    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1170b545-bb37-4499-9a2f-c0d7e976854d-registry-tls podName:1170b545-bb37-4499-9a2f-c0d7e976854d nodeName:}" failed. No retries permitted until 2026-09-09 20:48:20.814351391 +0000 UTC m=+65.266142897 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1170b545-bb37-4499-9a2f-c0d7e976854d-registry-tls") pod "image-registry-7cdff8874c-zhjsp" (UID: "1170b545-bb37-4499-9a2f-c0d7e976854d") : secret "image-registry-tls" not found
Sep 09 20:48:04.814707 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:48:04.814383    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37b0d343-5d35-4d62-b3f4-929029b915f2-networking-console-plugin-cert podName:37b0d343-5d35-4d62-b3f4-929029b915f2 nodeName:}" failed. No retries permitted until 2026-09-09 20:48:20.814377644 +0000 UTC m=+65.266169151 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/37b0d343-5d35-4d62-b3f4-929029b915f2-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-bjkpq" (UID: "37b0d343-5d35-4d62-b3f4-929029b915f2") : secret "networking-console-plugin-cert" not found
Sep 09 20:48:04.915070 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:48:04.915037    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8d37bae7-db79-4322-9ba1-012a68918b86-metrics-tls\") pod \"dns-default-dg6rb\" (UID: \"8d37bae7-db79-4322-9ba1-012a68918b86\") " pod="openshift-dns/dns-default-dg6rb"
Sep 09 20:48:04.915234 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:48:04.915211    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 20:48:04.915321 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:48:04.915308    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d37bae7-db79-4322-9ba1-012a68918b86-metrics-tls podName:8d37bae7-db79-4322-9ba1-012a68918b86 nodeName:}" failed. No retries permitted until 2026-09-09 20:48:20.915284992 +0000 UTC m=+65.367076514 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8d37bae7-db79-4322-9ba1-012a68918b86-metrics-tls") pod "dns-default-dg6rb" (UID: "8d37bae7-db79-4322-9ba1-012a68918b86") : secret "dns-default-metrics-tls" not found
Sep 09 20:48:16.269508 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:48:16.269479    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2thgv"
Sep 09 20:48:20.831447 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:48:20.831389    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1170b545-bb37-4499-9a2f-c0d7e976854d-registry-tls\") pod \"image-registry-7cdff8874c-zhjsp\" (UID: \"1170b545-bb37-4499-9a2f-c0d7e976854d\") " pod="openshift-image-registry/image-registry-7cdff8874c-zhjsp"
Sep 09 20:48:20.831447 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:48:20.831448    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/37b0d343-5d35-4d62-b3f4-929029b915f2-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-bjkpq\" (UID: \"37b0d343-5d35-4d62-b3f4-929029b915f2\") " pod="openshift-network-console/networking-console-plugin-79977f9844-bjkpq"
Sep 09 20:48:20.831904 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:48:20.831528    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 20:48:20.831904 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:48:20.831548    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7cdff8874c-zhjsp: secret "image-registry-tls" not found
Sep 09 20:48:20.831904 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:48:20.831580    2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 09 20:48:20.831904 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:48:20.831609    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1170b545-bb37-4499-9a2f-c0d7e976854d-registry-tls podName:1170b545-bb37-4499-9a2f-c0d7e976854d nodeName:}" failed. No retries permitted until 2026-09-09 20:48:52.831593805 +0000 UTC m=+97.283385310 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1170b545-bb37-4499-9a2f-c0d7e976854d-registry-tls") pod "image-registry-7cdff8874c-zhjsp" (UID: "1170b545-bb37-4499-9a2f-c0d7e976854d") : secret "image-registry-tls" not found
Sep 09 20:48:20.831904 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:48:20.831634    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37b0d343-5d35-4d62-b3f4-929029b915f2-networking-console-plugin-cert podName:37b0d343-5d35-4d62-b3f4-929029b915f2 nodeName:}" failed. No retries permitted until 2026-09-09 20:48:52.831622919 +0000 UTC m=+97.283414425 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/37b0d343-5d35-4d62-b3f4-929029b915f2-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-bjkpq" (UID: "37b0d343-5d35-4d62-b3f4-929029b915f2") : secret "networking-console-plugin-cert" not found
Sep 09 20:48:20.932221 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:48:20.932182    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8d37bae7-db79-4322-9ba1-012a68918b86-metrics-tls\") pod \"dns-default-dg6rb\" (UID: \"8d37bae7-db79-4322-9ba1-012a68918b86\") " pod="openshift-dns/dns-default-dg6rb"
Sep 09 20:48:20.932411 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:48:20.932339    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 20:48:20.932477 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:48:20.932416    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d37bae7-db79-4322-9ba1-012a68918b86-metrics-tls podName:8d37bae7-db79-4322-9ba1-012a68918b86 nodeName:}" failed. No retries permitted until 2026-09-09 20:48:52.932395926 +0000 UTC m=+97.384187432 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8d37bae7-db79-4322-9ba1-012a68918b86-metrics-tls") pod "dns-default-dg6rb" (UID: "8d37bae7-db79-4322-9ba1-012a68918b86") : secret "dns-default-metrics-tls" not found
Sep 09 20:48:21.837955 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:48:21.837908    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/34f7d128-9c82-4497-9766-0b314e3badce-original-pull-secret\") pod \"global-pull-secret-syncer-n276l\" (UID: \"34f7d128-9c82-4497-9766-0b314e3badce\") " pod="kube-system/global-pull-secret-syncer-n276l"
Sep 09 20:48:21.838346 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:48:21.837983    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3794c68-57f8-4bf6-9a86-b564da84a425-metrics-certs\") pod \"network-metrics-daemon-48bqr\" (UID: \"e3794c68-57f8-4bf6-9a86-b564da84a425\") " pod="openshift-multus/network-metrics-daemon-48bqr"
Sep 09 20:48:21.838346 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:48:21.838021    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wzkp\" (UniqueName: \"kubernetes.io/projected/9586d9e2-2e7a-4b4b-bc48-5cadd9a9dc49-kube-api-access-5wzkp\") pod \"network-check-target-ft6x6\" (UID: \"9586d9e2-2e7a-4b4b-bc48-5cadd9a9dc49\") " pod="openshift-network-diagnostics/network-check-target-ft6x6"
Sep 09 20:48:21.840763 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:48:21.840740    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 09 20:48:21.840807 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:48:21.840784    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 09 20:48:21.840807 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:48:21.840796    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 09 20:48:21.848148 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:48:21.848134    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 09 20:48:21.848195 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:48:21.848186    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3794c68-57f8-4bf6-9a86-b564da84a425-metrics-certs podName:e3794c68-57f8-4bf6-9a86-b564da84a425 nodeName:}" failed. No retries permitted until 2026-09-09 20:49:25.848171176 +0000 UTC m=+130.299962683 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3794c68-57f8-4bf6-9a86-b564da84a425-metrics-certs") pod "network-metrics-daemon-48bqr" (UID: "e3794c68-57f8-4bf6-9a86-b564da84a425") : secret "metrics-daemon-secret" not found
Sep 09 20:48:21.850375 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:48:21.850360    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 09 20:48:21.851273 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:48:21.851246    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/34f7d128-9c82-4497-9766-0b314e3badce-original-pull-secret\") pod \"global-pull-secret-syncer-n276l\" (UID: \"34f7d128-9c82-4497-9766-0b314e3badce\") " pod="kube-system/global-pull-secret-syncer-n276l"
Sep 09 20:48:21.858071 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:48:21.858050    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n276l"
Sep 09 20:48:21.861228 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:48:21.861208    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wzkp\" (UniqueName: \"kubernetes.io/projected/9586d9e2-2e7a-4b4b-bc48-5cadd9a9dc49-kube-api-access-5wzkp\") pod \"network-check-target-ft6x6\" (UID: \"9586d9e2-2e7a-4b4b-bc48-5cadd9a9dc49\") " pod="openshift-network-diagnostics/network-check-target-ft6x6"
Sep 09 20:48:21.866947 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:48:21.866928    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-kzsmd\""
Sep 09 20:48:21.874941 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:48:21.874915    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ft6x6"
Sep 09 20:48:22.130586 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:48:22.130499    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-n276l"]
Sep 09 20:48:22.136694 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:48:22.136640    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34f7d128_9c82_4497_9766_0b314e3badce.slice/crio-e333589974332a921a36c6562aa6bba00a095a606328cb6abc745b1a5e39fbe0 WatchSource:0}: Error finding container e333589974332a921a36c6562aa6bba00a095a606328cb6abc745b1a5e39fbe0: Status 404 returned error can't find the container with id e333589974332a921a36c6562aa6bba00a095a606328cb6abc745b1a5e39fbe0
Sep 09 20:48:22.151642 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:48:22.151614    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ft6x6"]
Sep 09 20:48:22.154913 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:48:22.154889    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9586d9e2_2e7a_4b4b_bc48_5cadd9a9dc49.slice/crio-f1ba2e34afa3270bd7d2a9091d4cacf7ce7810fa31d68a946267ab8e035077ef WatchSource:0}: Error finding container f1ba2e34afa3270bd7d2a9091d4cacf7ce7810fa31d68a946267ab8e035077ef: Status 404 returned error can't find the container with id f1ba2e34afa3270bd7d2a9091d4cacf7ce7810fa31d68a946267ab8e035077ef
Sep 09 20:48:22.367738 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:48:22.367700    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-n276l" event={"ID":"34f7d128-9c82-4497-9766-0b314e3badce","Type":"ContainerStarted","Data":"e333589974332a921a36c6562aa6bba00a095a606328cb6abc745b1a5e39fbe0"}
Sep 09 20:48:22.368818 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:48:22.368796    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ft6x6" event={"ID":"9586d9e2-2e7a-4b4b-bc48-5cadd9a9dc49","Type":"ContainerStarted","Data":"f1ba2e34afa3270bd7d2a9091d4cacf7ce7810fa31d68a946267ab8e035077ef"}
Sep 09 20:48:28.386381 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:48:28.386343    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ft6x6" event={"ID":"9586d9e2-2e7a-4b4b-bc48-5cadd9a9dc49","Type":"ContainerStarted","Data":"f7bc6995baa0bd93fb3282ea6cd591a5444322f483a8cd7aeab29d139c5b852d"}
Sep 09 20:48:28.386874 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:48:28.386396    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-ft6x6"
Sep 09 20:48:28.387800 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:48:28.387778    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-n276l" event={"ID":"34f7d128-9c82-4497-9766-0b314e3badce","Type":"ContainerStarted","Data":"a9f2706ef83061281a2e5c5772762d815e53c8ef12afff2ec94d2cbab4899e05"}
Sep 09 20:48:28.401923 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:48:28.401881    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-ft6x6" podStartSLOduration=66.957340852 podStartE2EDuration="1m12.401866993s" totalImagesPullingTime="5.444526141s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:47:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:48:28.401250683 +0000 UTC m=+72.853042212" watchObservedRunningTime="2026-09-09 20:48:28.401866993 +0000 UTC m=+72.853658520"
Sep 09 20:48:28.415100 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:48:28.415058    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-n276l" podStartSLOduration=66.960936405 podStartE2EDuration="1m12.415045277s" totalImagesPullingTime="5.454108872s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 20:47:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:48:28.414292462 +0000 UTC m=+72.866083985" watchObservedRunningTime="2026-09-09 20:48:28.415045277 +0000 UTC m=+72.866836805"
Sep 09 20:48:52.860272 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:48:52.860235    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1170b545-bb37-4499-9a2f-c0d7e976854d-registry-tls\") pod \"image-registry-7cdff8874c-zhjsp\" (UID: \"1170b545-bb37-4499-9a2f-c0d7e976854d\") " pod="openshift-image-registry/image-registry-7cdff8874c-zhjsp"
Sep 09 20:48:52.860272 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:48:52.860277    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/37b0d343-5d35-4d62-b3f4-929029b915f2-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-bjkpq\" (UID: \"37b0d343-5d35-4d62-b3f4-929029b915f2\") " pod="openshift-network-console/networking-console-plugin-79977f9844-bjkpq"
Sep 09 20:48:52.860791 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:48:52.860370    2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 09 20:48:52.860791 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:48:52.860385    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 20:48:52.860791 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:48:52.860407    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7cdff8874c-zhjsp: secret "image-registry-tls" not found
Sep 09 20:48:52.860791 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:48:52.860428    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37b0d343-5d35-4d62-b3f4-929029b915f2-networking-console-plugin-cert podName:37b0d343-5d35-4d62-b3f4-929029b915f2 nodeName:}" failed. No retries permitted until 2026-09-09 20:49:56.860412455 +0000 UTC m=+161.312203981 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/37b0d343-5d35-4d62-b3f4-929029b915f2-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-bjkpq" (UID: "37b0d343-5d35-4d62-b3f4-929029b915f2") : secret "networking-console-plugin-cert" not found
Sep 09 20:48:52.860791 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:48:52.860493    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1170b545-bb37-4499-9a2f-c0d7e976854d-registry-tls podName:1170b545-bb37-4499-9a2f-c0d7e976854d nodeName:}" failed. No retries permitted until 2026-09-09 20:49:56.860479365 +0000 UTC m=+161.312270876 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1170b545-bb37-4499-9a2f-c0d7e976854d-registry-tls") pod "image-registry-7cdff8874c-zhjsp" (UID: "1170b545-bb37-4499-9a2f-c0d7e976854d") : secret "image-registry-tls" not found
Sep 09 20:48:52.960804 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:48:52.960766    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8d37bae7-db79-4322-9ba1-012a68918b86-metrics-tls\") pod \"dns-default-dg6rb\" (UID: \"8d37bae7-db79-4322-9ba1-012a68918b86\") " pod="openshift-dns/dns-default-dg6rb"
Sep 09 20:48:52.960934 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:48:52.960910    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 20:48:52.960986 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:48:52.960977    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d37bae7-db79-4322-9ba1-012a68918b86-metrics-tls podName:8d37bae7-db79-4322-9ba1-012a68918b86 nodeName:}" failed. No retries permitted until 2026-09-09 20:49:56.960962914 +0000 UTC m=+161.412754425 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8d37bae7-db79-4322-9ba1-012a68918b86-metrics-tls") pod "dns-default-dg6rb" (UID: "8d37bae7-db79-4322-9ba1-012a68918b86") : secret "dns-default-metrics-tls" not found
Sep 09 20:48:59.392906 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:48:59.392875    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-ft6x6"
Sep 09 20:49:25.893155 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:49:25.893118    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3794c68-57f8-4bf6-9a86-b564da84a425-metrics-certs\") pod \"network-metrics-daemon-48bqr\" (UID: \"e3794c68-57f8-4bf6-9a86-b564da84a425\") " pod="openshift-multus/network-metrics-daemon-48bqr"
Sep 09 20:49:25.893557 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:49:25.893238    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 09 20:49:25.893557 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:49:25.893299    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3794c68-57f8-4bf6-9a86-b564da84a425-metrics-certs podName:e3794c68-57f8-4bf6-9a86-b564da84a425 nodeName:}" failed. No retries permitted until 2026-09-09 20:51:27.893284335 +0000 UTC m=+252.345075840 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3794c68-57f8-4bf6-9a86-b564da84a425-metrics-certs") pod "network-metrics-daemon-48bqr" (UID: "e3794c68-57f8-4bf6-9a86-b564da84a425") : secret "metrics-daemon-secret" not found
Sep 09 20:49:51.984421 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:49:51.984360    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-7cdff8874c-zhjsp" podUID="1170b545-bb37-4499-9a2f-c0d7e976854d"
Sep 09 20:49:52.010659 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:49:52.010625    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-79977f9844-bjkpq" podUID="37b0d343-5d35-4d62-b3f4-929029b915f2"
Sep 09 20:49:52.049827 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:49:52.049792    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-dg6rb" podUID="8d37bae7-db79-4322-9ba1-012a68918b86"
Sep 09 20:49:52.586067 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:49:52.586037    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7cdff8874c-zhjsp"
Sep 09 20:49:52.586262 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:49:52.586037    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-bjkpq"
Sep 09 20:49:53.070682 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:49:53.070638    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-48bqr" podUID="e3794c68-57f8-4bf6-9a86-b564da84a425"
Sep 09 20:49:56.916344 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:49:56.916290    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1170b545-bb37-4499-9a2f-c0d7e976854d-registry-tls\") pod \"image-registry-7cdff8874c-zhjsp\" (UID: \"1170b545-bb37-4499-9a2f-c0d7e976854d\") " pod="openshift-image-registry/image-registry-7cdff8874c-zhjsp"
Sep 09 20:49:56.916344 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:49:56.916348    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/37b0d343-5d35-4d62-b3f4-929029b915f2-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-bjkpq\" (UID: \"37b0d343-5d35-4d62-b3f4-929029b915f2\") " pod="openshift-network-console/networking-console-plugin-79977f9844-bjkpq"
Sep 09 20:49:56.916856 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:49:56.916440    2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 09 20:49:56.916856 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:49:56.916446    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 20:49:56.916856 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:49:56.916467    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7cdff8874c-zhjsp: secret "image-registry-tls" not found
Sep 09 20:49:56.916856 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:49:56.916493    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37b0d343-5d35-4d62-b3f4-929029b915f2-networking-console-plugin-cert podName:37b0d343-5d35-4d62-b3f4-929029b915f2 nodeName:}" failed. No retries permitted until 2026-09-09 20:51:58.916480258 +0000 UTC m=+283.368271765 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/37b0d343-5d35-4d62-b3f4-929029b915f2-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-bjkpq" (UID: "37b0d343-5d35-4d62-b3f4-929029b915f2") : secret "networking-console-plugin-cert" not found
Sep 09 20:49:56.916856 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:49:56.916519    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1170b545-bb37-4499-9a2f-c0d7e976854d-registry-tls podName:1170b545-bb37-4499-9a2f-c0d7e976854d nodeName:}" failed. No retries permitted until 2026-09-09 20:51:58.916506254 +0000 UTC m=+283.368297760 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1170b545-bb37-4499-9a2f-c0d7e976854d-registry-tls") pod "image-registry-7cdff8874c-zhjsp" (UID: "1170b545-bb37-4499-9a2f-c0d7e976854d") : secret "image-registry-tls" not found
Sep 09 20:49:57.017158 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:49:57.017122    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8d37bae7-db79-4322-9ba1-012a68918b86-metrics-tls\") pod \"dns-default-dg6rb\" (UID: \"8d37bae7-db79-4322-9ba1-012a68918b86\") " pod="openshift-dns/dns-default-dg6rb"
Sep 09 20:49:57.017322 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:49:57.017250    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 20:49:57.017322 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:49:57.017304    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d37bae7-db79-4322-9ba1-012a68918b86-metrics-tls podName:8d37bae7-db79-4322-9ba1-012a68918b86 nodeName:}" failed. No retries permitted until 2026-09-09 20:51:59.017292276 +0000 UTC m=+283.469083781 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8d37bae7-db79-4322-9ba1-012a68918b86-metrics-tls") pod "dns-default-dg6rb" (UID: "8d37bae7-db79-4322-9ba1-012a68918b86") : secret "dns-default-metrics-tls" not found
Sep 09 20:50:04.041626 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:50:04.041584    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dg6rb"
Sep 09 20:50:06.042547 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:50:06.042516    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-48bqr"
Sep 09 20:51:27.938735 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:27.938691    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3794c68-57f8-4bf6-9a86-b564da84a425-metrics-certs\") pod \"network-metrics-daemon-48bqr\" (UID: \"e3794c68-57f8-4bf6-9a86-b564da84a425\") " pod="openshift-multus/network-metrics-daemon-48bqr"
Sep 09 20:51:27.939319 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:51:27.938881    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 09 20:51:27.939319 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:51:27.938968    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3794c68-57f8-4bf6-9a86-b564da84a425-metrics-certs podName:e3794c68-57f8-4bf6-9a86-b564da84a425 nodeName:}" failed. No retries permitted until 2026-09-09 20:53:29.938945927 +0000 UTC m=+374.390737433 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3794c68-57f8-4bf6-9a86-b564da84a425-metrics-certs") pod "network-metrics-daemon-48bqr" (UID: "e3794c68-57f8-4bf6-9a86-b564da84a425") : secret "metrics-daemon-secret" not found
Sep 09 20:51:32.411458 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.411421    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-mnzfm"]
Sep 09 20:51:32.413086 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.413067    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-mnzfm"
Sep 09 20:51:32.415264 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.415238    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-8llfb"]
Sep 09 20:51:32.416099 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.416072    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Sep 09 20:51:32.416408 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.416384    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Sep 09 20:51:32.416867 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.416846    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Sep 09 20:51:32.417408 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.417385    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Sep 09 20:51:32.417711 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.417690    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-fgfsb\""
Sep 09 20:51:32.422108 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.422087    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-wlkqm"]
Sep 09 20:51:32.422174 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.422164    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-8llfb"
Sep 09 20:51:32.423939 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.423924    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-85b454874b-zdfrv"]
Sep 09 20:51:32.424049 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.424033    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-wlkqm"
Sep 09 20:51:32.425629 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.425609    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85b454874b-zdfrv"
Sep 09 20:51:32.427047 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.427030    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-lw5fx\""
Sep 09 20:51:32.427151 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.427060    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Sep 09 20:51:32.432764 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.432745    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Sep 09 20:51:32.433053 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.433032    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Sep 09 20:51:32.433402 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.433367    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-dgmqc\""
Sep 09 20:51:32.433496 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.433177    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Sep 09 20:51:32.433583 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.433130    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Sep 09 20:51:32.433714 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.433231    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Sep 09 20:51:32.434032 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.433247    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Sep 09 20:51:32.434858 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.433285    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Sep 09 20:51:32.434858 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.433188    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Sep 09 20:51:32.435007 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.434990    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-hmbmv\""
Sep 09 20:51:32.435388 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.435367    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-mnzfm"]
Sep 09 20:51:32.436379 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.436355    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-8llfb"]
Sep 09 20:51:32.437427 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.437406    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-wlkqm"]
Sep 09 20:51:32.438779 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.438760    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85b454874b-zdfrv"]
Sep 09 20:51:32.443358 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.443340    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Sep 09 20:51:32.514131 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.514095    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-9rlcx"]
Sep 09 20:51:32.516442 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.516418    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-rwrpr"]
Sep 09 20:51:32.516582 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.516551    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-9rlcx"
Sep 09 20:51:32.518459 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.518440    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-nwv9w"]
Sep 09 20:51:32.518577 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.518559    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-76bcd6ccf5-rwrpr"
Sep 09 20:51:32.519066 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.519046    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-dwsfm\""
Sep 09 20:51:32.519216 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.519199    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 09 20:51:32.519988 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.519971    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 09 20:51:32.520316 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.520301    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Sep 09 20:51:32.520365 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.520331    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Sep 09 20:51:32.520646 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.520628    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-685456655f-nwv9w"
Sep 09 20:51:32.520729 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.520709    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-tnpsc\""
Sep 09 20:51:32.521071 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.521054    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Sep 09 20:51:32.521124 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.521060    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 09 20:51:32.521157 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.521062    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Sep 09 20:51:32.521372 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.521358    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 09 20:51:32.522914 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.522893    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-rc428\""
Sep 09 20:51:32.525078 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.525058    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-nwv9w"]
Sep 09 20:51:32.526704 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.526685    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Sep 09 20:51:32.529084 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.529043    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-9rlcx"]
Sep 09 20:51:32.530189 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.530170    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-rwrpr"]
Sep 09 20:51:32.569388 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.569358    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a23f7c09-09f4-49b5-a012-f1d3ec19fc27-serving-cert\") pod \"console-operator-85b454874b-zdfrv\" (UID: \"a23f7c09-09f4-49b5-a012-f1d3ec19fc27\") " pod="openshift-console-operator/console-operator-85b454874b-zdfrv"
Sep 09 20:51:32.569388 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.569390    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ksr84\" (UniqueName: \"kubernetes.io/projected/a23f7c09-09f4-49b5-a012-f1d3ec19fc27-kube-api-access-ksr84\") pod \"console-operator-85b454874b-zdfrv\" (UID: \"a23f7c09-09f4-49b5-a012-f1d3ec19fc27\") " pod="openshift-console-operator/console-operator-85b454874b-zdfrv"
Sep 09 20:51:32.569593 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.569412    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/513f5747-5c6e-4983-b573-1c3da7b2d8e2-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-mnzfm\" (UID: \"513f5747-5c6e-4983-b573-1c3da7b2d8e2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-mnzfm"
Sep 09 20:51:32.569593 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.569432    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/34775cd2-d236-4077-8ff6-2be4de016d08-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-wlkqm\" (UID: \"34775cd2-d236-4077-8ff6-2be4de016d08\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-wlkqm"
Sep 09 20:51:32.569593 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.569482    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rddch\" (UniqueName: \"kubernetes.io/projected/34775cd2-d236-4077-8ff6-2be4de016d08-kube-api-access-rddch\") pod \"cluster-samples-operator-7cdcfcf76c-wlkqm\" (UID: \"34775cd2-d236-4077-8ff6-2be4de016d08\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-wlkqm"
Sep 09 20:51:32.569593 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.569547    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a23f7c09-09f4-49b5-a012-f1d3ec19fc27-config\") pod \"console-operator-85b454874b-zdfrv\" (UID: \"a23f7c09-09f4-49b5-a012-f1d3ec19fc27\") " pod="openshift-console-operator/console-operator-85b454874b-zdfrv"
Sep 09 20:51:32.569593 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.569567    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2p9k8\" (UniqueName: \"kubernetes.io/projected/8068d21c-8270-4d4a-a68b-7cdc2ae18752-kube-api-access-2p9k8\") pod \"volume-data-source-validator-695c895bd6-8llfb\" (UID: \"8068d21c-8270-4d4a-a68b-7cdc2ae18752\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-8llfb"
Sep 09 20:51:32.569767 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.569595    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/513f5747-5c6e-4983-b573-1c3da7b2d8e2-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-mnzfm\" (UID: \"513f5747-5c6e-4983-b573-1c3da7b2d8e2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-mnzfm"
Sep 09 20:51:32.569767 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.569630    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vnpb\" (UniqueName: \"kubernetes.io/projected/513f5747-5c6e-4983-b573-1c3da7b2d8e2-kube-api-access-5vnpb\") pod \"kube-storage-version-migrator-operator-8d7dd4675-mnzfm\" (UID: \"513f5747-5c6e-4983-b573-1c3da7b2d8e2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-mnzfm"
Sep 09 20:51:32.569767 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.569687    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a23f7c09-09f4-49b5-a012-f1d3ec19fc27-trusted-ca\") pod \"console-operator-85b454874b-zdfrv\" (UID: \"a23f7c09-09f4-49b5-a012-f1d3ec19fc27\") " pod="openshift-console-operator/console-operator-85b454874b-zdfrv"
Sep 09 20:51:32.670514 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.670415    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rddch\" (UniqueName: \"kubernetes.io/projected/34775cd2-d236-4077-8ff6-2be4de016d08-kube-api-access-rddch\") pod \"cluster-samples-operator-7cdcfcf76c-wlkqm\" (UID: \"34775cd2-d236-4077-8ff6-2be4de016d08\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-wlkqm"
Sep 09 20:51:32.670514 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.670484    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2p9k8\" (UniqueName: \"kubernetes.io/projected/8068d21c-8270-4d4a-a68b-7cdc2ae18752-kube-api-access-2p9k8\") pod \"volume-data-source-validator-695c895bd6-8llfb\" (UID: \"8068d21c-8270-4d4a-a68b-7cdc2ae18752\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-8llfb"
Sep 09 20:51:32.670751 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.670647    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f2eca4c6-1767-466b-87e3-915079d3e8de-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-9rlcx\" (UID: \"f2eca4c6-1767-466b-87e3-915079d3e8de\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-9rlcx"
Sep 09 20:51:32.670751 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.670703    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cb1e1737-0c2a-4380-8fdd-cebe18bf1107-tmp\") pod \"insights-operator-76bcd6ccf5-rwrpr\" (UID: \"cb1e1737-0c2a-4380-8fdd-cebe18bf1107\") " pod="openshift-insights/insights-operator-76bcd6ccf5-rwrpr"
Sep 09 20:51:32.670751 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.670729    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a23f7c09-09f4-49b5-a012-f1d3ec19fc27-trusted-ca\") pod \"console-operator-85b454874b-zdfrv\" (UID: \"a23f7c09-09f4-49b5-a012-f1d3ec19fc27\") " pod="openshift-console-operator/console-operator-85b454874b-zdfrv"
Sep 09 20:51:32.670751 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.670751    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/513f5747-5c6e-4983-b573-1c3da7b2d8e2-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-mnzfm\" (UID: \"513f5747-5c6e-4983-b573-1c3da7b2d8e2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-mnzfm"
Sep 09 20:51:32.671050 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.670766    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vnpb\" (UniqueName: \"kubernetes.io/projected/513f5747-5c6e-4983-b573-1c3da7b2d8e2-kube-api-access-5vnpb\") pod \"kube-storage-version-migrator-operator-8d7dd4675-mnzfm\" (UID: \"513f5747-5c6e-4983-b573-1c3da7b2d8e2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-mnzfm"
Sep 09 20:51:32.671050 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.670788    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ksr84\" (UniqueName: \"kubernetes.io/projected/a23f7c09-09f4-49b5-a012-f1d3ec19fc27-kube-api-access-ksr84\") pod \"console-operator-85b454874b-zdfrv\" (UID: \"a23f7c09-09f4-49b5-a012-f1d3ec19fc27\") " pod="openshift-console-operator/console-operator-85b454874b-zdfrv"
Sep 09 20:51:32.671050 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.670812    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb1e1737-0c2a-4380-8fdd-cebe18bf1107-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-rwrpr\" (UID: \"cb1e1737-0c2a-4380-8fdd-cebe18bf1107\") " pod="openshift-insights/insights-operator-76bcd6ccf5-rwrpr"
Sep 09 20:51:32.671050 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.670835    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqzrb\" (UniqueName: \"kubernetes.io/projected/cb1e1737-0c2a-4380-8fdd-cebe18bf1107-kube-api-access-fqzrb\") pod \"insights-operator-76bcd6ccf5-rwrpr\" (UID: \"cb1e1737-0c2a-4380-8fdd-cebe18bf1107\") " pod="openshift-insights/insights-operator-76bcd6ccf5-rwrpr"
Sep 09 20:51:32.671050 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.670959    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/513f5747-5c6e-4983-b573-1c3da7b2d8e2-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-mnzfm\" (UID: \"513f5747-5c6e-4983-b573-1c3da7b2d8e2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-mnzfm"
Sep 09 20:51:32.671050 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.671002    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/34775cd2-d236-4077-8ff6-2be4de016d08-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-wlkqm\" (UID: \"34775cd2-d236-4077-8ff6-2be4de016d08\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-wlkqm"
Sep 09 20:51:32.671050 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.671033    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/f2eca4c6-1767-466b-87e3-915079d3e8de-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-9rlcx\" (UID: \"f2eca4c6-1767-466b-87e3-915079d3e8de\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-9rlcx"
Sep 09 20:51:32.671414 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.671066    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fk5kt\" (UniqueName: \"kubernetes.io/projected/f2eca4c6-1767-466b-87e3-915079d3e8de-kube-api-access-fk5kt\") pod \"cluster-monitoring-operator-6cdcc96965-9rlcx\" (UID: \"f2eca4c6-1767-466b-87e3-915079d3e8de\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-9rlcx"
Sep 09 20:51:32.671414 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.671119    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a23f7c09-09f4-49b5-a012-f1d3ec19fc27-config\") pod \"console-operator-85b454874b-zdfrv\" (UID: \"a23f7c09-09f4-49b5-a012-f1d3ec19fc27\") " pod="openshift-console-operator/console-operator-85b454874b-zdfrv"
Sep 09 20:51:32.671414 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:51:32.671167    2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 09 20:51:32.671414 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:51:32.671242    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34775cd2-d236-4077-8ff6-2be4de016d08-samples-operator-tls podName:34775cd2-d236-4077-8ff6-2be4de016d08 nodeName:}" failed. No retries permitted until 2026-09-09 20:51:33.171222229 +0000 UTC m=+257.623013739 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/34775cd2-d236-4077-8ff6-2be4de016d08-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-wlkqm" (UID: "34775cd2-d236-4077-8ff6-2be4de016d08") : secret "samples-operator-tls" not found
Sep 09 20:51:32.671414 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.671169    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpwtz\" (UniqueName: \"kubernetes.io/projected/1b1c6cd9-e153-4c58-a022-d924776f84ef-kube-api-access-fpwtz\") pod \"network-check-source-685456655f-nwv9w\" (UID: \"1b1c6cd9-e153-4c58-a022-d924776f84ef\") " pod="openshift-network-diagnostics/network-check-source-685456655f-nwv9w"
Sep 09 20:51:32.671414 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.671299    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/cb1e1737-0c2a-4380-8fdd-cebe18bf1107-snapshots\") pod \"insights-operator-76bcd6ccf5-rwrpr\" (UID: \"cb1e1737-0c2a-4380-8fdd-cebe18bf1107\") " pod="openshift-insights/insights-operator-76bcd6ccf5-rwrpr"
Sep 09 20:51:32.671414 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.671334    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb1e1737-0c2a-4380-8fdd-cebe18bf1107-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-rwrpr\" (UID: \"cb1e1737-0c2a-4380-8fdd-cebe18bf1107\") " pod="openshift-insights/insights-operator-76bcd6ccf5-rwrpr"
Sep 09 20:51:32.671414 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.671362    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a23f7c09-09f4-49b5-a012-f1d3ec19fc27-serving-cert\") pod \"console-operator-85b454874b-zdfrv\" (UID: \"a23f7c09-09f4-49b5-a012-f1d3ec19fc27\") " pod="openshift-console-operator/console-operator-85b454874b-zdfrv"
Sep 09 20:51:32.671414 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.671393    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cb1e1737-0c2a-4380-8fdd-cebe18bf1107-serving-cert\") pod \"insights-operator-76bcd6ccf5-rwrpr\" (UID: \"cb1e1737-0c2a-4380-8fdd-cebe18bf1107\") " pod="openshift-insights/insights-operator-76bcd6ccf5-rwrpr"
Sep 09 20:51:32.671854 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.671445    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/513f5747-5c6e-4983-b573-1c3da7b2d8e2-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-mnzfm\" (UID: \"513f5747-5c6e-4983-b573-1c3da7b2d8e2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-mnzfm"
Sep 09 20:51:32.671854 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.671752    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a23f7c09-09f4-49b5-a012-f1d3ec19fc27-trusted-ca\") pod \"console-operator-85b454874b-zdfrv\" (UID: \"a23f7c09-09f4-49b5-a012-f1d3ec19fc27\") " pod="openshift-console-operator/console-operator-85b454874b-zdfrv"
Sep 09 20:51:32.671854 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.671754    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a23f7c09-09f4-49b5-a012-f1d3ec19fc27-config\") pod \"console-operator-85b454874b-zdfrv\" (UID: \"a23f7c09-09f4-49b5-a012-f1d3ec19fc27\") " pod="openshift-console-operator/console-operator-85b454874b-zdfrv"
Sep 09 20:51:32.673281 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.673252    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/513f5747-5c6e-4983-b573-1c3da7b2d8e2-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-mnzfm\" (UID: \"513f5747-5c6e-4983-b573-1c3da7b2d8e2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-mnzfm"
Sep 09 20:51:32.673556 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.673539    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a23f7c09-09f4-49b5-a012-f1d3ec19fc27-serving-cert\") pod \"console-operator-85b454874b-zdfrv\" (UID: \"a23f7c09-09f4-49b5-a012-f1d3ec19fc27\") " pod="openshift-console-operator/console-operator-85b454874b-zdfrv"
Sep 09 20:51:32.678973 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.678947    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rddch\" (UniqueName: \"kubernetes.io/projected/34775cd2-d236-4077-8ff6-2be4de016d08-kube-api-access-rddch\") pod \"cluster-samples-operator-7cdcfcf76c-wlkqm\" (UID: \"34775cd2-d236-4077-8ff6-2be4de016d08\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-wlkqm"
Sep 09 20:51:32.681428 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.681403    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vnpb\" (UniqueName: \"kubernetes.io/projected/513f5747-5c6e-4983-b573-1c3da7b2d8e2-kube-api-access-5vnpb\") pod \"kube-storage-version-migrator-operator-8d7dd4675-mnzfm\" (UID: \"513f5747-5c6e-4983-b573-1c3da7b2d8e2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-mnzfm"
Sep 09 20:51:32.681531 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.681480    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksr84\" (UniqueName: \"kubernetes.io/projected/a23f7c09-09f4-49b5-a012-f1d3ec19fc27-kube-api-access-ksr84\") pod \"console-operator-85b454874b-zdfrv\" (UID: \"a23f7c09-09f4-49b5-a012-f1d3ec19fc27\") " pod="openshift-console-operator/console-operator-85b454874b-zdfrv"
Sep 09 20:51:32.681765 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.681738    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2p9k8\" (UniqueName: \"kubernetes.io/projected/8068d21c-8270-4d4a-a68b-7cdc2ae18752-kube-api-access-2p9k8\") pod \"volume-data-source-validator-695c895bd6-8llfb\" (UID: \"8068d21c-8270-4d4a-a68b-7cdc2ae18752\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-8llfb"
Sep 09 20:51:32.724114 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.724067    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-mnzfm"
Sep 09 20:51:32.735036 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.735008    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-8llfb"
Sep 09 20:51:32.747246 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.747218    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85b454874b-zdfrv"
Sep 09 20:51:32.772504 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.772396    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpwtz\" (UniqueName: \"kubernetes.io/projected/1b1c6cd9-e153-4c58-a022-d924776f84ef-kube-api-access-fpwtz\") pod \"network-check-source-685456655f-nwv9w\" (UID: \"1b1c6cd9-e153-4c58-a022-d924776f84ef\") " pod="openshift-network-diagnostics/network-check-source-685456655f-nwv9w"
Sep 09 20:51:32.772504 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.772466    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/cb1e1737-0c2a-4380-8fdd-cebe18bf1107-snapshots\") pod \"insights-operator-76bcd6ccf5-rwrpr\" (UID: \"cb1e1737-0c2a-4380-8fdd-cebe18bf1107\") " pod="openshift-insights/insights-operator-76bcd6ccf5-rwrpr"
Sep 09 20:51:32.772504 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.772503    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb1e1737-0c2a-4380-8fdd-cebe18bf1107-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-rwrpr\" (UID: \"cb1e1737-0c2a-4380-8fdd-cebe18bf1107\") " pod="openshift-insights/insights-operator-76bcd6ccf5-rwrpr"
Sep 09 20:51:32.774807 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.772535    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cb1e1737-0c2a-4380-8fdd-cebe18bf1107-serving-cert\") pod \"insights-operator-76bcd6ccf5-rwrpr\" (UID: \"cb1e1737-0c2a-4380-8fdd-cebe18bf1107\") " pod="openshift-insights/insights-operator-76bcd6ccf5-rwrpr"
Sep 09 20:51:32.774807 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.772600    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f2eca4c6-1767-466b-87e3-915079d3e8de-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-9rlcx\" (UID: \"f2eca4c6-1767-466b-87e3-915079d3e8de\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-9rlcx"
Sep 09 20:51:32.774807 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.772628    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cb1e1737-0c2a-4380-8fdd-cebe18bf1107-tmp\") pod \"insights-operator-76bcd6ccf5-rwrpr\" (UID: \"cb1e1737-0c2a-4380-8fdd-cebe18bf1107\") " pod="openshift-insights/insights-operator-76bcd6ccf5-rwrpr"
Sep 09 20:51:32.774807 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.772687    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb1e1737-0c2a-4380-8fdd-cebe18bf1107-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-rwrpr\" (UID: \"cb1e1737-0c2a-4380-8fdd-cebe18bf1107\") " pod="openshift-insights/insights-operator-76bcd6ccf5-rwrpr"
Sep 09 20:51:32.774807 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.772710    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqzrb\" (UniqueName: \"kubernetes.io/projected/cb1e1737-0c2a-4380-8fdd-cebe18bf1107-kube-api-access-fqzrb\") pod \"insights-operator-76bcd6ccf5-rwrpr\" (UID: \"cb1e1737-0c2a-4380-8fdd-cebe18bf1107\") " pod="openshift-insights/insights-operator-76bcd6ccf5-rwrpr"
Sep 09 20:51:32.774807 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.772755    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/f2eca4c6-1767-466b-87e3-915079d3e8de-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-9rlcx\" (UID: \"f2eca4c6-1767-466b-87e3-915079d3e8de\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-9rlcx"
Sep 09 20:51:32.774807 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.772782    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fk5kt\" (UniqueName: \"kubernetes.io/projected/f2eca4c6-1767-466b-87e3-915079d3e8de-kube-api-access-fk5kt\") pod \"cluster-monitoring-operator-6cdcc96965-9rlcx\" (UID: \"f2eca4c6-1767-466b-87e3-915079d3e8de\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-9rlcx"
Sep 09 20:51:32.774807 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:51:32.773056    2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 09 20:51:32.774807 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:51:32.773158    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2eca4c6-1767-466b-87e3-915079d3e8de-cluster-monitoring-operator-tls podName:f2eca4c6-1767-466b-87e3-915079d3e8de nodeName:}" failed. No retries permitted until 2026-09-09 20:51:33.273120561 +0000 UTC m=+257.724912081 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f2eca4c6-1767-466b-87e3-915079d3e8de-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-9rlcx" (UID: "f2eca4c6-1767-466b-87e3-915079d3e8de") : secret "cluster-monitoring-operator-tls" not found
Sep 09 20:51:32.774807 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.773492    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cb1e1737-0c2a-4380-8fdd-cebe18bf1107-tmp\") pod \"insights-operator-76bcd6ccf5-rwrpr\" (UID: \"cb1e1737-0c2a-4380-8fdd-cebe18bf1107\") " pod="openshift-insights/insights-operator-76bcd6ccf5-rwrpr"
Sep 09 20:51:32.774807 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.774122    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb1e1737-0c2a-4380-8fdd-cebe18bf1107-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-rwrpr\" (UID: \"cb1e1737-0c2a-4380-8fdd-cebe18bf1107\") " pod="openshift-insights/insights-operator-76bcd6ccf5-rwrpr"
Sep 09 20:51:32.774807 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.774604    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/cb1e1737-0c2a-4380-8fdd-cebe18bf1107-snapshots\") pod \"insights-operator-76bcd6ccf5-rwrpr\" (UID: \"cb1e1737-0c2a-4380-8fdd-cebe18bf1107\") " pod="openshift-insights/insights-operator-76bcd6ccf5-rwrpr"
Sep 09 20:51:32.775787 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.774922    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb1e1737-0c2a-4380-8fdd-cebe18bf1107-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-rwrpr\" (UID: \"cb1e1737-0c2a-4380-8fdd-cebe18bf1107\") " pod="openshift-insights/insights-operator-76bcd6ccf5-rwrpr"
Sep 09 20:51:32.775787 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.775074    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/f2eca4c6-1767-466b-87e3-915079d3e8de-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-9rlcx\" (UID: \"f2eca4c6-1767-466b-87e3-915079d3e8de\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-9rlcx"
Sep 09 20:51:32.778837 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.778549    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cb1e1737-0c2a-4380-8fdd-cebe18bf1107-serving-cert\") pod \"insights-operator-76bcd6ccf5-rwrpr\" (UID: \"cb1e1737-0c2a-4380-8fdd-cebe18bf1107\") " pod="openshift-insights/insights-operator-76bcd6ccf5-rwrpr"
Sep 09 20:51:32.783723 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.783118    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpwtz\" (UniqueName: \"kubernetes.io/projected/1b1c6cd9-e153-4c58-a022-d924776f84ef-kube-api-access-fpwtz\") pod \"network-check-source-685456655f-nwv9w\" (UID: \"1b1c6cd9-e153-4c58-a022-d924776f84ef\") " pod="openshift-network-diagnostics/network-check-source-685456655f-nwv9w"
Sep 09 20:51:32.783723 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.783656    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fk5kt\" (UniqueName: \"kubernetes.io/projected/f2eca4c6-1767-466b-87e3-915079d3e8de-kube-api-access-fk5kt\") pod \"cluster-monitoring-operator-6cdcc96965-9rlcx\" (UID: \"f2eca4c6-1767-466b-87e3-915079d3e8de\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-9rlcx"
Sep 09 20:51:32.784538 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.784511    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqzrb\" (UniqueName: \"kubernetes.io/projected/cb1e1737-0c2a-4380-8fdd-cebe18bf1107-kube-api-access-fqzrb\") pod \"insights-operator-76bcd6ccf5-rwrpr\" (UID: \"cb1e1737-0c2a-4380-8fdd-cebe18bf1107\") " pod="openshift-insights/insights-operator-76bcd6ccf5-rwrpr"
Sep 09 20:51:32.835167 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.835136    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-76bcd6ccf5-rwrpr"
Sep 09 20:51:32.839572 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.839500    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-685456655f-nwv9w"
Sep 09 20:51:32.995914 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:32.995890    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-mnzfm"]
Sep 09 20:51:32.998160 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:51:32.998138    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod513f5747_5c6e_4983_b573_1c3da7b2d8e2.slice/crio-b5e8518b78225a0a4fd5b99acbc6ca3a99a4db6b7e9d0a0a35714e35513c9ae5 WatchSource:0}: Error finding container b5e8518b78225a0a4fd5b99acbc6ca3a99a4db6b7e9d0a0a35714e35513c9ae5: Status 404 returned error can't find the container with id b5e8518b78225a0a4fd5b99acbc6ca3a99a4db6b7e9d0a0a35714e35513c9ae5
Sep 09 20:51:33.018471 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:33.018445    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-8llfb"]
Sep 09 20:51:33.021256 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:51:33.021234    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8068d21c_8270_4d4a_a68b_7cdc2ae18752.slice/crio-3649645e28642f7f97750b7a42a5b8c973b044af03b56acc7ef3136ff7e60de7 WatchSource:0}: Error finding container 3649645e28642f7f97750b7a42a5b8c973b044af03b56acc7ef3136ff7e60de7: Status 404 returned error can't find the container with id 3649645e28642f7f97750b7a42a5b8c973b044af03b56acc7ef3136ff7e60de7
Sep 09 20:51:33.041899 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:33.041878    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85b454874b-zdfrv"]
Sep 09 20:51:33.044003 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:51:33.043982    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda23f7c09_09f4_49b5_a012_f1d3ec19fc27.slice/crio-10beca332d90f6a1986decaf7c2e973a9d50a2a9d668c69fad9019ddd503950b WatchSource:0}: Error finding container 10beca332d90f6a1986decaf7c2e973a9d50a2a9d668c69fad9019ddd503950b: Status 404 returned error can't find the container with id 10beca332d90f6a1986decaf7c2e973a9d50a2a9d668c69fad9019ddd503950b
Sep 09 20:51:33.113399 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:33.113375    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-nwv9w"]
Sep 09 20:51:33.115650 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:33.115619    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-rwrpr"]
Sep 09 20:51:33.115913 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:51:33.115889    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b1c6cd9_e153_4c58_a022_d924776f84ef.slice/crio-9888063088b9a8162fd25260e7e8441ca8f8e242c5759b27c323b40002d4f662 WatchSource:0}: Error finding container 9888063088b9a8162fd25260e7e8441ca8f8e242c5759b27c323b40002d4f662: Status 404 returned error can't find the container with id 9888063088b9a8162fd25260e7e8441ca8f8e242c5759b27c323b40002d4f662
Sep 09 20:51:33.118230 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:51:33.118205    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb1e1737_0c2a_4380_8fdd_cebe18bf1107.slice/crio-6709da5ab6cfd5dae2ce82df46ee223de331d1ea8ec26686b2d7314ae38c4f36 WatchSource:0}: Error finding container 6709da5ab6cfd5dae2ce82df46ee223de331d1ea8ec26686b2d7314ae38c4f36: Status 404 returned error can't find the container with id 6709da5ab6cfd5dae2ce82df46ee223de331d1ea8ec26686b2d7314ae38c4f36
Sep 09 20:51:33.176544 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:33.176521    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/34775cd2-d236-4077-8ff6-2be4de016d08-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-wlkqm\" (UID: \"34775cd2-d236-4077-8ff6-2be4de016d08\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-wlkqm"
Sep 09 20:51:33.176709 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:51:33.176695    2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 09 20:51:33.176782 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:51:33.176756    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34775cd2-d236-4077-8ff6-2be4de016d08-samples-operator-tls podName:34775cd2-d236-4077-8ff6-2be4de016d08 nodeName:}" failed. No retries permitted until 2026-09-09 20:51:34.176735262 +0000 UTC m=+258.628526788 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/34775cd2-d236-4077-8ff6-2be4de016d08-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-wlkqm" (UID: "34775cd2-d236-4077-8ff6-2be4de016d08") : secret "samples-operator-tls" not found
Sep 09 20:51:33.277139 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:33.277070    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f2eca4c6-1767-466b-87e3-915079d3e8de-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-9rlcx\" (UID: \"f2eca4c6-1767-466b-87e3-915079d3e8de\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-9rlcx"
Sep 09 20:51:33.277247 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:51:33.277195    2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 09 20:51:33.277306 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:51:33.277260    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2eca4c6-1767-466b-87e3-915079d3e8de-cluster-monitoring-operator-tls podName:f2eca4c6-1767-466b-87e3-915079d3e8de nodeName:}" failed. No retries permitted until 2026-09-09 20:51:34.277238707 +0000 UTC m=+258.729030213 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f2eca4c6-1767-466b-87e3-915079d3e8de-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-9rlcx" (UID: "f2eca4c6-1767-466b-87e3-915079d3e8de") : secret "cluster-monitoring-operator-tls" not found
Sep 09 20:51:33.827920 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:33.827875    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-mnzfm" event={"ID":"513f5747-5c6e-4983-b573-1c3da7b2d8e2","Type":"ContainerStarted","Data":"b5e8518b78225a0a4fd5b99acbc6ca3a99a4db6b7e9d0a0a35714e35513c9ae5"}
Sep 09 20:51:33.829817 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:33.829785    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-8llfb" event={"ID":"8068d21c-8270-4d4a-a68b-7cdc2ae18752","Type":"ContainerStarted","Data":"3649645e28642f7f97750b7a42a5b8c973b044af03b56acc7ef3136ff7e60de7"}
Sep 09 20:51:33.831010 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:33.830984    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-rwrpr" event={"ID":"cb1e1737-0c2a-4380-8fdd-cebe18bf1107","Type":"ContainerStarted","Data":"6709da5ab6cfd5dae2ce82df46ee223de331d1ea8ec26686b2d7314ae38c4f36"}
Sep 09 20:51:33.832634 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:33.832602    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-685456655f-nwv9w" event={"ID":"1b1c6cd9-e153-4c58-a022-d924776f84ef","Type":"ContainerStarted","Data":"c8cb796471b1825d800eb31677255eff1b33096f9de63514b3972f4c21329a38"}
Sep 09 20:51:33.832772 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:33.832655    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-685456655f-nwv9w" event={"ID":"1b1c6cd9-e153-4c58-a022-d924776f84ef","Type":"ContainerStarted","Data":"9888063088b9a8162fd25260e7e8441ca8f8e242c5759b27c323b40002d4f662"}
Sep 09 20:51:33.833720 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:33.833695    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-zdfrv" event={"ID":"a23f7c09-09f4-49b5-a012-f1d3ec19fc27","Type":"ContainerStarted","Data":"10beca332d90f6a1986decaf7c2e973a9d50a2a9d668c69fad9019ddd503950b"}
Sep 09 20:51:33.848795 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:33.848751    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-685456655f-nwv9w" podStartSLOduration=1.848733038 podStartE2EDuration="1.848733038s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:51:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:51:33.847853936 +0000 UTC m=+258.299645465" watchObservedRunningTime="2026-09-09 20:51:33.848733038 +0000 UTC m=+258.300524561"
Sep 09 20:51:34.184266 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:34.184176    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/34775cd2-d236-4077-8ff6-2be4de016d08-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-wlkqm\" (UID: \"34775cd2-d236-4077-8ff6-2be4de016d08\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-wlkqm"
Sep 09 20:51:34.184426 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:51:34.184306    2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 09 20:51:34.184426 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:51:34.184362    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34775cd2-d236-4077-8ff6-2be4de016d08-samples-operator-tls podName:34775cd2-d236-4077-8ff6-2be4de016d08 nodeName:}" failed. No retries permitted until 2026-09-09 20:51:36.184348737 +0000 UTC m=+260.636140243 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/34775cd2-d236-4077-8ff6-2be4de016d08-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-wlkqm" (UID: "34775cd2-d236-4077-8ff6-2be4de016d08") : secret "samples-operator-tls" not found
Sep 09 20:51:34.284992 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:34.284960    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f2eca4c6-1767-466b-87e3-915079d3e8de-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-9rlcx\" (UID: \"f2eca4c6-1767-466b-87e3-915079d3e8de\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-9rlcx"
Sep 09 20:51:34.285211 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:51:34.285189    2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 09 20:51:34.285293 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:51:34.285276    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2eca4c6-1767-466b-87e3-915079d3e8de-cluster-monitoring-operator-tls podName:f2eca4c6-1767-466b-87e3-915079d3e8de nodeName:}" failed. No retries permitted until 2026-09-09 20:51:36.285255612 +0000 UTC m=+260.737047139 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f2eca4c6-1767-466b-87e3-915079d3e8de-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-9rlcx" (UID: "f2eca4c6-1767-466b-87e3-915079d3e8de") : secret "cluster-monitoring-operator-tls" not found
Sep 09 20:51:36.200907 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:36.200814    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/34775cd2-d236-4077-8ff6-2be4de016d08-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-wlkqm\" (UID: \"34775cd2-d236-4077-8ff6-2be4de016d08\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-wlkqm"
Sep 09 20:51:36.201324 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:51:36.200984    2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 09 20:51:36.201324 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:51:36.201065    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34775cd2-d236-4077-8ff6-2be4de016d08-samples-operator-tls podName:34775cd2-d236-4077-8ff6-2be4de016d08 nodeName:}" failed. No retries permitted until 2026-09-09 20:51:40.201044781 +0000 UTC m=+264.652836292 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/34775cd2-d236-4077-8ff6-2be4de016d08-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-wlkqm" (UID: "34775cd2-d236-4077-8ff6-2be4de016d08") : secret "samples-operator-tls" not found
Sep 09 20:51:36.302072 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:36.302035    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f2eca4c6-1767-466b-87e3-915079d3e8de-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-9rlcx\" (UID: \"f2eca4c6-1767-466b-87e3-915079d3e8de\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-9rlcx"
Sep 09 20:51:36.302248 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:51:36.302188    2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 09 20:51:36.302319 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:51:36.302253    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2eca4c6-1767-466b-87e3-915079d3e8de-cluster-monitoring-operator-tls podName:f2eca4c6-1767-466b-87e3-915079d3e8de nodeName:}" failed. No retries permitted until 2026-09-09 20:51:40.302234674 +0000 UTC m=+264.754026184 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f2eca4c6-1767-466b-87e3-915079d3e8de-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-9rlcx" (UID: "f2eca4c6-1767-466b-87e3-915079d3e8de") : secret "cluster-monitoring-operator-tls" not found
Sep 09 20:51:36.845390 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:36.845349    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-8llfb" event={"ID":"8068d21c-8270-4d4a-a68b-7cdc2ae18752","Type":"ContainerStarted","Data":"2510217cd7d39c2646e9219f037a4eb4e05f3d852e47f298a3fb2294cd356df3"}
Sep 09 20:51:36.846972 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:36.846941    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-rwrpr" event={"ID":"cb1e1737-0c2a-4380-8fdd-cebe18bf1107","Type":"ContainerStarted","Data":"d4c3de8ef7eed928855f201dab9ad06e7b3bebe2c04b68196c4e2f7978634c68"}
Sep 09 20:51:36.848634 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:36.848610    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-zdfrv_a23f7c09-09f4-49b5-a012-f1d3ec19fc27/console-operator/0.log"
Sep 09 20:51:36.848764 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:36.848652    2560 generic.go:356] "Generic (PLEG): container finished" podID="a23f7c09-09f4-49b5-a012-f1d3ec19fc27" containerID="5b740344297e0e57b63d9ce480e147a3056d75e5db85dc13b2110f2712637f5c" exitCode=255
Sep 09 20:51:36.848764 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:36.848744    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-zdfrv" event={"ID":"a23f7c09-09f4-49b5-a012-f1d3ec19fc27","Type":"ContainerDied","Data":"5b740344297e0e57b63d9ce480e147a3056d75e5db85dc13b2110f2712637f5c"}
Sep 09 20:51:36.848926 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:36.848909    2560 scope.go:117] "RemoveContainer" containerID="5b740344297e0e57b63d9ce480e147a3056d75e5db85dc13b2110f2712637f5c"
Sep 09 20:51:36.850262 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:36.850243    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-mnzfm" event={"ID":"513f5747-5c6e-4983-b573-1c3da7b2d8e2","Type":"ContainerStarted","Data":"3ec0869055128b35fd93b79794f39cd75f6658abad28785ed652e1a217ab33d7"}
Sep 09 20:51:36.862257 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:36.862209    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-8llfb" podStartSLOduration=1.99495157 podStartE2EDuration="4.862189399s" totalImagesPullingTime="2.867237829s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:51:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:51:36.860974156 +0000 UTC m=+261.312765685" watchObservedRunningTime="2026-09-09 20:51:36.862189399 +0000 UTC m=+261.313980931"
Sep 09 20:51:36.881704 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:36.881640    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-76bcd6ccf5-rwrpr" podStartSLOduration=2.109888507 podStartE2EDuration="4.881624588s" totalImagesPullingTime="2.771736081s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:51:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:51:36.880552676 +0000 UTC m=+261.332344205" watchObservedRunningTime="2026-09-09 20:51:36.881624588 +0000 UTC m=+261.333416114"
Sep 09 20:51:36.896102 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:36.896061    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-mnzfm" podStartSLOduration=2.008682051 podStartE2EDuration="4.896045019s" totalImagesPullingTime="2.887362968s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:51:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:51:36.895660219 +0000 UTC m=+261.347451748" watchObservedRunningTime="2026-09-09 20:51:36.896045019 +0000 UTC m=+261.347836592"
Sep 09 20:51:37.084510 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:37.084476    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-48c8q"]
Sep 09 20:51:37.086655 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:37.086639    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-48c8q"
Sep 09 20:51:37.088966 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:37.088938    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 09 20:51:37.089101 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:37.089006    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 09 20:51:37.089101 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:37.089015    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-x54bc\""
Sep 09 20:51:37.102748 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:37.101329    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-48c8q"]
Sep 09 20:51:37.210722 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:37.210660    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2732a615-b3a4-42fc-9364-cf6fca466415-crio-socket\") pod \"insights-runtime-extractor-48c8q\" (UID: \"2732a615-b3a4-42fc-9364-cf6fca466415\") " pod="openshift-insights/insights-runtime-extractor-48c8q"
Sep 09 20:51:37.211178 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:37.210757    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7cvp\" (UniqueName: \"kubernetes.io/projected/2732a615-b3a4-42fc-9364-cf6fca466415-kube-api-access-n7cvp\") pod \"insights-runtime-extractor-48c8q\" (UID: \"2732a615-b3a4-42fc-9364-cf6fca466415\") " pod="openshift-insights/insights-runtime-extractor-48c8q"
Sep 09 20:51:37.211178 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:37.210789    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2732a615-b3a4-42fc-9364-cf6fca466415-data-volume\") pod \"insights-runtime-extractor-48c8q\" (UID: \"2732a615-b3a4-42fc-9364-cf6fca466415\") " pod="openshift-insights/insights-runtime-extractor-48c8q"
Sep 09 20:51:37.211178 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:37.210885    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2732a615-b3a4-42fc-9364-cf6fca466415-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-48c8q\" (UID: \"2732a615-b3a4-42fc-9364-cf6fca466415\") " pod="openshift-insights/insights-runtime-extractor-48c8q"
Sep 09 20:51:37.211178 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:37.210959    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2732a615-b3a4-42fc-9364-cf6fca466415-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-48c8q\" (UID: \"2732a615-b3a4-42fc-9364-cf6fca466415\") " pod="openshift-insights/insights-runtime-extractor-48c8q"
Sep 09 20:51:37.312261 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:37.312225    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2732a615-b3a4-42fc-9364-cf6fca466415-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-48c8q\" (UID: \"2732a615-b3a4-42fc-9364-cf6fca466415\") " pod="openshift-insights/insights-runtime-extractor-48c8q"
Sep 09 20:51:37.312426 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:37.312290    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2732a615-b3a4-42fc-9364-cf6fca466415-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-48c8q\" (UID: \"2732a615-b3a4-42fc-9364-cf6fca466415\") " pod="openshift-insights/insights-runtime-extractor-48c8q"
Sep 09 20:51:37.312426 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:37.312328    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2732a615-b3a4-42fc-9364-cf6fca466415-crio-socket\") pod \"insights-runtime-extractor-48c8q\" (UID: \"2732a615-b3a4-42fc-9364-cf6fca466415\") " pod="openshift-insights/insights-runtime-extractor-48c8q"
Sep 09 20:51:37.312426 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:37.312365    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7cvp\" (UniqueName: \"kubernetes.io/projected/2732a615-b3a4-42fc-9364-cf6fca466415-kube-api-access-n7cvp\") pod \"insights-runtime-extractor-48c8q\" (UID: \"2732a615-b3a4-42fc-9364-cf6fca466415\") " pod="openshift-insights/insights-runtime-extractor-48c8q"
Sep 09 20:51:37.312426 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:37.312393    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2732a615-b3a4-42fc-9364-cf6fca466415-data-volume\") pod \"insights-runtime-extractor-48c8q\" (UID: \"2732a615-b3a4-42fc-9364-cf6fca466415\") " pod="openshift-insights/insights-runtime-extractor-48c8q"
Sep 09 20:51:37.312601 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:51:37.312426    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 20:51:37.312601 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:51:37.312458    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 09 20:51:37.312601 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:37.312472    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2732a615-b3a4-42fc-9364-cf6fca466415-crio-socket\") pod \"insights-runtime-extractor-48c8q\" (UID: \"2732a615-b3a4-42fc-9364-cf6fca466415\") " pod="openshift-insights/insights-runtime-extractor-48c8q"
Sep 09 20:51:37.312601 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:51:37.312513    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2732a615-b3a4-42fc-9364-cf6fca466415-insights-runtime-extractor-tls podName:2732a615-b3a4-42fc-9364-cf6fca466415 nodeName:}" failed. No retries permitted until 2026-09-09 20:51:37.812489734 +0000 UTC m=+262.264281259 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2732a615-b3a4-42fc-9364-cf6fca466415-insights-runtime-extractor-tls") pod "insights-runtime-extractor-48c8q" (UID: "2732a615-b3a4-42fc-9364-cf6fca466415") : secret "insights-runtime-extractor-tls" not found
Sep 09 20:51:37.312601 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:51:37.312534    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2732a615-b3a4-42fc-9364-cf6fca466415-kube-rbac-proxy-cm podName:2732a615-b3a4-42fc-9364-cf6fca466415 nodeName:}" failed. No retries permitted until 2026-09-09 20:51:37.812523472 +0000 UTC m=+262.264314981 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2732a615-b3a4-42fc-9364-cf6fca466415-kube-rbac-proxy-cm") pod "insights-runtime-extractor-48c8q" (UID: "2732a615-b3a4-42fc-9364-cf6fca466415") : configmap "kube-rbac-proxy" not found
Sep 09 20:51:37.312784 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:37.312745    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2732a615-b3a4-42fc-9364-cf6fca466415-data-volume\") pod \"insights-runtime-extractor-48c8q\" (UID: \"2732a615-b3a4-42fc-9364-cf6fca466415\") " pod="openshift-insights/insights-runtime-extractor-48c8q"
Sep 09 20:51:37.322728 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:37.322699    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7cvp\" (UniqueName: \"kubernetes.io/projected/2732a615-b3a4-42fc-9364-cf6fca466415-kube-api-access-n7cvp\") pod \"insights-runtime-extractor-48c8q\" (UID: \"2732a615-b3a4-42fc-9364-cf6fca466415\") " pod="openshift-insights/insights-runtime-extractor-48c8q"
Sep 09 20:51:37.816051 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:37.816003    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2732a615-b3a4-42fc-9364-cf6fca466415-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-48c8q\" (UID: \"2732a615-b3a4-42fc-9364-cf6fca466415\") " pod="openshift-insights/insights-runtime-extractor-48c8q"
Sep 09 20:51:37.816281 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:37.816125    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2732a615-b3a4-42fc-9364-cf6fca466415-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-48c8q\" (UID: \"2732a615-b3a4-42fc-9364-cf6fca466415\") " pod="openshift-insights/insights-runtime-extractor-48c8q"
Sep 09 20:51:37.816281 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:51:37.816148    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 09 20:51:37.816281 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:51:37.816226    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 20:51:37.816281 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:51:37.816232    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2732a615-b3a4-42fc-9364-cf6fca466415-kube-rbac-proxy-cm podName:2732a615-b3a4-42fc-9364-cf6fca466415 nodeName:}" failed. No retries permitted until 2026-09-09 20:51:38.816213724 +0000 UTC m=+263.268005231 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2732a615-b3a4-42fc-9364-cf6fca466415-kube-rbac-proxy-cm") pod "insights-runtime-extractor-48c8q" (UID: "2732a615-b3a4-42fc-9364-cf6fca466415") : configmap "kube-rbac-proxy" not found
Sep 09 20:51:37.816281 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:51:37.816278    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2732a615-b3a4-42fc-9364-cf6fca466415-insights-runtime-extractor-tls podName:2732a615-b3a4-42fc-9364-cf6fca466415 nodeName:}" failed. No retries permitted until 2026-09-09 20:51:38.816266064 +0000 UTC m=+263.268057569 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2732a615-b3a4-42fc-9364-cf6fca466415-insights-runtime-extractor-tls") pod "insights-runtime-extractor-48c8q" (UID: "2732a615-b3a4-42fc-9364-cf6fca466415") : secret "insights-runtime-extractor-tls" not found
Sep 09 20:51:37.855164 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:37.855133    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-zdfrv_a23f7c09-09f4-49b5-a012-f1d3ec19fc27/console-operator/1.log"
Sep 09 20:51:37.855540 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:37.855524    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-zdfrv_a23f7c09-09f4-49b5-a012-f1d3ec19fc27/console-operator/0.log"
Sep 09 20:51:37.855606 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:37.855561    2560 generic.go:356] "Generic (PLEG): container finished" podID="a23f7c09-09f4-49b5-a012-f1d3ec19fc27" containerID="fb899d47ef367607c4332f6b1052789d3250d8f8039200f59f0ed5343afc208e" exitCode=255
Sep 09 20:51:37.855703 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:37.855662    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-zdfrv" event={"ID":"a23f7c09-09f4-49b5-a012-f1d3ec19fc27","Type":"ContainerDied","Data":"fb899d47ef367607c4332f6b1052789d3250d8f8039200f59f0ed5343afc208e"}
Sep 09 20:51:37.855756 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:37.855739    2560 scope.go:117] "RemoveContainer" containerID="5b740344297e0e57b63d9ce480e147a3056d75e5db85dc13b2110f2712637f5c"
Sep 09 20:51:37.855928 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:37.855906    2560 scope.go:117] "RemoveContainer" containerID="fb899d47ef367607c4332f6b1052789d3250d8f8039200f59f0ed5343afc208e"
Sep 09 20:51:37.856150 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:51:37.856124    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-zdfrv_openshift-console-operator(a23f7c09-09f4-49b5-a012-f1d3ec19fc27)\"" pod="openshift-console-operator/console-operator-85b454874b-zdfrv" podUID="a23f7c09-09f4-49b5-a012-f1d3ec19fc27"
Sep 09 20:51:38.199583 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:38.199480    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-75d99c484-72fs7"]
Sep 09 20:51:38.203659 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:38.203640    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-75d99c484-72fs7"
Sep 09 20:51:38.206920 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:38.206881    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Sep 09 20:51:38.207060 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:38.206895    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Sep 09 20:51:38.207060 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:38.206974    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Sep 09 20:51:38.207180 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:38.207131    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Sep 09 20:51:38.207725 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:38.207707    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-dp4sz\""
Sep 09 20:51:38.213422 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:38.213397    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-75d99c484-72fs7"]
Sep 09 20:51:38.312938 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:38.312900    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-b8775"]
Sep 09 20:51:38.316143 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:38.316121    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-b8775"
Sep 09 20:51:38.318895 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:38.318863    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Sep 09 20:51:38.318895 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:38.318865    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Sep 09 20:51:38.319429 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:38.319406    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-7zvct\""
Sep 09 20:51:38.321379 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:38.321356    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/e4c9c0a1-aefd-4b64-a33a-7fb4174b3e41-signing-key\") pod \"service-ca-75d99c484-72fs7\" (UID: \"e4c9c0a1-aefd-4b64-a33a-7fb4174b3e41\") " pod="openshift-service-ca/service-ca-75d99c484-72fs7"
Sep 09 20:51:38.321512 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:38.321493    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwt65\" (UniqueName: \"kubernetes.io/projected/e4c9c0a1-aefd-4b64-a33a-7fb4174b3e41-kube-api-access-wwt65\") pod \"service-ca-75d99c484-72fs7\" (UID: \"e4c9c0a1-aefd-4b64-a33a-7fb4174b3e41\") " pod="openshift-service-ca/service-ca-75d99c484-72fs7"
Sep 09 20:51:38.321597 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:38.321583    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/e4c9c0a1-aefd-4b64-a33a-7fb4174b3e41-signing-cabundle\") pod \"service-ca-75d99c484-72fs7\" (UID: \"e4c9c0a1-aefd-4b64-a33a-7fb4174b3e41\") " pod="openshift-service-ca/service-ca-75d99c484-72fs7"
Sep 09 20:51:38.327732 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:38.327704    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-b8775"]
Sep 09 20:51:38.422459 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:38.422419    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwt65\" (UniqueName: \"kubernetes.io/projected/e4c9c0a1-aefd-4b64-a33a-7fb4174b3e41-kube-api-access-wwt65\") pod \"service-ca-75d99c484-72fs7\" (UID: \"e4c9c0a1-aefd-4b64-a33a-7fb4174b3e41\") " pod="openshift-service-ca/service-ca-75d99c484-72fs7"
Sep 09 20:51:38.422610 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:38.422515    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/e4c9c0a1-aefd-4b64-a33a-7fb4174b3e41-signing-cabundle\") pod \"service-ca-75d99c484-72fs7\" (UID: \"e4c9c0a1-aefd-4b64-a33a-7fb4174b3e41\") " pod="openshift-service-ca/service-ca-75d99c484-72fs7"
Sep 09 20:51:38.422610 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:38.422546    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/e4c9c0a1-aefd-4b64-a33a-7fb4174b3e41-signing-key\") pod \"service-ca-75d99c484-72fs7\" (UID: \"e4c9c0a1-aefd-4b64-a33a-7fb4174b3e41\") " pod="openshift-service-ca/service-ca-75d99c484-72fs7"
Sep 09 20:51:38.422610 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:38.422572    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djsfp\" (UniqueName: \"kubernetes.io/projected/59769896-669a-4ae9-a788-1d7e89083416-kube-api-access-djsfp\") pod \"migrator-fdbb8fdff-b8775\" (UID: \"59769896-669a-4ae9-a788-1d7e89083416\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-b8775"
Sep 09 20:51:38.423287 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:38.423257    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/e4c9c0a1-aefd-4b64-a33a-7fb4174b3e41-signing-cabundle\") pod \"service-ca-75d99c484-72fs7\" (UID: \"e4c9c0a1-aefd-4b64-a33a-7fb4174b3e41\") " pod="openshift-service-ca/service-ca-75d99c484-72fs7"
Sep 09 20:51:38.424999 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:38.424980    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/e4c9c0a1-aefd-4b64-a33a-7fb4174b3e41-signing-key\") pod \"service-ca-75d99c484-72fs7\" (UID: \"e4c9c0a1-aefd-4b64-a33a-7fb4174b3e41\") " pod="openshift-service-ca/service-ca-75d99c484-72fs7"
Sep 09 20:51:38.430614 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:38.430589    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwt65\" (UniqueName: \"kubernetes.io/projected/e4c9c0a1-aefd-4b64-a33a-7fb4174b3e41-kube-api-access-wwt65\") pod \"service-ca-75d99c484-72fs7\" (UID: \"e4c9c0a1-aefd-4b64-a33a-7fb4174b3e41\") " pod="openshift-service-ca/service-ca-75d99c484-72fs7"
Sep 09 20:51:38.513128 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:38.513028    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-75d99c484-72fs7"
Sep 09 20:51:38.523394 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:38.523367    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djsfp\" (UniqueName: \"kubernetes.io/projected/59769896-669a-4ae9-a788-1d7e89083416-kube-api-access-djsfp\") pod \"migrator-fdbb8fdff-b8775\" (UID: \"59769896-669a-4ae9-a788-1d7e89083416\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-b8775"
Sep 09 20:51:38.533068 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:38.532606    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-djsfp\" (UniqueName: \"kubernetes.io/projected/59769896-669a-4ae9-a788-1d7e89083416-kube-api-access-djsfp\") pod \"migrator-fdbb8fdff-b8775\" (UID: \"59769896-669a-4ae9-a788-1d7e89083416\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-b8775"
Sep 09 20:51:38.625229 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:38.625190    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-b8775"
Sep 09 20:51:38.793087 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:38.793055    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-75d99c484-72fs7"]
Sep 09 20:51:38.795847 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:51:38.795810    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4c9c0a1_aefd_4b64_a33a_7fb4174b3e41.slice/crio-612b7e2c3ae9858c03fdc67da12b9637bbd967596e1800739be8aa24b0967bb4 WatchSource:0}: Error finding container 612b7e2c3ae9858c03fdc67da12b9637bbd967596e1800739be8aa24b0967bb4: Status 404 returned error can't find the container with id 612b7e2c3ae9858c03fdc67da12b9637bbd967596e1800739be8aa24b0967bb4
Sep 09 20:51:38.825694 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:38.825631    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2732a615-b3a4-42fc-9364-cf6fca466415-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-48c8q\" (UID: \"2732a615-b3a4-42fc-9364-cf6fca466415\") " pod="openshift-insights/insights-runtime-extractor-48c8q"
Sep 09 20:51:38.825864 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:51:38.825807    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 20:51:38.825864 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:38.825824    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2732a615-b3a4-42fc-9364-cf6fca466415-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-48c8q\" (UID: \"2732a615-b3a4-42fc-9364-cf6fca466415\") " pod="openshift-insights/insights-runtime-extractor-48c8q"
Sep 09 20:51:38.826006 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:51:38.825913    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2732a615-b3a4-42fc-9364-cf6fca466415-insights-runtime-extractor-tls podName:2732a615-b3a4-42fc-9364-cf6fca466415 nodeName:}" failed. No retries permitted until 2026-09-09 20:51:40.825893591 +0000 UTC m=+265.277685116 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2732a615-b3a4-42fc-9364-cf6fca466415-insights-runtime-extractor-tls") pod "insights-runtime-extractor-48c8q" (UID: "2732a615-b3a4-42fc-9364-cf6fca466415") : secret "insights-runtime-extractor-tls" not found
Sep 09 20:51:38.826006 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:51:38.825936    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 09 20:51:38.826006 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:51:38.825982    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2732a615-b3a4-42fc-9364-cf6fca466415-kube-rbac-proxy-cm podName:2732a615-b3a4-42fc-9364-cf6fca466415 nodeName:}" failed. No retries permitted until 2026-09-09 20:51:40.825966746 +0000 UTC m=+265.277758255 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2732a615-b3a4-42fc-9364-cf6fca466415-kube-rbac-proxy-cm") pod "insights-runtime-extractor-48c8q" (UID: "2732a615-b3a4-42fc-9364-cf6fca466415") : configmap "kube-rbac-proxy" not found
Sep 09 20:51:38.851197 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:38.851168    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rcqv7_23e34008-d8bb-4baf-beef-dc0c8f67e8a8/dns-node-resolver/0.log"
Sep 09 20:51:38.860467 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:38.860444    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-zdfrv_a23f7c09-09f4-49b5-a012-f1d3ec19fc27/console-operator/1.log"
Sep 09 20:51:38.860847 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:38.860827    2560 scope.go:117] "RemoveContainer" containerID="fb899d47ef367607c4332f6b1052789d3250d8f8039200f59f0ed5343afc208e"
Sep 09 20:51:38.861020 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:51:38.860997    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-zdfrv_openshift-console-operator(a23f7c09-09f4-49b5-a012-f1d3ec19fc27)\"" pod="openshift-console-operator/console-operator-85b454874b-zdfrv" podUID="a23f7c09-09f4-49b5-a012-f1d3ec19fc27"
Sep 09 20:51:38.861593 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:38.861573    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-75d99c484-72fs7" event={"ID":"e4c9c0a1-aefd-4b64-a33a-7fb4174b3e41","Type":"ContainerStarted","Data":"612b7e2c3ae9858c03fdc67da12b9637bbd967596e1800739be8aa24b0967bb4"}
Sep 09 20:51:38.902819 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:38.902777    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-b8775"]
Sep 09 20:51:38.906325 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:51:38.906297    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59769896_669a_4ae9_a788_1d7e89083416.slice/crio-d4763bbba6819603d73fccf7eccc37efdf4b1191306acc06430515e7ce0fd1fb WatchSource:0}: Error finding container d4763bbba6819603d73fccf7eccc37efdf4b1191306acc06430515e7ce0fd1fb: Status 404 returned error can't find the container with id d4763bbba6819603d73fccf7eccc37efdf4b1191306acc06430515e7ce0fd1fb
Sep 09 20:51:39.866522 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:39.866483    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-b8775" event={"ID":"59769896-669a-4ae9-a788-1d7e89083416","Type":"ContainerStarted","Data":"d4763bbba6819603d73fccf7eccc37efdf4b1191306acc06430515e7ce0fd1fb"}
Sep 09 20:51:40.048508 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:40.048482    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-t84p6_a7237351-1190-42ae-9092-b049a203cadc/node-ca/0.log"
Sep 09 20:51:40.238846 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:40.238758    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/34775cd2-d236-4077-8ff6-2be4de016d08-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-wlkqm\" (UID: \"34775cd2-d236-4077-8ff6-2be4de016d08\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-wlkqm"
Sep 09 20:51:40.239019 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:51:40.238950    2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 09 20:51:40.239102 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:51:40.239033    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34775cd2-d236-4077-8ff6-2be4de016d08-samples-operator-tls podName:34775cd2-d236-4077-8ff6-2be4de016d08 nodeName:}" failed. No retries permitted until 2026-09-09 20:51:48.239010894 +0000 UTC m=+272.690802406 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/34775cd2-d236-4077-8ff6-2be4de016d08-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-wlkqm" (UID: "34775cd2-d236-4077-8ff6-2be4de016d08") : secret "samples-operator-tls" not found
Sep 09 20:51:40.339984 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:40.339929    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f2eca4c6-1767-466b-87e3-915079d3e8de-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-9rlcx\" (UID: \"f2eca4c6-1767-466b-87e3-915079d3e8de\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-9rlcx"
Sep 09 20:51:40.340166 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:51:40.340104    2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 09 20:51:40.340221 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:51:40.340184    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2eca4c6-1767-466b-87e3-915079d3e8de-cluster-monitoring-operator-tls podName:f2eca4c6-1767-466b-87e3-915079d3e8de nodeName:}" failed. No retries permitted until 2026-09-09 20:51:48.340163244 +0000 UTC m=+272.791954756 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f2eca4c6-1767-466b-87e3-915079d3e8de-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-9rlcx" (UID: "f2eca4c6-1767-466b-87e3-915079d3e8de") : secret "cluster-monitoring-operator-tls" not found
Sep 09 20:51:40.844263 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:40.844220    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2732a615-b3a4-42fc-9364-cf6fca466415-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-48c8q\" (UID: \"2732a615-b3a4-42fc-9364-cf6fca466415\") " pod="openshift-insights/insights-runtime-extractor-48c8q"
Sep 09 20:51:40.844430 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:40.844307    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2732a615-b3a4-42fc-9364-cf6fca466415-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-48c8q\" (UID: \"2732a615-b3a4-42fc-9364-cf6fca466415\") " pod="openshift-insights/insights-runtime-extractor-48c8q"
Sep 09 20:51:40.844430 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:51:40.844370    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 20:51:40.844535 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:51:40.844424    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 09 20:51:40.844535 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:51:40.844435    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2732a615-b3a4-42fc-9364-cf6fca466415-insights-runtime-extractor-tls podName:2732a615-b3a4-42fc-9364-cf6fca466415 nodeName:}" failed. No retries permitted until 2026-09-09 20:51:44.844420423 +0000 UTC m=+269.296211929 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2732a615-b3a4-42fc-9364-cf6fca466415-insights-runtime-extractor-tls") pod "insights-runtime-extractor-48c8q" (UID: "2732a615-b3a4-42fc-9364-cf6fca466415") : secret "insights-runtime-extractor-tls" not found
Sep 09 20:51:40.844535 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:51:40.844487    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2732a615-b3a4-42fc-9364-cf6fca466415-kube-rbac-proxy-cm podName:2732a615-b3a4-42fc-9364-cf6fca466415 nodeName:}" failed. No retries permitted until 2026-09-09 20:51:44.844470571 +0000 UTC m=+269.296262077 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2732a615-b3a4-42fc-9364-cf6fca466415-kube-rbac-proxy-cm") pod "insights-runtime-extractor-48c8q" (UID: "2732a615-b3a4-42fc-9364-cf6fca466415") : configmap "kube-rbac-proxy" not found
Sep 09 20:51:41.049132 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:41.049097    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-p796n_aebf38f1-b76f-4d9b-af1c-3144bb61c4e0/serve-healthcheck-canary/0.log"
Sep 09 20:51:41.878108 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:41.878069    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-75d99c484-72fs7" event={"ID":"e4c9c0a1-aefd-4b64-a33a-7fb4174b3e41","Type":"ContainerStarted","Data":"5bbc8d6781e9c01d6d99d7e93bf359fa84e790710f5e314ed1c601e780d25e03"}
Sep 09 20:51:41.898724 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:41.898648    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-75d99c484-72fs7" podStartSLOduration=1.821302398 podStartE2EDuration="3.898625817s" totalImagesPullingTime="2.077323419s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:51:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:51:41.897599672 +0000 UTC m=+266.349391200" watchObservedRunningTime="2026-09-09 20:51:41.898625817 +0000 UTC m=+266.350417347"
Sep 09 20:51:42.747411 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:42.747313    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-zdfrv"
Sep 09 20:51:42.747411 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:42.747378    2560 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-85b454874b-zdfrv"
Sep 09 20:51:42.747836 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:42.747797    2560 scope.go:117] "RemoveContainer" containerID="fb899d47ef367607c4332f6b1052789d3250d8f8039200f59f0ed5343afc208e"
Sep 09 20:51:42.747995 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:51:42.747969    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-zdfrv_openshift-console-operator(a23f7c09-09f4-49b5-a012-f1d3ec19fc27)\"" pod="openshift-console-operator/console-operator-85b454874b-zdfrv" podUID="a23f7c09-09f4-49b5-a012-f1d3ec19fc27"
Sep 09 20:51:42.885314 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:42.885277    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-b8775" event={"ID":"59769896-669a-4ae9-a788-1d7e89083416","Type":"ContainerStarted","Data":"4eeade7e5004c71901e6a405a26e39fde12505b0f430a40302b7a636ec80180a"}
Sep 09 20:51:42.885516 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:42.885338    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-b8775" event={"ID":"59769896-669a-4ae9-a788-1d7e89083416","Type":"ContainerStarted","Data":"05cd32c824d28c552c8a7ae382917b9ebf1f3dacf947fd6d9fdf69a068159d1e"}
Sep 09 20:51:42.903389 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:42.903311    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-b8775" podStartSLOduration=1.844721565 podStartE2EDuration="4.903288385s" totalImagesPullingTime="3.05856682s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:51:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:51:42.901952387 +0000 UTC m=+267.353743916" watchObservedRunningTime="2026-09-09 20:51:42.903288385 +0000 UTC m=+267.355079914"
Sep 09 20:51:44.881532 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:44.881487    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2732a615-b3a4-42fc-9364-cf6fca466415-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-48c8q\" (UID: \"2732a615-b3a4-42fc-9364-cf6fca466415\") " pod="openshift-insights/insights-runtime-extractor-48c8q"
Sep 09 20:51:44.882038 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:44.881606    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2732a615-b3a4-42fc-9364-cf6fca466415-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-48c8q\" (UID: \"2732a615-b3a4-42fc-9364-cf6fca466415\") " pod="openshift-insights/insights-runtime-extractor-48c8q"
Sep 09 20:51:44.882038 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:51:44.881639    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 09 20:51:44.882038 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:51:44.881741    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2732a615-b3a4-42fc-9364-cf6fca466415-kube-rbac-proxy-cm podName:2732a615-b3a4-42fc-9364-cf6fca466415 nodeName:}" failed. No retries permitted until 2026-09-09 20:51:52.881723117 +0000 UTC m=+277.333514675 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2732a615-b3a4-42fc-9364-cf6fca466415-kube-rbac-proxy-cm") pod "insights-runtime-extractor-48c8q" (UID: "2732a615-b3a4-42fc-9364-cf6fca466415") : configmap "kube-rbac-proxy" not found
Sep 09 20:51:44.882038 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:51:44.881764    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 20:51:44.882038 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:51:44.881808    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2732a615-b3a4-42fc-9364-cf6fca466415-insights-runtime-extractor-tls podName:2732a615-b3a4-42fc-9364-cf6fca466415 nodeName:}" failed. No retries permitted until 2026-09-09 20:51:52.881795998 +0000 UTC m=+277.333587504 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2732a615-b3a4-42fc-9364-cf6fca466415-insights-runtime-extractor-tls") pod "insights-runtime-extractor-48c8q" (UID: "2732a615-b3a4-42fc-9364-cf6fca466415") : secret "insights-runtime-extractor-tls" not found
Sep 09 20:51:48.308593 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:48.308560    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/34775cd2-d236-4077-8ff6-2be4de016d08-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-wlkqm\" (UID: \"34775cd2-d236-4077-8ff6-2be4de016d08\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-wlkqm"
Sep 09 20:51:48.310902 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:48.310880    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/34775cd2-d236-4077-8ff6-2be4de016d08-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-wlkqm\" (UID: \"34775cd2-d236-4077-8ff6-2be4de016d08\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-wlkqm"
Sep 09 20:51:48.341275 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:48.341245    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-wlkqm"
Sep 09 20:51:48.409295 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:48.409260    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f2eca4c6-1767-466b-87e3-915079d3e8de-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-9rlcx\" (UID: \"f2eca4c6-1767-466b-87e3-915079d3e8de\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-9rlcx"
Sep 09 20:51:48.409428 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:51:48.409406    2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 09 20:51:48.409500 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:51:48.409489    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2eca4c6-1767-466b-87e3-915079d3e8de-cluster-monitoring-operator-tls podName:f2eca4c6-1767-466b-87e3-915079d3e8de nodeName:}" failed. No retries permitted until 2026-09-09 20:52:04.409466408 +0000 UTC m=+288.861257931 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f2eca4c6-1767-466b-87e3-915079d3e8de-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-9rlcx" (UID: "f2eca4c6-1767-466b-87e3-915079d3e8de") : secret "cluster-monitoring-operator-tls" not found
Sep 09 20:51:48.609084 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:48.609059    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-wlkqm"]
Sep 09 20:51:48.909379 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:48.909317    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-wlkqm" event={"ID":"34775cd2-d236-4077-8ff6-2be4de016d08","Type":"ContainerStarted","Data":"07012c784ac36e6b69021c12f52f02df06fce810cb5858da1d6254b057660ce7"}
Sep 09 20:51:50.918188 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:50.918106    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-wlkqm" event={"ID":"34775cd2-d236-4077-8ff6-2be4de016d08","Type":"ContainerStarted","Data":"f7a39c4eb6d59c642da11c6d5eefc09a8cf6db792f5b99a60e7b797eb5dc9063"}
Sep 09 20:51:50.918188 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:50.918164    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-wlkqm" event={"ID":"34775cd2-d236-4077-8ff6-2be4de016d08","Type":"ContainerStarted","Data":"13d70c570ec2f1593633218ddec42f75b3f2cfc28ec2f8602143ca0a54a72007"}
Sep 09 20:51:50.934566 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:50.934516    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-wlkqm" podStartSLOduration=16.992499655 podStartE2EDuration="18.934499131s" totalImagesPullingTime="1.941999476s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:51:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:51:50.933517294 +0000 UTC m=+275.385308825" watchObservedRunningTime="2026-09-09 20:51:50.934499131 +0000 UTC m=+275.386290659"
Sep 09 20:51:52.949237 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:52.949205    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2732a615-b3a4-42fc-9364-cf6fca466415-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-48c8q\" (UID: \"2732a615-b3a4-42fc-9364-cf6fca466415\") " pod="openshift-insights/insights-runtime-extractor-48c8q"
Sep 09 20:51:52.949606 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:52.949372    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2732a615-b3a4-42fc-9364-cf6fca466415-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-48c8q\" (UID: \"2732a615-b3a4-42fc-9364-cf6fca466415\") " pod="openshift-insights/insights-runtime-extractor-48c8q"
Sep 09 20:51:52.949718 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:52.949701    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2732a615-b3a4-42fc-9364-cf6fca466415-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-48c8q\" (UID: \"2732a615-b3a4-42fc-9364-cf6fca466415\") " pod="openshift-insights/insights-runtime-extractor-48c8q"
Sep 09 20:51:52.951500 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:52.951480    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2732a615-b3a4-42fc-9364-cf6fca466415-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-48c8q\" (UID: \"2732a615-b3a4-42fc-9364-cf6fca466415\") " pod="openshift-insights/insights-runtime-extractor-48c8q"
Sep 09 20:51:52.996409 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:52.996390    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-48c8q"
Sep 09 20:51:53.264892 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:53.264807    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-48c8q"]
Sep 09 20:51:53.267753 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:51:53.267719    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2732a615_b3a4_42fc_9364_cf6fca466415.slice/crio-28a67831dff597bf2627794f5b5f56090759ca9c89b980aa667d07e5e0e7b5d5 WatchSource:0}: Error finding container 28a67831dff597bf2627794f5b5f56090759ca9c89b980aa667d07e5e0e7b5d5: Status 404 returned error can't find the container with id 28a67831dff597bf2627794f5b5f56090759ca9c89b980aa667d07e5e0e7b5d5
Sep 09 20:51:53.930724 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:53.930684    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-48c8q" event={"ID":"2732a615-b3a4-42fc-9364-cf6fca466415","Type":"ContainerStarted","Data":"af79a3536889849260fdfa8cbf560f1867c6fbe9a978869ef84f0531a38ac096"}
Sep 09 20:51:53.930874 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:53.930760    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-48c8q" event={"ID":"2732a615-b3a4-42fc-9364-cf6fca466415","Type":"ContainerStarted","Data":"28a67831dff597bf2627794f5b5f56090759ca9c89b980aa667d07e5e0e7b5d5"}
Sep 09 20:51:54.934837 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:54.934798    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-48c8q" event={"ID":"2732a615-b3a4-42fc-9364-cf6fca466415","Type":"ContainerStarted","Data":"38ca6d1e534caea17cee0f9b48cc6af59696ff5751890e6e059c8ec95e76f8de"}
Sep 09 20:51:55.586952 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:51:55.586904    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-7cdff8874c-zhjsp" podUID="1170b545-bb37-4499-9a2f-c0d7e976854d"
Sep 09 20:51:55.586952 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:51:55.586904    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-79977f9844-bjkpq" podUID="37b0d343-5d35-4d62-b3f4-929029b915f2"
Sep 09 20:51:55.939638 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:55.939555    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-bjkpq"
Sep 09 20:51:55.939638 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:55.939595    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7cdff8874c-zhjsp"
Sep 09 20:51:55.940087 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:55.939566    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-48c8q" event={"ID":"2732a615-b3a4-42fc-9364-cf6fca466415","Type":"ContainerStarted","Data":"7a95c103f0ba57ff65204adff235c4a70d95407f6272821b5bec5247d20bcabb"}
Sep 09 20:51:55.961257 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:55.961198    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-48c8q" podStartSLOduration=16.669040909 podStartE2EDuration="18.961184346s" totalImagesPullingTime="2.292143437s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 20:51:37 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:51:55.959777951 +0000 UTC m=+280.411569479" watchObservedRunningTime="2026-09-09 20:51:55.961184346 +0000 UTC m=+280.412975874"
Sep 09 20:51:58.042078 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:58.042044    2560 scope.go:117] "RemoveContainer" containerID="fb899d47ef367607c4332f6b1052789d3250d8f8039200f59f0ed5343afc208e"
Sep 09 20:51:58.952224 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:58.952197    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-zdfrv_a23f7c09-09f4-49b5-a012-f1d3ec19fc27/console-operator/1.log"
Sep 09 20:51:58.952370 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:58.952261    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-zdfrv" event={"ID":"a23f7c09-09f4-49b5-a012-f1d3ec19fc27","Type":"ContainerStarted","Data":"ab41c5a0b4c330e1ef2b826676147241a51efcc3496e6b8e0177930ec8e2f65e"}
Sep 09 20:51:58.952552 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:58.952523    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-zdfrv"
Sep 09 20:51:58.957337 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:58.957314    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-85b454874b-zdfrv"
Sep 09 20:51:58.973219 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:58.973177    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-85b454874b-zdfrv" podStartSLOduration=23.527079099 podStartE2EDuration="26.973163409s" totalImagesPullingTime="3.44608431s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:51:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:51:58.972080358 +0000 UTC m=+283.423871885" watchObservedRunningTime="2026-09-09 20:51:58.973163409 +0000 UTC m=+283.424954936"
Sep 09 20:51:59.001464 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:59.001430    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1170b545-bb37-4499-9a2f-c0d7e976854d-registry-tls\") pod \"image-registry-7cdff8874c-zhjsp\" (UID: \"1170b545-bb37-4499-9a2f-c0d7e976854d\") " pod="openshift-image-registry/image-registry-7cdff8874c-zhjsp"
Sep 09 20:51:59.001815 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:59.001791    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/37b0d343-5d35-4d62-b3f4-929029b915f2-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-bjkpq\" (UID: \"37b0d343-5d35-4d62-b3f4-929029b915f2\") " pod="openshift-network-console/networking-console-plugin-79977f9844-bjkpq"
Sep 09 20:51:59.004075 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:59.004044    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1170b545-bb37-4499-9a2f-c0d7e976854d-registry-tls\") pod \"image-registry-7cdff8874c-zhjsp\" (UID: \"1170b545-bb37-4499-9a2f-c0d7e976854d\") " pod="openshift-image-registry/image-registry-7cdff8874c-zhjsp"
Sep 09 20:51:59.004501 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:59.004477    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/37b0d343-5d35-4d62-b3f4-929029b915f2-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-bjkpq\" (UID: \"37b0d343-5d35-4d62-b3f4-929029b915f2\") " pod="openshift-network-console/networking-console-plugin-79977f9844-bjkpq"
Sep 09 20:51:59.102778 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:59.102740    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8d37bae7-db79-4322-9ba1-012a68918b86-metrics-tls\") pod \"dns-default-dg6rb\" (UID: \"8d37bae7-db79-4322-9ba1-012a68918b86\") " pod="openshift-dns/dns-default-dg6rb"
Sep 09 20:51:59.105079 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:59.105049    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8d37bae7-db79-4322-9ba1-012a68918b86-metrics-tls\") pod \"dns-default-dg6rb\" (UID: \"8d37bae7-db79-4322-9ba1-012a68918b86\") " pod="openshift-dns/dns-default-dg6rb"
Sep 09 20:51:59.242704 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:59.242590    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-hrwrq\""
Sep 09 20:51:59.242951 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:59.242705    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-nwrwc\""
Sep 09 20:51:59.244052 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:59.244034    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5nprp\""
Sep 09 20:51:59.250730 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:59.250712    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7cdff8874c-zhjsp"
Sep 09 20:51:59.250806 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:59.250730    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-bjkpq"
Sep 09 20:51:59.252897 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:59.252883    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dg6rb"
Sep 09 20:51:59.534043 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:59.534020    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-bjkpq"]
Sep 09 20:51:59.535452 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:59.535428    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dg6rb"]
Sep 09 20:51:59.536878 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:59.536854    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7cdff8874c-zhjsp"]
Sep 09 20:51:59.540023 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:51:59.539988    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1170b545_bb37_4499_9a2f_c0d7e976854d.slice/crio-7a90cb4d57b0e7cf4edd105d12798c90d6d65822dde085e6f13c157849d3afff WatchSource:0}: Error finding container 7a90cb4d57b0e7cf4edd105d12798c90d6d65822dde085e6f13c157849d3afff: Status 404 returned error can't find the container with id 7a90cb4d57b0e7cf4edd105d12798c90d6d65822dde085e6f13c157849d3afff
Sep 09 20:51:59.958086 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:59.958039    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dg6rb" event={"ID":"8d37bae7-db79-4322-9ba1-012a68918b86","Type":"ContainerStarted","Data":"30d5f476b3b690f49dbf1fc731d295b85b850ae0f6d7b3a1325bc711234d19ab"}
Sep 09 20:51:59.959872 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:59.959837    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-79977f9844-bjkpq" event={"ID":"37b0d343-5d35-4d62-b3f4-929029b915f2","Type":"ContainerStarted","Data":"4e4876b7d4ac72416a52adf235c8de49c3a593b685e5470270f5863778bcb7b2"}
Sep 09 20:51:59.962350 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:59.962325    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7cdff8874c-zhjsp" event={"ID":"1170b545-bb37-4499-9a2f-c0d7e976854d","Type":"ContainerStarted","Data":"4bef41b0e4f08de7300c8d51070c3bd5a33c804a7db12fc62656245f1ee43b41"}
Sep 09 20:51:59.962447 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:59.962370    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7cdff8874c-zhjsp" event={"ID":"1170b545-bb37-4499-9a2f-c0d7e976854d","Type":"ContainerStarted","Data":"7a90cb4d57b0e7cf4edd105d12798c90d6d65822dde085e6f13c157849d3afff"}
Sep 09 20:51:59.962761 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:59.962744    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7cdff8874c-zhjsp"
Sep 09 20:51:59.986207 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:51:59.986158    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7cdff8874c-zhjsp" podStartSLOduration=283.986144965 podStartE2EDuration="4m43.986144965s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:47:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:51:59.984614659 +0000 UTC m=+284.436406187" watchObservedRunningTime="2026-09-09 20:51:59.986144965 +0000 UTC m=+284.437936494"
Sep 09 20:52:00.966920 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:00.966879    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-79977f9844-bjkpq" event={"ID":"37b0d343-5d35-4d62-b3f4-929029b915f2","Type":"ContainerStarted","Data":"35e282abbe3e763fa31b0d9cd6c20f847ce308b3a15825ebb0940b20c342fad2"}
Sep 09 20:52:00.986319 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:00.986272    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-79977f9844-bjkpq" podStartSLOduration=265.786481928 podStartE2EDuration="4m26.98623907s" totalImagesPullingTime="1.199757142s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:47:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:52:00.985411719 +0000 UTC m=+285.437203247" watchObservedRunningTime="2026-09-09 20:52:00.98623907 +0000 UTC m=+285.438030598"
Sep 09 20:52:02.976063 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:02.976030    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dg6rb" event={"ID":"8d37bae7-db79-4322-9ba1-012a68918b86","Type":"ContainerStarted","Data":"c01bc384e26fed4e8c3ce80e348ec5d86b87731d035caa086fd2e41445409225"}
Sep 09 20:52:02.976410 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:02.976084    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dg6rb" event={"ID":"8d37bae7-db79-4322-9ba1-012a68918b86","Type":"ContainerStarted","Data":"ddd62530e8bf56f7c8e958bfc07956d8c0ec9b25705f1de6b2218a918f0bbba5"}
Sep 09 20:52:02.976410 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:02.976158    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-dg6rb"
Sep 09 20:52:02.992940 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:02.992889    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-dg6rb" podStartSLOduration=252.347274547 podStartE2EDuration="4m14.992872498s" totalImagesPullingTime="2.645597951s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:47:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:52:02.991878756 +0000 UTC m=+287.443670283" watchObservedRunningTime="2026-09-09 20:52:02.992872498 +0000 UTC m=+287.444664027"
Sep 09 20:52:04.448262 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:04.448226    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f2eca4c6-1767-466b-87e3-915079d3e8de-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-9rlcx\" (UID: \"f2eca4c6-1767-466b-87e3-915079d3e8de\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-9rlcx"
Sep 09 20:52:04.450415 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:04.450379    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f2eca4c6-1767-466b-87e3-915079d3e8de-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-9rlcx\" (UID: \"f2eca4c6-1767-466b-87e3-915079d3e8de\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-9rlcx"
Sep 09 20:52:04.627283 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:04.627250    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-9rlcx"
Sep 09 20:52:04.896788 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:04.896752    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-9rlcx"]
Sep 09 20:52:04.902472 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:52:04.902443    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2eca4c6_1767_466b_87e3_915079d3e8de.slice/crio-f87e57bab55d610b4e62d6cbec81baf05da5f301958d86e5c2aad8ac3ae8e578 WatchSource:0}: Error finding container f87e57bab55d610b4e62d6cbec81baf05da5f301958d86e5c2aad8ac3ae8e578: Status 404 returned error can't find the container with id f87e57bab55d610b4e62d6cbec81baf05da5f301958d86e5c2aad8ac3ae8e578
Sep 09 20:52:04.984026 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:04.983980    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-9rlcx" event={"ID":"f2eca4c6-1767-466b-87e3-915079d3e8de","Type":"ContainerStarted","Data":"f87e57bab55d610b4e62d6cbec81baf05da5f301958d86e5c2aad8ac3ae8e578"}
Sep 09 20:52:06.992837 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:06.992754    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-9rlcx" event={"ID":"f2eca4c6-1767-466b-87e3-915079d3e8de","Type":"ContainerStarted","Data":"ab79285884e79e0b9a4e3463d822b8347f52a8ab1c87f77fc4e970ac22bbe026"}
Sep 09 20:52:07.008326 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:07.008282    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-9rlcx" podStartSLOduration=33.258942942 podStartE2EDuration="35.008266642s" totalImagesPullingTime="1.7493237s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:51:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:52:07.007704624 +0000 UTC m=+291.459496152" watchObservedRunningTime="2026-09-09 20:52:07.008266642 +0000 UTC m=+291.460058203"
Sep 09 20:52:09.043846 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:52:09.043797    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-48bqr" podUID="e3794c68-57f8-4bf6-9a86-b564da84a425"
Sep 09 20:52:12.981830 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:12.981799    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-dg6rb"
Sep 09 20:52:15.952727 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:15.952697    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-zdfrv_a23f7c09-09f4-49b5-a012-f1d3ec19fc27/console-operator/1.log"
Sep 09 20:52:15.953172 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:15.952847    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-zdfrv_a23f7c09-09f4-49b5-a012-f1d3ec19fc27/console-operator/1.log"
Sep 09 20:52:15.960633 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:15.960608    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2thgv_25e8b7cb-d3ab-4da2-bcfe-c061509f457b/ovn-acl-logging/0.log"
Sep 09 20:52:15.960980 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:15.960960    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2thgv_25e8b7cb-d3ab-4da2-bcfe-c061509f457b/ovn-acl-logging/0.log"
Sep 09 20:52:15.968248 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:15.968229    2560 kubelet.go:1648] "Image garbage collection succeeded"
Sep 09 20:52:18.178301 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:18.178268    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-hbtfj"]
Sep 09 20:52:18.180321 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:18.180306    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-hbtfj"
Sep 09 20:52:18.182574 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:18.182552    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Sep 09 20:52:18.183504 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:18.183486    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Sep 09 20:52:18.183617 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:18.183513    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 09 20:52:18.183903 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:18.183886    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-29bm9\""
Sep 09 20:52:18.191059 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:18.191038    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-hbtfj"]
Sep 09 20:52:18.255788 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:18.255745    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fv79\" (UniqueName: \"kubernetes.io/projected/661d6e5a-83ef-432f-aad5-8a4f1a73ef9a-kube-api-access-9fv79\") pod \"prometheus-operator-6f4946db56-hbtfj\" (UID: \"661d6e5a-83ef-432f-aad5-8a4f1a73ef9a\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-hbtfj"
Sep 09 20:52:18.255980 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:18.255801    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/661d6e5a-83ef-432f-aad5-8a4f1a73ef9a-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-hbtfj\" (UID: \"661d6e5a-83ef-432f-aad5-8a4f1a73ef9a\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-hbtfj"
Sep 09 20:52:18.255980 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:18.255828    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/661d6e5a-83ef-432f-aad5-8a4f1a73ef9a-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-hbtfj\" (UID: \"661d6e5a-83ef-432f-aad5-8a4f1a73ef9a\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-hbtfj"
Sep 09 20:52:18.255980 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:18.255862    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/661d6e5a-83ef-432f-aad5-8a4f1a73ef9a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-hbtfj\" (UID: \"661d6e5a-83ef-432f-aad5-8a4f1a73ef9a\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-hbtfj"
Sep 09 20:52:18.357125 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:18.357082    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/661d6e5a-83ef-432f-aad5-8a4f1a73ef9a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-hbtfj\" (UID: \"661d6e5a-83ef-432f-aad5-8a4f1a73ef9a\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-hbtfj"
Sep 09 20:52:18.357321 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:18.357169    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fv79\" (UniqueName: \"kubernetes.io/projected/661d6e5a-83ef-432f-aad5-8a4f1a73ef9a-kube-api-access-9fv79\") pod \"prometheus-operator-6f4946db56-hbtfj\" (UID: \"661d6e5a-83ef-432f-aad5-8a4f1a73ef9a\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-hbtfj"
Sep 09 20:52:18.357321 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:18.357214    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/661d6e5a-83ef-432f-aad5-8a4f1a73ef9a-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-hbtfj\" (UID: \"661d6e5a-83ef-432f-aad5-8a4f1a73ef9a\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-hbtfj"
Sep 09 20:52:18.357321 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:18.357239    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/661d6e5a-83ef-432f-aad5-8a4f1a73ef9a-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-hbtfj\" (UID: \"661d6e5a-83ef-432f-aad5-8a4f1a73ef9a\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-hbtfj"
Sep 09 20:52:18.357952 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:18.357927    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/661d6e5a-83ef-432f-aad5-8a4f1a73ef9a-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-hbtfj\" (UID: \"661d6e5a-83ef-432f-aad5-8a4f1a73ef9a\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-hbtfj"
Sep 09 20:52:18.359484 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:18.359463    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/661d6e5a-83ef-432f-aad5-8a4f1a73ef9a-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-hbtfj\" (UID: \"661d6e5a-83ef-432f-aad5-8a4f1a73ef9a\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-hbtfj"
Sep 09 20:52:18.359575 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:18.359515    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/661d6e5a-83ef-432f-aad5-8a4f1a73ef9a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-hbtfj\" (UID: \"661d6e5a-83ef-432f-aad5-8a4f1a73ef9a\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-hbtfj"
Sep 09 20:52:18.366180 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:18.366159    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fv79\" (UniqueName: \"kubernetes.io/projected/661d6e5a-83ef-432f-aad5-8a4f1a73ef9a-kube-api-access-9fv79\") pod \"prometheus-operator-6f4946db56-hbtfj\" (UID: \"661d6e5a-83ef-432f-aad5-8a4f1a73ef9a\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-hbtfj"
Sep 09 20:52:18.489994 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:18.489904    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-hbtfj"
Sep 09 20:52:18.758917 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:18.758873    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-hbtfj"]
Sep 09 20:52:18.761402 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:52:18.761371    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod661d6e5a_83ef_432f_aad5_8a4f1a73ef9a.slice/crio-ecd1d8aec2211169027d80aa8e208ba08b19f68e165bbcc01076c1eb2d1b94f1 WatchSource:0}: Error finding container ecd1d8aec2211169027d80aa8e208ba08b19f68e165bbcc01076c1eb2d1b94f1: Status 404 returned error can't find the container with id ecd1d8aec2211169027d80aa8e208ba08b19f68e165bbcc01076c1eb2d1b94f1
Sep 09 20:52:18.763252 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:18.763232    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 20:52:19.033841 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:19.033755    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-hbtfj" event={"ID":"661d6e5a-83ef-432f-aad5-8a4f1a73ef9a","Type":"ContainerStarted","Data":"ecd1d8aec2211169027d80aa8e208ba08b19f68e165bbcc01076c1eb2d1b94f1"}
Sep 09 20:52:19.255318 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:19.255280    2560 patch_prober.go:28] interesting pod/image-registry-7cdff8874c-zhjsp container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 20:52:19.255690 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:19.255332    2560 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7cdff8874c-zhjsp" podUID="1170b545-bb37-4499-9a2f-c0d7e976854d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 20:52:20.734141 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:20.734106    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7cdff8874c-zhjsp"]
Sep 09 20:52:20.739313 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:20.739275    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7cdff8874c-zhjsp"
Sep 09 20:52:21.043825 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:21.043793    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-hbtfj" event={"ID":"661d6e5a-83ef-432f-aad5-8a4f1a73ef9a","Type":"ContainerStarted","Data":"09cc3d2421e1cb2087c6efaa7d06b448c1cba0024a999aea2ea5dbf355ea976b"}
Sep 09 20:52:21.043992 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:21.043844    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-hbtfj" event={"ID":"661d6e5a-83ef-432f-aad5-8a4f1a73ef9a","Type":"ContainerStarted","Data":"863c7d253ff4753584d993f2f458d81836a1d124b9bc0f63b3f0e540225a4b28"}
Sep 09 20:52:21.066297 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:21.066248    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-6f4946db56-hbtfj" podStartSLOduration=1.0237656 podStartE2EDuration="3.066229543s" totalImagesPullingTime="2.042463943s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:52:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:52:21.065375455 +0000 UTC m=+305.517166983" watchObservedRunningTime="2026-09-09 20:52:21.066229543 +0000 UTC m=+305.518021070"
Sep 09 20:52:22.621527 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:22.621488    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-llwpd"]
Sep 09 20:52:22.626965 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:22.626938    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-llwpd"
Sep 09 20:52:22.629795 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:22.629771    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-hgk6b\""
Sep 09 20:52:22.629927 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:22.629772    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 09 20:52:22.630747 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:22.630727    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 09 20:52:22.630859 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:22.630771    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 09 20:52:22.796971 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:22.796919    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8be450a0-f7ec-4c5f-b3ba-049242433802-node-exporter-wtmp\") pod \"node-exporter-llwpd\" (UID: \"8be450a0-f7ec-4c5f-b3ba-049242433802\") " pod="openshift-monitoring/node-exporter-llwpd"
Sep 09 20:52:22.797168 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:22.796975    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8be450a0-f7ec-4c5f-b3ba-049242433802-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-llwpd\" (UID: \"8be450a0-f7ec-4c5f-b3ba-049242433802\") " pod="openshift-monitoring/node-exporter-llwpd"
Sep 09 20:52:22.797168 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:22.797098    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8be450a0-f7ec-4c5f-b3ba-049242433802-node-exporter-tls\") pod \"node-exporter-llwpd\" (UID: \"8be450a0-f7ec-4c5f-b3ba-049242433802\") " pod="openshift-monitoring/node-exporter-llwpd"
Sep 09 20:52:22.797168 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:22.797149    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8be450a0-f7ec-4c5f-b3ba-049242433802-node-exporter-textfile\") pod \"node-exporter-llwpd\" (UID: \"8be450a0-f7ec-4c5f-b3ba-049242433802\") " pod="openshift-monitoring/node-exporter-llwpd"
Sep 09 20:52:22.797302 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:22.797215    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8be450a0-f7ec-4c5f-b3ba-049242433802-root\") pod \"node-exporter-llwpd\" (UID: \"8be450a0-f7ec-4c5f-b3ba-049242433802\") " pod="openshift-monitoring/node-exporter-llwpd"
Sep 09 20:52:22.797302 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:22.797275    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8be450a0-f7ec-4c5f-b3ba-049242433802-sys\") pod \"node-exporter-llwpd\" (UID: \"8be450a0-f7ec-4c5f-b3ba-049242433802\") " pod="openshift-monitoring/node-exporter-llwpd"
Sep 09 20:52:22.797375 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:22.797314    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8be450a0-f7ec-4c5f-b3ba-049242433802-metrics-client-ca\") pod \"node-exporter-llwpd\" (UID: \"8be450a0-f7ec-4c5f-b3ba-049242433802\") " pod="openshift-monitoring/node-exporter-llwpd"
Sep 09 20:52:22.797375 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:22.797347    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8be450a0-f7ec-4c5f-b3ba-049242433802-node-exporter-accelerators-collector-config\") pod \"node-exporter-llwpd\" (UID: \"8be450a0-f7ec-4c5f-b3ba-049242433802\") " pod="openshift-monitoring/node-exporter-llwpd"
Sep 09 20:52:22.797455 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:22.797383    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rw5r\" (UniqueName: \"kubernetes.io/projected/8be450a0-f7ec-4c5f-b3ba-049242433802-kube-api-access-5rw5r\") pod \"node-exporter-llwpd\" (UID: \"8be450a0-f7ec-4c5f-b3ba-049242433802\") " pod="openshift-monitoring/node-exporter-llwpd"
Sep 09 20:52:22.898590 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:22.898495    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rw5r\" (UniqueName: \"kubernetes.io/projected/8be450a0-f7ec-4c5f-b3ba-049242433802-kube-api-access-5rw5r\") pod \"node-exporter-llwpd\" (UID: \"8be450a0-f7ec-4c5f-b3ba-049242433802\") " pod="openshift-monitoring/node-exporter-llwpd"
Sep 09 20:52:22.898590 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:22.898564    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8be450a0-f7ec-4c5f-b3ba-049242433802-node-exporter-wtmp\") pod \"node-exporter-llwpd\" (UID: \"8be450a0-f7ec-4c5f-b3ba-049242433802\") " pod="openshift-monitoring/node-exporter-llwpd"
Sep 09 20:52:22.898847 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:22.898596    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8be450a0-f7ec-4c5f-b3ba-049242433802-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-llwpd\" (UID: \"8be450a0-f7ec-4c5f-b3ba-049242433802\") " pod="openshift-monitoring/node-exporter-llwpd"
Sep 09 20:52:22.898847 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:22.898624    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8be450a0-f7ec-4c5f-b3ba-049242433802-node-exporter-tls\") pod \"node-exporter-llwpd\" (UID: \"8be450a0-f7ec-4c5f-b3ba-049242433802\") " pod="openshift-monitoring/node-exporter-llwpd"
Sep 09 20:52:22.898847 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:22.898651    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8be450a0-f7ec-4c5f-b3ba-049242433802-node-exporter-textfile\") pod \"node-exporter-llwpd\" (UID: \"8be450a0-f7ec-4c5f-b3ba-049242433802\") " pod="openshift-monitoring/node-exporter-llwpd"
Sep 09 20:52:22.898847 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:22.898721    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8be450a0-f7ec-4c5f-b3ba-049242433802-root\") pod \"node-exporter-llwpd\" (UID: \"8be450a0-f7ec-4c5f-b3ba-049242433802\") " pod="openshift-monitoring/node-exporter-llwpd"
Sep 09 20:52:22.898847 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:22.898753    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8be450a0-f7ec-4c5f-b3ba-049242433802-sys\") pod \"node-exporter-llwpd\" (UID: \"8be450a0-f7ec-4c5f-b3ba-049242433802\") " pod="openshift-monitoring/node-exporter-llwpd"
Sep 09 20:52:22.898847 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:22.898780    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8be450a0-f7ec-4c5f-b3ba-049242433802-metrics-client-ca\") pod \"node-exporter-llwpd\" (UID: \"8be450a0-f7ec-4c5f-b3ba-049242433802\") " pod="openshift-monitoring/node-exporter-llwpd"
Sep 09 20:52:22.898847 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:22.898783    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8be450a0-f7ec-4c5f-b3ba-049242433802-node-exporter-wtmp\") pod \"node-exporter-llwpd\" (UID: \"8be450a0-f7ec-4c5f-b3ba-049242433802\") " pod="openshift-monitoring/node-exporter-llwpd"
Sep 09 20:52:22.898847 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:22.898839    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8be450a0-f7ec-4c5f-b3ba-049242433802-node-exporter-accelerators-collector-config\") pod \"node-exporter-llwpd\" (UID: \"8be450a0-f7ec-4c5f-b3ba-049242433802\") " pod="openshift-monitoring/node-exporter-llwpd"
Sep 09 20:52:22.899228 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:22.898917    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8be450a0-f7ec-4c5f-b3ba-049242433802-root\") pod \"node-exporter-llwpd\" (UID: \"8be450a0-f7ec-4c5f-b3ba-049242433802\") " pod="openshift-monitoring/node-exporter-llwpd"
Sep 09 20:52:22.899228 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:22.898968    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8be450a0-f7ec-4c5f-b3ba-049242433802-sys\") pod \"node-exporter-llwpd\" (UID: \"8be450a0-f7ec-4c5f-b3ba-049242433802\") " pod="openshift-monitoring/node-exporter-llwpd"
Sep 09 20:52:22.899228 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:22.899151    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8be450a0-f7ec-4c5f-b3ba-049242433802-node-exporter-textfile\") pod \"node-exporter-llwpd\" (UID: \"8be450a0-f7ec-4c5f-b3ba-049242433802\") " pod="openshift-monitoring/node-exporter-llwpd"
Sep 09 20:52:22.899486 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:22.899464    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8be450a0-f7ec-4c5f-b3ba-049242433802-node-exporter-accelerators-collector-config\") pod \"node-exporter-llwpd\" (UID: \"8be450a0-f7ec-4c5f-b3ba-049242433802\") " pod="openshift-monitoring/node-exporter-llwpd"
Sep 09 20:52:22.899555 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:22.899489    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8be450a0-f7ec-4c5f-b3ba-049242433802-metrics-client-ca\") pod \"node-exporter-llwpd\" (UID: \"8be450a0-f7ec-4c5f-b3ba-049242433802\") " pod="openshift-monitoring/node-exporter-llwpd"
Sep 09 20:52:22.901155 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:22.901126    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8be450a0-f7ec-4c5f-b3ba-049242433802-node-exporter-tls\") pod \"node-exporter-llwpd\" (UID: \"8be450a0-f7ec-4c5f-b3ba-049242433802\") " pod="openshift-monitoring/node-exporter-llwpd"
Sep 09 20:52:22.901385 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:22.901365    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8be450a0-f7ec-4c5f-b3ba-049242433802-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-llwpd\" (UID: \"8be450a0-f7ec-4c5f-b3ba-049242433802\") " pod="openshift-monitoring/node-exporter-llwpd"
Sep 09 20:52:22.906682 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:22.906649    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rw5r\" (UniqueName: \"kubernetes.io/projected/8be450a0-f7ec-4c5f-b3ba-049242433802-kube-api-access-5rw5r\") pod \"node-exporter-llwpd\" (UID: \"8be450a0-f7ec-4c5f-b3ba-049242433802\") " pod="openshift-monitoring/node-exporter-llwpd"
Sep 09 20:52:22.937801 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:22.937767    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-llwpd"
Sep 09 20:52:22.951986 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:52:22.951955    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8be450a0_f7ec_4c5f_b3ba_049242433802.slice/crio-097b4b64afc38b4dd784e0093197ca1c328cba78a8f81a562ee47402a93d64ef WatchSource:0}: Error finding container 097b4b64afc38b4dd784e0093197ca1c328cba78a8f81a562ee47402a93d64ef: Status 404 returned error can't find the container with id 097b4b64afc38b4dd784e0093197ca1c328cba78a8f81a562ee47402a93d64ef
Sep 09 20:52:23.051776 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:23.051738    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-llwpd" event={"ID":"8be450a0-f7ec-4c5f-b3ba-049242433802","Type":"ContainerStarted","Data":"097b4b64afc38b4dd784e0093197ca1c328cba78a8f81a562ee47402a93d64ef"}
Sep 09 20:52:24.041984 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:24.041955    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-48bqr"
Sep 09 20:52:25.061027 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:25.060990    2560 generic.go:356] "Generic (PLEG): container finished" podID="8be450a0-f7ec-4c5f-b3ba-049242433802" containerID="84fca50d452f04eb80ddcabe73b5b5cf8105b4b8101f315401498edb09924cf2" exitCode=0
Sep 09 20:52:25.061027 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:25.061025    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-llwpd" event={"ID":"8be450a0-f7ec-4c5f-b3ba-049242433802","Type":"ContainerDied","Data":"84fca50d452f04eb80ddcabe73b5b5cf8105b4b8101f315401498edb09924cf2"}
Sep 09 20:52:25.680133 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:25.680101    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5bcc6c5fc9-85grm"]
Sep 09 20:52:25.684368 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:25.684349    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5bcc6c5fc9-85grm"
Sep 09 20:52:25.687852 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:25.687833    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Sep 09 20:52:25.687852 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:25.687846    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Sep 09 20:52:25.688002 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:25.687903    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Sep 09 20:52:25.688363 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:25.688345    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-73vhsf86h0k5o\""
Sep 09 20:52:25.688448 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:25.688405    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-hw46r\""
Sep 09 20:52:25.688511 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:25.688349    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Sep 09 20:52:25.688716 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:25.688697    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Sep 09 20:52:25.698725 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:25.698703    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5bcc6c5fc9-85grm"]
Sep 09 20:52:25.822386 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:25.822340    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3df0326f-55e9-4469-b42e-7854954895f9-metrics-client-ca\") pod \"thanos-querier-5bcc6c5fc9-85grm\" (UID: \"3df0326f-55e9-4469-b42e-7854954895f9\") " pod="openshift-monitoring/thanos-querier-5bcc6c5fc9-85grm"
Sep 09 20:52:25.822558 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:25.822404    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3df0326f-55e9-4469-b42e-7854954895f9-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5bcc6c5fc9-85grm\" (UID: \"3df0326f-55e9-4469-b42e-7854954895f9\") " pod="openshift-monitoring/thanos-querier-5bcc6c5fc9-85grm"
Sep 09 20:52:25.822558 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:25.822451    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/3df0326f-55e9-4469-b42e-7854954895f9-secret-thanos-querier-tls\") pod \"thanos-querier-5bcc6c5fc9-85grm\" (UID: \"3df0326f-55e9-4469-b42e-7854954895f9\") " pod="openshift-monitoring/thanos-querier-5bcc6c5fc9-85grm"
Sep 09 20:52:25.822558 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:25.822492    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3df0326f-55e9-4469-b42e-7854954895f9-secret-grpc-tls\") pod \"thanos-querier-5bcc6c5fc9-85grm\" (UID: \"3df0326f-55e9-4469-b42e-7854954895f9\") " pod="openshift-monitoring/thanos-querier-5bcc6c5fc9-85grm"
Sep 09 20:52:25.822558 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:25.822522    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/3df0326f-55e9-4469-b42e-7854954895f9-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5bcc6c5fc9-85grm\" (UID: \"3df0326f-55e9-4469-b42e-7854954895f9\") " pod="openshift-monitoring/thanos-querier-5bcc6c5fc9-85grm"
Sep 09 20:52:25.822729 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:25.822559    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/3df0326f-55e9-4469-b42e-7854954895f9-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5bcc6c5fc9-85grm\" (UID: \"3df0326f-55e9-4469-b42e-7854954895f9\") " pod="openshift-monitoring/thanos-querier-5bcc6c5fc9-85grm"
Sep 09 20:52:25.822729 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:25.822584    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3df0326f-55e9-4469-b42e-7854954895f9-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5bcc6c5fc9-85grm\" (UID: \"3df0326f-55e9-4469-b42e-7854954895f9\") " pod="openshift-monitoring/thanos-querier-5bcc6c5fc9-85grm"
Sep 09 20:52:25.822729 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:25.822632    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dznf\" (UniqueName: \"kubernetes.io/projected/3df0326f-55e9-4469-b42e-7854954895f9-kube-api-access-7dznf\") pod \"thanos-querier-5bcc6c5fc9-85grm\" (UID: \"3df0326f-55e9-4469-b42e-7854954895f9\") " pod="openshift-monitoring/thanos-querier-5bcc6c5fc9-85grm"
Sep 09 20:52:25.923318 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:25.923284    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3df0326f-55e9-4469-b42e-7854954895f9-secret-grpc-tls\") pod \"thanos-querier-5bcc6c5fc9-85grm\" (UID: \"3df0326f-55e9-4469-b42e-7854954895f9\") " pod="openshift-monitoring/thanos-querier-5bcc6c5fc9-85grm"
Sep 09 20:52:25.923492 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:25.923335    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/3df0326f-55e9-4469-b42e-7854954895f9-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5bcc6c5fc9-85grm\" (UID: \"3df0326f-55e9-4469-b42e-7854954895f9\") " pod="openshift-monitoring/thanos-querier-5bcc6c5fc9-85grm"
Sep 09 20:52:25.923492 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:25.923372    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/3df0326f-55e9-4469-b42e-7854954895f9-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5bcc6c5fc9-85grm\" (UID: \"3df0326f-55e9-4469-b42e-7854954895f9\") " pod="openshift-monitoring/thanos-querier-5bcc6c5fc9-85grm"
Sep 09 20:52:25.923492 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:25.923396    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3df0326f-55e9-4469-b42e-7854954895f9-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5bcc6c5fc9-85grm\" (UID: \"3df0326f-55e9-4469-b42e-7854954895f9\") " pod="openshift-monitoring/thanos-querier-5bcc6c5fc9-85grm"
Sep 09 20:52:25.923492 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:25.923434    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dznf\" (UniqueName: \"kubernetes.io/projected/3df0326f-55e9-4469-b42e-7854954895f9-kube-api-access-7dznf\") pod \"thanos-querier-5bcc6c5fc9-85grm\" (UID: \"3df0326f-55e9-4469-b42e-7854954895f9\") " pod="openshift-monitoring/thanos-querier-5bcc6c5fc9-85grm"
Sep 09 20:52:25.923492 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:25.923479    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3df0326f-55e9-4469-b42e-7854954895f9-metrics-client-ca\") pod \"thanos-querier-5bcc6c5fc9-85grm\" (UID: \"3df0326f-55e9-4469-b42e-7854954895f9\") " pod="openshift-monitoring/thanos-querier-5bcc6c5fc9-85grm"
Sep 09 20:52:25.923663 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:25.923532    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3df0326f-55e9-4469-b42e-7854954895f9-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5bcc6c5fc9-85grm\" (UID: \"3df0326f-55e9-4469-b42e-7854954895f9\") " pod="openshift-monitoring/thanos-querier-5bcc6c5fc9-85grm"
Sep 09 20:52:25.923663 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:25.923560    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/3df0326f-55e9-4469-b42e-7854954895f9-secret-thanos-querier-tls\") pod \"thanos-querier-5bcc6c5fc9-85grm\" (UID: \"3df0326f-55e9-4469-b42e-7854954895f9\") " pod="openshift-monitoring/thanos-querier-5bcc6c5fc9-85grm"
Sep 09 20:52:25.924573 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:25.924545    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3df0326f-55e9-4469-b42e-7854954895f9-metrics-client-ca\") pod \"thanos-querier-5bcc6c5fc9-85grm\" (UID: \"3df0326f-55e9-4469-b42e-7854954895f9\") " pod="openshift-monitoring/thanos-querier-5bcc6c5fc9-85grm"
Sep 09 20:52:25.926462 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:25.926403    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/3df0326f-55e9-4469-b42e-7854954895f9-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5bcc6c5fc9-85grm\" (UID: \"3df0326f-55e9-4469-b42e-7854954895f9\") " pod="openshift-monitoring/thanos-querier-5bcc6c5fc9-85grm"
Sep 09 20:52:25.926895 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:25.926505    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/3df0326f-55e9-4469-b42e-7854954895f9-secret-thanos-querier-tls\") pod \"thanos-querier-5bcc6c5fc9-85grm\" (UID: \"3df0326f-55e9-4469-b42e-7854954895f9\") " pod="openshift-monitoring/thanos-querier-5bcc6c5fc9-85grm"
Sep 09 20:52:25.926895 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:25.926549    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3df0326f-55e9-4469-b42e-7854954895f9-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5bcc6c5fc9-85grm\" (UID: \"3df0326f-55e9-4469-b42e-7854954895f9\") " pod="openshift-monitoring/thanos-querier-5bcc6c5fc9-85grm"
Sep 09 20:52:25.926895 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:25.926867    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/3df0326f-55e9-4469-b42e-7854954895f9-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5bcc6c5fc9-85grm\" (UID: \"3df0326f-55e9-4469-b42e-7854954895f9\") " pod="openshift-monitoring/thanos-querier-5bcc6c5fc9-85grm"
Sep 09 20:52:25.927064 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:25.926931    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3df0326f-55e9-4469-b42e-7854954895f9-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5bcc6c5fc9-85grm\" (UID: \"3df0326f-55e9-4469-b42e-7854954895f9\") " pod="openshift-monitoring/thanos-querier-5bcc6c5fc9-85grm"
Sep 09 20:52:25.927064 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:25.926984    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3df0326f-55e9-4469-b42e-7854954895f9-secret-grpc-tls\") pod \"thanos-querier-5bcc6c5fc9-85grm\" (UID: \"3df0326f-55e9-4469-b42e-7854954895f9\") " pod="openshift-monitoring/thanos-querier-5bcc6c5fc9-85grm"
Sep 09 20:52:25.931742 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:25.931634    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dznf\" (UniqueName: \"kubernetes.io/projected/3df0326f-55e9-4469-b42e-7854954895f9-kube-api-access-7dznf\") pod \"thanos-querier-5bcc6c5fc9-85grm\" (UID: \"3df0326f-55e9-4469-b42e-7854954895f9\") " pod="openshift-monitoring/thanos-querier-5bcc6c5fc9-85grm"
Sep 09 20:52:25.995626 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:25.995607    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5bcc6c5fc9-85grm"
Sep 09 20:52:26.067722 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:26.067662    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-llwpd" event={"ID":"8be450a0-f7ec-4c5f-b3ba-049242433802","Type":"ContainerStarted","Data":"acd402eef169b1b07d2cb639048d149f4fd4239ad03d472b716252d95443bcb8"}
Sep 09 20:52:26.068008 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:26.067745    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-llwpd" event={"ID":"8be450a0-f7ec-4c5f-b3ba-049242433802","Type":"ContainerStarted","Data":"ca77a6b362a36d77ef9964c005567cdadd6d5b3a6f4b179dd3716946813bdc10"}
Sep 09 20:52:26.086179 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:26.086135    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-llwpd" podStartSLOduration=2.944251619 podStartE2EDuration="4.086120063s" totalImagesPullingTime="1.082634633s" totalInitContainerRuntime="59.233811ms" isStatefulPod=true podCreationTimestamp="2026-09-09 20:52:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:52:26.085192775 +0000 UTC m=+310.536984303" watchObservedRunningTime="2026-09-09 20:52:26.086120063 +0000 UTC m=+310.537911591"
Sep 09 20:52:26.265685 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:26.265650    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5bcc6c5fc9-85grm"]
Sep 09 20:52:26.267573 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:52:26.267549    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3df0326f_55e9_4469_b42e_7854954895f9.slice/crio-891e49a509ad6187e070d1bc614ebcf7cd6be4dd244f4cdee239fc66fef007ed WatchSource:0}: Error finding container 891e49a509ad6187e070d1bc614ebcf7cd6be4dd244f4cdee239fc66fef007ed: Status 404 returned error can't find the container with id 891e49a509ad6187e070d1bc614ebcf7cd6be4dd244f4cdee239fc66fef007ed
Sep 09 20:52:27.072742 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:27.072701    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5bcc6c5fc9-85grm" event={"ID":"3df0326f-55e9-4469-b42e-7854954895f9","Type":"ContainerStarted","Data":"891e49a509ad6187e070d1bc614ebcf7cd6be4dd244f4cdee239fc66fef007ed"}
Sep 09 20:52:27.359779 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:27.359659    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-bdp2n"]
Sep 09 20:52:27.362997 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:27.362973    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-bdp2n"
Sep 09 20:52:27.365939 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:27.365910    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-4bbm4\""
Sep 09 20:52:27.366092 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:27.365960    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Sep 09 20:52:27.375248 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:27.375223    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-bdp2n"]
Sep 09 20:52:27.537115 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:27.537083    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwfm6\" (UniqueName: \"kubernetes.io/projected/48ef9fca-e641-4068-ac68-e895f4f7a09f-kube-api-access-hwfm6\") pod \"monitoring-plugin-85bbbbbf4-bdp2n\" (UID: \"48ef9fca-e641-4068-ac68-e895f4f7a09f\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-bdp2n"
Sep 09 20:52:27.537285 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:27.537130    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/48ef9fca-e641-4068-ac68-e895f4f7a09f-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-bdp2n\" (UID: \"48ef9fca-e641-4068-ac68-e895f4f7a09f\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-bdp2n"
Sep 09 20:52:27.638492 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:27.638403    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwfm6\" (UniqueName: \"kubernetes.io/projected/48ef9fca-e641-4068-ac68-e895f4f7a09f-kube-api-access-hwfm6\") pod \"monitoring-plugin-85bbbbbf4-bdp2n\" (UID: \"48ef9fca-e641-4068-ac68-e895f4f7a09f\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-bdp2n"
Sep 09 20:52:27.638492 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:27.638462    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/48ef9fca-e641-4068-ac68-e895f4f7a09f-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-bdp2n\" (UID: \"48ef9fca-e641-4068-ac68-e895f4f7a09f\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-bdp2n"
Sep 09 20:52:27.641329 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:27.641287    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/48ef9fca-e641-4068-ac68-e895f4f7a09f-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-bdp2n\" (UID: \"48ef9fca-e641-4068-ac68-e895f4f7a09f\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-bdp2n"
Sep 09 20:52:27.646932 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:27.646904    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwfm6\" (UniqueName: \"kubernetes.io/projected/48ef9fca-e641-4068-ac68-e895f4f7a09f-kube-api-access-hwfm6\") pod \"monitoring-plugin-85bbbbbf4-bdp2n\" (UID: \"48ef9fca-e641-4068-ac68-e895f4f7a09f\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-bdp2n"
Sep 09 20:52:27.677526 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:27.677502    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-bdp2n"
Sep 09 20:52:27.784240 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:27.784206    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-749d9cbccb-dvsf2"]
Sep 09 20:52:27.789392 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:27.789363    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-749d9cbccb-dvsf2"
Sep 09 20:52:27.792465 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:27.792428    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Sep 09 20:52:27.792465 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:27.792440    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Sep 09 20:52:27.793065 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:27.793031    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Sep 09 20:52:27.793200 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:27.793134    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-xdqwb\""
Sep 09 20:52:27.793256 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:27.793195    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Sep 09 20:52:27.793306 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:27.793285    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Sep 09 20:52:27.798875 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:27.798854    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Sep 09 20:52:27.804081 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:27.804059    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-749d9cbccb-dvsf2"]
Sep 09 20:52:27.941532 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:27.941447    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a7be6858-279a-44d8-8b9e-e51f67250852-secret-telemeter-client\") pod \"telemeter-client-749d9cbccb-dvsf2\" (UID: \"a7be6858-279a-44d8-8b9e-e51f67250852\") " pod="openshift-monitoring/telemeter-client-749d9cbccb-dvsf2"
Sep 09 20:52:27.941532 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:27.941484    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7be6858-279a-44d8-8b9e-e51f67250852-telemeter-trusted-ca-bundle\") pod \"telemeter-client-749d9cbccb-dvsf2\" (UID: \"a7be6858-279a-44d8-8b9e-e51f67250852\") " pod="openshift-monitoring/telemeter-client-749d9cbccb-dvsf2"
Sep 09 20:52:27.941532 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:27.941508    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a7be6858-279a-44d8-8b9e-e51f67250852-metrics-client-ca\") pod \"telemeter-client-749d9cbccb-dvsf2\" (UID: \"a7be6858-279a-44d8-8b9e-e51f67250852\") " pod="openshift-monitoring/telemeter-client-749d9cbccb-dvsf2"
Sep 09 20:52:27.941800 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:27.941596    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a7be6858-279a-44d8-8b9e-e51f67250852-federate-client-tls\") pod \"telemeter-client-749d9cbccb-dvsf2\" (UID: \"a7be6858-279a-44d8-8b9e-e51f67250852\") " pod="openshift-monitoring/telemeter-client-749d9cbccb-dvsf2"
Sep 09 20:52:27.941800 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:27.941639    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a7be6858-279a-44d8-8b9e-e51f67250852-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-749d9cbccb-dvsf2\" (UID: \"a7be6858-279a-44d8-8b9e-e51f67250852\") " pod="openshift-monitoring/telemeter-client-749d9cbccb-dvsf2"
Sep 09 20:52:27.941800 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:27.941697    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7be6858-279a-44d8-8b9e-e51f67250852-serving-certs-ca-bundle\") pod \"telemeter-client-749d9cbccb-dvsf2\" (UID: \"a7be6858-279a-44d8-8b9e-e51f67250852\") " pod="openshift-monitoring/telemeter-client-749d9cbccb-dvsf2"
Sep 09 20:52:27.941800 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:27.941772    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a7be6858-279a-44d8-8b9e-e51f67250852-telemeter-client-tls\") pod \"telemeter-client-749d9cbccb-dvsf2\" (UID: \"a7be6858-279a-44d8-8b9e-e51f67250852\") " pod="openshift-monitoring/telemeter-client-749d9cbccb-dvsf2"
Sep 09 20:52:27.941951 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:27.941813    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6cxn\" (UniqueName: \"kubernetes.io/projected/a7be6858-279a-44d8-8b9e-e51f67250852-kube-api-access-d6cxn\") pod \"telemeter-client-749d9cbccb-dvsf2\" (UID: \"a7be6858-279a-44d8-8b9e-e51f67250852\") " pod="openshift-monitoring/telemeter-client-749d9cbccb-dvsf2"
Sep 09 20:52:28.043047 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:28.043009    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a7be6858-279a-44d8-8b9e-e51f67250852-federate-client-tls\") pod \"telemeter-client-749d9cbccb-dvsf2\" (UID: \"a7be6858-279a-44d8-8b9e-e51f67250852\") " pod="openshift-monitoring/telemeter-client-749d9cbccb-dvsf2"
Sep 09 20:52:28.043184 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:28.043064    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a7be6858-279a-44d8-8b9e-e51f67250852-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-749d9cbccb-dvsf2\" (UID: \"a7be6858-279a-44d8-8b9e-e51f67250852\") " pod="openshift-monitoring/telemeter-client-749d9cbccb-dvsf2"
Sep 09 20:52:28.043184 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:28.043099    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7be6858-279a-44d8-8b9e-e51f67250852-serving-certs-ca-bundle\") pod \"telemeter-client-749d9cbccb-dvsf2\" (UID: \"a7be6858-279a-44d8-8b9e-e51f67250852\") " pod="openshift-monitoring/telemeter-client-749d9cbccb-dvsf2"
Sep 09 20:52:28.043184 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:28.043120    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a7be6858-279a-44d8-8b9e-e51f67250852-telemeter-client-tls\") pod \"telemeter-client-749d9cbccb-dvsf2\" (UID: \"a7be6858-279a-44d8-8b9e-e51f67250852\") " pod="openshift-monitoring/telemeter-client-749d9cbccb-dvsf2"
Sep 09 20:52:28.043184 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:28.043144    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6cxn\" (UniqueName: \"kubernetes.io/projected/a7be6858-279a-44d8-8b9e-e51f67250852-kube-api-access-d6cxn\") pod \"telemeter-client-749d9cbccb-dvsf2\" (UID: \"a7be6858-279a-44d8-8b9e-e51f67250852\") " pod="openshift-monitoring/telemeter-client-749d9cbccb-dvsf2"
Sep 09 20:52:28.043400 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:28.043224    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a7be6858-279a-44d8-8b9e-e51f67250852-secret-telemeter-client\") pod \"telemeter-client-749d9cbccb-dvsf2\" (UID: \"a7be6858-279a-44d8-8b9e-e51f67250852\") " pod="openshift-monitoring/telemeter-client-749d9cbccb-dvsf2"
Sep 09 20:52:28.043400 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:28.043262    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7be6858-279a-44d8-8b9e-e51f67250852-telemeter-trusted-ca-bundle\") pod \"telemeter-client-749d9cbccb-dvsf2\" (UID: \"a7be6858-279a-44d8-8b9e-e51f67250852\") " pod="openshift-monitoring/telemeter-client-749d9cbccb-dvsf2"
Sep 09 20:52:28.043400 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:28.043286    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a7be6858-279a-44d8-8b9e-e51f67250852-metrics-client-ca\") pod \"telemeter-client-749d9cbccb-dvsf2\" (UID: \"a7be6858-279a-44d8-8b9e-e51f67250852\") " pod="openshift-monitoring/telemeter-client-749d9cbccb-dvsf2"
Sep 09 20:52:28.044100 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:28.044063    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a7be6858-279a-44d8-8b9e-e51f67250852-metrics-client-ca\") pod \"telemeter-client-749d9cbccb-dvsf2\" (UID: \"a7be6858-279a-44d8-8b9e-e51f67250852\") " pod="openshift-monitoring/telemeter-client-749d9cbccb-dvsf2"
Sep 09 20:52:28.044240 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:28.044194    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7be6858-279a-44d8-8b9e-e51f67250852-serving-certs-ca-bundle\") pod \"telemeter-client-749d9cbccb-dvsf2\" (UID: \"a7be6858-279a-44d8-8b9e-e51f67250852\") " pod="openshift-monitoring/telemeter-client-749d9cbccb-dvsf2"
Sep 09 20:52:28.044448 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:28.044419    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7be6858-279a-44d8-8b9e-e51f67250852-telemeter-trusted-ca-bundle\") pod \"telemeter-client-749d9cbccb-dvsf2\" (UID: \"a7be6858-279a-44d8-8b9e-e51f67250852\") " pod="openshift-monitoring/telemeter-client-749d9cbccb-dvsf2"
Sep 09 20:52:28.046358 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:28.046312    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a7be6858-279a-44d8-8b9e-e51f67250852-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-749d9cbccb-dvsf2\" (UID: \"a7be6858-279a-44d8-8b9e-e51f67250852\") " pod="openshift-monitoring/telemeter-client-749d9cbccb-dvsf2"
Sep 09 20:52:28.046576 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:28.046559    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a7be6858-279a-44d8-8b9e-e51f67250852-federate-client-tls\") pod \"telemeter-client-749d9cbccb-dvsf2\" (UID: \"a7be6858-279a-44d8-8b9e-e51f67250852\") " pod="openshift-monitoring/telemeter-client-749d9cbccb-dvsf2"
Sep 09 20:52:28.046702 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:28.046658    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a7be6858-279a-44d8-8b9e-e51f67250852-secret-telemeter-client\") pod \"telemeter-client-749d9cbccb-dvsf2\" (UID: \"a7be6858-279a-44d8-8b9e-e51f67250852\") " pod="openshift-monitoring/telemeter-client-749d9cbccb-dvsf2"
Sep 09 20:52:28.046763 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:28.046750    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a7be6858-279a-44d8-8b9e-e51f67250852-telemeter-client-tls\") pod \"telemeter-client-749d9cbccb-dvsf2\" (UID: \"a7be6858-279a-44d8-8b9e-e51f67250852\") " pod="openshift-monitoring/telemeter-client-749d9cbccb-dvsf2"
Sep 09 20:52:28.051153 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:28.051130    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6cxn\" (UniqueName: \"kubernetes.io/projected/a7be6858-279a-44d8-8b9e-e51f67250852-kube-api-access-d6cxn\") pod \"telemeter-client-749d9cbccb-dvsf2\" (UID: \"a7be6858-279a-44d8-8b9e-e51f67250852\") " pod="openshift-monitoring/telemeter-client-749d9cbccb-dvsf2"
Sep 09 20:52:28.101236 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:28.101215    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-749d9cbccb-dvsf2"
Sep 09 20:52:28.304280 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:28.304176    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-bdp2n"]
Sep 09 20:52:28.307501 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:52:28.307473    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48ef9fca_e641_4068_ac68_e895f4f7a09f.slice/crio-d09393b515d4fbae4b22db48cce4a555487d10c273c6a97d37cb4dea2831bc05 WatchSource:0}: Error finding container d09393b515d4fbae4b22db48cce4a555487d10c273c6a97d37cb4dea2831bc05: Status 404 returned error can't find the container with id d09393b515d4fbae4b22db48cce4a555487d10c273c6a97d37cb4dea2831bc05
Sep 09 20:52:28.380040 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:28.379987    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-749d9cbccb-dvsf2"]
Sep 09 20:52:28.382903 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:52:28.382877    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7be6858_279a_44d8_8b9e_e51f67250852.slice/crio-21f8ca6d024fd1b200d9297c0775ebc56c5ea7d1cca5f57efe3adf838050254e WatchSource:0}: Error finding container 21f8ca6d024fd1b200d9297c0775ebc56c5ea7d1cca5f57efe3adf838050254e: Status 404 returned error can't find the container with id 21f8ca6d024fd1b200d9297c0775ebc56c5ea7d1cca5f57efe3adf838050254e
Sep 09 20:52:29.082158 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:29.082118    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-749d9cbccb-dvsf2" event={"ID":"a7be6858-279a-44d8-8b9e-e51f67250852","Type":"ContainerStarted","Data":"21f8ca6d024fd1b200d9297c0775ebc56c5ea7d1cca5f57efe3adf838050254e"}
Sep 09 20:52:29.084818 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:29.084785    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5bcc6c5fc9-85grm" event={"ID":"3df0326f-55e9-4469-b42e-7854954895f9","Type":"ContainerStarted","Data":"59b197dac2927e8b3cb8307b94ab9be689f99f90cf7ff336d206fb18213c6a5f"}
Sep 09 20:52:29.084953 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:29.084865    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5bcc6c5fc9-85grm" event={"ID":"3df0326f-55e9-4469-b42e-7854954895f9","Type":"ContainerStarted","Data":"9afd4b84ac2f8cd7b7aaaabd14fa4c3646d2ebc00eb0e163d877704cbef649d2"}
Sep 09 20:52:29.084953 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:29.084916    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5bcc6c5fc9-85grm" event={"ID":"3df0326f-55e9-4469-b42e-7854954895f9","Type":"ContainerStarted","Data":"04312ebfebf01a5bb60820c82ca8c858f456c96fab0d0b60e82745568a5a4cc3"}
Sep 09 20:52:29.086207 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:29.086178    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-bdp2n" event={"ID":"48ef9fca-e641-4068-ac68-e895f4f7a09f","Type":"ContainerStarted","Data":"d09393b515d4fbae4b22db48cce4a555487d10c273c6a97d37cb4dea2831bc05"}
Sep 09 20:52:31.095943 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:31.095900    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-bdp2n" event={"ID":"48ef9fca-e641-4068-ac68-e895f4f7a09f","Type":"ContainerStarted","Data":"1b364fc8917553c23cc5170211ef3be82eb24244be92e24e331a4b8ffc28386f"}
Sep 09 20:52:31.096437 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:31.095997    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-bdp2n"
Sep 09 20:52:31.097568 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:31.097530    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-749d9cbccb-dvsf2" event={"ID":"a7be6858-279a-44d8-8b9e-e51f67250852","Type":"ContainerStarted","Data":"c4d582b7fdbfbbe3a4189732cb18092eee070802d10e089714baa072e1e0211e"}
Sep 09 20:52:31.100776 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:31.100749    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5bcc6c5fc9-85grm" event={"ID":"3df0326f-55e9-4469-b42e-7854954895f9","Type":"ContainerStarted","Data":"2ec903357a827768f788fc13cf56b1dfabb446dfc945a72e63d5f5f2b9c140ec"}
Sep 09 20:52:31.100897 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:31.100801    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5bcc6c5fc9-85grm" event={"ID":"3df0326f-55e9-4469-b42e-7854954895f9","Type":"ContainerStarted","Data":"4543b3a3df9bc56421af038dfec09304eb2fd45bd249efee3975ed47dbe5b7f1"}
Sep 09 20:52:31.100897 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:31.100826    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5bcc6c5fc9-85grm" event={"ID":"3df0326f-55e9-4469-b42e-7854954895f9","Type":"ContainerStarted","Data":"f55fb06260add1ec219a4a0f9d8a795eab6487f99e20114e5f3e49c53d20718b"}
Sep 09 20:52:31.101002 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:31.100910    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5bcc6c5fc9-85grm"
Sep 09 20:52:31.101628 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:31.101602    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-bdp2n"
Sep 09 20:52:31.111857 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:31.111808    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-bdp2n" podStartSLOduration=1.915406343 podStartE2EDuration="4.11179353s" totalImagesPullingTime="2.196387187s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:52:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:52:31.111005099 +0000 UTC m=+315.562796630" watchObservedRunningTime="2026-09-09 20:52:31.11179353 +0000 UTC m=+315.563585060"
Sep 09 20:52:31.151318 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:31.151260    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5bcc6c5fc9-85grm" podStartSLOduration=2.102090868 podStartE2EDuration="6.151241681s" totalImagesPullingTime="4.049150813s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:52:25 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:52:31.149705396 +0000 UTC m=+315.601496922" watchObservedRunningTime="2026-09-09 20:52:31.151241681 +0000 UTC m=+315.603033264"
Sep 09 20:52:32.108593 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:32.108556    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-749d9cbccb-dvsf2" event={"ID":"a7be6858-279a-44d8-8b9e-e51f67250852","Type":"ContainerStarted","Data":"7dddb71cf42cc9acafa9cbe15606c558758f543bf35bf7654befc9c0a8337072"}
Sep 09 20:52:32.109047 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:32.108619    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-749d9cbccb-dvsf2" event={"ID":"a7be6858-279a-44d8-8b9e-e51f67250852","Type":"ContainerStarted","Data":"bcfda6157965a48b445d017265404a92da04c17815415d42db373b0864238ac8"}
Sep 09 20:52:32.131003 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:32.130954    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-749d9cbccb-dvsf2" podStartSLOduration=1.983697509 podStartE2EDuration="5.130938126s" totalImagesPullingTime="3.147240617s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:52:27 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:52:32.128714737 +0000 UTC m=+316.580506265" watchObservedRunningTime="2026-09-09 20:52:32.130938126 +0000 UTC m=+316.582729671"
Sep 09 20:52:37.114810 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:37.114780    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5bcc6c5fc9-85grm"
Sep 09 20:52:42.149164 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:42.149130    2560 generic.go:356] "Generic (PLEG): container finished" podID="cb1e1737-0c2a-4380-8fdd-cebe18bf1107" containerID="d4c3de8ef7eed928855f201dab9ad06e7b3bebe2c04b68196c4e2f7978634c68" exitCode=0
Sep 09 20:52:42.149553 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:42.149169    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-rwrpr" event={"ID":"cb1e1737-0c2a-4380-8fdd-cebe18bf1107","Type":"ContainerDied","Data":"d4c3de8ef7eed928855f201dab9ad06e7b3bebe2c04b68196c4e2f7978634c68"}
Sep 09 20:52:42.149553 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:42.149487    2560 scope.go:117] "RemoveContainer" containerID="d4c3de8ef7eed928855f201dab9ad06e7b3bebe2c04b68196c4e2f7978634c68"
Sep 09 20:52:43.156688 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:43.156642    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-rwrpr" event={"ID":"cb1e1737-0c2a-4380-8fdd-cebe18bf1107","Type":"ContainerStarted","Data":"89baa1b0e0e524ed2a1441b0b9c3d7ba065f479d64d3588a7ed711145fee8963"}
Sep 09 20:52:45.756184 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:45.756139    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7cdff8874c-zhjsp" podUID="1170b545-bb37-4499-9a2f-c0d7e976854d" containerName="registry" containerID="cri-o://4bef41b0e4f08de7300c8d51070c3bd5a33c804a7db12fc62656245f1ee43b41" gracePeriod=30
Sep 09 20:52:45.992887 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:45.992862    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7cdff8874c-zhjsp"
Sep 09 20:52:46.095109 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:46.095073    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1170b545-bb37-4499-9a2f-c0d7e976854d-trusted-ca\") pod \"1170b545-bb37-4499-9a2f-c0d7e976854d\" (UID: \"1170b545-bb37-4499-9a2f-c0d7e976854d\") "
Sep 09 20:52:46.095109 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:46.095114    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1170b545-bb37-4499-9a2f-c0d7e976854d-registry-tls\") pod \"1170b545-bb37-4499-9a2f-c0d7e976854d\" (UID: \"1170b545-bb37-4499-9a2f-c0d7e976854d\") "
Sep 09 20:52:46.095361 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:46.095137    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cns8c\" (UniqueName: \"kubernetes.io/projected/1170b545-bb37-4499-9a2f-c0d7e976854d-kube-api-access-cns8c\") pod \"1170b545-bb37-4499-9a2f-c0d7e976854d\" (UID: \"1170b545-bb37-4499-9a2f-c0d7e976854d\") "
Sep 09 20:52:46.095361 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:46.095156    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1170b545-bb37-4499-9a2f-c0d7e976854d-registry-certificates\") pod \"1170b545-bb37-4499-9a2f-c0d7e976854d\" (UID: \"1170b545-bb37-4499-9a2f-c0d7e976854d\") "
Sep 09 20:52:46.095361 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:46.095182    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1170b545-bb37-4499-9a2f-c0d7e976854d-bound-sa-token\") pod \"1170b545-bb37-4499-9a2f-c0d7e976854d\" (UID: \"1170b545-bb37-4499-9a2f-c0d7e976854d\") "
Sep 09 20:52:46.095361 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:46.095258    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1170b545-bb37-4499-9a2f-c0d7e976854d-image-registry-private-configuration\") pod \"1170b545-bb37-4499-9a2f-c0d7e976854d\" (UID: \"1170b545-bb37-4499-9a2f-c0d7e976854d\") "
Sep 09 20:52:46.095361 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:46.095295    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1170b545-bb37-4499-9a2f-c0d7e976854d-installation-pull-secrets\") pod \"1170b545-bb37-4499-9a2f-c0d7e976854d\" (UID: \"1170b545-bb37-4499-9a2f-c0d7e976854d\") "
Sep 09 20:52:46.095361 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:46.095338    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1170b545-bb37-4499-9a2f-c0d7e976854d-ca-trust-extracted\") pod \"1170b545-bb37-4499-9a2f-c0d7e976854d\" (UID: \"1170b545-bb37-4499-9a2f-c0d7e976854d\") "
Sep 09 20:52:46.095659 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:46.095605    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1170b545-bb37-4499-9a2f-c0d7e976854d-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "1170b545-bb37-4499-9a2f-c0d7e976854d" (UID: "1170b545-bb37-4499-9a2f-c0d7e976854d"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:52:46.095659 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:46.095621    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1170b545-bb37-4499-9a2f-c0d7e976854d-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "1170b545-bb37-4499-9a2f-c0d7e976854d" (UID: "1170b545-bb37-4499-9a2f-c0d7e976854d"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:52:46.097912 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:46.097856    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1170b545-bb37-4499-9a2f-c0d7e976854d-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "1170b545-bb37-4499-9a2f-c0d7e976854d" (UID: "1170b545-bb37-4499-9a2f-c0d7e976854d"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:52:46.097912 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:46.097894    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1170b545-bb37-4499-9a2f-c0d7e976854d-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "1170b545-bb37-4499-9a2f-c0d7e976854d" (UID: "1170b545-bb37-4499-9a2f-c0d7e976854d"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:52:46.098086 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:46.097972    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1170b545-bb37-4499-9a2f-c0d7e976854d-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "1170b545-bb37-4499-9a2f-c0d7e976854d" (UID: "1170b545-bb37-4499-9a2f-c0d7e976854d"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:52:46.098086 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:46.098011    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1170b545-bb37-4499-9a2f-c0d7e976854d-kube-api-access-cns8c" (OuterVolumeSpecName: "kube-api-access-cns8c") pod "1170b545-bb37-4499-9a2f-c0d7e976854d" (UID: "1170b545-bb37-4499-9a2f-c0d7e976854d"). InnerVolumeSpecName "kube-api-access-cns8c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:52:46.098086 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:46.098048    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1170b545-bb37-4499-9a2f-c0d7e976854d-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "1170b545-bb37-4499-9a2f-c0d7e976854d" (UID: "1170b545-bb37-4499-9a2f-c0d7e976854d"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:52:46.104094 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:46.104067    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1170b545-bb37-4499-9a2f-c0d7e976854d-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "1170b545-bb37-4499-9a2f-c0d7e976854d" (UID: "1170b545-bb37-4499-9a2f-c0d7e976854d"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 20:52:46.170072 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:46.170038    2560 generic.go:356] "Generic (PLEG): container finished" podID="1170b545-bb37-4499-9a2f-c0d7e976854d" containerID="4bef41b0e4f08de7300c8d51070c3bd5a33c804a7db12fc62656245f1ee43b41" exitCode=0
Sep 09 20:52:46.170294 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:46.170086    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7cdff8874c-zhjsp"
Sep 09 20:52:46.170294 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:46.170094    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7cdff8874c-zhjsp" event={"ID":"1170b545-bb37-4499-9a2f-c0d7e976854d","Type":"ContainerDied","Data":"4bef41b0e4f08de7300c8d51070c3bd5a33c804a7db12fc62656245f1ee43b41"}
Sep 09 20:52:46.170294 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:46.170134    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7cdff8874c-zhjsp" event={"ID":"1170b545-bb37-4499-9a2f-c0d7e976854d","Type":"ContainerDied","Data":"7a90cb4d57b0e7cf4edd105d12798c90d6d65822dde085e6f13c157849d3afff"}
Sep 09 20:52:46.170294 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:46.170153    2560 scope.go:117] "RemoveContainer" containerID="4bef41b0e4f08de7300c8d51070c3bd5a33c804a7db12fc62656245f1ee43b41"
Sep 09 20:52:46.178818 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:46.178800    2560 scope.go:117] "RemoveContainer" containerID="4bef41b0e4f08de7300c8d51070c3bd5a33c804a7db12fc62656245f1ee43b41"
Sep 09 20:52:46.179125 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:52:46.179098    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4bef41b0e4f08de7300c8d51070c3bd5a33c804a7db12fc62656245f1ee43b41\": container with ID starting with 4bef41b0e4f08de7300c8d51070c3bd5a33c804a7db12fc62656245f1ee43b41 not found: ID does not exist" containerID="4bef41b0e4f08de7300c8d51070c3bd5a33c804a7db12fc62656245f1ee43b41"
Sep 09 20:52:46.179173 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:46.179136    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4bef41b0e4f08de7300c8d51070c3bd5a33c804a7db12fc62656245f1ee43b41"} err="failed to get container status \"4bef41b0e4f08de7300c8d51070c3bd5a33c804a7db12fc62656245f1ee43b41\": rpc error: code = NotFound desc = could not find container \"4bef41b0e4f08de7300c8d51070c3bd5a33c804a7db12fc62656245f1ee43b41\": container with ID starting with 4bef41b0e4f08de7300c8d51070c3bd5a33c804a7db12fc62656245f1ee43b41 not found: ID does not exist"
Sep 09 20:52:46.196698 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:46.196646    2560 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1170b545-bb37-4499-9a2f-c0d7e976854d-ca-trust-extracted\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 09 20:52:46.196698 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:46.196690    2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1170b545-bb37-4499-9a2f-c0d7e976854d-trusted-ca\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 09 20:52:46.196698 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:46.196701    2560 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1170b545-bb37-4499-9a2f-c0d7e976854d-registry-tls\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 09 20:52:46.196698 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:46.196709    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cns8c\" (UniqueName: \"kubernetes.io/projected/1170b545-bb37-4499-9a2f-c0d7e976854d-kube-api-access-cns8c\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 09 20:52:46.196999 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:46.196719    2560 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1170b545-bb37-4499-9a2f-c0d7e976854d-registry-certificates\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 09 20:52:46.196999 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:46.196728    2560 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1170b545-bb37-4499-9a2f-c0d7e976854d-bound-sa-token\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 09 20:52:46.196999 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:46.196737    2560 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1170b545-bb37-4499-9a2f-c0d7e976854d-image-registry-private-configuration\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 09 20:52:46.196999 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:46.196746    2560 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1170b545-bb37-4499-9a2f-c0d7e976854d-installation-pull-secrets\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 09 20:52:46.197153 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:46.197041    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7cdff8874c-zhjsp"]
Sep 09 20:52:46.205647 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:46.205619    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7cdff8874c-zhjsp"]
Sep 09 20:52:48.047283 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:48.047244    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1170b545-bb37-4499-9a2f-c0d7e976854d" path="/var/lib/kubelet/pods/1170b545-bb37-4499-9a2f-c0d7e976854d/volumes"
Sep 09 20:52:53.200581 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:53.200548    2560 generic.go:356] "Generic (PLEG): container finished" podID="513f5747-5c6e-4983-b573-1c3da7b2d8e2" containerID="3ec0869055128b35fd93b79794f39cd75f6658abad28785ed652e1a217ab33d7" exitCode=0
Sep 09 20:52:53.200967 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:53.200610    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-mnzfm" event={"ID":"513f5747-5c6e-4983-b573-1c3da7b2d8e2","Type":"ContainerDied","Data":"3ec0869055128b35fd93b79794f39cd75f6658abad28785ed652e1a217ab33d7"}
Sep 09 20:52:53.200967 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:53.200928    2560 scope.go:117] "RemoveContainer" containerID="3ec0869055128b35fd93b79794f39cd75f6658abad28785ed652e1a217ab33d7"
Sep 09 20:52:54.207894 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:52:54.207856    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-mnzfm" event={"ID":"513f5747-5c6e-4983-b573-1c3da7b2d8e2","Type":"ContainerStarted","Data":"df521f9cdcf0fe78741d4858885812b54ca75de0b4c728063a94cae90b1e29a3"}
Sep 09 20:53:29.962367 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:53:29.962307    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3794c68-57f8-4bf6-9a86-b564da84a425-metrics-certs\") pod \"network-metrics-daemon-48bqr\" (UID: \"e3794c68-57f8-4bf6-9a86-b564da84a425\") " pod="openshift-multus/network-metrics-daemon-48bqr"
Sep 09 20:53:29.964611 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:53:29.964590    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3794c68-57f8-4bf6-9a86-b564da84a425-metrics-certs\") pod \"network-metrics-daemon-48bqr\" (UID: \"e3794c68-57f8-4bf6-9a86-b564da84a425\") " pod="openshift-multus/network-metrics-daemon-48bqr"
Sep 09 20:53:30.044814 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:53:30.044786    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-slrrp\""
Sep 09 20:53:30.053125 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:53:30.053037    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-48bqr"
Sep 09 20:53:30.324924 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:53:30.324896    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-48bqr"]
Sep 09 20:53:30.327337 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:53:30.327305    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3794c68_57f8_4bf6_9a86_b564da84a425.slice/crio-77994598c17eb80c0fe845900047451a865239923b78d4b121068aeeeb732c39 WatchSource:0}: Error finding container 77994598c17eb80c0fe845900047451a865239923b78d4b121068aeeeb732c39: Status 404 returned error can't find the container with id 77994598c17eb80c0fe845900047451a865239923b78d4b121068aeeeb732c39
Sep 09 20:53:30.351266 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:53:30.351232    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-48bqr" event={"ID":"e3794c68-57f8-4bf6-9a86-b564da84a425","Type":"ContainerStarted","Data":"77994598c17eb80c0fe845900047451a865239923b78d4b121068aeeeb732c39"}
Sep 09 20:53:31.359688 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:53:31.359639    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-48bqr" event={"ID":"e3794c68-57f8-4bf6-9a86-b564da84a425","Type":"ContainerStarted","Data":"e142e2ac0037264c34ae2997114904da083094c9bf821eaca3168a21d242d03d"}
Sep 09 20:53:31.360077 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:53:31.359704    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-48bqr" event={"ID":"e3794c68-57f8-4bf6-9a86-b564da84a425","Type":"ContainerStarted","Data":"c02767d0b23219768148f119e93d98ce7e097214a50dca1985a90ee16f5cba8a"}
Sep 09 20:53:31.377375 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:53:31.377327    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-48bqr" podStartSLOduration=374.55429782 podStartE2EDuration="6m15.377310707s" totalImagesPullingTime="823.012887ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:47:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:53:31.376328768 +0000 UTC m=+375.828120295" watchObservedRunningTime="2026-09-09 20:53:31.377310707 +0000 UTC m=+375.829102235"
Sep 09 20:55:33.770710 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:55:33.770662    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-2bc29"]
Sep 09 20:55:33.774689 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:55:33.771586    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1170b545-bb37-4499-9a2f-c0d7e976854d" containerName="registry"
Sep 09 20:55:33.774689 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:55:33.771619    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="1170b545-bb37-4499-9a2f-c0d7e976854d" containerName="registry"
Sep 09 20:55:33.774689 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:55:33.771834    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="1170b545-bb37-4499-9a2f-c0d7e976854d" containerName="registry"
Sep 09 20:55:33.776662 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:55:33.776638    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-2bc29"
Sep 09 20:55:33.779587 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:55:33.779566    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 09 20:55:33.779885 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:55:33.779869    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 09 20:55:33.788233 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:55:33.788205    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-2bc29"]
Sep 09 20:55:33.899404 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:55:33.899365    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9d7d638c-c38e-4e1e-b818-4dd4d23a7c28-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-2bc29\" (UID: \"9d7d638c-c38e-4e1e-b818-4dd4d23a7c28\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2bc29"
Sep 09 20:55:33.899581 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:55:33.899434    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jkr9r\" (UniqueName: \"kubernetes.io/projected/9d7d638c-c38e-4e1e-b818-4dd4d23a7c28-kube-api-access-jkr9r\") pod \"cert-manager-webhook-6486ffd997-2bc29\" (UID: \"9d7d638c-c38e-4e1e-b818-4dd4d23a7c28\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2bc29"
Sep 09 20:55:34.000243 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:55:34.000197    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jkr9r\" (UniqueName: \"kubernetes.io/projected/9d7d638c-c38e-4e1e-b818-4dd4d23a7c28-kube-api-access-jkr9r\") pod \"cert-manager-webhook-6486ffd997-2bc29\" (UID: \"9d7d638c-c38e-4e1e-b818-4dd4d23a7c28\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2bc29"
Sep 09 20:55:34.000417 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:55:34.000348    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9d7d638c-c38e-4e1e-b818-4dd4d23a7c28-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-2bc29\" (UID: \"9d7d638c-c38e-4e1e-b818-4dd4d23a7c28\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2bc29"
Sep 09 20:55:34.020702 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:55:34.020650    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jkr9r\" (UniqueName: \"kubernetes.io/projected/9d7d638c-c38e-4e1e-b818-4dd4d23a7c28-kube-api-access-jkr9r\") pod \"cert-manager-webhook-6486ffd997-2bc29\" (UID: \"9d7d638c-c38e-4e1e-b818-4dd4d23a7c28\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2bc29"
Sep 09 20:55:34.023542 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:55:34.023478    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9d7d638c-c38e-4e1e-b818-4dd4d23a7c28-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-2bc29\" (UID: \"9d7d638c-c38e-4e1e-b818-4dd4d23a7c28\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2bc29"
Sep 09 20:55:34.100494 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:55:34.100452    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-2bc29"
Sep 09 20:55:34.376370 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:55:34.376344    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-2bc29"]
Sep 09 20:55:34.378537 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:55:34.378508    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9d7d638c_c38e_4e1e_b818_4dd4d23a7c28.slice/crio-5ad04985ff9eac53d8cfca837772761fdba82a329ee4e1db9ad85a4bb760022b WatchSource:0}: Error finding container 5ad04985ff9eac53d8cfca837772761fdba82a329ee4e1db9ad85a4bb760022b: Status 404 returned error can't find the container with id 5ad04985ff9eac53d8cfca837772761fdba82a329ee4e1db9ad85a4bb760022b
Sep 09 20:55:34.844251 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:55:34.844211    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-2bc29" event={"ID":"9d7d638c-c38e-4e1e-b818-4dd4d23a7c28","Type":"ContainerStarted","Data":"5ad04985ff9eac53d8cfca837772761fdba82a329ee4e1db9ad85a4bb760022b"}
Sep 09 20:55:37.269934 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:55:37.269899    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-jrtlg"]
Sep 09 20:55:37.272624 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:55:37.272604    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-jrtlg"
Sep 09 20:55:37.275254 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:55:37.275232    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-fdpqb\""
Sep 09 20:55:37.286903 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:55:37.286873    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-jrtlg"]
Sep 09 20:55:37.433029 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:55:37.433005    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7658\" (UniqueName: \"kubernetes.io/projected/ae874177-2ca7-4a32-96fc-69de73edd343-kube-api-access-k7658\") pod \"cert-manager-cainjector-559cdd8c87-jrtlg\" (UID: \"ae874177-2ca7-4a32-96fc-69de73edd343\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-jrtlg"
Sep 09 20:55:37.433123 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:55:37.433062    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ae874177-2ca7-4a32-96fc-69de73edd343-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-jrtlg\" (UID: \"ae874177-2ca7-4a32-96fc-69de73edd343\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-jrtlg"
Sep 09 20:55:37.534540 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:55:37.534454    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ae874177-2ca7-4a32-96fc-69de73edd343-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-jrtlg\" (UID: \"ae874177-2ca7-4a32-96fc-69de73edd343\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-jrtlg"
Sep 09 20:55:37.534540 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:55:37.534516    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7658\" (UniqueName: \"kubernetes.io/projected/ae874177-2ca7-4a32-96fc-69de73edd343-kube-api-access-k7658\") pod \"cert-manager-cainjector-559cdd8c87-jrtlg\" (UID: \"ae874177-2ca7-4a32-96fc-69de73edd343\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-jrtlg"
Sep 09 20:55:37.546653 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:55:37.546619    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ae874177-2ca7-4a32-96fc-69de73edd343-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-jrtlg\" (UID: \"ae874177-2ca7-4a32-96fc-69de73edd343\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-jrtlg"
Sep 09 20:55:37.547254 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:55:37.547235    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7658\" (UniqueName: \"kubernetes.io/projected/ae874177-2ca7-4a32-96fc-69de73edd343-kube-api-access-k7658\") pod \"cert-manager-cainjector-559cdd8c87-jrtlg\" (UID: \"ae874177-2ca7-4a32-96fc-69de73edd343\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-jrtlg"
Sep 09 20:55:37.584137 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:55:37.584107    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-jrtlg"
Sep 09 20:55:37.852162 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:55:37.852137    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-jrtlg"]
Sep 09 20:55:37.854572 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:55:37.854546    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podae874177_2ca7_4a32_96fc_69de73edd343.slice/crio-de3698e8543d6747add87de7ae4749834c07341299349cdf07c21750c0e5afae WatchSource:0}: Error finding container de3698e8543d6747add87de7ae4749834c07341299349cdf07c21750c0e5afae: Status 404 returned error can't find the container with id de3698e8543d6747add87de7ae4749834c07341299349cdf07c21750c0e5afae
Sep 09 20:55:37.859190 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:55:37.859169    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-2bc29" event={"ID":"9d7d638c-c38e-4e1e-b818-4dd4d23a7c28","Type":"ContainerStarted","Data":"30d558b2fa02013ad78b1015f3f0d356074e4ebf6ed7c4daed681b876dd17b20"}
Sep 09 20:55:37.861096 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:55:37.861064    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-2bc29"
Sep 09 20:55:37.876015 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:55:37.875976    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-2bc29" podStartSLOduration=1.8819030410000002 podStartE2EDuration="4.875960727s" totalImagesPullingTime="2.994057686s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:55:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:55:37.875367998 +0000 UTC m=+502.327159521" watchObservedRunningTime="2026-09-09 20:55:37.875960727 +0000 UTC m=+502.327752255"
Sep 09 20:55:38.865177 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:55:38.865133    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-jrtlg" event={"ID":"ae874177-2ca7-4a32-96fc-69de73edd343","Type":"ContainerStarted","Data":"b243718576db7d5d82e26b715d1dc434dbfa06a30dd44ac40e3c60d538fad50e"}
Sep 09 20:55:38.865177 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:55:38.865182    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-jrtlg" event={"ID":"ae874177-2ca7-4a32-96fc-69de73edd343","Type":"ContainerStarted","Data":"de3698e8543d6747add87de7ae4749834c07341299349cdf07c21750c0e5afae"}
Sep 09 20:55:38.882988 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:55:38.882937    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-jrtlg" podStartSLOduration=1.8829223929999999 podStartE2EDuration="1.882922393s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:55:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:55:38.882320275 +0000 UTC m=+503.334111794" watchObservedRunningTime="2026-09-09 20:55:38.882922393 +0000 UTC m=+503.334713920"
Sep 09 20:55:43.867270 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:55:43.867234    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-2bc29"
Sep 09 20:56:08.376575 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:08.376493    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-97cf5684c-pfzjz"]
Sep 09 20:56:08.379961 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:08.379944    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-97cf5684c-pfzjz"
Sep 09 20:56:08.385162 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:08.385135    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 09 20:56:08.385272 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:08.385185    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 09 20:56:08.385272 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:08.385235    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 09 20:56:08.385389 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:08.385366    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-69dvb\""
Sep 09 20:56:08.386303 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:08.386287    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 09 20:56:08.479875 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:08.479844    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-97cf5684c-pfzjz"]
Sep 09 20:56:08.487820 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:08.487791    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ccfdd141-601a-43f3-b25a-2e9fb368f262-tmp\") pod \"opendatahub-operator-controller-manager-97cf5684c-pfzjz\" (UID: \"ccfdd141-601a-43f3-b25a-2e9fb368f262\") " pod="opendatahub/opendatahub-operator-controller-manager-97cf5684c-pfzjz"
Sep 09 20:56:08.487960 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:08.487827    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ccfdd141-601a-43f3-b25a-2e9fb368f262-webhook-cert\") pod \"opendatahub-operator-controller-manager-97cf5684c-pfzjz\" (UID: \"ccfdd141-601a-43f3-b25a-2e9fb368f262\") " pod="opendatahub/opendatahub-operator-controller-manager-97cf5684c-pfzjz"
Sep 09 20:56:08.487960 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:08.487854    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l89dt\" (UniqueName: \"kubernetes.io/projected/ccfdd141-601a-43f3-b25a-2e9fb368f262-kube-api-access-l89dt\") pod \"opendatahub-operator-controller-manager-97cf5684c-pfzjz\" (UID: \"ccfdd141-601a-43f3-b25a-2e9fb368f262\") " pod="opendatahub/opendatahub-operator-controller-manager-97cf5684c-pfzjz"
Sep 09 20:56:08.487960 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:08.487940    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ccfdd141-601a-43f3-b25a-2e9fb368f262-manifests\") pod \"opendatahub-operator-controller-manager-97cf5684c-pfzjz\" (UID: \"ccfdd141-601a-43f3-b25a-2e9fb368f262\") " pod="opendatahub/opendatahub-operator-controller-manager-97cf5684c-pfzjz"
Sep 09 20:56:08.488063 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:08.487988    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ccfdd141-601a-43f3-b25a-2e9fb368f262-apiservice-cert\") pod \"opendatahub-operator-controller-manager-97cf5684c-pfzjz\" (UID: \"ccfdd141-601a-43f3-b25a-2e9fb368f262\") " pod="opendatahub/opendatahub-operator-controller-manager-97cf5684c-pfzjz"
Sep 09 20:56:08.588579 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:08.588543    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l89dt\" (UniqueName: \"kubernetes.io/projected/ccfdd141-601a-43f3-b25a-2e9fb368f262-kube-api-access-l89dt\") pod \"opendatahub-operator-controller-manager-97cf5684c-pfzjz\" (UID: \"ccfdd141-601a-43f3-b25a-2e9fb368f262\") " pod="opendatahub/opendatahub-operator-controller-manager-97cf5684c-pfzjz"
Sep 09 20:56:08.588766 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:08.588603    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ccfdd141-601a-43f3-b25a-2e9fb368f262-manifests\") pod \"opendatahub-operator-controller-manager-97cf5684c-pfzjz\" (UID: \"ccfdd141-601a-43f3-b25a-2e9fb368f262\") " pod="opendatahub/opendatahub-operator-controller-manager-97cf5684c-pfzjz"
Sep 09 20:56:08.588766 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:08.588640    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ccfdd141-601a-43f3-b25a-2e9fb368f262-apiservice-cert\") pod \"opendatahub-operator-controller-manager-97cf5684c-pfzjz\" (UID: \"ccfdd141-601a-43f3-b25a-2e9fb368f262\") " pod="opendatahub/opendatahub-operator-controller-manager-97cf5684c-pfzjz"
Sep 09 20:56:08.588766 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:08.588707    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ccfdd141-601a-43f3-b25a-2e9fb368f262-tmp\") pod \"opendatahub-operator-controller-manager-97cf5684c-pfzjz\" (UID: \"ccfdd141-601a-43f3-b25a-2e9fb368f262\") " pod="opendatahub/opendatahub-operator-controller-manager-97cf5684c-pfzjz"
Sep 09 20:56:08.588766 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:08.588736    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ccfdd141-601a-43f3-b25a-2e9fb368f262-webhook-cert\") pod \"opendatahub-operator-controller-manager-97cf5684c-pfzjz\" (UID: \"ccfdd141-601a-43f3-b25a-2e9fb368f262\") " pod="opendatahub/opendatahub-operator-controller-manager-97cf5684c-pfzjz"
Sep 09 20:56:08.589037 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:08.589016    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ccfdd141-601a-43f3-b25a-2e9fb368f262-manifests\") pod \"opendatahub-operator-controller-manager-97cf5684c-pfzjz\" (UID: \"ccfdd141-601a-43f3-b25a-2e9fb368f262\") " pod="opendatahub/opendatahub-operator-controller-manager-97cf5684c-pfzjz"
Sep 09 20:56:08.591114 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:08.591081    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ccfdd141-601a-43f3-b25a-2e9fb368f262-tmp\") pod \"opendatahub-operator-controller-manager-97cf5684c-pfzjz\" (UID: \"ccfdd141-601a-43f3-b25a-2e9fb368f262\") " pod="opendatahub/opendatahub-operator-controller-manager-97cf5684c-pfzjz"
Sep 09 20:56:08.591242 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:08.591153    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ccfdd141-601a-43f3-b25a-2e9fb368f262-apiservice-cert\") pod \"opendatahub-operator-controller-manager-97cf5684c-pfzjz\" (UID: \"ccfdd141-601a-43f3-b25a-2e9fb368f262\") " pod="opendatahub/opendatahub-operator-controller-manager-97cf5684c-pfzjz"
Sep 09 20:56:08.591242 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:08.591180    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ccfdd141-601a-43f3-b25a-2e9fb368f262-webhook-cert\") pod \"opendatahub-operator-controller-manager-97cf5684c-pfzjz\" (UID: \"ccfdd141-601a-43f3-b25a-2e9fb368f262\") " pod="opendatahub/opendatahub-operator-controller-manager-97cf5684c-pfzjz"
Sep 09 20:56:08.597433 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:08.597412    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l89dt\" (UniqueName: \"kubernetes.io/projected/ccfdd141-601a-43f3-b25a-2e9fb368f262-kube-api-access-l89dt\") pod \"opendatahub-operator-controller-manager-97cf5684c-pfzjz\" (UID: \"ccfdd141-601a-43f3-b25a-2e9fb368f262\") " pod="opendatahub/opendatahub-operator-controller-manager-97cf5684c-pfzjz"
Sep 09 20:56:08.690590 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:08.690501    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-97cf5684c-pfzjz"
Sep 09 20:56:08.966011 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:08.965936    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-97cf5684c-pfzjz"]
Sep 09 20:56:08.969049 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:56:08.969022    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccfdd141_601a_43f3_b25a_2e9fb368f262.slice/crio-fe8b98253cebeefd2d49e6b2afcce135ea8995a8927a053526585b886c79e3b6 WatchSource:0}: Error finding container fe8b98253cebeefd2d49e6b2afcce135ea8995a8927a053526585b886c79e3b6: Status 404 returned error can't find the container with id fe8b98253cebeefd2d49e6b2afcce135ea8995a8927a053526585b886c79e3b6
Sep 09 20:56:08.990415 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:08.990381    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-97cf5684c-pfzjz" event={"ID":"ccfdd141-601a-43f3-b25a-2e9fb368f262","Type":"ContainerStarted","Data":"fe8b98253cebeefd2d49e6b2afcce135ea8995a8927a053526585b886c79e3b6"}
Sep 09 20:56:13.013759 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:13.013722    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-97cf5684c-pfzjz" event={"ID":"ccfdd141-601a-43f3-b25a-2e9fb368f262","Type":"ContainerStarted","Data":"8e4f32ee50d65b50d768a2aa59f5029282179285113c7c8df2198c9ec818e732"}
Sep 09 20:56:14.019746 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:14.019707    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-97cf5684c-pfzjz" event={"ID":"ccfdd141-601a-43f3-b25a-2e9fb368f262","Type":"ContainerDied","Data":"8e4f32ee50d65b50d768a2aa59f5029282179285113c7c8df2198c9ec818e732"}
Sep 09 20:56:14.019746 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:14.019665    2560 generic.go:356] "Generic (PLEG): container finished" podID="ccfdd141-601a-43f3-b25a-2e9fb368f262" containerID="8e4f32ee50d65b50d768a2aa59f5029282179285113c7c8df2198c9ec818e732" exitCode=0
Sep 09 20:56:15.031850 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:15.031816    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-97cf5684c-pfzjz" event={"ID":"ccfdd141-601a-43f3-b25a-2e9fb368f262","Type":"ContainerStarted","Data":"8f588388bc49087ae76bbb9e0ecf043c089dd4bde39b78779b8d093eccf7fade"}
Sep 09 20:56:15.032250 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:15.032068    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-97cf5684c-pfzjz"
Sep 09 20:56:15.054384 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:15.054342    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-97cf5684c-pfzjz" podStartSLOduration=2.44587309 podStartE2EDuration="7.054322416s" totalImagesPullingTime="3.575133943s" totalInitContainerRuntime="1.033315383s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:56:08 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:56:15.052189678 +0000 UTC m=+539.503981206" watchObservedRunningTime="2026-09-09 20:56:15.054322416 +0000 UTC m=+539.506113943"
Sep 09 20:56:26.038271 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:26.038232    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-97cf5684c-pfzjz"
Sep 09 20:56:28.781486 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:28.781447    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7c789b6945-tvsmn"]
Sep 09 20:56:28.789984 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:28.789957    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7c789b6945-tvsmn"
Sep 09 20:56:28.795544 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:28.795524    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 09 20:56:28.796757 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:28.796730    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 09 20:56:28.796849 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:28.796757    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 09 20:56:28.796849 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:28.796772    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 09 20:56:28.835004 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:28.834981    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7c789b6945-tvsmn"]
Sep 09 20:56:28.961296 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:28.961266    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2d361c83-2db9-41f9-b1ae-2be0350ec754-tls-certs\") pod \"kube-auth-proxy-7c789b6945-tvsmn\" (UID: \"2d361c83-2db9-41f9-b1ae-2be0350ec754\") " pod="openshift-ingress/kube-auth-proxy-7c789b6945-tvsmn"
Sep 09 20:56:28.961464 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:28.961318    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svndk\" (UniqueName: \"kubernetes.io/projected/2d361c83-2db9-41f9-b1ae-2be0350ec754-kube-api-access-svndk\") pod \"kube-auth-proxy-7c789b6945-tvsmn\" (UID: \"2d361c83-2db9-41f9-b1ae-2be0350ec754\") " pod="openshift-ingress/kube-auth-proxy-7c789b6945-tvsmn"
Sep 09 20:56:28.961464 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:28.961401    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2d361c83-2db9-41f9-b1ae-2be0350ec754-tmp\") pod \"kube-auth-proxy-7c789b6945-tvsmn\" (UID: \"2d361c83-2db9-41f9-b1ae-2be0350ec754\") " pod="openshift-ingress/kube-auth-proxy-7c789b6945-tvsmn"
Sep 09 20:56:29.062288 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:29.062257    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2d361c83-2db9-41f9-b1ae-2be0350ec754-tmp\") pod \"kube-auth-proxy-7c789b6945-tvsmn\" (UID: \"2d361c83-2db9-41f9-b1ae-2be0350ec754\") " pod="openshift-ingress/kube-auth-proxy-7c789b6945-tvsmn"
Sep 09 20:56:29.062435 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:29.062310    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2d361c83-2db9-41f9-b1ae-2be0350ec754-tls-certs\") pod \"kube-auth-proxy-7c789b6945-tvsmn\" (UID: \"2d361c83-2db9-41f9-b1ae-2be0350ec754\") " pod="openshift-ingress/kube-auth-proxy-7c789b6945-tvsmn"
Sep 09 20:56:29.062435 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:29.062346    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svndk\" (UniqueName: \"kubernetes.io/projected/2d361c83-2db9-41f9-b1ae-2be0350ec754-kube-api-access-svndk\") pod \"kube-auth-proxy-7c789b6945-tvsmn\" (UID: \"2d361c83-2db9-41f9-b1ae-2be0350ec754\") " pod="openshift-ingress/kube-auth-proxy-7c789b6945-tvsmn"
Sep 09 20:56:29.064451 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:29.064421    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2d361c83-2db9-41f9-b1ae-2be0350ec754-tmp\") pod \"kube-auth-proxy-7c789b6945-tvsmn\" (UID: \"2d361c83-2db9-41f9-b1ae-2be0350ec754\") " pod="openshift-ingress/kube-auth-proxy-7c789b6945-tvsmn"
Sep 09 20:56:29.064724 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:29.064706    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2d361c83-2db9-41f9-b1ae-2be0350ec754-tls-certs\") pod \"kube-auth-proxy-7c789b6945-tvsmn\" (UID: \"2d361c83-2db9-41f9-b1ae-2be0350ec754\") " pod="openshift-ingress/kube-auth-proxy-7c789b6945-tvsmn"
Sep 09 20:56:29.099705 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:29.099653    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-svndk\" (UniqueName: \"kubernetes.io/projected/2d361c83-2db9-41f9-b1ae-2be0350ec754-kube-api-access-svndk\") pod \"kube-auth-proxy-7c789b6945-tvsmn\" (UID: \"2d361c83-2db9-41f9-b1ae-2be0350ec754\") " pod="openshift-ingress/kube-auth-proxy-7c789b6945-tvsmn"
Sep 09 20:56:29.399887 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:29.399809    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7c789b6945-tvsmn"
Sep 09 20:56:29.673072 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:29.672977    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7c789b6945-tvsmn"]
Sep 09 20:56:29.675907 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:56:29.675873    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d361c83_2db9_41f9_b1ae_2be0350ec754.slice/crio-014029bb96973718435cf22131b5356ea120dc75a2a5b5a96465225c3e8353a3 WatchSource:0}: Error finding container 014029bb96973718435cf22131b5356ea120dc75a2a5b5a96465225c3e8353a3: Status 404 returned error can't find the container with id 014029bb96973718435cf22131b5356ea120dc75a2a5b5a96465225c3e8353a3
Sep 09 20:56:30.098495 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:30.098460    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7c789b6945-tvsmn" event={"ID":"2d361c83-2db9-41f9-b1ae-2be0350ec754","Type":"ContainerStarted","Data":"014029bb96973718435cf22131b5356ea120dc75a2a5b5a96465225c3e8353a3"}
Sep 09 20:56:33.116010 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:33.115973    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7c789b6945-tvsmn" event={"ID":"2d361c83-2db9-41f9-b1ae-2be0350ec754","Type":"ContainerStarted","Data":"aac91ac6ebd8f5d9e2b4ebf2a96baa87b9aaaf11b1197daba61c1a0bcd8b48eb"}
Sep 09 20:56:33.133629 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:33.133579    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7c789b6945-tvsmn" podStartSLOduration=2.312075437 podStartE2EDuration="5.133565066s" totalImagesPullingTime="2.821489629s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:56:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:56:33.131806812 +0000 UTC m=+557.583598341" watchObservedRunningTime="2026-09-09 20:56:33.133565066 +0000 UTC m=+557.585356612"
Sep 09 20:56:35.447438 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:35.447400    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bct7lck"]
Sep 09 20:56:35.450847 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:35.450827    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bct7lck"
Sep 09 20:56:35.453105 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:35.453084    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 09 20:56:35.453105 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:35.453098    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-bc4fn\""
Sep 09 20:56:35.464811 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:35.464784    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bct7lck"]
Sep 09 20:56:35.502172 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:35.502145    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xmj7p"]
Sep 09 20:56:35.505299 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:35.505284    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xmj7p"
Sep 09 20:56:35.518975 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:35.518955    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xmj7p"]
Sep 09 20:56:35.611689 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:35.611631    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/109a883d-bde2-4d4b-ac9a-736ccb3a4daa-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xmj7p\" (UID: \"109a883d-bde2-4d4b-ac9a-736ccb3a4daa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xmj7p"
Sep 09 20:56:35.611689 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:35.611694    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/302eae5a-1394-49dc-bf95-b1377b3e02a5-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bct7lck\" (UID: \"302eae5a-1394-49dc-bf95-b1377b3e02a5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bct7lck"
Sep 09 20:56:35.611878 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:35.611728    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/109a883d-bde2-4d4b-ac9a-736ccb3a4daa-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xmj7p\" (UID: \"109a883d-bde2-4d4b-ac9a-736ccb3a4daa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xmj7p"
Sep 09 20:56:35.611878 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:35.611749    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jp599\" (UniqueName: \"kubernetes.io/projected/109a883d-bde2-4d4b-ac9a-736ccb3a4daa-kube-api-access-jp599\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xmj7p\" (UID: \"109a883d-bde2-4d4b-ac9a-736ccb3a4daa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xmj7p"
Sep 09 20:56:35.611878 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:35.611766    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/302eae5a-1394-49dc-bf95-b1377b3e02a5-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bct7lck\" (UID: \"302eae5a-1394-49dc-bf95-b1377b3e02a5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bct7lck"
Sep 09 20:56:35.611878 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:35.611840    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/109a883d-bde2-4d4b-ac9a-736ccb3a4daa-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xmj7p\" (UID: \"109a883d-bde2-4d4b-ac9a-736ccb3a4daa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xmj7p"
Sep 09 20:56:35.612003 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:35.611879    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/302eae5a-1394-49dc-bf95-b1377b3e02a5-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bct7lck\" (UID: \"302eae5a-1394-49dc-bf95-b1377b3e02a5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bct7lck"
Sep 09 20:56:35.612003 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:35.611903    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/109a883d-bde2-4d4b-ac9a-736ccb3a4daa-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xmj7p\" (UID: \"109a883d-bde2-4d4b-ac9a-736ccb3a4daa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xmj7p"
Sep 09 20:56:35.612003 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:35.611920    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/302eae5a-1394-49dc-bf95-b1377b3e02a5-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bct7lck\" (UID: \"302eae5a-1394-49dc-bf95-b1377b3e02a5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bct7lck"
Sep 09 20:56:35.612003 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:35.611953    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/109a883d-bde2-4d4b-ac9a-736ccb3a4daa-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xmj7p\" (UID: \"109a883d-bde2-4d4b-ac9a-736ccb3a4daa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xmj7p"
Sep 09 20:56:35.612003 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:35.611971    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/302eae5a-1394-49dc-bf95-b1377b3e02a5-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bct7lck\" (UID: \"302eae5a-1394-49dc-bf95-b1377b3e02a5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bct7lck"
Sep 09 20:56:35.612003 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:35.611990    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/109a883d-bde2-4d4b-ac9a-736ccb3a4daa-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xmj7p\" (UID: \"109a883d-bde2-4d4b-ac9a-736ccb3a4daa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xmj7p"
Sep 09 20:56:35.612003 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:35.612003    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/302eae5a-1394-49dc-bf95-b1377b3e02a5-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bct7lck\" (UID: \"302eae5a-1394-49dc-bf95-b1377b3e02a5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bct7lck"
Sep 09 20:56:35.612223 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:35.612026    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/302eae5a-1394-49dc-bf95-b1377b3e02a5-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bct7lck\" (UID: \"302eae5a-1394-49dc-bf95-b1377b3e02a5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bct7lck"
Sep 09 20:56:35.612223 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:35.612043    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/109a883d-bde2-4d4b-ac9a-736ccb3a4daa-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xmj7p\" (UID: \"109a883d-bde2-4d4b-ac9a-736ccb3a4daa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xmj7p"
Sep 09 20:56:35.612223 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:35.612096    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/302eae5a-1394-49dc-bf95-b1377b3e02a5-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bct7lck\" (UID: \"302eae5a-1394-49dc-bf95-b1377b3e02a5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bct7lck"
Sep 09 20:56:35.612223 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:35.612131    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcqv7\" (UniqueName: \"kubernetes.io/projected/302eae5a-1394-49dc-bf95-b1377b3e02a5-kube-api-access-gcqv7\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bct7lck\" (UID: \"302eae5a-1394-49dc-bf95-b1377b3e02a5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bct7lck"
Sep 09 20:56:35.612223 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:35.612150    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/109a883d-bde2-4d4b-ac9a-736ccb3a4daa-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xmj7p\" (UID: \"109a883d-bde2-4d4b-ac9a-736ccb3a4daa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xmj7p"
Sep 09 20:56:35.713106 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:35.713032    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/109a883d-bde2-4d4b-ac9a-736ccb3a4daa-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xmj7p\" (UID: \"109a883d-bde2-4d4b-ac9a-736ccb3a4daa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xmj7p"
Sep 09 20:56:35.713106 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:35.713066    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jp599\" (UniqueName: \"kubernetes.io/projected/109a883d-bde2-4d4b-ac9a-736ccb3a4daa-kube-api-access-jp599\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xmj7p\" (UID: \"109a883d-bde2-4d4b-ac9a-736ccb3a4daa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xmj7p"
Sep 09 20:56:35.713106 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:35.713090    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/302eae5a-1394-49dc-bf95-b1377b3e02a5-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bct7lck\" (UID: \"302eae5a-1394-49dc-bf95-b1377b3e02a5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bct7lck"
Sep 09 20:56:35.713357 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:35.713127    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/109a883d-bde2-4d4b-ac9a-736ccb3a4daa-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xmj7p\" (UID: \"109a883d-bde2-4d4b-ac9a-736ccb3a4daa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xmj7p"
Sep 09 20:56:35.713357 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:35.713150    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/302eae5a-1394-49dc-bf95-b1377b3e02a5-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bct7lck\" (UID: \"302eae5a-1394-49dc-bf95-b1377b3e02a5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bct7lck"
Sep 09 20:56:35.713357 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:35.713180    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/109a883d-bde2-4d4b-ac9a-736ccb3a4daa-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xmj7p\" (UID: \"109a883d-bde2-4d4b-ac9a-736ccb3a4daa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xmj7p"
Sep 09 20:56:35.713357 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:35.713317    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/302eae5a-1394-49dc-bf95-b1377b3e02a5-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bct7lck\" (UID: \"302eae5a-1394-49dc-bf95-b1377b3e02a5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bct7lck"
Sep 09 20:56:35.713570 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:35.713362    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/109a883d-bde2-4d4b-ac9a-736ccb3a4daa-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xmj7p\" (UID: \"109a883d-bde2-4d4b-ac9a-736ccb3a4daa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xmj7p"
Sep 09 20:56:35.713570 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:35.713380    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/302eae5a-1394-49dc-bf95-b1377b3e02a5-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bct7lck\" (UID: \"302eae5a-1394-49dc-bf95-b1377b3e02a5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bct7lck"
Sep 09 20:56:35.713570 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:35.713405    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/109a883d-bde2-4d4b-ac9a-736ccb3a4daa-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xmj7p\" (UID: \"109a883d-bde2-4d4b-ac9a-736ccb3a4daa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xmj7p"
Sep 09 20:56:35.713570 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:35.713447    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/302eae5a-1394-49dc-bf95-b1377b3e02a5-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bct7lck\" (UID: \"302eae5a-1394-49dc-bf95-b1377b3e02a5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bct7lck"
Sep 09 20:56:35.713570 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:35.713450    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/109a883d-bde2-4d4b-ac9a-736ccb3a4daa-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xmj7p\" (UID: \"109a883d-bde2-4d4b-ac9a-736ccb3a4daa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xmj7p"
Sep 09 20:56:35.713570 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:35.713480    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/302eae5a-1394-49dc-bf95-b1377b3e02a5-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bct7lck\" (UID: \"302eae5a-1394-49dc-bf95-b1377b3e02a5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bct7lck"
Sep 09 20:56:35.713570 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:35.713508    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/109a883d-bde2-4d4b-ac9a-736ccb3a4daa-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xmj7p\" (UID: \"109a883d-bde2-4d4b-ac9a-736ccb3a4daa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xmj7p"
Sep 09 20:56:35.713570 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:35.713522    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/302eae5a-1394-49dc-bf95-b1377b3e02a5-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bct7lck\" (UID: \"302eae5a-1394-49dc-bf95-b1377b3e02a5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bct7lck"
Sep 09 20:56:35.713570 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:35.713554    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/302eae5a-1394-49dc-bf95-b1377b3e02a5-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bct7lck\" (UID: \"302eae5a-1394-49dc-bf95-b1377b3e02a5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bct7lck"
Sep 09 20:56:35.713570 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:35.713546    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/109a883d-bde2-4d4b-ac9a-736ccb3a4daa-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xmj7p\" (UID: \"109a883d-bde2-4d4b-ac9a-736ccb3a4daa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xmj7p"
Sep 09 20:56:35.714109 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:35.713583    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcqv7\" (UniqueName: \"kubernetes.io/projected/302eae5a-1394-49dc-bf95-b1377b3e02a5-kube-api-access-gcqv7\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bct7lck\" (UID: \"302eae5a-1394-49dc-bf95-b1377b3e02a5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bct7lck"
Sep 09 20:56:35.714109 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:35.713587    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/109a883d-bde2-4d4b-ac9a-736ccb3a4daa-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xmj7p\" (UID: \"109a883d-bde2-4d4b-ac9a-736ccb3a4daa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xmj7p"
Sep 09 20:56:35.714109 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:35.713630    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/109a883d-bde2-4d4b-ac9a-736ccb3a4daa-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xmj7p\" (UID: \"109a883d-bde2-4d4b-ac9a-736ccb3a4daa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xmj7p"
Sep 09 20:56:35.714109 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:35.713948    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/302eae5a-1394-49dc-bf95-b1377b3e02a5-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bct7lck\" (UID: \"302eae5a-1394-49dc-bf95-b1377b3e02a5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bct7lck"
Sep 09 20:56:35.714361 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:35.714112    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/302eae5a-1394-49dc-bf95-b1377b3e02a5-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bct7lck\" (UID: \"302eae5a-1394-49dc-bf95-b1377b3e02a5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bct7lck"
Sep 09 20:56:35.714361 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:35.714142    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/109a883d-bde2-4d4b-ac9a-736ccb3a4daa-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xmj7p\" (UID: \"109a883d-bde2-4d4b-ac9a-736ccb3a4daa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xmj7p"
Sep 09 20:56:35.714361 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:35.714149    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/109a883d-bde2-4d4b-ac9a-736ccb3a4daa-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xmj7p\" (UID: \"109a883d-bde2-4d4b-ac9a-736ccb3a4daa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xmj7p"
Sep 09 20:56:35.714361 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:35.714304    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/302eae5a-1394-49dc-bf95-b1377b3e02a5-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bct7lck\" (UID: \"302eae5a-1394-49dc-bf95-b1377b3e02a5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bct7lck"
Sep 09 20:56:35.714595 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:35.714576    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/302eae5a-1394-49dc-bf95-b1377b3e02a5-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bct7lck\" (UID: \"302eae5a-1394-49dc-bf95-b1377b3e02a5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bct7lck"
Sep 09 20:56:35.714656 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:35.714604    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/109a883d-bde2-4d4b-ac9a-736ccb3a4daa-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xmj7p\" (UID: \"109a883d-bde2-4d4b-ac9a-736ccb3a4daa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xmj7p"
Sep 09 20:56:35.714726 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:35.714650    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/302eae5a-1394-49dc-bf95-b1377b3e02a5-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bct7lck\" (UID: \"302eae5a-1394-49dc-bf95-b1377b3e02a5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bct7lck"
Sep 09 20:56:35.715818 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:35.715796    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/302eae5a-1394-49dc-bf95-b1377b3e02a5-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bct7lck\" (UID: \"302eae5a-1394-49dc-bf95-b1377b3e02a5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bct7lck"
Sep 09 20:56:35.716139 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:35.716110    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/109a883d-bde2-4d4b-ac9a-736ccb3a4daa-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xmj7p\" (UID: \"109a883d-bde2-4d4b-ac9a-736ccb3a4daa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xmj7p"
Sep 09 20:56:35.716218 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:35.716150    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/109a883d-bde2-4d4b-ac9a-736ccb3a4daa-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xmj7p\" (UID: \"109a883d-bde2-4d4b-ac9a-736ccb3a4daa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xmj7p"
Sep 09 20:56:35.716333 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:35.716316    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/302eae5a-1394-49dc-bf95-b1377b3e02a5-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bct7lck\" (UID: \"302eae5a-1394-49dc-bf95-b1377b3e02a5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bct7lck"
Sep 09 20:56:35.720574 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:35.720547    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jp599\" (UniqueName: \"kubernetes.io/projected/109a883d-bde2-4d4b-ac9a-736ccb3a4daa-kube-api-access-jp599\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xmj7p\" (UID: \"109a883d-bde2-4d4b-ac9a-736ccb3a4daa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xmj7p"
Sep 09 20:56:35.721137 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:35.721116    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcqv7\" (UniqueName: \"kubernetes.io/projected/302eae5a-1394-49dc-bf95-b1377b3e02a5-kube-api-access-gcqv7\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bct7lck\" (UID: \"302eae5a-1394-49dc-bf95-b1377b3e02a5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bct7lck"
Sep 09 20:56:35.721806 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:35.721777    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/109a883d-bde2-4d4b-ac9a-736ccb3a4daa-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xmj7p\" (UID: \"109a883d-bde2-4d4b-ac9a-736ccb3a4daa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xmj7p"
Sep 09 20:56:35.722000 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:35.721979    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/302eae5a-1394-49dc-bf95-b1377b3e02a5-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bct7lck\" (UID: \"302eae5a-1394-49dc-bf95-b1377b3e02a5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bct7lck"
Sep 09 20:56:35.760575 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:35.760553    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bct7lck"
Sep 09 20:56:35.815022 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:35.814987    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xmj7p"
Sep 09 20:56:36.032551 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:36.032526    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bct7lck"]
Sep 09 20:56:36.035089 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:56:36.035061    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod302eae5a_1394_49dc_bf95_b1377b3e02a5.slice/crio-9833944f07cfebe3716bcc00ab5c3777783dc8d8e3ccea1546265f4560f674f1 WatchSource:0}: Error finding container 9833944f07cfebe3716bcc00ab5c3777783dc8d8e3ccea1546265f4560f674f1: Status 404 returned error can't find the container with id 9833944f07cfebe3716bcc00ab5c3777783dc8d8e3ccea1546265f4560f674f1
Sep 09 20:56:36.090238 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:36.090218    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xmj7p"]
Sep 09 20:56:36.091635 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:56:36.091611    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod109a883d_bde2_4d4b_ac9a_736ccb3a4daa.slice/crio-1a2d39e254907885b8cc13c468e4797ce8fbc7dd46698b58b41579220a518ef5 WatchSource:0}: Error finding container 1a2d39e254907885b8cc13c468e4797ce8fbc7dd46698b58b41579220a518ef5: Status 404 returned error can't find the container with id 1a2d39e254907885b8cc13c468e4797ce8fbc7dd46698b58b41579220a518ef5
Sep 09 20:56:36.128942 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:36.128909    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bct7lck" event={"ID":"302eae5a-1394-49dc-bf95-b1377b3e02a5","Type":"ContainerStarted","Data":"9833944f07cfebe3716bcc00ab5c3777783dc8d8e3ccea1546265f4560f674f1"}
Sep 09 20:56:36.130045 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:36.130018    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xmj7p" event={"ID":"109a883d-bde2-4d4b-ac9a-736ccb3a4daa","Type":"ContainerStarted","Data":"1a2d39e254907885b8cc13c468e4797ce8fbc7dd46698b58b41579220a518ef5"}
Sep 09 20:56:39.287791 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:39.287715    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-zwkf6"]
Sep 09 20:56:39.295362 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:39.295334    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-zwkf6"
Sep 09 20:56:39.297888 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:39.297863    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Sep 09 20:56:39.298194 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:39.298143    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-wqngz\""
Sep 09 20:56:39.299565 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:39.299541    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-zwkf6"]
Sep 09 20:56:39.346016 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:39.345978    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mk4q\" (UniqueName: \"kubernetes.io/projected/d9b0f975-e729-4cbc-bc29-96b3e925f1e0-kube-api-access-5mk4q\") pod \"odh-model-controller-7998c67dc4-zwkf6\" (UID: \"d9b0f975-e729-4cbc-bc29-96b3e925f1e0\") " pod="opendatahub/odh-model-controller-7998c67dc4-zwkf6"
Sep 09 20:56:39.346152 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:39.346128    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d9b0f975-e729-4cbc-bc29-96b3e925f1e0-cert\") pod \"odh-model-controller-7998c67dc4-zwkf6\" (UID: \"d9b0f975-e729-4cbc-bc29-96b3e925f1e0\") " pod="opendatahub/odh-model-controller-7998c67dc4-zwkf6"
Sep 09 20:56:39.446988 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:39.446645    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d9b0f975-e729-4cbc-bc29-96b3e925f1e0-cert\") pod \"odh-model-controller-7998c67dc4-zwkf6\" (UID: \"d9b0f975-e729-4cbc-bc29-96b3e925f1e0\") " pod="opendatahub/odh-model-controller-7998c67dc4-zwkf6"
Sep 09 20:56:39.446988 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:56:39.446786    2560 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Sep 09 20:56:39.446988 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:39.446802    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mk4q\" (UniqueName: \"kubernetes.io/projected/d9b0f975-e729-4cbc-bc29-96b3e925f1e0-kube-api-access-5mk4q\") pod \"odh-model-controller-7998c67dc4-zwkf6\" (UID: \"d9b0f975-e729-4cbc-bc29-96b3e925f1e0\") " pod="opendatahub/odh-model-controller-7998c67dc4-zwkf6"
Sep 09 20:56:39.446988 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:56:39.446850    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9b0f975-e729-4cbc-bc29-96b3e925f1e0-cert podName:d9b0f975-e729-4cbc-bc29-96b3e925f1e0 nodeName:}" failed. No retries permitted until 2026-09-09 20:56:39.946829247 +0000 UTC m=+564.398620774 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d9b0f975-e729-4cbc-bc29-96b3e925f1e0-cert") pod "odh-model-controller-7998c67dc4-zwkf6" (UID: "d9b0f975-e729-4cbc-bc29-96b3e925f1e0") : secret "odh-model-controller-webhook-cert" not found
Sep 09 20:56:39.458104 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:39.458073    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mk4q\" (UniqueName: \"kubernetes.io/projected/d9b0f975-e729-4cbc-bc29-96b3e925f1e0-kube-api-access-5mk4q\") pod \"odh-model-controller-7998c67dc4-zwkf6\" (UID: \"d9b0f975-e729-4cbc-bc29-96b3e925f1e0\") " pod="opendatahub/odh-model-controller-7998c67dc4-zwkf6"
Sep 09 20:56:39.898687 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:39.898649    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-frlr2"]
Sep 09 20:56:39.902776 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:39.902759    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-frlr2"
Sep 09 20:56:39.905477 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:39.905453    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Sep 09 20:56:39.905572 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:39.905510    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-tk67n\""
Sep 09 20:56:39.911878 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:39.911058    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-frlr2"]
Sep 09 20:56:39.950928 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:39.950900    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0fd32ab-0394-42b6-8b17-62c1ba72fb1d-tls-certs\") pod \"model-serving-api-54d89bd5fc-frlr2\" (UID: \"f0fd32ab-0394-42b6-8b17-62c1ba72fb1d\") " pod="opendatahub/model-serving-api-54d89bd5fc-frlr2"
Sep 09 20:56:39.951029 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:39.950982    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fghc8\" (UniqueName: \"kubernetes.io/projected/f0fd32ab-0394-42b6-8b17-62c1ba72fb1d-kube-api-access-fghc8\") pod \"model-serving-api-54d89bd5fc-frlr2\" (UID: \"f0fd32ab-0394-42b6-8b17-62c1ba72fb1d\") " pod="opendatahub/model-serving-api-54d89bd5fc-frlr2"
Sep 09 20:56:39.951080 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:39.951048    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d9b0f975-e729-4cbc-bc29-96b3e925f1e0-cert\") pod \"odh-model-controller-7998c67dc4-zwkf6\" (UID: \"d9b0f975-e729-4cbc-bc29-96b3e925f1e0\") " pod="opendatahub/odh-model-controller-7998c67dc4-zwkf6"
Sep 09 20:56:39.953428 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:39.953407    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d9b0f975-e729-4cbc-bc29-96b3e925f1e0-cert\") pod \"odh-model-controller-7998c67dc4-zwkf6\" (UID: \"d9b0f975-e729-4cbc-bc29-96b3e925f1e0\") " pod="opendatahub/odh-model-controller-7998c67dc4-zwkf6"
Sep 09 20:56:39.994252 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:39.994219    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 09 20:56:39.994340 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:39.994286    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 09 20:56:39.994340 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:39.994327    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 09 20:56:40.001029 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:40.000949    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 09 20:56:40.001029 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:40.001006    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 09 20:56:40.001110 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:40.001034    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 09 20:56:40.051387 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:40.051366    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fghc8\" (UniqueName: \"kubernetes.io/projected/f0fd32ab-0394-42b6-8b17-62c1ba72fb1d-kube-api-access-fghc8\") pod \"model-serving-api-54d89bd5fc-frlr2\" (UID: \"f0fd32ab-0394-42b6-8b17-62c1ba72fb1d\") " pod="opendatahub/model-serving-api-54d89bd5fc-frlr2"
Sep 09 20:56:40.051497 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:40.051481    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0fd32ab-0394-42b6-8b17-62c1ba72fb1d-tls-certs\") pod \"model-serving-api-54d89bd5fc-frlr2\" (UID: \"f0fd32ab-0394-42b6-8b17-62c1ba72fb1d\") " pod="opendatahub/model-serving-api-54d89bd5fc-frlr2"
Sep 09 20:56:40.051593 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:56:40.051579    2560 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Sep 09 20:56:40.051649 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:56:40.051638    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0fd32ab-0394-42b6-8b17-62c1ba72fb1d-tls-certs podName:f0fd32ab-0394-42b6-8b17-62c1ba72fb1d nodeName:}" failed. No retries permitted until 2026-09-09 20:56:40.551618945 +0000 UTC m=+565.003410453 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/f0fd32ab-0394-42b6-8b17-62c1ba72fb1d-tls-certs") pod "model-serving-api-54d89bd5fc-frlr2" (UID: "f0fd32ab-0394-42b6-8b17-62c1ba72fb1d") : secret "model-serving-api-tls" not found
Sep 09 20:56:40.063155 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:40.063134    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fghc8\" (UniqueName: \"kubernetes.io/projected/f0fd32ab-0394-42b6-8b17-62c1ba72fb1d-kube-api-access-fghc8\") pod \"model-serving-api-54d89bd5fc-frlr2\" (UID: \"f0fd32ab-0394-42b6-8b17-62c1ba72fb1d\") " pod="opendatahub/model-serving-api-54d89bd5fc-frlr2"
Sep 09 20:56:40.152911 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:40.152827    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bct7lck" event={"ID":"302eae5a-1394-49dc-bf95-b1377b3e02a5","Type":"ContainerStarted","Data":"aa10868fdbcef15a420364f24b6b6edf5457bcb3da261287d024f0aef74aba74"}
Sep 09 20:56:40.154466 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:40.154439    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xmj7p" event={"ID":"109a883d-bde2-4d4b-ac9a-736ccb3a4daa","Type":"ContainerStarted","Data":"029b248d3540fb785a4af668d619cdf6c4929071be4ab999b33616be94fe5380"}
Sep 09 20:56:40.175210 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:40.175159    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bct7lck" podStartSLOduration=1.218238478 podStartE2EDuration="5.17513996s" totalImagesPullingTime="3.956901482s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:56:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:56:40.172931284 +0000 UTC m=+564.624722814" watchObservedRunningTime="2026-09-09 20:56:40.17513996 +0000 UTC m=+564.626931490"
Sep 09 20:56:40.193392 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:40.193344    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xmj7p" podStartSLOduration=1.286104424 podStartE2EDuration="5.193323332s" totalImagesPullingTime="3.907218908s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:56:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:56:40.192630872 +0000 UTC m=+564.644422403" watchObservedRunningTime="2026-09-09 20:56:40.193323332 +0000 UTC m=+564.645114864"
Sep 09 20:56:40.209989 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:40.209963    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-zwkf6"
Sep 09 20:56:40.482811 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:40.482726    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-zwkf6"]
Sep 09 20:56:40.485065 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:56:40.485034    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9b0f975_e729_4cbc_bc29_96b3e925f1e0.slice/crio-9b46213e8811495ffa002af22b979703a4fb896d488f102b531ad47dc8a06db2 WatchSource:0}: Error finding container 9b46213e8811495ffa002af22b979703a4fb896d488f102b531ad47dc8a06db2: Status 404 returned error can't find the container with id 9b46213e8811495ffa002af22b979703a4fb896d488f102b531ad47dc8a06db2
Sep 09 20:56:40.556289 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:40.556255    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0fd32ab-0394-42b6-8b17-62c1ba72fb1d-tls-certs\") pod \"model-serving-api-54d89bd5fc-frlr2\" (UID: \"f0fd32ab-0394-42b6-8b17-62c1ba72fb1d\") " pod="opendatahub/model-serving-api-54d89bd5fc-frlr2"
Sep 09 20:56:40.558768 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:40.558744    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0fd32ab-0394-42b6-8b17-62c1ba72fb1d-tls-certs\") pod \"model-serving-api-54d89bd5fc-frlr2\" (UID: \"f0fd32ab-0394-42b6-8b17-62c1ba72fb1d\") " pod="opendatahub/model-serving-api-54d89bd5fc-frlr2"
Sep 09 20:56:40.761393 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:40.761312    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bct7lck"
Sep 09 20:56:40.816036 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:40.816000    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xmj7p"
Sep 09 20:56:40.816192 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:40.816082    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-frlr2"
Sep 09 20:56:41.083889 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:41.083863    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-frlr2"]
Sep 09 20:56:41.086226 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:56:41.086201    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0fd32ab_0394_42b6_8b17_62c1ba72fb1d.slice/crio-e8e7292ef29126c709b5b9d0788b0128ef0002287bf2c5d9a3ddb021b9771cdb WatchSource:0}: Error finding container e8e7292ef29126c709b5b9d0788b0128ef0002287bf2c5d9a3ddb021b9771cdb: Status 404 returned error can't find the container with id e8e7292ef29126c709b5b9d0788b0128ef0002287bf2c5d9a3ddb021b9771cdb
Sep 09 20:56:41.159881 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:41.159855    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-zwkf6" event={"ID":"d9b0f975-e729-4cbc-bc29-96b3e925f1e0","Type":"ContainerStarted","Data":"9b46213e8811495ffa002af22b979703a4fb896d488f102b531ad47dc8a06db2"}
Sep 09 20:56:41.161027 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:41.161003    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-frlr2" event={"ID":"f0fd32ab-0394-42b6-8b17-62c1ba72fb1d","Type":"ContainerStarted","Data":"e8e7292ef29126c709b5b9d0788b0128ef0002287bf2c5d9a3ddb021b9771cdb"}
Sep 09 20:56:41.762516 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:41.762473    2560 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-6745bb66bct7lck container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.28:15021/healthz/ready\": dial tcp 10.132.0.28:15021: connect: connection refused" start-of-body=
Sep 09 20:56:41.763020 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:41.762546    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bct7lck" podUID="302eae5a-1394-49dc-bf95-b1377b3e02a5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.28:15021/healthz/ready\": dial tcp 10.132.0.28:15021: connect: connection refused"
Sep 09 20:56:41.821179 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:41.820937    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xmj7p"
Sep 09 20:56:42.167945 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:42.167883    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xmj7p"
Sep 09 20:56:42.169161 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:42.169130    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xmj7p"
Sep 09 20:56:42.217775 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:42.217736    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bct7lck"]
Sep 09 20:56:42.761005 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:42.760911    2560 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-6745bb66bct7lck container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.28:15021/healthz/ready\": dial tcp 10.132.0.28:15021: connect: connection refused" start-of-body=
Sep 09 20:56:42.761162 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:42.760993    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bct7lck" podUID="302eae5a-1394-49dc-bf95-b1377b3e02a5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.28:15021/healthz/ready\": dial tcp 10.132.0.28:15021: connect: connection refused"
Sep 09 20:56:43.174015 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:43.173974    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bct7lck" podUID="302eae5a-1394-49dc-bf95-b1377b3e02a5" containerName="istio-proxy" containerID="cri-o://aa10868fdbcef15a420364f24b6b6edf5457bcb3da261287d024f0aef74aba74" gracePeriod=30
Sep 09 20:56:44.180466 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:44.180433    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-zwkf6" event={"ID":"d9b0f975-e729-4cbc-bc29-96b3e925f1e0","Type":"ContainerStarted","Data":"1f451c5e7826b995dc3572d2cbf8ddaac9afb4271981d8ad97ba7000c19126ac"}
Sep 09 20:56:44.180897 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:44.180542    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-zwkf6"
Sep 09 20:56:44.182100 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:44.182076    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-frlr2" event={"ID":"f0fd32ab-0394-42b6-8b17-62c1ba72fb1d","Type":"ContainerStarted","Data":"ec26c1b1b336df697c459c8210bf66e352e97e89d74c976c84eb1c01f8da01c3"}
Sep 09 20:56:44.206415 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:44.206375    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-zwkf6" podStartSLOduration=1.709250873 podStartE2EDuration="5.206362166s" totalImagesPullingTime="3.497111293s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:56:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:56:44.205028563 +0000 UTC m=+568.656820109" watchObservedRunningTime="2026-09-09 20:56:44.206362166 +0000 UTC m=+568.658153694"
Sep 09 20:56:44.236526 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:44.236453    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-frlr2" podStartSLOduration=2.344791055 podStartE2EDuration="5.236440887s" totalImagesPullingTime="2.891649832s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:56:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:56:44.234944953 +0000 UTC m=+568.686736481" watchObservedRunningTime="2026-09-09 20:56:44.236440887 +0000 UTC m=+568.688232424"
Sep 09 20:56:45.186305 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:45.186271    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-frlr2"
Sep 09 20:56:46.677747 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:46.677712    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-2d9km"]
Sep 09 20:56:46.680336 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:46.680316    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2d9km"
Sep 09 20:56:46.682949 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:46.682926    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 09 20:56:46.683059 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:46.683041    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 09 20:56:46.683253 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:46.683215    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 09 20:56:46.683493 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:46.683473    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-sj4lm\""
Sep 09 20:56:46.697138 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:46.697114    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-2d9km"]
Sep 09 20:56:46.711348 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:46.711315    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ec17322b-e607-443b-9064-638d442fc550-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-2d9km\" (UID: \"ec17322b-e607-443b-9064-638d442fc550\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2d9km"
Sep 09 20:56:46.711348 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:46.711356    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ec17322b-e607-443b-9064-638d442fc550-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-2d9km\" (UID: \"ec17322b-e607-443b-9064-638d442fc550\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2d9km"
Sep 09 20:56:46.711601 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:46.711391    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ec17322b-e607-443b-9064-638d442fc550-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-2d9km\" (UID: \"ec17322b-e607-443b-9064-638d442fc550\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2d9km"
Sep 09 20:56:46.711601 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:46.711475    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ec17322b-e607-443b-9064-638d442fc550-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-2d9km\" (UID: \"ec17322b-e607-443b-9064-638d442fc550\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2d9km"
Sep 09 20:56:46.711601 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:46.711507    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ddmm\" (UniqueName: \"kubernetes.io/projected/ec17322b-e607-443b-9064-638d442fc550-kube-api-access-4ddmm\") pod \"istiod-openshift-gateway-5677ccb49b-2d9km\" (UID: \"ec17322b-e607-443b-9064-638d442fc550\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2d9km"
Sep 09 20:56:46.711601 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:46.711537    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec17322b-e607-443b-9064-638d442fc550-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-2d9km\" (UID: \"ec17322b-e607-443b-9064-638d442fc550\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2d9km"
Sep 09 20:56:46.711842 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:46.711603    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec17322b-e607-443b-9064-638d442fc550-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-2d9km\" (UID: \"ec17322b-e607-443b-9064-638d442fc550\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2d9km"
Sep 09 20:56:46.812690 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:46.812639    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ec17322b-e607-443b-9064-638d442fc550-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-2d9km\" (UID: \"ec17322b-e607-443b-9064-638d442fc550\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2d9km"
Sep 09 20:56:46.812690 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:46.812691    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ddmm\" (UniqueName: \"kubernetes.io/projected/ec17322b-e607-443b-9064-638d442fc550-kube-api-access-4ddmm\") pod \"istiod-openshift-gateway-5677ccb49b-2d9km\" (UID: \"ec17322b-e607-443b-9064-638d442fc550\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2d9km"
Sep 09 20:56:46.812893 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:46.812714    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec17322b-e607-443b-9064-638d442fc550-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-2d9km\" (UID: \"ec17322b-e607-443b-9064-638d442fc550\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2d9km"
Sep 09 20:56:46.812893 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:46.812737    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec17322b-e607-443b-9064-638d442fc550-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-2d9km\" (UID: \"ec17322b-e607-443b-9064-638d442fc550\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2d9km"
Sep 09 20:56:46.812893 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:46.812775    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ec17322b-e607-443b-9064-638d442fc550-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-2d9km\" (UID: \"ec17322b-e607-443b-9064-638d442fc550\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2d9km"
Sep 09 20:56:46.812893 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:46.812798    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ec17322b-e607-443b-9064-638d442fc550-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-2d9km\" (UID: \"ec17322b-e607-443b-9064-638d442fc550\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2d9km"
Sep 09 20:56:46.812893 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:46.812874    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ec17322b-e607-443b-9064-638d442fc550-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-2d9km\" (UID: \"ec17322b-e607-443b-9064-638d442fc550\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2d9km"
Sep 09 20:56:46.813512 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:46.813484    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ec17322b-e607-443b-9064-638d442fc550-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-2d9km\" (UID: \"ec17322b-e607-443b-9064-638d442fc550\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2d9km"
Sep 09 20:56:46.815137 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:46.815110    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec17322b-e607-443b-9064-638d442fc550-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-2d9km\" (UID: \"ec17322b-e607-443b-9064-638d442fc550\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2d9km"
Sep 09 20:56:46.815258 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:46.815242    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ec17322b-e607-443b-9064-638d442fc550-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-2d9km\" (UID: \"ec17322b-e607-443b-9064-638d442fc550\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2d9km"
Sep 09 20:56:46.815337 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:46.815320    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ec17322b-e607-443b-9064-638d442fc550-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-2d9km\" (UID: \"ec17322b-e607-443b-9064-638d442fc550\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2d9km"
Sep 09 20:56:46.815431 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:46.815410    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ec17322b-e607-443b-9064-638d442fc550-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-2d9km\" (UID: \"ec17322b-e607-443b-9064-638d442fc550\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2d9km"
Sep 09 20:56:46.823065 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:46.823039    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ddmm\" (UniqueName: \"kubernetes.io/projected/ec17322b-e607-443b-9064-638d442fc550-kube-api-access-4ddmm\") pod \"istiod-openshift-gateway-5677ccb49b-2d9km\" (UID: \"ec17322b-e607-443b-9064-638d442fc550\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2d9km"
Sep 09 20:56:46.823159 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:46.823093    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec17322b-e607-443b-9064-638d442fc550-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-2d9km\" (UID: \"ec17322b-e607-443b-9064-638d442fc550\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2d9km"
Sep 09 20:56:46.991351 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:46.991271    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2d9km"
Sep 09 20:56:47.390597 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:56:47.390562    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec17322b_e607_443b_9064_638d442fc550.slice/crio-ccec652dd79ce6874e1f20af4fd97dc37037548ec83bde3c52775f7cddcb906a WatchSource:0}: Error finding container ccec652dd79ce6874e1f20af4fd97dc37037548ec83bde3c52775f7cddcb906a: Status 404 returned error can't find the container with id ccec652dd79ce6874e1f20af4fd97dc37037548ec83bde3c52775f7cddcb906a
Sep 09 20:56:47.407396 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:47.407364    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-2d9km"]
Sep 09 20:56:48.203164 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:48.203130    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2d9km" event={"ID":"ec17322b-e607-443b-9064-638d442fc550","Type":"ContainerStarted","Data":"ccec652dd79ce6874e1f20af4fd97dc37037548ec83bde3c52775f7cddcb906a"}
Sep 09 20:56:48.443936 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:48.443873    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bct7lck"
Sep 09 20:56:48.531564 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:48.530782    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/302eae5a-1394-49dc-bf95-b1377b3e02a5-workload-certs\") pod \"302eae5a-1394-49dc-bf95-b1377b3e02a5\" (UID: \"302eae5a-1394-49dc-bf95-b1377b3e02a5\") "
Sep 09 20:56:48.531564 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:48.530837    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/302eae5a-1394-49dc-bf95-b1377b3e02a5-istio-podinfo\") pod \"302eae5a-1394-49dc-bf95-b1377b3e02a5\" (UID: \"302eae5a-1394-49dc-bf95-b1377b3e02a5\") "
Sep 09 20:56:48.531564 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:48.530883    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/302eae5a-1394-49dc-bf95-b1377b3e02a5-istio-data\") pod \"302eae5a-1394-49dc-bf95-b1377b3e02a5\" (UID: \"302eae5a-1394-49dc-bf95-b1377b3e02a5\") "
Sep 09 20:56:48.531564 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:48.530918    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/302eae5a-1394-49dc-bf95-b1377b3e02a5-istio-token\") pod \"302eae5a-1394-49dc-bf95-b1377b3e02a5\" (UID: \"302eae5a-1394-49dc-bf95-b1377b3e02a5\") "
Sep 09 20:56:48.531564 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:48.530972    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gcqv7\" (UniqueName: \"kubernetes.io/projected/302eae5a-1394-49dc-bf95-b1377b3e02a5-kube-api-access-gcqv7\") pod \"302eae5a-1394-49dc-bf95-b1377b3e02a5\" (UID: \"302eae5a-1394-49dc-bf95-b1377b3e02a5\") "
Sep 09 20:56:48.531564 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:48.531007    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/302eae5a-1394-49dc-bf95-b1377b3e02a5-istio-envoy\") pod \"302eae5a-1394-49dc-bf95-b1377b3e02a5\" (UID: \"302eae5a-1394-49dc-bf95-b1377b3e02a5\") "
Sep 09 20:56:48.531564 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:48.531031    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/302eae5a-1394-49dc-bf95-b1377b3e02a5-credential-socket\") pod \"302eae5a-1394-49dc-bf95-b1377b3e02a5\" (UID: \"302eae5a-1394-49dc-bf95-b1377b3e02a5\") "
Sep 09 20:56:48.531564 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:48.531068    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/302eae5a-1394-49dc-bf95-b1377b3e02a5-workload-socket\") pod \"302eae5a-1394-49dc-bf95-b1377b3e02a5\" (UID: \"302eae5a-1394-49dc-bf95-b1377b3e02a5\") "
Sep 09 20:56:48.531564 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:48.531099    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/302eae5a-1394-49dc-bf95-b1377b3e02a5-istiod-ca-cert\") pod \"302eae5a-1394-49dc-bf95-b1377b3e02a5\" (UID: \"302eae5a-1394-49dc-bf95-b1377b3e02a5\") "
Sep 09 20:56:48.532418 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:48.532217    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/302eae5a-1394-49dc-bf95-b1377b3e02a5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "302eae5a-1394-49dc-bf95-b1377b3e02a5" (UID: "302eae5a-1394-49dc-bf95-b1377b3e02a5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 20:56:48.532418 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:48.532331    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/302eae5a-1394-49dc-bf95-b1377b3e02a5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "302eae5a-1394-49dc-bf95-b1377b3e02a5" (UID: "302eae5a-1394-49dc-bf95-b1377b3e02a5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:56:48.532566 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:48.532421    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/302eae5a-1394-49dc-bf95-b1377b3e02a5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "302eae5a-1394-49dc-bf95-b1377b3e02a5" (UID: "302eae5a-1394-49dc-bf95-b1377b3e02a5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 20:56:48.532782 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:48.532736    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/302eae5a-1394-49dc-bf95-b1377b3e02a5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "302eae5a-1394-49dc-bf95-b1377b3e02a5" (UID: "302eae5a-1394-49dc-bf95-b1377b3e02a5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 20:56:48.532944 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:48.532912    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/302eae5a-1394-49dc-bf95-b1377b3e02a5-istio-data" (OuterVolumeSpecName: "istio-data") pod "302eae5a-1394-49dc-bf95-b1377b3e02a5" (UID: "302eae5a-1394-49dc-bf95-b1377b3e02a5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 20:56:48.534525 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:48.534474    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/302eae5a-1394-49dc-bf95-b1377b3e02a5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "302eae5a-1394-49dc-bf95-b1377b3e02a5" (UID: "302eae5a-1394-49dc-bf95-b1377b3e02a5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 20:56:48.534896 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:48.534868    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/302eae5a-1394-49dc-bf95-b1377b3e02a5-kube-api-access-gcqv7" (OuterVolumeSpecName: "kube-api-access-gcqv7") pod "302eae5a-1394-49dc-bf95-b1377b3e02a5" (UID: "302eae5a-1394-49dc-bf95-b1377b3e02a5"). InnerVolumeSpecName "kube-api-access-gcqv7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:56:48.535744 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:48.535708    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/302eae5a-1394-49dc-bf95-b1377b3e02a5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "302eae5a-1394-49dc-bf95-b1377b3e02a5" (UID: "302eae5a-1394-49dc-bf95-b1377b3e02a5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 20:56:48.536345 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:48.536317    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/302eae5a-1394-49dc-bf95-b1377b3e02a5-istio-token" (OuterVolumeSpecName: "istio-token") pod "302eae5a-1394-49dc-bf95-b1377b3e02a5" (UID: "302eae5a-1394-49dc-bf95-b1377b3e02a5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:56:48.631956 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:48.631926    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/302eae5a-1394-49dc-bf95-b1377b3e02a5-workload-certs\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 09 20:56:48.631956 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:48.631956    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/302eae5a-1394-49dc-bf95-b1377b3e02a5-istio-podinfo\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 09 20:56:48.631956 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:48.631968    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/302eae5a-1394-49dc-bf95-b1377b3e02a5-istio-data\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 09 20:56:48.632199 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:48.631980    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/302eae5a-1394-49dc-bf95-b1377b3e02a5-istio-token\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 09 20:56:48.632199 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:48.631994    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gcqv7\" (UniqueName: \"kubernetes.io/projected/302eae5a-1394-49dc-bf95-b1377b3e02a5-kube-api-access-gcqv7\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 09 20:56:48.632199 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:48.632005    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/302eae5a-1394-49dc-bf95-b1377b3e02a5-istio-envoy\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 09 20:56:48.632199 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:48.632016    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/302eae5a-1394-49dc-bf95-b1377b3e02a5-credential-socket\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 09 20:56:48.632199 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:48.632029    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/302eae5a-1394-49dc-bf95-b1377b3e02a5-workload-socket\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 09 20:56:48.632199 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:48.632040    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/302eae5a-1394-49dc-bf95-b1377b3e02a5-istiod-ca-cert\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 09 20:56:49.210493 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:49.210448    2560 generic.go:356] "Generic (PLEG): container finished" podID="302eae5a-1394-49dc-bf95-b1377b3e02a5" containerID="aa10868fdbcef15a420364f24b6b6edf5457bcb3da261287d024f0aef74aba74" exitCode=0
Sep 09 20:56:49.210930 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:49.210518    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bct7lck"
Sep 09 20:56:49.210930 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:49.210517    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bct7lck" event={"ID":"302eae5a-1394-49dc-bf95-b1377b3e02a5","Type":"ContainerDied","Data":"aa10868fdbcef15a420364f24b6b6edf5457bcb3da261287d024f0aef74aba74"}
Sep 09 20:56:49.210930 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:49.210584    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bct7lck" event={"ID":"302eae5a-1394-49dc-bf95-b1377b3e02a5","Type":"ContainerDied","Data":"9833944f07cfebe3716bcc00ab5c3777783dc8d8e3ccea1546265f4560f674f1"}
Sep 09 20:56:49.210930 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:49.210615    2560 scope.go:117] "RemoveContainer" containerID="aa10868fdbcef15a420364f24b6b6edf5457bcb3da261287d024f0aef74aba74"
Sep 09 20:56:49.251035 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:49.251007    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bct7lck"]
Sep 09 20:56:49.254142 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:49.254115    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bct7lck"]
Sep 09 20:56:49.429844 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:49.429590    2560 scope.go:117] "RemoveContainer" containerID="aa10868fdbcef15a420364f24b6b6edf5457bcb3da261287d024f0aef74aba74"
Sep 09 20:56:49.429991 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:56:49.429972    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa10868fdbcef15a420364f24b6b6edf5457bcb3da261287d024f0aef74aba74\": container with ID starting with aa10868fdbcef15a420364f24b6b6edf5457bcb3da261287d024f0aef74aba74 not found: ID does not exist" containerID="aa10868fdbcef15a420364f24b6b6edf5457bcb3da261287d024f0aef74aba74"
Sep 09 20:56:49.430050 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:49.429998    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa10868fdbcef15a420364f24b6b6edf5457bcb3da261287d024f0aef74aba74"} err="failed to get container status \"aa10868fdbcef15a420364f24b6b6edf5457bcb3da261287d024f0aef74aba74\": rpc error: code = NotFound desc = could not find container \"aa10868fdbcef15a420364f24b6b6edf5457bcb3da261287d024f0aef74aba74\": container with ID starting with aa10868fdbcef15a420364f24b6b6edf5457bcb3da261287d024f0aef74aba74 not found: ID does not exist"
Sep 09 20:56:49.466253 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:49.466210    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 09 20:56:49.466325 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:49.466288    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 09 20:56:50.051146 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:50.051106    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="302eae5a-1394-49dc-bf95-b1377b3e02a5" path="/var/lib/kubelet/pods/302eae5a-1394-49dc-bf95-b1377b3e02a5/volumes"
Sep 09 20:56:50.217663 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:50.217616    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2d9km" event={"ID":"ec17322b-e607-443b-9064-638d442fc550","Type":"ContainerStarted","Data":"2b38c1806ec73ac5edd6f148c7100176bf163b718bae1398f6831c5596fefec2"}
Sep 09 20:56:50.218126 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:50.217787    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2d9km"
Sep 09 20:56:50.219608 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:50.219582    2560 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-2d9km container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 09 20:56:50.219744 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:50.219632    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2d9km" podUID="ec17322b-e607-443b-9064-638d442fc550" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 20:56:51.224381 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:51.224352    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2d9km"
Sep 09 20:56:51.311273 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:51.311223    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2d9km" podStartSLOduration=3.2379390949999998 podStartE2EDuration="5.311207688s" totalImagesPullingTime="2.073268593s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:56:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:56:50.262529374 +0000 UTC m=+574.714320903" watchObservedRunningTime="2026-09-09 20:56:51.311207688 +0000 UTC m=+575.762999216"
Sep 09 20:56:55.188527 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:55.188493    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-zwkf6"
Sep 09 20:56:56.194966 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:56:56.194936    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-frlr2"
Sep 09 20:57:15.990200 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:57:15.989984    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-zdfrv_a23f7c09-09f4-49b5-a012-f1d3ec19fc27/console-operator/1.log"
Sep 09 20:57:15.990540 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:57:15.990212    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-zdfrv_a23f7c09-09f4-49b5-a012-f1d3ec19fc27/console-operator/1.log"
Sep 09 20:57:15.993901 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:57:15.993876    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2thgv_25e8b7cb-d3ab-4da2-bcfe-c061509f457b/ovn-acl-logging/0.log"
Sep 09 20:57:15.994098 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:57:15.994080    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2thgv_25e8b7cb-d3ab-4da2-bcfe-c061509f457b/ovn-acl-logging/0.log"
Sep 09 20:57:59.946047 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:57:59.946006    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-ngf5m"]
Sep 09 20:57:59.946519 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:57:59.946386    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="302eae5a-1394-49dc-bf95-b1377b3e02a5" containerName="istio-proxy"
Sep 09 20:57:59.946519 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:57:59.946398    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="302eae5a-1394-49dc-bf95-b1377b3e02a5" containerName="istio-proxy"
Sep 09 20:57:59.946519 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:57:59.946463    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="302eae5a-1394-49dc-bf95-b1377b3e02a5" containerName="istio-proxy"
Sep 09 20:57:59.948408 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:57:59.948391    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-ngf5m"
Sep 09 20:57:59.951277 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:57:59.951259    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 09 20:57:59.951523 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:57:59.951507    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 09 20:57:59.951575 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:57:59.951513    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-dnk8x\""
Sep 09 20:57:59.961933 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:57:59.961908    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-ngf5m"]
Sep 09 20:58:00.029604 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:58:00.029558    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svrlh\" (UniqueName: \"kubernetes.io/projected/394546ad-4cf9-4515-8b71-51ac43157b7b-kube-api-access-svrlh\") pod \"authorino-operator-76b478bd78-ngf5m\" (UID: \"394546ad-4cf9-4515-8b71-51ac43157b7b\") " pod="kuadrant-system/authorino-operator-76b478bd78-ngf5m"
Sep 09 20:58:00.130752 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:58:00.130709    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svrlh\" (UniqueName: \"kubernetes.io/projected/394546ad-4cf9-4515-8b71-51ac43157b7b-kube-api-access-svrlh\") pod \"authorino-operator-76b478bd78-ngf5m\" (UID: \"394546ad-4cf9-4515-8b71-51ac43157b7b\") " pod="kuadrant-system/authorino-operator-76b478bd78-ngf5m"
Sep 09 20:58:00.147536 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:58:00.147499    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-svrlh\" (UniqueName: \"kubernetes.io/projected/394546ad-4cf9-4515-8b71-51ac43157b7b-kube-api-access-svrlh\") pod \"authorino-operator-76b478bd78-ngf5m\" (UID: \"394546ad-4cf9-4515-8b71-51ac43157b7b\") " pod="kuadrant-system/authorino-operator-76b478bd78-ngf5m"
Sep 09 20:58:00.259040 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:58:00.258946    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-ngf5m"
Sep 09 20:58:00.532094 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:58:00.532048    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-ngf5m"]
Sep 09 20:58:00.539452 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:58:00.539420    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod394546ad_4cf9_4515_8b71_51ac43157b7b.slice/crio-bd66b45eae4a71e35de234fc0ef27cc82d42d86a51cdc5b6473299593c6ee858 WatchSource:0}: Error finding container bd66b45eae4a71e35de234fc0ef27cc82d42d86a51cdc5b6473299593c6ee858: Status 404 returned error can't find the container with id bd66b45eae4a71e35de234fc0ef27cc82d42d86a51cdc5b6473299593c6ee858
Sep 09 20:58:00.541518 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:58:00.541497    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 20:58:00.556695 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:58:00.556634    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-ngf5m" event={"ID":"394546ad-4cf9-4515-8b71-51ac43157b7b","Type":"ContainerStarted","Data":"bd66b45eae4a71e35de234fc0ef27cc82d42d86a51cdc5b6473299593c6ee858"}
Sep 09 20:58:07.053881 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:58:07.053845    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-4brpd"]
Sep 09 20:58:07.056998 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:58:07.056979    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-4brpd"
Sep 09 20:58:07.059366 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:58:07.059345    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-bmn9g\""
Sep 09 20:58:07.072460 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:58:07.072433    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-4brpd"]
Sep 09 20:58:07.193831 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:58:07.193793    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ttnh\" (UniqueName: \"kubernetes.io/projected/23a4c5bb-da70-4f07-886b-12a1dc1d855a-kube-api-access-4ttnh\") pod \"limitador-operator-controller-manager-74495c69f8-4brpd\" (UID: \"23a4c5bb-da70-4f07-886b-12a1dc1d855a\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-4brpd"
Sep 09 20:58:07.294638 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:58:07.294592    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ttnh\" (UniqueName: \"kubernetes.io/projected/23a4c5bb-da70-4f07-886b-12a1dc1d855a-kube-api-access-4ttnh\") pod \"limitador-operator-controller-manager-74495c69f8-4brpd\" (UID: \"23a4c5bb-da70-4f07-886b-12a1dc1d855a\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-4brpd"
Sep 09 20:58:07.320944 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:58:07.320874    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ttnh\" (UniqueName: \"kubernetes.io/projected/23a4c5bb-da70-4f07-886b-12a1dc1d855a-kube-api-access-4ttnh\") pod \"limitador-operator-controller-manager-74495c69f8-4brpd\" (UID: \"23a4c5bb-da70-4f07-886b-12a1dc1d855a\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-4brpd"
Sep 09 20:58:07.367873 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:58:07.367837    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-4brpd"
Sep 09 20:58:07.668029 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:58:07.668004    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-4brpd"]
Sep 09 20:58:07.670886 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:58:07.670861    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23a4c5bb_da70_4f07_886b_12a1dc1d855a.slice/crio-836314736afa6e14fa761ecd2ead7835eff4160f817e477f7c7566a21f29e038 WatchSource:0}: Error finding container 836314736afa6e14fa761ecd2ead7835eff4160f817e477f7c7566a21f29e038: Status 404 returned error can't find the container with id 836314736afa6e14fa761ecd2ead7835eff4160f817e477f7c7566a21f29e038
Sep 09 20:58:08.596886 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:58:08.596849    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-4brpd" event={"ID":"23a4c5bb-da70-4f07-886b-12a1dc1d855a","Type":"ContainerStarted","Data":"836314736afa6e14fa761ecd2ead7835eff4160f817e477f7c7566a21f29e038"}
Sep 09 20:58:10.611075 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:58:10.610970    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-4brpd" event={"ID":"23a4c5bb-da70-4f07-886b-12a1dc1d855a","Type":"ContainerStarted","Data":"c008aff75f2143367641ee8acfcb7cdf4c748c1426c9afcf28064c5a0ae24f39"}
Sep 09 20:58:10.611075 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:58:10.611068    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-4brpd"
Sep 09 20:58:10.660558 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:58:10.660504    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-4brpd" podStartSLOduration=0.972634723 podStartE2EDuration="3.66048846s" totalImagesPullingTime="2.687853737s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:58:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:58:10.658303044 +0000 UTC m=+655.110094571" watchObservedRunningTime="2026-09-09 20:58:10.66048846 +0000 UTC m=+655.112279988"
Sep 09 20:58:19.664477 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:58:19.664433    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-ngf5m" event={"ID":"394546ad-4cf9-4515-8b71-51ac43157b7b","Type":"ContainerStarted","Data":"91b0eee06d0a1251d363882431dc397c7bb566fc46538dbce71277d7fe249a06"}
Sep 09 20:58:19.664960 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:58:19.664494    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-76b478bd78-ngf5m"
Sep 09 20:58:19.699329 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:58:19.699269    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-76b478bd78-ngf5m" podStartSLOduration=2.575616035 podStartE2EDuration="20.699252326s" totalImagesPullingTime="18.123636291s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:57:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:58:19.695839127 +0000 UTC m=+664.147630654" watchObservedRunningTime="2026-09-09 20:58:19.699252326 +0000 UTC m=+664.151043854"
Sep 09 20:58:21.619014 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:58:21.618978    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-4brpd"
Sep 09 20:58:24.289503 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:58:24.289472    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-4brpd"]
Sep 09 20:58:24.289890 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:58:24.289716    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-4brpd" podUID="23a4c5bb-da70-4f07-886b-12a1dc1d855a" containerName="manager" containerID="cri-o://c008aff75f2143367641ee8acfcb7cdf4c748c1426c9afcf28064c5a0ae24f39" gracePeriod=2
Sep 09 20:58:24.297958 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:58:24.297931    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-4brpd"]
Sep 09 20:58:24.351156 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:58:24.351123    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-d4zp8"]
Sep 09 20:58:24.351520 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:58:24.351505    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23a4c5bb-da70-4f07-886b-12a1dc1d855a" containerName="manager"
Sep 09 20:58:24.351520 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:58:24.351519    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="23a4c5bb-da70-4f07-886b-12a1dc1d855a" containerName="manager"
Sep 09 20:58:24.351651 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:58:24.351597    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="23a4c5bb-da70-4f07-886b-12a1dc1d855a" containerName="manager"
Sep 09 20:58:24.353936 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:58:24.353914    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-d4zp8"
Sep 09 20:58:24.356110 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:58:24.356074    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-4brpd\" is forbidden: User \"system:node:ip-10-0-140-70.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-70.ec2.internal' and this object" podUID="23a4c5bb-da70-4f07-886b-12a1dc1d855a" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-4brpd"
Sep 09 20:58:24.400491 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:58:24.400460    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-d4zp8"]
Sep 09 20:58:24.443275 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:58:24.443236    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kk25l\" (UniqueName: \"kubernetes.io/projected/781b3827-fbc2-46a6-b9f2-1f95eacbcfbb-kube-api-access-kk25l\") pod \"limitador-operator-controller-manager-74495c69f8-d4zp8\" (UID: \"781b3827-fbc2-46a6-b9f2-1f95eacbcfbb\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-d4zp8"
Sep 09 20:58:24.539262 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:58:24.539237    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-4brpd"
Sep 09 20:58:24.543553 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:58:24.543498    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-4brpd\" is forbidden: User \"system:node:ip-10-0-140-70.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-70.ec2.internal' and this object" podUID="23a4c5bb-da70-4f07-886b-12a1dc1d855a" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-4brpd"
Sep 09 20:58:24.543762 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:58:24.543742    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kk25l\" (UniqueName: \"kubernetes.io/projected/781b3827-fbc2-46a6-b9f2-1f95eacbcfbb-kube-api-access-kk25l\") pod \"limitador-operator-controller-manager-74495c69f8-d4zp8\" (UID: \"781b3827-fbc2-46a6-b9f2-1f95eacbcfbb\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-d4zp8"
Sep 09 20:58:24.561739 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:58:24.561717    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kk25l\" (UniqueName: \"kubernetes.io/projected/781b3827-fbc2-46a6-b9f2-1f95eacbcfbb-kube-api-access-kk25l\") pod \"limitador-operator-controller-manager-74495c69f8-d4zp8\" (UID: \"781b3827-fbc2-46a6-b9f2-1f95eacbcfbb\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-d4zp8"
Sep 09 20:58:24.644689 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:58:24.644646    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4ttnh\" (UniqueName: \"kubernetes.io/projected/23a4c5bb-da70-4f07-886b-12a1dc1d855a-kube-api-access-4ttnh\") pod \"23a4c5bb-da70-4f07-886b-12a1dc1d855a\" (UID: \"23a4c5bb-da70-4f07-886b-12a1dc1d855a\") "
Sep 09 20:58:24.646868 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:58:24.646844    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23a4c5bb-da70-4f07-886b-12a1dc1d855a-kube-api-access-4ttnh" (OuterVolumeSpecName: "kube-api-access-4ttnh") pod "23a4c5bb-da70-4f07-886b-12a1dc1d855a" (UID: "23a4c5bb-da70-4f07-886b-12a1dc1d855a"). InnerVolumeSpecName "kube-api-access-4ttnh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:58:24.673020 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:58:24.672992    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-d4zp8"
Sep 09 20:58:24.691463 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:58:24.691433    2560 generic.go:356] "Generic (PLEG): container finished" podID="23a4c5bb-da70-4f07-886b-12a1dc1d855a" containerID="c008aff75f2143367641ee8acfcb7cdf4c748c1426c9afcf28064c5a0ae24f39" exitCode=0
Sep 09 20:58:24.691567 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:58:24.691481    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-4brpd"
Sep 09 20:58:24.691567 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:58:24.691526    2560 scope.go:117] "RemoveContainer" containerID="c008aff75f2143367641ee8acfcb7cdf4c748c1426c9afcf28064c5a0ae24f39"
Sep 09 20:58:24.694032 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:58:24.694002    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-4brpd\" is forbidden: User \"system:node:ip-10-0-140-70.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-70.ec2.internal' and this object" podUID="23a4c5bb-da70-4f07-886b-12a1dc1d855a" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-4brpd"
Sep 09 20:58:24.700384 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:58:24.700362    2560 scope.go:117] "RemoveContainer" containerID="c008aff75f2143367641ee8acfcb7cdf4c748c1426c9afcf28064c5a0ae24f39"
Sep 09 20:58:24.700704 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:58:24.700662    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c008aff75f2143367641ee8acfcb7cdf4c748c1426c9afcf28064c5a0ae24f39\": container with ID starting with c008aff75f2143367641ee8acfcb7cdf4c748c1426c9afcf28064c5a0ae24f39 not found: ID does not exist" containerID="c008aff75f2143367641ee8acfcb7cdf4c748c1426c9afcf28064c5a0ae24f39"
Sep 09 20:58:24.700812 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:58:24.700714    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c008aff75f2143367641ee8acfcb7cdf4c748c1426c9afcf28064c5a0ae24f39"} err="failed to get container status \"c008aff75f2143367641ee8acfcb7cdf4c748c1426c9afcf28064c5a0ae24f39\": rpc error: code = NotFound desc = could not find container \"c008aff75f2143367641ee8acfcb7cdf4c748c1426c9afcf28064c5a0ae24f39\": container with ID starting with c008aff75f2143367641ee8acfcb7cdf4c748c1426c9afcf28064c5a0ae24f39 not found: ID does not exist"
Sep 09 20:58:24.703872 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:58:24.703840    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-4brpd\" is forbidden: User \"system:node:ip-10-0-140-70.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-70.ec2.internal' and this object" podUID="23a4c5bb-da70-4f07-886b-12a1dc1d855a" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-4brpd"
Sep 09 20:58:24.745980 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:58:24.745946    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4ttnh\" (UniqueName: \"kubernetes.io/projected/23a4c5bb-da70-4f07-886b-12a1dc1d855a-kube-api-access-4ttnh\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 09 20:58:24.966410 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:58:24.966364    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-d4zp8"]
Sep 09 20:58:24.971528 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:58:24.971473    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod781b3827_fbc2_46a6_b9f2_1f95eacbcfbb.slice/crio-772275f432479117409cdc28bc56909ccb43dcf976fa6dd05e5b93dfe5976182 WatchSource:0}: Error finding container 772275f432479117409cdc28bc56909ccb43dcf976fa6dd05e5b93dfe5976182: Status 404 returned error can't find the container with id 772275f432479117409cdc28bc56909ccb43dcf976fa6dd05e5b93dfe5976182
Sep 09 20:58:25.697797 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:58:25.697757    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-d4zp8" event={"ID":"781b3827-fbc2-46a6-b9f2-1f95eacbcfbb","Type":"ContainerStarted","Data":"1159dcbd224b0170f7880776aeb8bfa51b9db1516c92ca14d48e7b765fe9f11f"}
Sep 09 20:58:25.698272 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:58:25.697818    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-d4zp8" event={"ID":"781b3827-fbc2-46a6-b9f2-1f95eacbcfbb","Type":"ContainerStarted","Data":"772275f432479117409cdc28bc56909ccb43dcf976fa6dd05e5b93dfe5976182"}
Sep 09 20:58:25.698272 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:58:25.697926    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-d4zp8"
Sep 09 20:58:25.700199 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:58:25.700170    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-4brpd\" is forbidden: User \"system:node:ip-10-0-140-70.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-70.ec2.internal' and this object" podUID="23a4c5bb-da70-4f07-886b-12a1dc1d855a" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-4brpd"
Sep 09 20:58:25.722632 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:58:25.722584    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-d4zp8" podStartSLOduration=1.722567802 podStartE2EDuration="1.722567802s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:58:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:58:25.721337015 +0000 UTC m=+670.173128543" watchObservedRunningTime="2026-09-09 20:58:25.722567802 +0000 UTC m=+670.174359330"
Sep 09 20:58:26.046715 ip-10-0-140-70 kubenswrapper[2560]: E0909 20:58:26.046658    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-4brpd\" is forbidden: User \"system:node:ip-10-0-140-70.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-70.ec2.internal' and this object" podUID="23a4c5bb-da70-4f07-886b-12a1dc1d855a" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-4brpd"
Sep 09 20:58:26.049533 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:58:26.049509    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="23a4c5bb-da70-4f07-886b-12a1dc1d855a" path="/var/lib/kubelet/pods/23a4c5bb-da70-4f07-886b-12a1dc1d855a/volumes"
Sep 09 20:58:30.672452 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:58:30.672411    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-76b478bd78-ngf5m"
Sep 09 20:58:36.706334 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:58:36.706302    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-d4zp8"
Sep 09 20:58:54.641744 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:58:54.641706    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-bdx8p"]
Sep 09 20:58:54.650145 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:58:54.650123    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-bdx8p"
Sep 09 20:58:54.652637 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:58:54.652612    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-m6pzg\""
Sep 09 20:58:54.662517 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:58:54.662493    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-bdx8p"]
Sep 09 20:58:54.817800 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:58:54.817754    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a3892e4a-facc-43ff-a868-f2388afe8ebd-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-bdx8p\" (UID: \"a3892e4a-facc-43ff-a868-f2388afe8ebd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-bdx8p"
Sep 09 20:58:54.817800 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:58:54.817806    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a3892e4a-facc-43ff-a868-f2388afe8ebd-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-bdx8p\" (UID: \"a3892e4a-facc-43ff-a868-f2388afe8ebd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-bdx8p"
Sep 09 20:58:54.818009 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:58:54.817887    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlh5v\" (UniqueName: \"kubernetes.io/projected/a3892e4a-facc-43ff-a868-f2388afe8ebd-kube-api-access-wlh5v\") pod \"maas-default-gateway-openshift-default-78bb78ff78-bdx8p\" (UID: \"a3892e4a-facc-43ff-a868-f2388afe8ebd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-bdx8p"
Sep 09 20:58:54.818009 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:58:54.817938    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3892e4a-facc-43ff-a868-f2388afe8ebd-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-bdx8p\" (UID: \"a3892e4a-facc-43ff-a868-f2388afe8ebd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-bdx8p"
Sep 09 20:58:54.818009 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:58:54.817958    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a3892e4a-facc-43ff-a868-f2388afe8ebd-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-bdx8p\" (UID: \"a3892e4a-facc-43ff-a868-f2388afe8ebd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-bdx8p"
Sep 09 20:58:54.818009 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:58:54.818002    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a3892e4a-facc-43ff-a868-f2388afe8ebd-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-bdx8p\" (UID: \"a3892e4a-facc-43ff-a868-f2388afe8ebd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-bdx8p"
Sep 09 20:58:54.818138 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:58:54.818036    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a3892e4a-facc-43ff-a868-f2388afe8ebd-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-bdx8p\" (UID: \"a3892e4a-facc-43ff-a868-f2388afe8ebd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-bdx8p"
Sep 09 20:58:54.818138 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:58:54.818083    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3892e4a-facc-43ff-a868-f2388afe8ebd-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-bdx8p\" (UID: \"a3892e4a-facc-43ff-a868-f2388afe8ebd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-bdx8p"
Sep 09 20:58:54.818200 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:58:54.818158    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a3892e4a-facc-43ff-a868-f2388afe8ebd-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-bdx8p\" (UID: \"a3892e4a-facc-43ff-a868-f2388afe8ebd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-bdx8p"
Sep 09 20:58:54.919487 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:58:54.919390    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a3892e4a-facc-43ff-a868-f2388afe8ebd-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-bdx8p\" (UID: \"a3892e4a-facc-43ff-a868-f2388afe8ebd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-bdx8p"
Sep 09 20:58:54.919487 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:58:54.919445    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a3892e4a-facc-43ff-a868-f2388afe8ebd-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-bdx8p\" (UID: \"a3892e4a-facc-43ff-a868-f2388afe8ebd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-bdx8p"
Sep 09 20:58:54.919487 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:58:54.919467    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a3892e4a-facc-43ff-a868-f2388afe8ebd-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-bdx8p\" (UID: \"a3892e4a-facc-43ff-a868-f2388afe8ebd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-bdx8p"
Sep 09 20:58:54.919895 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:58:54.919494    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlh5v\" (UniqueName: \"kubernetes.io/projected/a3892e4a-facc-43ff-a868-f2388afe8ebd-kube-api-access-wlh5v\") pod \"maas-default-gateway-openshift-default-78bb78ff78-bdx8p\" (UID: \"a3892e4a-facc-43ff-a868-f2388afe8ebd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-bdx8p"
Sep 09 20:58:54.919895 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:58:54.919524    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3892e4a-facc-43ff-a868-f2388afe8ebd-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-bdx8p\" (UID: \"a3892e4a-facc-43ff-a868-f2388afe8ebd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-bdx8p"
Sep 09 20:58:54.919895 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:58:54.919542    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a3892e4a-facc-43ff-a868-f2388afe8ebd-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-bdx8p\" (UID: \"a3892e4a-facc-43ff-a868-f2388afe8ebd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-bdx8p"
Sep 09 20:58:54.919895 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:58:54.919574    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a3892e4a-facc-43ff-a868-f2388afe8ebd-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-bdx8p\" (UID: \"a3892e4a-facc-43ff-a868-f2388afe8ebd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-bdx8p"
Sep 09 20:58:54.919895 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:58:54.919774    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a3892e4a-facc-43ff-a868-f2388afe8ebd-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-bdx8p\" (UID: \"a3892e4a-facc-43ff-a868-f2388afe8ebd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-bdx8p"
Sep 09 20:58:54.919895 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:58:54.919817    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3892e4a-facc-43ff-a868-f2388afe8ebd-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-bdx8p\" (UID: \"a3892e4a-facc-43ff-a868-f2388afe8ebd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-bdx8p"
Sep 09 20:58:54.920209 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:58:54.919900    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a3892e4a-facc-43ff-a868-f2388afe8ebd-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-bdx8p\" (UID: \"a3892e4a-facc-43ff-a868-f2388afe8ebd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-bdx8p"
Sep 09 20:58:54.920209 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:58:54.920049    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3892e4a-facc-43ff-a868-f2388afe8ebd-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-bdx8p\" (UID: \"a3892e4a-facc-43ff-a868-f2388afe8ebd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-bdx8p"
Sep 09 20:58:54.920209 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:58:54.920148    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3892e4a-facc-43ff-a868-f2388afe8ebd-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-bdx8p\" (UID: \"a3892e4a-facc-43ff-a868-f2388afe8ebd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-bdx8p"
Sep 09 20:58:54.920337 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:58:54.920239    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a3892e4a-facc-43ff-a868-f2388afe8ebd-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-bdx8p\" (UID: \"a3892e4a-facc-43ff-a868-f2388afe8ebd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-bdx8p"
Sep 09 20:58:54.920394 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:58:54.920354    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a3892e4a-facc-43ff-a868-f2388afe8ebd-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-bdx8p\" (UID: \"a3892e4a-facc-43ff-a868-f2388afe8ebd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-bdx8p"
Sep 09 20:58:54.922201 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:58:54.922175    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a3892e4a-facc-43ff-a868-f2388afe8ebd-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-bdx8p\" (UID: \"a3892e4a-facc-43ff-a868-f2388afe8ebd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-bdx8p"
Sep 09 20:58:54.922296 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:58:54.922237    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a3892e4a-facc-43ff-a868-f2388afe8ebd-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-bdx8p\" (UID: \"a3892e4a-facc-43ff-a868-f2388afe8ebd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-bdx8p"
Sep 09 20:58:54.929106 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:58:54.929077    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlh5v\" (UniqueName: \"kubernetes.io/projected/a3892e4a-facc-43ff-a868-f2388afe8ebd-kube-api-access-wlh5v\") pod \"maas-default-gateway-openshift-default-78bb78ff78-bdx8p\" (UID: \"a3892e4a-facc-43ff-a868-f2388afe8ebd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-bdx8p"
Sep 09 20:58:54.931187 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:58:54.931164    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a3892e4a-facc-43ff-a868-f2388afe8ebd-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-bdx8p\" (UID: \"a3892e4a-facc-43ff-a868-f2388afe8ebd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-bdx8p"
Sep 09 20:58:54.962641 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:58:54.962608    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-bdx8p"
Sep 09 20:58:55.238761 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:58:55.238737    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-bdx8p"]
Sep 09 20:58:55.240867 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:58:55.240838    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3892e4a_facc_43ff_a868_f2388afe8ebd.slice/crio-040118c2662faf120bd9417e47067fb111d23340d260ae44fbc74a94a5e6a326 WatchSource:0}: Error finding container 040118c2662faf120bd9417e47067fb111d23340d260ae44fbc74a94a5e6a326: Status 404 returned error can't find the container with id 040118c2662faf120bd9417e47067fb111d23340d260ae44fbc74a94a5e6a326
Sep 09 20:58:55.242919 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:58:55.242877    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 09 20:58:55.243027 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:58:55.242963    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 09 20:58:55.243027 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:58:55.243007    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 09 20:58:55.848201 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:58:55.848153    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-bdx8p" event={"ID":"a3892e4a-facc-43ff-a868-f2388afe8ebd","Type":"ContainerStarted","Data":"20694ef04f07c1b502c3e2a2ca466eb429c9b45a8a94f7de50fb0a47df25aa23"}
Sep 09 20:58:55.848589 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:58:55.848219    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-bdx8p" event={"ID":"a3892e4a-facc-43ff-a868-f2388afe8ebd","Type":"ContainerStarted","Data":"040118c2662faf120bd9417e47067fb111d23340d260ae44fbc74a94a5e6a326"}
Sep 09 20:58:55.869770 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:58:55.869721    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-bdx8p" podStartSLOduration=1.869705407 podStartE2EDuration="1.869705407s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:58:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:58:55.867391602 +0000 UTC m=+700.319183130" watchObservedRunningTime="2026-09-09 20:58:55.869705407 +0000 UTC m=+700.321496934"
Sep 09 20:58:55.963388 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:58:55.963355    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-bdx8p"
Sep 09 20:58:56.968513 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:58:56.968480    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-bdx8p"
Sep 09 20:58:57.105877 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:58:57.105840    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-swpwl"]
Sep 09 20:58:57.109723 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:58:57.109701    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-swpwl"
Sep 09 20:58:57.112183 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:58:57.112154    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 09 20:58:57.112183 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:58:57.112180    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-fc772\""
Sep 09 20:58:57.120221 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:58:57.120197    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-swpwl"]
Sep 09 20:58:57.161978 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:58:57.161944    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-swpwl"]
Sep 09 20:58:57.241116 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:58:57.241027    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ea4e0c6d-5e34-4be8-a5a6-41083a764bdd-config-file\") pod \"limitador-limitador-84994f7ffc-swpwl\" (UID: \"ea4e0c6d-5e34-4be8-a5a6-41083a764bdd\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-swpwl"
Sep 09 20:58:57.241116 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:58:57.241068    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thvnq\" (UniqueName: \"kubernetes.io/projected/ea4e0c6d-5e34-4be8-a5a6-41083a764bdd-kube-api-access-thvnq\") pod \"limitador-limitador-84994f7ffc-swpwl\" (UID: \"ea4e0c6d-5e34-4be8-a5a6-41083a764bdd\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-swpwl"
Sep 09 20:58:57.342540 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:58:57.342503    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ea4e0c6d-5e34-4be8-a5a6-41083a764bdd-config-file\") pod \"limitador-limitador-84994f7ffc-swpwl\" (UID: \"ea4e0c6d-5e34-4be8-a5a6-41083a764bdd\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-swpwl"
Sep 09 20:58:57.342760 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:58:57.342555    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thvnq\" (UniqueName: \"kubernetes.io/projected/ea4e0c6d-5e34-4be8-a5a6-41083a764bdd-kube-api-access-thvnq\") pod \"limitador-limitador-84994f7ffc-swpwl\" (UID: \"ea4e0c6d-5e34-4be8-a5a6-41083a764bdd\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-swpwl"
Sep 09 20:58:57.343189 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:58:57.343166    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ea4e0c6d-5e34-4be8-a5a6-41083a764bdd-config-file\") pod \"limitador-limitador-84994f7ffc-swpwl\" (UID: \"ea4e0c6d-5e34-4be8-a5a6-41083a764bdd\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-swpwl"
Sep 09 20:58:57.353342 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:58:57.353312    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-thvnq\" (UniqueName: \"kubernetes.io/projected/ea4e0c6d-5e34-4be8-a5a6-41083a764bdd-kube-api-access-thvnq\") pod \"limitador-limitador-84994f7ffc-swpwl\" (UID: \"ea4e0c6d-5e34-4be8-a5a6-41083a764bdd\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-swpwl"
Sep 09 20:58:57.421738 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:58:57.421693    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-swpwl"
Sep 09 20:58:57.698252 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:58:57.698215    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-swpwl"]
Sep 09 20:58:57.701499 ip-10-0-140-70 kubenswrapper[2560]: W0909 20:58:57.701469    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea4e0c6d_5e34_4be8_a5a6_41083a764bdd.slice/crio-37e73dfc83e1e2ccae235230ee9583cb9f2510f646f2e251ae64e8968073170e WatchSource:0}: Error finding container 37e73dfc83e1e2ccae235230ee9583cb9f2510f646f2e251ae64e8968073170e: Status 404 returned error can't find the container with id 37e73dfc83e1e2ccae235230ee9583cb9f2510f646f2e251ae64e8968073170e
Sep 09 20:58:57.859139 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:58:57.859101    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-swpwl" event={"ID":"ea4e0c6d-5e34-4be8-a5a6-41083a764bdd","Type":"ContainerStarted","Data":"37e73dfc83e1e2ccae235230ee9583cb9f2510f646f2e251ae64e8968073170e"}
Sep 09 20:58:57.859363 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:58:57.859338    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-bdx8p"
Sep 09 20:58:57.860478 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:58:57.860455    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-bdx8p"
Sep 09 20:59:00.876603 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:59:00.876569    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-swpwl" event={"ID":"ea4e0c6d-5e34-4be8-a5a6-41083a764bdd","Type":"ContainerStarted","Data":"314c67f85b89db398a0baaa39d381c6a50d5d69c820b8c9a08cb803057aad61d"}
Sep 09 20:59:00.877029 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:59:00.876641    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-swpwl"
Sep 09 20:59:00.894453 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:59:00.894405    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-84994f7ffc-swpwl" podStartSLOduration=1.239369557 podStartE2EDuration="3.894389734s" totalImagesPullingTime="2.655020177s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:58:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:59:00.892566788 +0000 UTC m=+705.344358316" watchObservedRunningTime="2026-09-09 20:59:00.894389734 +0000 UTC m=+705.346181261"
Sep 09 20:59:11.882491 ip-10-0-140-70 kubenswrapper[2560]: I0909 20:59:11.882403    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-swpwl"
Sep 09 21:00:11.326216 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:00:11.326176    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-swpwl"]
Sep 09 21:00:21.260147 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:00:21.260112    2560 generic.go:356] "Generic (PLEG): container finished" podID="a3892e4a-facc-43ff-a868-f2388afe8ebd" containerID="20694ef04f07c1b502c3e2a2ca466eb429c9b45a8a94f7de50fb0a47df25aa23" exitCode=0
Sep 09 21:00:21.260539 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:00:21.260183    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-bdx8p" event={"ID":"a3892e4a-facc-43ff-a868-f2388afe8ebd","Type":"ContainerDied","Data":"20694ef04f07c1b502c3e2a2ca466eb429c9b45a8a94f7de50fb0a47df25aa23"}
Sep 09 21:00:21.260582 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:00:21.260567    2560 scope.go:117] "RemoveContainer" containerID="20694ef04f07c1b502c3e2a2ca466eb429c9b45a8a94f7de50fb0a47df25aa23"
Sep 09 21:00:21.261551 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:00:21.261525    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 09 21:00:21.261602 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:00:21.261587    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 09 21:00:21.261636 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:00:21.261621    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 09 21:00:22.270497 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:00:22.270458    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-bdx8p" event={"ID":"a3892e4a-facc-43ff-a868-f2388afe8ebd","Type":"ContainerStarted","Data":"b36feb8f03464ea18cdaa7656e9d8d07f0f6091e42b593414e743707c3e48fd0"}
Sep 09 21:00:22.963836 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:00:22.963802    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-bdx8p"
Sep 09 21:00:22.964229 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:00:22.964134    2560 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-bdx8p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" start-of-body=
Sep 09 21:00:22.964422 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:00:22.964397    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-bdx8p" podUID="a3892e4a-facc-43ff-a868-f2388afe8ebd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused"
Sep 09 21:00:23.963878 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:00:23.963834    2560 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-bdx8p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" start-of-body=
Sep 09 21:00:23.964375 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:00:23.963903    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-bdx8p" podUID="a3892e4a-facc-43ff-a868-f2388afe8ebd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused"
Sep 09 21:00:24.963195 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:00:24.963150    2560 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-bdx8p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" start-of-body=
Sep 09 21:00:24.963408 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:00:24.963222    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-bdx8p" podUID="a3892e4a-facc-43ff-a868-f2388afe8ebd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused"
Sep 09 21:00:25.963714 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:00:25.963651    2560 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-bdx8p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" start-of-body=
Sep 09 21:00:25.964370 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:00:25.964333    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-bdx8p" podUID="a3892e4a-facc-43ff-a868-f2388afe8ebd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused"
Sep 09 21:00:26.963654 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:00:26.963602    2560 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-bdx8p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" start-of-body=
Sep 09 21:00:26.963889 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:00:26.963715    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-bdx8p" podUID="a3892e4a-facc-43ff-a868-f2388afe8ebd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused"
Sep 09 21:00:27.859651 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:00:27.859618    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-bdx8p"
Sep 09 21:00:27.966684 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:00:27.966648    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-bdx8p"
Sep 09 21:00:28.246992 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:00:28.246913    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-swpwl"]
Sep 09 21:00:28.300664 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:00:28.300641    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-bdx8p"
Sep 09 21:00:32.699559 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:00:32.699520    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-6685d86975-5qcsl"]
Sep 09 21:00:32.702467 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:00:32.702443    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-6685d86975-5qcsl"
Sep 09 21:00:32.705126 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:00:32.705104    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Sep 09 21:00:32.705210 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:00:32.705104    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 09 21:00:32.706224 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:00:32.706207    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 09 21:00:32.706296 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:00:32.706278    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-gkdq5\""
Sep 09 21:00:32.713650 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:00:32.713630    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-6685d86975-5qcsl"]
Sep 09 21:00:32.776641 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:00:32.776614    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/55a84eac-e988-4438-b562-536bca73e5cd-model-cache\") pod \"e2e-distinct-simulated-kserve-6685d86975-5qcsl\" (UID: \"55a84eac-e988-4438-b562-536bca73e5cd\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-5qcsl"
Sep 09 21:00:32.776766 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:00:32.776648    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/55a84eac-e988-4438-b562-536bca73e5cd-tls-certs\") pod \"e2e-distinct-simulated-kserve-6685d86975-5qcsl\" (UID: \"55a84eac-e988-4438-b562-536bca73e5cd\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-5qcsl"
Sep 09 21:00:32.776766 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:00:32.776750    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d595q\" (UniqueName: \"kubernetes.io/projected/55a84eac-e988-4438-b562-536bca73e5cd-kube-api-access-d595q\") pod \"e2e-distinct-simulated-kserve-6685d86975-5qcsl\" (UID: \"55a84eac-e988-4438-b562-536bca73e5cd\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-5qcsl"
Sep 09 21:00:32.776839 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:00:32.776786    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/55a84eac-e988-4438-b562-536bca73e5cd-tmp-dir\") pod \"e2e-distinct-simulated-kserve-6685d86975-5qcsl\" (UID: \"55a84eac-e988-4438-b562-536bca73e5cd\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-5qcsl"
Sep 09 21:00:32.776839 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:00:32.776819    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/55a84eac-e988-4438-b562-536bca73e5cd-home\") pod \"e2e-distinct-simulated-kserve-6685d86975-5qcsl\" (UID: \"55a84eac-e988-4438-b562-536bca73e5cd\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-5qcsl"
Sep 09 21:00:32.776905 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:00:32.776844    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/55a84eac-e988-4438-b562-536bca73e5cd-dshm\") pod \"e2e-distinct-simulated-kserve-6685d86975-5qcsl\" (UID: \"55a84eac-e988-4438-b562-536bca73e5cd\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-5qcsl"
Sep 09 21:00:32.877507 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:00:32.877476    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/55a84eac-e988-4438-b562-536bca73e5cd-tmp-dir\") pod \"e2e-distinct-simulated-kserve-6685d86975-5qcsl\" (UID: \"55a84eac-e988-4438-b562-536bca73e5cd\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-5qcsl"
Sep 09 21:00:32.877611 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:00:32.877517    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/55a84eac-e988-4438-b562-536bca73e5cd-home\") pod \"e2e-distinct-simulated-kserve-6685d86975-5qcsl\" (UID: \"55a84eac-e988-4438-b562-536bca73e5cd\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-5qcsl"
Sep 09 21:00:32.877611 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:00:32.877538    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/55a84eac-e988-4438-b562-536bca73e5cd-dshm\") pod \"e2e-distinct-simulated-kserve-6685d86975-5qcsl\" (UID: \"55a84eac-e988-4438-b562-536bca73e5cd\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-5qcsl"
Sep 09 21:00:32.877611 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:00:32.877583    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/55a84eac-e988-4438-b562-536bca73e5cd-model-cache\") pod \"e2e-distinct-simulated-kserve-6685d86975-5qcsl\" (UID: \"55a84eac-e988-4438-b562-536bca73e5cd\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-5qcsl"
Sep 09 21:00:32.877611 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:00:32.877607    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/55a84eac-e988-4438-b562-536bca73e5cd-tls-certs\") pod \"e2e-distinct-simulated-kserve-6685d86975-5qcsl\" (UID: \"55a84eac-e988-4438-b562-536bca73e5cd\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-5qcsl"
Sep 09 21:00:32.877827 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:00:32.877700    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d595q\" (UniqueName: \"kubernetes.io/projected/55a84eac-e988-4438-b562-536bca73e5cd-kube-api-access-d595q\") pod \"e2e-distinct-simulated-kserve-6685d86975-5qcsl\" (UID: \"55a84eac-e988-4438-b562-536bca73e5cd\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-5qcsl"
Sep 09 21:00:32.877986 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:00:32.877966    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/55a84eac-e988-4438-b562-536bca73e5cd-home\") pod \"e2e-distinct-simulated-kserve-6685d86975-5qcsl\" (UID: \"55a84eac-e988-4438-b562-536bca73e5cd\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-5qcsl"
Sep 09 21:00:32.878066 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:00:32.877967    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/55a84eac-e988-4438-b562-536bca73e5cd-tmp-dir\") pod \"e2e-distinct-simulated-kserve-6685d86975-5qcsl\" (UID: \"55a84eac-e988-4438-b562-536bca73e5cd\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-5qcsl"
Sep 09 21:00:32.878105 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:00:32.878066    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/55a84eac-e988-4438-b562-536bca73e5cd-model-cache\") pod \"e2e-distinct-simulated-kserve-6685d86975-5qcsl\" (UID: \"55a84eac-e988-4438-b562-536bca73e5cd\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-5qcsl"
Sep 09 21:00:32.879916 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:00:32.879893    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/55a84eac-e988-4438-b562-536bca73e5cd-dshm\") pod \"e2e-distinct-simulated-kserve-6685d86975-5qcsl\" (UID: \"55a84eac-e988-4438-b562-536bca73e5cd\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-5qcsl"
Sep 09 21:00:32.880140 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:00:32.880121    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/55a84eac-e988-4438-b562-536bca73e5cd-tls-certs\") pod \"e2e-distinct-simulated-kserve-6685d86975-5qcsl\" (UID: \"55a84eac-e988-4438-b562-536bca73e5cd\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-5qcsl"
Sep 09 21:00:32.889763 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:00:32.889737    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d595q\" (UniqueName: \"kubernetes.io/projected/55a84eac-e988-4438-b562-536bca73e5cd-kube-api-access-d595q\") pod \"e2e-distinct-simulated-kserve-6685d86975-5qcsl\" (UID: \"55a84eac-e988-4438-b562-536bca73e5cd\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-5qcsl"
Sep 09 21:00:33.013058 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:00:33.012998    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-6685d86975-5qcsl"
Sep 09 21:00:33.298818 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:00:33.297130    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-6685d86975-5qcsl"]
Sep 09 21:00:33.300704 ip-10-0-140-70 kubenswrapper[2560]: W0909 21:00:33.300648    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55a84eac_e988_4438_b562_536bca73e5cd.slice/crio-7b71303374223b07e7d85bc9b32a1a618c19df288aa99cb47a49d4219959e44f WatchSource:0}: Error finding container 7b71303374223b07e7d85bc9b32a1a618c19df288aa99cb47a49d4219959e44f: Status 404 returned error can't find the container with id 7b71303374223b07e7d85bc9b32a1a618c19df288aa99cb47a49d4219959e44f
Sep 09 21:00:33.324245 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:00:33.324217    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-5qcsl" event={"ID":"55a84eac-e988-4438-b562-536bca73e5cd","Type":"ContainerStarted","Data":"7b71303374223b07e7d85bc9b32a1a618c19df288aa99cb47a49d4219959e44f"}
Sep 09 21:00:33.579991 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:00:33.579924    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-swpwl"]
Sep 09 21:00:35.336169 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:00:35.336137    2560 generic.go:356] "Generic (PLEG): container finished" podID="55a84eac-e988-4438-b562-536bca73e5cd" containerID="144b1d61bde6cda320772d7031855b2fefa14db63af02adcdf7398d355a27226" exitCode=0
Sep 09 21:00:35.336566 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:00:35.336182    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-5qcsl" event={"ID":"55a84eac-e988-4438-b562-536bca73e5cd","Type":"ContainerDied","Data":"144b1d61bde6cda320772d7031855b2fefa14db63af02adcdf7398d355a27226"}
Sep 09 21:00:35.336566 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:00:35.336376    2560 scope.go:117] "RemoveContainer" containerID="144b1d61bde6cda320772d7031855b2fefa14db63af02adcdf7398d355a27226"
Sep 09 21:00:36.342804 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:00:36.342769    2560 generic.go:356] "Generic (PLEG): container finished" podID="55a84eac-e988-4438-b562-536bca73e5cd" containerID="400f0e049c0cce65052f45f026e2a048a40b079131c13677ae693933164a2947" exitCode=0
Sep 09 21:00:36.343206 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:00:36.342812    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-5qcsl" event={"ID":"55a84eac-e988-4438-b562-536bca73e5cd","Type":"ContainerDied","Data":"400f0e049c0cce65052f45f026e2a048a40b079131c13677ae693933164a2947"}
Sep 09 21:00:36.343206 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:00:36.342858    2560 scope.go:117] "RemoveContainer" containerID="144b1d61bde6cda320772d7031855b2fefa14db63af02adcdf7398d355a27226"
Sep 09 21:00:36.343206 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:00:36.343104    2560 scope.go:117] "RemoveContainer" containerID="400f0e049c0cce65052f45f026e2a048a40b079131c13677ae693933164a2947"
Sep 09 21:00:36.343347 ip-10-0-140-70 kubenswrapper[2560]: E0909 21:00:36.343324    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-5qcsl_llm(55a84eac-e988-4438-b562-536bca73e5cd)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-5qcsl" podUID="55a84eac-e988-4438-b562-536bca73e5cd"
Sep 09 21:00:37.349152 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:00:37.349124    2560 scope.go:117] "RemoveContainer" containerID="400f0e049c0cce65052f45f026e2a048a40b079131c13677ae693933164a2947"
Sep 09 21:00:37.349523 ip-10-0-140-70 kubenswrapper[2560]: E0909 21:00:37.349280    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-5qcsl_llm(55a84eac-e988-4438-b562-536bca73e5cd)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-5qcsl" podUID="55a84eac-e988-4438-b562-536bca73e5cd"
Sep 09 21:00:43.013370 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:00:43.013334    2560 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-5qcsl"
Sep 09 21:00:43.013746 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:00:43.013396    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-5qcsl"
Sep 09 21:00:43.013746 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:00:43.013413    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-5qcsl"
Sep 09 21:00:43.013746 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:00:43.013430    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-6685d86975-5qcsl"
Sep 09 21:00:43.013746 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:00:43.013735    2560 scope.go:117] "RemoveContainer" containerID="400f0e049c0cce65052f45f026e2a048a40b079131c13677ae693933164a2947"
Sep 09 21:00:43.013904 ip-10-0-140-70 kubenswrapper[2560]: E0909 21:00:43.013886    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-5qcsl_llm(55a84eac-e988-4438-b562-536bca73e5cd)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-5qcsl" podUID="55a84eac-e988-4438-b562-536bca73e5cd"
Sep 09 21:00:50.823203 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:00:50.823168    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-swpwl"]
Sep 09 21:00:57.042222 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:00:57.042189    2560 scope.go:117] "RemoveContainer" containerID="400f0e049c0cce65052f45f026e2a048a40b079131c13677ae693933164a2947"
Sep 09 21:00:57.450180 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:00:57.450150    2560 generic.go:356] "Generic (PLEG): container finished" podID="55a84eac-e988-4438-b562-536bca73e5cd" containerID="ce5e2843ad4a6aec16e71e4ace76c374d2e49a02209d37d4a874aa02c9cfad4e" exitCode=0
Sep 09 21:00:57.450341 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:00:57.450228    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-5qcsl" event={"ID":"55a84eac-e988-4438-b562-536bca73e5cd","Type":"ContainerDied","Data":"ce5e2843ad4a6aec16e71e4ace76c374d2e49a02209d37d4a874aa02c9cfad4e"}
Sep 09 21:00:57.450341 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:00:57.450296    2560 scope.go:117] "RemoveContainer" containerID="400f0e049c0cce65052f45f026e2a048a40b079131c13677ae693933164a2947"
Sep 09 21:00:57.450706 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:00:57.450660    2560 scope.go:117] "RemoveContainer" containerID="ce5e2843ad4a6aec16e71e4ace76c374d2e49a02209d37d4a874aa02c9cfad4e"
Sep 09 21:00:57.450920 ip-10-0-140-70 kubenswrapper[2560]: E0909 21:00:57.450897    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-5qcsl_llm(55a84eac-e988-4438-b562-536bca73e5cd)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-5qcsl" podUID="55a84eac-e988-4438-b562-536bca73e5cd"
Sep 09 21:01:02.022229 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:01:02.022194    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-swpwl"]
Sep 09 21:01:03.013378 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:01:03.013337    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-6685d86975-5qcsl"
Sep 09 21:01:03.013569 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:01:03.013402    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-5qcsl"
Sep 09 21:01:03.013569 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:01:03.013419    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-5qcsl"
Sep 09 21:01:03.013569 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:01:03.013433    2560 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-5qcsl"
Sep 09 21:01:03.013817 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:01:03.013804    2560 scope.go:117] "RemoveContainer" containerID="ce5e2843ad4a6aec16e71e4ace76c374d2e49a02209d37d4a874aa02c9cfad4e"
Sep 09 21:01:03.013989 ip-10-0-140-70 kubenswrapper[2560]: E0909 21:01:03.013971    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-5qcsl_llm(55a84eac-e988-4438-b562-536bca73e5cd)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-5qcsl" podUID="55a84eac-e988-4438-b562-536bca73e5cd"
Sep 09 21:01:03.481072 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:01:03.481046    2560 scope.go:117] "RemoveContainer" containerID="ce5e2843ad4a6aec16e71e4ace76c374d2e49a02209d37d4a874aa02c9cfad4e"
Sep 09 21:01:03.481423 ip-10-0-140-70 kubenswrapper[2560]: E0909 21:01:03.481219    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-5qcsl_llm(55a84eac-e988-4438-b562-536bca73e5cd)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-5qcsl" podUID="55a84eac-e988-4438-b562-536bca73e5cd"
Sep 09 21:01:08.311923 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:01:08.311887    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-swpwl"]
Sep 09 21:01:09.001891 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:01:09.001861    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf"]
Sep 09 21:01:09.005022 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:01:09.004996    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf"
Sep 09 21:01:09.007477 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:01:09.007455    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Sep 09 21:01:09.015613 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:01:09.015589    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf"]
Sep 09 21:01:09.090187 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:01:09.090152    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/590a2d15-b403-40de-81df-417fc78194c4-dshm\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf\" (UID: \"590a2d15-b403-40de-81df-417fc78194c4\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf"
Sep 09 21:01:09.090187 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:01:09.090191    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/590a2d15-b403-40de-81df-417fc78194c4-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf\" (UID: \"590a2d15-b403-40de-81df-417fc78194c4\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf"
Sep 09 21:01:09.090369 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:01:09.090209    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/590a2d15-b403-40de-81df-417fc78194c4-home\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf\" (UID: \"590a2d15-b403-40de-81df-417fc78194c4\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf"
Sep 09 21:01:09.090369 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:01:09.090225    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/590a2d15-b403-40de-81df-417fc78194c4-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf\" (UID: \"590a2d15-b403-40de-81df-417fc78194c4\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf"
Sep 09 21:01:09.090369 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:01:09.090282    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gg28t\" (UniqueName: \"kubernetes.io/projected/590a2d15-b403-40de-81df-417fc78194c4-kube-api-access-gg28t\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf\" (UID: \"590a2d15-b403-40de-81df-417fc78194c4\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf"
Sep 09 21:01:09.090369 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:01:09.090339    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/590a2d15-b403-40de-81df-417fc78194c4-model-cache\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf\" (UID: \"590a2d15-b403-40de-81df-417fc78194c4\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf"
Sep 09 21:01:09.191307 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:01:09.191272    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/590a2d15-b403-40de-81df-417fc78194c4-dshm\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf\" (UID: \"590a2d15-b403-40de-81df-417fc78194c4\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf"
Sep 09 21:01:09.191505 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:01:09.191314    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/590a2d15-b403-40de-81df-417fc78194c4-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf\" (UID: \"590a2d15-b403-40de-81df-417fc78194c4\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf"
Sep 09 21:01:09.191505 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:01:09.191331    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/590a2d15-b403-40de-81df-417fc78194c4-home\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf\" (UID: \"590a2d15-b403-40de-81df-417fc78194c4\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf"
Sep 09 21:01:09.191505 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:01:09.191346    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/590a2d15-b403-40de-81df-417fc78194c4-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf\" (UID: \"590a2d15-b403-40de-81df-417fc78194c4\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf"
Sep 09 21:01:09.191505 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:01:09.191394    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gg28t\" (UniqueName: \"kubernetes.io/projected/590a2d15-b403-40de-81df-417fc78194c4-kube-api-access-gg28t\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf\" (UID: \"590a2d15-b403-40de-81df-417fc78194c4\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf"
Sep 09 21:01:09.191505 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:01:09.191423    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/590a2d15-b403-40de-81df-417fc78194c4-model-cache\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf\" (UID: \"590a2d15-b403-40de-81df-417fc78194c4\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf"
Sep 09 21:01:09.191874 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:01:09.191788    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/590a2d15-b403-40de-81df-417fc78194c4-home\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf\" (UID: \"590a2d15-b403-40de-81df-417fc78194c4\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf"
Sep 09 21:01:09.191874 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:01:09.191813    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/590a2d15-b403-40de-81df-417fc78194c4-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf\" (UID: \"590a2d15-b403-40de-81df-417fc78194c4\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf"
Sep 09 21:01:09.191874 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:01:09.191850    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/590a2d15-b403-40de-81df-417fc78194c4-model-cache\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf\" (UID: \"590a2d15-b403-40de-81df-417fc78194c4\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf"
Sep 09 21:01:09.193638 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:01:09.193611    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/590a2d15-b403-40de-81df-417fc78194c4-dshm\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf\" (UID: \"590a2d15-b403-40de-81df-417fc78194c4\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf"
Sep 09 21:01:09.193913 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:01:09.193897    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/590a2d15-b403-40de-81df-417fc78194c4-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf\" (UID: \"590a2d15-b403-40de-81df-417fc78194c4\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf"
Sep 09 21:01:09.200073 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:01:09.200054    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gg28t\" (UniqueName: \"kubernetes.io/projected/590a2d15-b403-40de-81df-417fc78194c4-kube-api-access-gg28t\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf\" (UID: \"590a2d15-b403-40de-81df-417fc78194c4\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf"
Sep 09 21:01:09.317371 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:01:09.317314    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf"
Sep 09 21:01:09.586537 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:01:09.586506    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf"]
Sep 09 21:01:09.588120 ip-10-0-140-70 kubenswrapper[2560]: W0909 21:01:09.588094    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod590a2d15_b403_40de_81df_417fc78194c4.slice/crio-ef8a54f92597a6dee3cdd74ffdfcd2628443e96529bfd10bbf96d637353a984b WatchSource:0}: Error finding container ef8a54f92597a6dee3cdd74ffdfcd2628443e96529bfd10bbf96d637353a984b: Status 404 returned error can't find the container with id ef8a54f92597a6dee3cdd74ffdfcd2628443e96529bfd10bbf96d637353a984b
Sep 09 21:01:10.523083 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:01:10.523047    2560 generic.go:356] "Generic (PLEG): container finished" podID="590a2d15-b403-40de-81df-417fc78194c4" containerID="aa5a14200977338ac3f6bbcf9cc85f027f9ae8d10f43a742ed97d0a799532f6c" exitCode=0
Sep 09 21:01:10.523451 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:01:10.523101    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf" event={"ID":"590a2d15-b403-40de-81df-417fc78194c4","Type":"ContainerDied","Data":"aa5a14200977338ac3f6bbcf9cc85f027f9ae8d10f43a742ed97d0a799532f6c"}
Sep 09 21:01:10.523451 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:01:10.523142    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf" event={"ID":"590a2d15-b403-40de-81df-417fc78194c4","Type":"ContainerStarted","Data":"ef8a54f92597a6dee3cdd74ffdfcd2628443e96529bfd10bbf96d637353a984b"}
Sep 09 21:01:10.523451 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:01:10.523354    2560 scope.go:117] "RemoveContainer" containerID="aa5a14200977338ac3f6bbcf9cc85f027f9ae8d10f43a742ed97d0a799532f6c"
Sep 09 21:01:11.530012 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:01:11.529976    2560 generic.go:356] "Generic (PLEG): container finished" podID="590a2d15-b403-40de-81df-417fc78194c4" containerID="68d8440f4a67de86fc8ff1253b8f1866cc9d6f0fb28d18f5cc888b573c7c400f" exitCode=0
Sep 09 21:01:11.530413 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:01:11.530059    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf" event={"ID":"590a2d15-b403-40de-81df-417fc78194c4","Type":"ContainerDied","Data":"68d8440f4a67de86fc8ff1253b8f1866cc9d6f0fb28d18f5cc888b573c7c400f"}
Sep 09 21:01:11.530413 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:01:11.530119    2560 scope.go:117] "RemoveContainer" containerID="aa5a14200977338ac3f6bbcf9cc85f027f9ae8d10f43a742ed97d0a799532f6c"
Sep 09 21:01:11.530413 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:01:11.530350    2560 scope.go:117] "RemoveContainer" containerID="68d8440f4a67de86fc8ff1253b8f1866cc9d6f0fb28d18f5cc888b573c7c400f"
Sep 09 21:01:11.530562 ip-10-0-140-70 kubenswrapper[2560]: E0909 21:01:11.530542    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf_llm(590a2d15-b403-40de-81df-417fc78194c4)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf" podUID="590a2d15-b403-40de-81df-417fc78194c4"
Sep 09 21:01:12.537145 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:01:12.537122    2560 scope.go:117] "RemoveContainer" containerID="68d8440f4a67de86fc8ff1253b8f1866cc9d6f0fb28d18f5cc888b573c7c400f"
Sep 09 21:01:12.537473 ip-10-0-140-70 kubenswrapper[2560]: E0909 21:01:12.537288    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf_llm(590a2d15-b403-40de-81df-417fc78194c4)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf" podUID="590a2d15-b403-40de-81df-417fc78194c4"
Sep 09 21:01:14.602700 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:01:14.602653    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-swpwl"]
Sep 09 21:01:18.042497 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:01:18.042463    2560 scope.go:117] "RemoveContainer" containerID="ce5e2843ad4a6aec16e71e4ace76c374d2e49a02209d37d4a874aa02c9cfad4e"
Sep 09 21:01:18.569621 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:01:18.569537    2560 generic.go:356] "Generic (PLEG): container finished" podID="55a84eac-e988-4438-b562-536bca73e5cd" containerID="b0094a2cb7033c317f6d0eb4a226a40dd3e83f7e532016f5c74aa351541d1e8b" exitCode=0
Sep 09 21:01:18.569621 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:01:18.569608    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-5qcsl" event={"ID":"55a84eac-e988-4438-b562-536bca73e5cd","Type":"ContainerDied","Data":"b0094a2cb7033c317f6d0eb4a226a40dd3e83f7e532016f5c74aa351541d1e8b"}
Sep 09 21:01:18.569842 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:01:18.569692    2560 scope.go:117] "RemoveContainer" containerID="ce5e2843ad4a6aec16e71e4ace76c374d2e49a02209d37d4a874aa02c9cfad4e"
Sep 09 21:01:18.570050 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:01:18.570028    2560 scope.go:117] "RemoveContainer" containerID="b0094a2cb7033c317f6d0eb4a226a40dd3e83f7e532016f5c74aa351541d1e8b"
Sep 09 21:01:18.570269 ip-10-0-140-70 kubenswrapper[2560]: E0909 21:01:18.570249    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-5qcsl_llm(55a84eac-e988-4438-b562-536bca73e5cd)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-5qcsl" podUID="55a84eac-e988-4438-b562-536bca73e5cd"
Sep 09 21:01:19.317740 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:01:19.317709    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf"
Sep 09 21:01:19.318116 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:01:19.317779    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf"
Sep 09 21:01:19.318116 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:01:19.317797    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf"
Sep 09 21:01:19.318116 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:01:19.317810    2560 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf"
Sep 09 21:01:19.318244 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:01:19.318178    2560 scope.go:117] "RemoveContainer" containerID="68d8440f4a67de86fc8ff1253b8f1866cc9d6f0fb28d18f5cc888b573c7c400f"
Sep 09 21:01:19.318373 ip-10-0-140-70 kubenswrapper[2560]: E0909 21:01:19.318349    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf_llm(590a2d15-b403-40de-81df-417fc78194c4)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf" podUID="590a2d15-b403-40de-81df-417fc78194c4"
Sep 09 21:01:23.014106 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:01:23.014061    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-6685d86975-5qcsl"
Sep 09 21:01:23.014547 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:01:23.014146    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-5qcsl"
Sep 09 21:01:23.014547 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:01:23.014172    2560 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-5qcsl"
Sep 09 21:01:23.014547 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:01:23.014194    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-5qcsl"
Sep 09 21:01:23.014686 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:01:23.014642    2560 scope.go:117] "RemoveContainer" containerID="b0094a2cb7033c317f6d0eb4a226a40dd3e83f7e532016f5c74aa351541d1e8b"
Sep 09 21:01:23.014940 ip-10-0-140-70 kubenswrapper[2560]: E0909 21:01:23.014912    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-5qcsl_llm(55a84eac-e988-4438-b562-536bca73e5cd)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-5qcsl" podUID="55a84eac-e988-4438-b562-536bca73e5cd"
Sep 09 21:01:23.596829 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:01:23.596798    2560 scope.go:117] "RemoveContainer" containerID="b0094a2cb7033c317f6d0eb4a226a40dd3e83f7e532016f5c74aa351541d1e8b"
Sep 09 21:01:23.597005 ip-10-0-140-70 kubenswrapper[2560]: E0909 21:01:23.596988    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-5qcsl_llm(55a84eac-e988-4438-b562-536bca73e5cd)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-5qcsl" podUID="55a84eac-e988-4438-b562-536bca73e5cd"
Sep 09 21:01:33.042364 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:01:33.042334    2560 scope.go:117] "RemoveContainer" containerID="68d8440f4a67de86fc8ff1253b8f1866cc9d6f0fb28d18f5cc888b573c7c400f"
Sep 09 21:01:33.647641 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:01:33.647563    2560 generic.go:356] "Generic (PLEG): container finished" podID="590a2d15-b403-40de-81df-417fc78194c4" containerID="3c5bde151b4a3034e0a5f02cc36a397e06db618ba83eed7d5816594586b91932" exitCode=0
Sep 09 21:01:33.647792 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:01:33.647635    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf" event={"ID":"590a2d15-b403-40de-81df-417fc78194c4","Type":"ContainerDied","Data":"3c5bde151b4a3034e0a5f02cc36a397e06db618ba83eed7d5816594586b91932"}
Sep 09 21:01:33.647792 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:01:33.647737    2560 scope.go:117] "RemoveContainer" containerID="68d8440f4a67de86fc8ff1253b8f1866cc9d6f0fb28d18f5cc888b573c7c400f"
Sep 09 21:01:33.648064 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:01:33.648046    2560 scope.go:117] "RemoveContainer" containerID="3c5bde151b4a3034e0a5f02cc36a397e06db618ba83eed7d5816594586b91932"
Sep 09 21:01:33.648249 ip-10-0-140-70 kubenswrapper[2560]: E0909 21:01:33.648231    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf_llm(590a2d15-b403-40de-81df-417fc78194c4)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf" podUID="590a2d15-b403-40de-81df-417fc78194c4"
Sep 09 21:01:39.042220 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:01:39.042184    2560 scope.go:117] "RemoveContainer" containerID="b0094a2cb7033c317f6d0eb4a226a40dd3e83f7e532016f5c74aa351541d1e8b"
Sep 09 21:01:39.042605 ip-10-0-140-70 kubenswrapper[2560]: E0909 21:01:39.042368    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-5qcsl_llm(55a84eac-e988-4438-b562-536bca73e5cd)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-5qcsl" podUID="55a84eac-e988-4438-b562-536bca73e5cd"
Sep 09 21:01:39.318252 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:01:39.318169    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf"
Sep 09 21:01:39.318252 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:01:39.318251    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf"
Sep 09 21:01:39.318431 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:01:39.318267    2560 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf"
Sep 09 21:01:39.318431 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:01:39.318281    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf"
Sep 09 21:01:39.318593 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:01:39.318581    2560 scope.go:117] "RemoveContainer" containerID="3c5bde151b4a3034e0a5f02cc36a397e06db618ba83eed7d5816594586b91932"
Sep 09 21:01:39.318795 ip-10-0-140-70 kubenswrapper[2560]: E0909 21:01:39.318776    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf_llm(590a2d15-b403-40de-81df-417fc78194c4)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf" podUID="590a2d15-b403-40de-81df-417fc78194c4"
Sep 09 21:01:51.042319 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:01:51.042280    2560 scope.go:117] "RemoveContainer" containerID="3c5bde151b4a3034e0a5f02cc36a397e06db618ba83eed7d5816594586b91932"
Sep 09 21:01:51.042814 ip-10-0-140-70 kubenswrapper[2560]: E0909 21:01:51.042469    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf_llm(590a2d15-b403-40de-81df-417fc78194c4)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf" podUID="590a2d15-b403-40de-81df-417fc78194c4"
Sep 09 21:01:52.042824 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:01:52.042786    2560 scope.go:117] "RemoveContainer" containerID="b0094a2cb7033c317f6d0eb4a226a40dd3e83f7e532016f5c74aa351541d1e8b"
Sep 09 21:01:52.043284 ip-10-0-140-70 kubenswrapper[2560]: E0909 21:01:52.043040    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-5qcsl_llm(55a84eac-e988-4438-b562-536bca73e5cd)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-5qcsl" podUID="55a84eac-e988-4438-b562-536bca73e5cd"
Sep 09 21:02:03.042234 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:02:03.042200    2560 scope.go:117] "RemoveContainer" containerID="b0094a2cb7033c317f6d0eb4a226a40dd3e83f7e532016f5c74aa351541d1e8b"
Sep 09 21:02:03.799168 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:02:03.799137    2560 generic.go:356] "Generic (PLEG): container finished" podID="55a84eac-e988-4438-b562-536bca73e5cd" containerID="b1438a0a437f8ade4ca123d7bbacae070eb59ca931c5fefcc6fa80130a312e69" exitCode=0
Sep 09 21:02:03.799411 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:02:03.799209    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-5qcsl" event={"ID":"55a84eac-e988-4438-b562-536bca73e5cd","Type":"ContainerDied","Data":"b1438a0a437f8ade4ca123d7bbacae070eb59ca931c5fefcc6fa80130a312e69"}
Sep 09 21:02:03.799411 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:02:03.799272    2560 scope.go:117] "RemoveContainer" containerID="b0094a2cb7033c317f6d0eb4a226a40dd3e83f7e532016f5c74aa351541d1e8b"
Sep 09 21:02:03.799606 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:02:03.799590    2560 scope.go:117] "RemoveContainer" containerID="b1438a0a437f8ade4ca123d7bbacae070eb59ca931c5fefcc6fa80130a312e69"
Sep 09 21:02:03.799814 ip-10-0-140-70 kubenswrapper[2560]: E0909 21:02:03.799792    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-5qcsl_llm(55a84eac-e988-4438-b562-536bca73e5cd)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-5qcsl" podUID="55a84eac-e988-4438-b562-536bca73e5cd"
Sep 09 21:02:04.042659 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:02:04.042628    2560 scope.go:117] "RemoveContainer" containerID="3c5bde151b4a3034e0a5f02cc36a397e06db618ba83eed7d5816594586b91932"
Sep 09 21:02:04.806006 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:02:04.805972    2560 generic.go:356] "Generic (PLEG): container finished" podID="590a2d15-b403-40de-81df-417fc78194c4" containerID="f29465bae110e1508dd23617e3524f2c10bf5f39a97d75c0e0a35c7616a1bd1d" exitCode=0
Sep 09 21:02:04.806180 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:02:04.806047    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf" event={"ID":"590a2d15-b403-40de-81df-417fc78194c4","Type":"ContainerDied","Data":"f29465bae110e1508dd23617e3524f2c10bf5f39a97d75c0e0a35c7616a1bd1d"}
Sep 09 21:02:04.806180 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:02:04.806109    2560 scope.go:117] "RemoveContainer" containerID="3c5bde151b4a3034e0a5f02cc36a397e06db618ba83eed7d5816594586b91932"
Sep 09 21:02:04.806494 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:02:04.806475    2560 scope.go:117] "RemoveContainer" containerID="f29465bae110e1508dd23617e3524f2c10bf5f39a97d75c0e0a35c7616a1bd1d"
Sep 09 21:02:04.806740 ip-10-0-140-70 kubenswrapper[2560]: E0909 21:02:04.806716    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf_llm(590a2d15-b403-40de-81df-417fc78194c4)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf" podUID="590a2d15-b403-40de-81df-417fc78194c4"
Sep 09 21:02:09.318057 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:02:09.317978    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf"
Sep 09 21:02:09.318057 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:02:09.318044    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf"
Sep 09 21:02:09.318057 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:02:09.318060    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf"
Sep 09 21:02:09.318472 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:02:09.318073    2560 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf"
Sep 09 21:02:09.318472 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:02:09.318409    2560 scope.go:117] "RemoveContainer" containerID="f29465bae110e1508dd23617e3524f2c10bf5f39a97d75c0e0a35c7616a1bd1d"
Sep 09 21:02:09.318596 ip-10-0-140-70 kubenswrapper[2560]: E0909 21:02:09.318576    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf_llm(590a2d15-b403-40de-81df-417fc78194c4)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf" podUID="590a2d15-b403-40de-81df-417fc78194c4"
Sep 09 21:02:09.834158 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:02:09.834127    2560 scope.go:117] "RemoveContainer" containerID="f29465bae110e1508dd23617e3524f2c10bf5f39a97d75c0e0a35c7616a1bd1d"
Sep 09 21:02:09.834325 ip-10-0-140-70 kubenswrapper[2560]: E0909 21:02:09.834298    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf_llm(590a2d15-b403-40de-81df-417fc78194c4)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf" podUID="590a2d15-b403-40de-81df-417fc78194c4"
Sep 09 21:02:13.014071 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:02:13.014039    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-6685d86975-5qcsl"
Sep 09 21:02:13.014443 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:02:13.014117    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-5qcsl"
Sep 09 21:02:13.014443 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:02:13.014151    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-5qcsl"
Sep 09 21:02:13.014443 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:02:13.014169    2560 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-5qcsl"
Sep 09 21:02:13.014542 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:02:13.014458    2560 scope.go:117] "RemoveContainer" containerID="b1438a0a437f8ade4ca123d7bbacae070eb59ca931c5fefcc6fa80130a312e69"
Sep 09 21:02:13.014650 ip-10-0-140-70 kubenswrapper[2560]: E0909 21:02:13.014630    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-5qcsl_llm(55a84eac-e988-4438-b562-536bca73e5cd)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-5qcsl" podUID="55a84eac-e988-4438-b562-536bca73e5cd"
Sep 09 21:02:13.853572 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:02:13.853542    2560 scope.go:117] "RemoveContainer" containerID="b1438a0a437f8ade4ca123d7bbacae070eb59ca931c5fefcc6fa80130a312e69"
Sep 09 21:02:13.853772 ip-10-0-140-70 kubenswrapper[2560]: E0909 21:02:13.853751    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-5qcsl_llm(55a84eac-e988-4438-b562-536bca73e5cd)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-5qcsl" podUID="55a84eac-e988-4438-b562-536bca73e5cd"
Sep 09 21:02:16.024305 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:02:16.024277    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-zdfrv_a23f7c09-09f4-49b5-a012-f1d3ec19fc27/console-operator/1.log"
Sep 09 21:02:16.025851 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:02:16.025829    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-zdfrv_a23f7c09-09f4-49b5-a012-f1d3ec19fc27/console-operator/1.log"
Sep 09 21:02:16.028201 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:02:16.028183    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2thgv_25e8b7cb-d3ab-4da2-bcfe-c061509f457b/ovn-acl-logging/0.log"
Sep 09 21:02:16.029818 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:02:16.029797    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2thgv_25e8b7cb-d3ab-4da2-bcfe-c061509f457b/ovn-acl-logging/0.log"
Sep 09 21:02:22.042400 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:02:22.042361    2560 scope.go:117] "RemoveContainer" containerID="f29465bae110e1508dd23617e3524f2c10bf5f39a97d75c0e0a35c7616a1bd1d"
Sep 09 21:02:22.042811 ip-10-0-140-70 kubenswrapper[2560]: E0909 21:02:22.042582    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf_llm(590a2d15-b403-40de-81df-417fc78194c4)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf" podUID="590a2d15-b403-40de-81df-417fc78194c4"
Sep 09 21:02:25.042309 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:02:25.042276    2560 scope.go:117] "RemoveContainer" containerID="b1438a0a437f8ade4ca123d7bbacae070eb59ca931c5fefcc6fa80130a312e69"
Sep 09 21:02:25.042708 ip-10-0-140-70 kubenswrapper[2560]: E0909 21:02:25.042470    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-5qcsl_llm(55a84eac-e988-4438-b562-536bca73e5cd)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-5qcsl" podUID="55a84eac-e988-4438-b562-536bca73e5cd"
Sep 09 21:02:35.041851 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:02:35.041817    2560 scope.go:117] "RemoveContainer" containerID="f29465bae110e1508dd23617e3524f2c10bf5f39a97d75c0e0a35c7616a1bd1d"
Sep 09 21:02:35.042312 ip-10-0-140-70 kubenswrapper[2560]: E0909 21:02:35.042000    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf_llm(590a2d15-b403-40de-81df-417fc78194c4)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf" podUID="590a2d15-b403-40de-81df-417fc78194c4"
Sep 09 21:02:39.042192 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:02:39.042153    2560 scope.go:117] "RemoveContainer" containerID="b1438a0a437f8ade4ca123d7bbacae070eb59ca931c5fefcc6fa80130a312e69"
Sep 09 21:02:39.042562 ip-10-0-140-70 kubenswrapper[2560]: E0909 21:02:39.042383    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-5qcsl_llm(55a84eac-e988-4438-b562-536bca73e5cd)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-5qcsl" podUID="55a84eac-e988-4438-b562-536bca73e5cd"
Sep 09 21:02:49.042092 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:02:49.042060    2560 scope.go:117] "RemoveContainer" containerID="f29465bae110e1508dd23617e3524f2c10bf5f39a97d75c0e0a35c7616a1bd1d"
Sep 09 21:02:50.026204 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:02:50.026169    2560 generic.go:356] "Generic (PLEG): container finished" podID="590a2d15-b403-40de-81df-417fc78194c4" containerID="57f8eb021e834f24cc7d11b063ba6c26aeda0895bee2cdd6199e19179141dab0" exitCode=0
Sep 09 21:02:50.026379 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:02:50.026241    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf" event={"ID":"590a2d15-b403-40de-81df-417fc78194c4","Type":"ContainerDied","Data":"57f8eb021e834f24cc7d11b063ba6c26aeda0895bee2cdd6199e19179141dab0"}
Sep 09 21:02:50.026379 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:02:50.026300    2560 scope.go:117] "RemoveContainer" containerID="f29465bae110e1508dd23617e3524f2c10bf5f39a97d75c0e0a35c7616a1bd1d"
Sep 09 21:02:50.026718 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:02:50.026702    2560 scope.go:117] "RemoveContainer" containerID="57f8eb021e834f24cc7d11b063ba6c26aeda0895bee2cdd6199e19179141dab0"
Sep 09 21:02:50.026933 ip-10-0-140-70 kubenswrapper[2560]: E0909 21:02:50.026910    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf_llm(590a2d15-b403-40de-81df-417fc78194c4)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf" podUID="590a2d15-b403-40de-81df-417fc78194c4"
Sep 09 21:02:54.042340 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:02:54.042306    2560 scope.go:117] "RemoveContainer" containerID="b1438a0a437f8ade4ca123d7bbacae070eb59ca931c5fefcc6fa80130a312e69"
Sep 09 21:02:54.042743 ip-10-0-140-70 kubenswrapper[2560]: E0909 21:02:54.042495    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-5qcsl_llm(55a84eac-e988-4438-b562-536bca73e5cd)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-5qcsl" podUID="55a84eac-e988-4438-b562-536bca73e5cd"
Sep 09 21:02:59.318305 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:02:59.318258    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf"
Sep 09 21:02:59.318808 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:02:59.318363    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf"
Sep 09 21:02:59.318808 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:02:59.318387    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf"
Sep 09 21:02:59.318808 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:02:59.318408    2560 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf"
Sep 09 21:02:59.318977 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:02:59.318859    2560 scope.go:117] "RemoveContainer" containerID="57f8eb021e834f24cc7d11b063ba6c26aeda0895bee2cdd6199e19179141dab0"
Sep 09 21:02:59.319103 ip-10-0-140-70 kubenswrapper[2560]: E0909 21:02:59.319078    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf_llm(590a2d15-b403-40de-81df-417fc78194c4)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf" podUID="590a2d15-b403-40de-81df-417fc78194c4"
Sep 09 21:03:05.042584 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:03:05.042551    2560 scope.go:117] "RemoveContainer" containerID="b1438a0a437f8ade4ca123d7bbacae070eb59ca931c5fefcc6fa80130a312e69"
Sep 09 21:03:05.043006 ip-10-0-140-70 kubenswrapper[2560]: E0909 21:03:05.042725    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-5qcsl_llm(55a84eac-e988-4438-b562-536bca73e5cd)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-5qcsl" podUID="55a84eac-e988-4438-b562-536bca73e5cd"
Sep 09 21:03:11.042447 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:03:11.042408    2560 scope.go:117] "RemoveContainer" containerID="57f8eb021e834f24cc7d11b063ba6c26aeda0895bee2cdd6199e19179141dab0"
Sep 09 21:03:11.042936 ip-10-0-140-70 kubenswrapper[2560]: E0909 21:03:11.042569    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf_llm(590a2d15-b403-40de-81df-417fc78194c4)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf" podUID="590a2d15-b403-40de-81df-417fc78194c4"
Sep 09 21:03:20.042192 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:03:20.042158    2560 scope.go:117] "RemoveContainer" containerID="b1438a0a437f8ade4ca123d7bbacae070eb59ca931c5fefcc6fa80130a312e69"
Sep 09 21:03:20.042692 ip-10-0-140-70 kubenswrapper[2560]: E0909 21:03:20.042354    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-5qcsl_llm(55a84eac-e988-4438-b562-536bca73e5cd)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-5qcsl" podUID="55a84eac-e988-4438-b562-536bca73e5cd"
Sep 09 21:03:26.045306 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:03:26.045267    2560 scope.go:117] "RemoveContainer" containerID="57f8eb021e834f24cc7d11b063ba6c26aeda0895bee2cdd6199e19179141dab0"
Sep 09 21:03:26.045691 ip-10-0-140-70 kubenswrapper[2560]: E0909 21:03:26.045501    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf_llm(590a2d15-b403-40de-81df-417fc78194c4)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf" podUID="590a2d15-b403-40de-81df-417fc78194c4"
Sep 09 21:03:31.042299 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:03:31.042265    2560 scope.go:117] "RemoveContainer" containerID="b1438a0a437f8ade4ca123d7bbacae070eb59ca931c5fefcc6fa80130a312e69"
Sep 09 21:03:31.042710 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:03:31.042549    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 21:03:32.247889 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:03:32.247855    2560 generic.go:356] "Generic (PLEG): container finished" podID="55a84eac-e988-4438-b562-536bca73e5cd" containerID="c7888ff4b7da7337d3e5c4e9bccdceef758dd483cbb171ef292e3106a940e03e" exitCode=0
Sep 09 21:03:32.248290 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:03:32.247931    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-5qcsl" event={"ID":"55a84eac-e988-4438-b562-536bca73e5cd","Type":"ContainerDied","Data":"c7888ff4b7da7337d3e5c4e9bccdceef758dd483cbb171ef292e3106a940e03e"}
Sep 09 21:03:32.248290 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:03:32.247998    2560 scope.go:117] "RemoveContainer" containerID="b1438a0a437f8ade4ca123d7bbacae070eb59ca931c5fefcc6fa80130a312e69"
Sep 09 21:03:32.248403 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:03:32.248349    2560 scope.go:117] "RemoveContainer" containerID="c7888ff4b7da7337d3e5c4e9bccdceef758dd483cbb171ef292e3106a940e03e"
Sep 09 21:03:32.248561 ip-10-0-140-70 kubenswrapper[2560]: E0909 21:03:32.248538    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-5qcsl_llm(55a84eac-e988-4438-b562-536bca73e5cd)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-5qcsl" podUID="55a84eac-e988-4438-b562-536bca73e5cd"
Sep 09 21:03:33.014131 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:03:33.014096    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-6685d86975-5qcsl"
Sep 09 21:03:33.014294 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:03:33.014154    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-5qcsl"
Sep 09 21:03:33.014294 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:03:33.014169    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-5qcsl"
Sep 09 21:03:33.014294 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:03:33.014180    2560 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-5qcsl"
Sep 09 21:03:33.255178 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:03:33.255154    2560 scope.go:117] "RemoveContainer" containerID="c7888ff4b7da7337d3e5c4e9bccdceef758dd483cbb171ef292e3106a940e03e"
Sep 09 21:03:33.255536 ip-10-0-140-70 kubenswrapper[2560]: E0909 21:03:33.255348    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-5qcsl_llm(55a84eac-e988-4438-b562-536bca73e5cd)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-5qcsl" podUID="55a84eac-e988-4438-b562-536bca73e5cd"
Sep 09 21:03:40.041887 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:03:40.041815    2560 scope.go:117] "RemoveContainer" containerID="57f8eb021e834f24cc7d11b063ba6c26aeda0895bee2cdd6199e19179141dab0"
Sep 09 21:03:40.042245 ip-10-0-140-70 kubenswrapper[2560]: E0909 21:03:40.041994    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf_llm(590a2d15-b403-40de-81df-417fc78194c4)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf" podUID="590a2d15-b403-40de-81df-417fc78194c4"
Sep 09 21:03:47.041750 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:03:47.041718    2560 scope.go:117] "RemoveContainer" containerID="c7888ff4b7da7337d3e5c4e9bccdceef758dd483cbb171ef292e3106a940e03e"
Sep 09 21:03:47.042179 ip-10-0-140-70 kubenswrapper[2560]: E0909 21:03:47.041900    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-5qcsl_llm(55a84eac-e988-4438-b562-536bca73e5cd)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-5qcsl" podUID="55a84eac-e988-4438-b562-536bca73e5cd"
Sep 09 21:03:53.042363 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:03:53.042337    2560 scope.go:117] "RemoveContainer" containerID="57f8eb021e834f24cc7d11b063ba6c26aeda0895bee2cdd6199e19179141dab0"
Sep 09 21:03:53.042724 ip-10-0-140-70 kubenswrapper[2560]: E0909 21:03:53.042502    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf_llm(590a2d15-b403-40de-81df-417fc78194c4)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf" podUID="590a2d15-b403-40de-81df-417fc78194c4"
Sep 09 21:04:00.042111 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:04:00.042074    2560 scope.go:117] "RemoveContainer" containerID="c7888ff4b7da7337d3e5c4e9bccdceef758dd483cbb171ef292e3106a940e03e"
Sep 09 21:04:00.042568 ip-10-0-140-70 kubenswrapper[2560]: E0909 21:04:00.042307    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-5qcsl_llm(55a84eac-e988-4438-b562-536bca73e5cd)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-5qcsl" podUID="55a84eac-e988-4438-b562-536bca73e5cd"
Sep 09 21:04:06.044693 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:04:06.044646    2560 scope.go:117] "RemoveContainer" containerID="57f8eb021e834f24cc7d11b063ba6c26aeda0895bee2cdd6199e19179141dab0"
Sep 09 21:04:06.045057 ip-10-0-140-70 kubenswrapper[2560]: E0909 21:04:06.044845    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf_llm(590a2d15-b403-40de-81df-417fc78194c4)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf" podUID="590a2d15-b403-40de-81df-417fc78194c4"
Sep 09 21:04:12.041917 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:04:12.041883    2560 scope.go:117] "RemoveContainer" containerID="c7888ff4b7da7337d3e5c4e9bccdceef758dd483cbb171ef292e3106a940e03e"
Sep 09 21:04:12.042331 ip-10-0-140-70 kubenswrapper[2560]: E0909 21:04:12.042068    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-5qcsl_llm(55a84eac-e988-4438-b562-536bca73e5cd)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-5qcsl" podUID="55a84eac-e988-4438-b562-536bca73e5cd"
Sep 09 21:04:18.042882 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:04:18.042844    2560 scope.go:117] "RemoveContainer" containerID="57f8eb021e834f24cc7d11b063ba6c26aeda0895bee2cdd6199e19179141dab0"
Sep 09 21:04:18.472942 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:04:18.472912    2560 generic.go:356] "Generic (PLEG): container finished" podID="590a2d15-b403-40de-81df-417fc78194c4" containerID="45e59f256aa72a5643984edf9f6ffff1c285bb558d2812430e5a43cad1d9e3ce" exitCode=0
Sep 09 21:04:18.473090 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:04:18.472951    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf" event={"ID":"590a2d15-b403-40de-81df-417fc78194c4","Type":"ContainerDied","Data":"45e59f256aa72a5643984edf9f6ffff1c285bb558d2812430e5a43cad1d9e3ce"}
Sep 09 21:04:18.473090 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:04:18.472998    2560 scope.go:117] "RemoveContainer" containerID="57f8eb021e834f24cc7d11b063ba6c26aeda0895bee2cdd6199e19179141dab0"
Sep 09 21:04:18.473401 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:04:18.473384    2560 scope.go:117] "RemoveContainer" containerID="45e59f256aa72a5643984edf9f6ffff1c285bb558d2812430e5a43cad1d9e3ce"
Sep 09 21:04:18.473598 ip-10-0-140-70 kubenswrapper[2560]: E0909 21:04:18.473579    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf_llm(590a2d15-b403-40de-81df-417fc78194c4)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf" podUID="590a2d15-b403-40de-81df-417fc78194c4"
Sep 09 21:04:19.318443 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:04:19.318399    2560 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf"
Sep 09 21:04:19.318840 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:04:19.318465    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf"
Sep 09 21:04:19.318840 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:04:19.318479    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf"
Sep 09 21:04:19.318840 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:04:19.318495    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf"
Sep 09 21:04:19.480013 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:04:19.479974    2560 scope.go:117] "RemoveContainer" containerID="45e59f256aa72a5643984edf9f6ffff1c285bb558d2812430e5a43cad1d9e3ce"
Sep 09 21:04:19.480196 ip-10-0-140-70 kubenswrapper[2560]: E0909 21:04:19.480177    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf_llm(590a2d15-b403-40de-81df-417fc78194c4)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf" podUID="590a2d15-b403-40de-81df-417fc78194c4"
Sep 09 21:04:25.042396 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:04:25.042357    2560 scope.go:117] "RemoveContainer" containerID="c7888ff4b7da7337d3e5c4e9bccdceef758dd483cbb171ef292e3106a940e03e"
Sep 09 21:04:25.042896 ip-10-0-140-70 kubenswrapper[2560]: E0909 21:04:25.042530    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-5qcsl_llm(55a84eac-e988-4438-b562-536bca73e5cd)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-5qcsl" podUID="55a84eac-e988-4438-b562-536bca73e5cd"
Sep 09 21:04:33.042790 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:04:33.042754    2560 scope.go:117] "RemoveContainer" containerID="45e59f256aa72a5643984edf9f6ffff1c285bb558d2812430e5a43cad1d9e3ce"
Sep 09 21:04:33.043290 ip-10-0-140-70 kubenswrapper[2560]: E0909 21:04:33.043001    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf_llm(590a2d15-b403-40de-81df-417fc78194c4)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf" podUID="590a2d15-b403-40de-81df-417fc78194c4"
Sep 09 21:04:39.042466 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:04:39.042430    2560 scope.go:117] "RemoveContainer" containerID="c7888ff4b7da7337d3e5c4e9bccdceef758dd483cbb171ef292e3106a940e03e"
Sep 09 21:04:39.042867 ip-10-0-140-70 kubenswrapper[2560]: E0909 21:04:39.042639    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-5qcsl_llm(55a84eac-e988-4438-b562-536bca73e5cd)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-5qcsl" podUID="55a84eac-e988-4438-b562-536bca73e5cd"
Sep 09 21:04:45.042130 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:04:45.042093    2560 scope.go:117] "RemoveContainer" containerID="45e59f256aa72a5643984edf9f6ffff1c285bb558d2812430e5a43cad1d9e3ce"
Sep 09 21:04:45.042513 ip-10-0-140-70 kubenswrapper[2560]: E0909 21:04:45.042330    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf_llm(590a2d15-b403-40de-81df-417fc78194c4)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf" podUID="590a2d15-b403-40de-81df-417fc78194c4"
Sep 09 21:04:53.042445 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:04:53.042415    2560 scope.go:117] "RemoveContainer" containerID="c7888ff4b7da7337d3e5c4e9bccdceef758dd483cbb171ef292e3106a940e03e"
Sep 09 21:04:53.042893 ip-10-0-140-70 kubenswrapper[2560]: E0909 21:04:53.042613    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-5qcsl_llm(55a84eac-e988-4438-b562-536bca73e5cd)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-5qcsl" podUID="55a84eac-e988-4438-b562-536bca73e5cd"
Sep 09 21:05:00.042906 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:05:00.042869    2560 scope.go:117] "RemoveContainer" containerID="45e59f256aa72a5643984edf9f6ffff1c285bb558d2812430e5a43cad1d9e3ce"
Sep 09 21:05:00.043368 ip-10-0-140-70 kubenswrapper[2560]: E0909 21:05:00.043033    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf_llm(590a2d15-b403-40de-81df-417fc78194c4)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf" podUID="590a2d15-b403-40de-81df-417fc78194c4"
Sep 09 21:05:04.042527 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:05:04.042491    2560 scope.go:117] "RemoveContainer" containerID="c7888ff4b7da7337d3e5c4e9bccdceef758dd483cbb171ef292e3106a940e03e"
Sep 09 21:05:04.042915 ip-10-0-140-70 kubenswrapper[2560]: E0909 21:05:04.042708    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-5qcsl_llm(55a84eac-e988-4438-b562-536bca73e5cd)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-5qcsl" podUID="55a84eac-e988-4438-b562-536bca73e5cd"
Sep 09 21:05:14.042828 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:05:14.042792    2560 scope.go:117] "RemoveContainer" containerID="45e59f256aa72a5643984edf9f6ffff1c285bb558d2812430e5a43cad1d9e3ce"
Sep 09 21:05:14.043305 ip-10-0-140-70 kubenswrapper[2560]: E0909 21:05:14.043066    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf_llm(590a2d15-b403-40de-81df-417fc78194c4)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf" podUID="590a2d15-b403-40de-81df-417fc78194c4"
Sep 09 21:05:16.044047 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:05:16.044001    2560 scope.go:117] "RemoveContainer" containerID="c7888ff4b7da7337d3e5c4e9bccdceef758dd483cbb171ef292e3106a940e03e"
Sep 09 21:05:16.044447 ip-10-0-140-70 kubenswrapper[2560]: E0909 21:05:16.044205    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-5qcsl_llm(55a84eac-e988-4438-b562-536bca73e5cd)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-5qcsl" podUID="55a84eac-e988-4438-b562-536bca73e5cd"
Sep 09 21:05:26.405165 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:05:26.405135    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf_590a2d15-b403-40de-81df-417fc78194c4/main/5.log"
Sep 09 21:05:26.525949 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:05:26.525909    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf_590a2d15-b403-40de-81df-417fc78194c4/main/5.log"
Sep 09 21:05:27.042174 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:05:27.042138    2560 scope.go:117] "RemoveContainer" containerID="c7888ff4b7da7337d3e5c4e9bccdceef758dd483cbb171ef292e3106a940e03e"
Sep 09 21:05:27.042373 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:05:27.042241    2560 scope.go:117] "RemoveContainer" containerID="45e59f256aa72a5643984edf9f6ffff1c285bb558d2812430e5a43cad1d9e3ce"
Sep 09 21:05:27.042444 ip-10-0-140-70 kubenswrapper[2560]: E0909 21:05:27.042389    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-5qcsl_llm(55a84eac-e988-4438-b562-536bca73e5cd)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-5qcsl" podUID="55a84eac-e988-4438-b562-536bca73e5cd"
Sep 09 21:05:27.042444 ip-10-0-140-70 kubenswrapper[2560]: E0909 21:05:27.042400    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf_llm(590a2d15-b403-40de-81df-417fc78194c4)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf" podUID="590a2d15-b403-40de-81df-417fc78194c4"
Sep 09 21:05:34.221161 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:05:34.221129    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-frlr2_f0fd32ab-0394-42b6-8b17-62c1ba72fb1d/server/0.log"
Sep 09 21:05:34.344214 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:05:34.344180    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-zwkf6_d9b0f975-e729-4cbc-bc29-96b3e925f1e0/manager/0.log"
Sep 09 21:05:34.709415 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:05:34.709387    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-97cf5684c-pfzjz_ccfdd141-601a-43f3-b25a-2e9fb368f262/copy-manifests/0.log"
Sep 09 21:05:34.715877 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:05:34.715849    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-97cf5684c-pfzjz_ccfdd141-601a-43f3-b25a-2e9fb368f262/manager/0.log"
Sep 09 21:05:36.123129 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:05:36.123099    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-ngf5m_394546ad-4cf9-4515-8b71-51ac43157b7b/manager/0.log"
Sep 09 21:05:36.608566 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:05:36.608535    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-swpwl_ea4e0c6d-5e34-4be8-a5a6-41083a764bdd/limitador/0.log"
Sep 09 21:05:36.723462 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:05:36.723404    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-d4zp8_781b3827-fbc2-46a6-b9f2-1f95eacbcfbb/manager/0.log"
Sep 09 21:05:37.086305 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:05:37.086272    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-xmj7p_109a883d-bde2-4d4b-ac9a-736ccb3a4daa/istio-proxy/0.log"
Sep 09 21:05:37.217806 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:05:37.217770    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-2d9km_ec17322b-e607-443b-9064-638d442fc550/discovery/0.log"
Sep 09 21:05:37.449508 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:05:37.449425    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7c789b6945-tvsmn_2d361c83-2db9-41f9-b1ae-2be0350ec754/kube-auth-proxy/0.log"
Sep 09 21:05:37.563409 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:05:37.563380    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-bdx8p_a3892e4a-facc-43ff-a868-f2388afe8ebd/istio-proxy/1.log"
Sep 09 21:05:38.042214 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:05:38.042181    2560 scope.go:117] "RemoveContainer" containerID="c7888ff4b7da7337d3e5c4e9bccdceef758dd483cbb171ef292e3106a940e03e"
Sep 09 21:05:38.042424 ip-10-0-140-70 kubenswrapper[2560]: E0909 21:05:38.042368    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-5qcsl_llm(55a84eac-e988-4438-b562-536bca73e5cd)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-5qcsl" podUID="55a84eac-e988-4438-b562-536bca73e5cd"
Sep 09 21:05:38.365914 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:05:38.365837    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-6685d86975-5qcsl_55a84eac-e988-4438-b562-536bca73e5cd/main/5.log"
Sep 09 21:05:38.841070 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:05:38.841043    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf_590a2d15-b403-40de-81df-417fc78194c4/main/5.log"
Sep 09 21:05:42.041799 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:05:42.041763    2560 scope.go:117] "RemoveContainer" containerID="45e59f256aa72a5643984edf9f6ffff1c285bb558d2812430e5a43cad1d9e3ce"
Sep 09 21:05:42.042190 ip-10-0-140-70 kubenswrapper[2560]: E0909 21:05:42.041958    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf_llm(590a2d15-b403-40de-81df-417fc78194c4)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf" podUID="590a2d15-b403-40de-81df-417fc78194c4"
Sep 09 21:05:47.967275 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:05:47.967239    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-n276l_34f7d128-9c82-4497-9766-0b314e3badce/global-pull-secret-syncer/0.log"
Sep 09 21:05:48.056299 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:05:48.056263    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-jsj9x_372edd34-17d7-4bc8-8038-65a02776d964/konnectivity-agent/0.log"
Sep 09 21:05:48.135779 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:05:48.135748    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-70.ec2.internal_e0ddac653a796266e178e69d3c0547bd/haproxy/0.log"
Sep 09 21:05:51.042655 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:05:51.042621    2560 scope.go:117] "RemoveContainer" containerID="c7888ff4b7da7337d3e5c4e9bccdceef758dd483cbb171ef292e3106a940e03e"
Sep 09 21:05:51.043104 ip-10-0-140-70 kubenswrapper[2560]: E0909 21:05:51.042849    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-5qcsl_llm(55a84eac-e988-4438-b562-536bca73e5cd)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-5qcsl" podUID="55a84eac-e988-4438-b562-536bca73e5cd"
Sep 09 21:05:53.041994 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:05:53.041964    2560 scope.go:117] "RemoveContainer" containerID="45e59f256aa72a5643984edf9f6ffff1c285bb558d2812430e5a43cad1d9e3ce"
Sep 09 21:05:53.042385 ip-10-0-140-70 kubenswrapper[2560]: E0909 21:05:53.042163    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf_llm(590a2d15-b403-40de-81df-417fc78194c4)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf" podUID="590a2d15-b403-40de-81df-417fc78194c4"
Sep 09 21:05:53.162453 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:05:53.162423    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-ngf5m_394546ad-4cf9-4515-8b71-51ac43157b7b/manager/0.log"
Sep 09 21:05:53.296510 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:05:53.296430    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-swpwl_ea4e0c6d-5e34-4be8-a5a6-41083a764bdd/limitador/0.log"
Sep 09 21:05:53.336224 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:05:53.336191    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-d4zp8_781b3827-fbc2-46a6-b9f2-1f95eacbcfbb/manager/0.log"
Sep 09 21:05:54.855958 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:05:54.855922    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cdcc96965-9rlcx_f2eca4c6-1767-466b-87e3-915079d3e8de/cluster-monitoring-operator/0.log"
Sep 09 21:05:55.042575 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:05:55.042547    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-85bbbbbf4-bdp2n_48ef9fca-e641-4068-ac68-e895f4f7a09f/monitoring-plugin/0.log"
Sep 09 21:05:55.172547 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:05:55.172470    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-llwpd_8be450a0-f7ec-4c5f-b3ba-049242433802/node-exporter/0.log"
Sep 09 21:05:55.200182 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:05:55.200154    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-llwpd_8be450a0-f7ec-4c5f-b3ba-049242433802/kube-rbac-proxy/0.log"
Sep 09 21:05:55.227004 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:05:55.226978    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-llwpd_8be450a0-f7ec-4c5f-b3ba-049242433802/init-textfile/0.log"
Sep 09 21:05:55.753135 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:05:55.753106    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-hbtfj_661d6e5a-83ef-432f-aad5-8a4f1a73ef9a/prometheus-operator/0.log"
Sep 09 21:05:55.777974 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:05:55.777943    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-hbtfj_661d6e5a-83ef-432f-aad5-8a4f1a73ef9a/kube-rbac-proxy/0.log"
Sep 09 21:05:55.835066 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:05:55.835033    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-749d9cbccb-dvsf2_a7be6858-279a-44d8-8b9e-e51f67250852/telemeter-client/0.log"
Sep 09 21:05:55.857689 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:05:55.857655    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-749d9cbccb-dvsf2_a7be6858-279a-44d8-8b9e-e51f67250852/reload/0.log"
Sep 09 21:05:55.880603 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:05:55.880574    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-749d9cbccb-dvsf2_a7be6858-279a-44d8-8b9e-e51f67250852/kube-rbac-proxy/0.log"
Sep 09 21:05:55.912979 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:05:55.912948    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5bcc6c5fc9-85grm_3df0326f-55e9-4469-b42e-7854954895f9/thanos-query/0.log"
Sep 09 21:05:55.942246 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:05:55.942212    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5bcc6c5fc9-85grm_3df0326f-55e9-4469-b42e-7854954895f9/kube-rbac-proxy-web/0.log"
Sep 09 21:05:55.968457 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:05:55.968427    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5bcc6c5fc9-85grm_3df0326f-55e9-4469-b42e-7854954895f9/kube-rbac-proxy/0.log"
Sep 09 21:05:55.992114 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:05:55.992086    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5bcc6c5fc9-85grm_3df0326f-55e9-4469-b42e-7854954895f9/prom-label-proxy/0.log"
Sep 09 21:05:56.018059 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:05:56.017977    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5bcc6c5fc9-85grm_3df0326f-55e9-4469-b42e-7854954895f9/kube-rbac-proxy-rules/0.log"
Sep 09 21:05:56.039846 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:05:56.039815    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5bcc6c5fc9-85grm_3df0326f-55e9-4469-b42e-7854954895f9/kube-rbac-proxy-metrics/0.log"
Sep 09 21:05:57.141600 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:05:57.141573    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-79977f9844-bjkpq_37b0d343-5d35-4d62-b3f4-929029b915f2/networking-console-plugin/0.log"
Sep 09 21:05:57.532661 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:05:57.532579    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-qh5hz/perf-node-gather-daemonset-n2bd5"]
Sep 09 21:05:57.536496 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:05:57.536473    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qh5hz/perf-node-gather-daemonset-n2bd5"
Sep 09 21:05:57.539004 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:05:57.538977    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qh5hz\"/\"openshift-service-ca.crt\""
Sep 09 21:05:57.539004 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:05:57.538992    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-qh5hz\"/\"default-dockercfg-k6l4r\""
Sep 09 21:05:57.539767 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:05:57.539751    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qh5hz\"/\"kube-root-ca.crt\""
Sep 09 21:05:57.552705 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:05:57.552665    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qh5hz/perf-node-gather-daemonset-n2bd5"]
Sep 09 21:05:57.555003 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:05:57.554975    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/67eed592-6bbe-4072-a1ef-c425ce73e789-lib-modules\") pod \"perf-node-gather-daemonset-n2bd5\" (UID: \"67eed592-6bbe-4072-a1ef-c425ce73e789\") " pod="openshift-must-gather-qh5hz/perf-node-gather-daemonset-n2bd5"
Sep 09 21:05:57.555097 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:05:57.555012    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/67eed592-6bbe-4072-a1ef-c425ce73e789-proc\") pod \"perf-node-gather-daemonset-n2bd5\" (UID: \"67eed592-6bbe-4072-a1ef-c425ce73e789\") " pod="openshift-must-gather-qh5hz/perf-node-gather-daemonset-n2bd5"
Sep 09 21:05:57.555097 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:05:57.555042    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/67eed592-6bbe-4072-a1ef-c425ce73e789-sys\") pod \"perf-node-gather-daemonset-n2bd5\" (UID: \"67eed592-6bbe-4072-a1ef-c425ce73e789\") " pod="openshift-must-gather-qh5hz/perf-node-gather-daemonset-n2bd5"
Sep 09 21:05:57.555169 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:05:57.555093    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/67eed592-6bbe-4072-a1ef-c425ce73e789-podres\") pod \"perf-node-gather-daemonset-n2bd5\" (UID: \"67eed592-6bbe-4072-a1ef-c425ce73e789\") " pod="openshift-must-gather-qh5hz/perf-node-gather-daemonset-n2bd5"
Sep 09 21:05:57.555169 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:05:57.555144    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqxvm\" (UniqueName: \"kubernetes.io/projected/67eed592-6bbe-4072-a1ef-c425ce73e789-kube-api-access-rqxvm\") pod \"perf-node-gather-daemonset-n2bd5\" (UID: \"67eed592-6bbe-4072-a1ef-c425ce73e789\") " pod="openshift-must-gather-qh5hz/perf-node-gather-daemonset-n2bd5"
Sep 09 21:05:57.655862 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:05:57.655819    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/67eed592-6bbe-4072-a1ef-c425ce73e789-sys\") pod \"perf-node-gather-daemonset-n2bd5\" (UID: \"67eed592-6bbe-4072-a1ef-c425ce73e789\") " pod="openshift-must-gather-qh5hz/perf-node-gather-daemonset-n2bd5"
Sep 09 21:05:57.655862 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:05:57.655863    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/67eed592-6bbe-4072-a1ef-c425ce73e789-podres\") pod \"perf-node-gather-daemonset-n2bd5\" (UID: \"67eed592-6bbe-4072-a1ef-c425ce73e789\") " pod="openshift-must-gather-qh5hz/perf-node-gather-daemonset-n2bd5"
Sep 09 21:05:57.656070 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:05:57.655902    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqxvm\" (UniqueName: \"kubernetes.io/projected/67eed592-6bbe-4072-a1ef-c425ce73e789-kube-api-access-rqxvm\") pod \"perf-node-gather-daemonset-n2bd5\" (UID: \"67eed592-6bbe-4072-a1ef-c425ce73e789\") " pod="openshift-must-gather-qh5hz/perf-node-gather-daemonset-n2bd5"
Sep 09 21:05:57.656070 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:05:57.655963    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/67eed592-6bbe-4072-a1ef-c425ce73e789-sys\") pod \"perf-node-gather-daemonset-n2bd5\" (UID: \"67eed592-6bbe-4072-a1ef-c425ce73e789\") " pod="openshift-must-gather-qh5hz/perf-node-gather-daemonset-n2bd5"
Sep 09 21:05:57.656070 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:05:57.655995    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/67eed592-6bbe-4072-a1ef-c425ce73e789-lib-modules\") pod \"perf-node-gather-daemonset-n2bd5\" (UID: \"67eed592-6bbe-4072-a1ef-c425ce73e789\") " pod="openshift-must-gather-qh5hz/perf-node-gather-daemonset-n2bd5"
Sep 09 21:05:57.656070 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:05:57.656035    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/67eed592-6bbe-4072-a1ef-c425ce73e789-proc\") pod \"perf-node-gather-daemonset-n2bd5\" (UID: \"67eed592-6bbe-4072-a1ef-c425ce73e789\") " pod="openshift-must-gather-qh5hz/perf-node-gather-daemonset-n2bd5"
Sep 09 21:05:57.656070 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:05:57.656056    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/67eed592-6bbe-4072-a1ef-c425ce73e789-podres\") pod \"perf-node-gather-daemonset-n2bd5\" (UID: \"67eed592-6bbe-4072-a1ef-c425ce73e789\") " pod="openshift-must-gather-qh5hz/perf-node-gather-daemonset-n2bd5"
Sep 09 21:05:57.656230 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:05:57.656113    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/67eed592-6bbe-4072-a1ef-c425ce73e789-proc\") pod \"perf-node-gather-daemonset-n2bd5\" (UID: \"67eed592-6bbe-4072-a1ef-c425ce73e789\") " pod="openshift-must-gather-qh5hz/perf-node-gather-daemonset-n2bd5"
Sep 09 21:05:57.656230 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:05:57.656163    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/67eed592-6bbe-4072-a1ef-c425ce73e789-lib-modules\") pod \"perf-node-gather-daemonset-n2bd5\" (UID: \"67eed592-6bbe-4072-a1ef-c425ce73e789\") " pod="openshift-must-gather-qh5hz/perf-node-gather-daemonset-n2bd5"
Sep 09 21:05:57.665534 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:05:57.665505    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqxvm\" (UniqueName: \"kubernetes.io/projected/67eed592-6bbe-4072-a1ef-c425ce73e789-kube-api-access-rqxvm\") pod \"perf-node-gather-daemonset-n2bd5\" (UID: \"67eed592-6bbe-4072-a1ef-c425ce73e789\") " pod="openshift-must-gather-qh5hz/perf-node-gather-daemonset-n2bd5"
Sep 09 21:05:57.808420 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:05:57.808392    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-zdfrv_a23f7c09-09f4-49b5-a012-f1d3ec19fc27/console-operator/1.log"
Sep 09 21:05:57.812479 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:05:57.812459    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-zdfrv_a23f7c09-09f4-49b5-a012-f1d3ec19fc27/console-operator/2.log"
Sep 09 21:05:57.846443 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:05:57.846410    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qh5hz/perf-node-gather-daemonset-n2bd5"
Sep 09 21:05:58.118274 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:05:58.118250    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qh5hz/perf-node-gather-daemonset-n2bd5"]
Sep 09 21:05:58.120701 ip-10-0-140-70 kubenswrapper[2560]: W0909 21:05:58.120657    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod67eed592_6bbe_4072_a1ef_c425ce73e789.slice/crio-7163f16322f34d72e3c782408eb844617807dcd03dd82e0b43980a8572f7573d WatchSource:0}: Error finding container 7163f16322f34d72e3c782408eb844617807dcd03dd82e0b43980a8572f7573d: Status 404 returned error can't find the container with id 7163f16322f34d72e3c782408eb844617807dcd03dd82e0b43980a8572f7573d
Sep 09 21:05:58.986201 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:05:58.986153    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qh5hz/perf-node-gather-daemonset-n2bd5" event={"ID":"67eed592-6bbe-4072-a1ef-c425ce73e789","Type":"ContainerStarted","Data":"66f3e375d01a452a8b31f13fc2539d54eecd5e9f1b5fad2d6d12aa52abaea53b"}
Sep 09 21:05:58.986638 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:05:58.986220    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qh5hz/perf-node-gather-daemonset-n2bd5" event={"ID":"67eed592-6bbe-4072-a1ef-c425ce73e789","Type":"ContainerStarted","Data":"7163f16322f34d72e3c782408eb844617807dcd03dd82e0b43980a8572f7573d"}
Sep 09 21:05:58.986638 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:05:58.986250    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-qh5hz/perf-node-gather-daemonset-n2bd5"
Sep 09 21:05:59.007129 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:05:59.007075    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-qh5hz/perf-node-gather-daemonset-n2bd5" podStartSLOduration=2.007056141 podStartE2EDuration="2.007056141s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 21:05:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:05:59.005111391 +0000 UTC m=+1123.456902913" watchObservedRunningTime="2026-09-09 21:05:59.007056141 +0000 UTC m=+1123.458847669"
Sep 09 21:05:59.109171 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:05:59.109138    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-695c895bd6-8llfb_8068d21c-8270-4d4a-a68b-7cdc2ae18752/volume-data-source-validator/0.log"
Sep 09 21:06:00.122662 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:06:00.122600    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dg6rb_8d37bae7-db79-4322-9ba1-012a68918b86/dns/0.log"
Sep 09 21:06:00.146118 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:06:00.146086    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dg6rb_8d37bae7-db79-4322-9ba1-012a68918b86/kube-rbac-proxy/0.log"
Sep 09 21:06:00.271573 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:06:00.271531    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rcqv7_23e34008-d8bb-4baf-beef-dc0c8f67e8a8/dns-node-resolver/0.log"
Sep 09 21:06:00.901106 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:06:00.901075    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-t84p6_a7237351-1190-42ae-9092-b049a203cadc/node-ca/0.log"
Sep 09 21:06:01.872666 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:06:01.872637    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-xmj7p_109a883d-bde2-4d4b-ac9a-736ccb3a4daa/istio-proxy/0.log"
Sep 09 21:06:01.919816 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:06:01.919782    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-2d9km_ec17322b-e607-443b-9064-638d442fc550/discovery/0.log"
Sep 09 21:06:01.970315 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:06:01.970286    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7c789b6945-tvsmn_2d361c83-2db9-41f9-b1ae-2be0350ec754/kube-auth-proxy/0.log"
Sep 09 21:06:02.004360 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:06:02.004317    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-bdx8p_a3892e4a-facc-43ff-a868-f2388afe8ebd/istio-proxy/1.log"
Sep 09 21:06:02.004653 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:06:02.004619    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-bdx8p_a3892e4a-facc-43ff-a868-f2388afe8ebd/istio-proxy/0.log"
Sep 09 21:06:02.822228 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:06:02.822198    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-p796n_aebf38f1-b76f-4d9b-af1c-3144bb61c4e0/serve-healthcheck-canary/0.log"
Sep 09 21:06:03.041857 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:06:03.041824    2560 scope.go:117] "RemoveContainer" containerID="c7888ff4b7da7337d3e5c4e9bccdceef758dd483cbb171ef292e3106a940e03e"
Sep 09 21:06:03.042243 ip-10-0-140-70 kubenswrapper[2560]: E0909 21:06:03.042026    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-5qcsl_llm(55a84eac-e988-4438-b562-536bca73e5cd)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-5qcsl" podUID="55a84eac-e988-4438-b562-536bca73e5cd"
Sep 09 21:06:03.315376 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:06:03.315336    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-76bcd6ccf5-rwrpr_cb1e1737-0c2a-4380-8fdd-cebe18bf1107/insights-operator/0.log"
Sep 09 21:06:03.315601 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:06:03.315371    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-76bcd6ccf5-rwrpr_cb1e1737-0c2a-4380-8fdd-cebe18bf1107/insights-operator/1.log"
Sep 09 21:06:03.357340 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:06:03.357306    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-48c8q_2732a615-b3a4-42fc-9364-cf6fca466415/kube-rbac-proxy/0.log"
Sep 09 21:06:03.379999 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:06:03.379973    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-48c8q_2732a615-b3a4-42fc-9364-cf6fca466415/exporter/0.log"
Sep 09 21:06:03.403604 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:06:03.403584    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-48c8q_2732a615-b3a4-42fc-9364-cf6fca466415/extractor/0.log"
Sep 09 21:06:05.001409 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:06:05.001376    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-qh5hz/perf-node-gather-daemonset-n2bd5"
Sep 09 21:06:05.801405 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:06:05.801373    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-frlr2_f0fd32ab-0394-42b6-8b17-62c1ba72fb1d/server/0.log"
Sep 09 21:06:05.853488 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:06:05.853449    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-zwkf6_d9b0f975-e729-4cbc-bc29-96b3e925f1e0/manager/0.log"
Sep 09 21:06:06.018800 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:06:06.018775    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-97cf5684c-pfzjz_ccfdd141-601a-43f3-b25a-2e9fb368f262/manager/0.log"
Sep 09 21:06:06.040683 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:06:06.040636    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-97cf5684c-pfzjz_ccfdd141-601a-43f3-b25a-2e9fb368f262/copy-manifests/0.log"
Sep 09 21:06:08.042143 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:06:08.042114    2560 scope.go:117] "RemoveContainer" containerID="45e59f256aa72a5643984edf9f6ffff1c285bb558d2812430e5a43cad1d9e3ce"
Sep 09 21:06:08.042607 ip-10-0-140-70 kubenswrapper[2560]: E0909 21:06:08.042281    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf_llm(590a2d15-b403-40de-81df-417fc78194c4)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wddjf" podUID="590a2d15-b403-40de-81df-417fc78194c4"
Sep 09 21:06:08.283497 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:06:08.283465    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-xmj7p_109a883d-bde2-4d4b-ac9a-736ccb3a4daa/istio-proxy/0.log"
Sep 09 21:06:08.322811 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:06:08.322708    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-2d9km_ec17322b-e607-443b-9064-638d442fc550/discovery/0.log"
Sep 09 21:06:08.366468 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:06:08.366438    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7c789b6945-tvsmn_2d361c83-2db9-41f9-b1ae-2be0350ec754/kube-auth-proxy/0.log"
Sep 09 21:06:08.389078 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:06:08.389046    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-bdx8p_a3892e4a-facc-43ff-a868-f2388afe8ebd/istio-proxy/1.log"
Sep 09 21:06:08.389358 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:06:08.389332    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-bdx8p_a3892e4a-facc-43ff-a868-f2388afe8ebd/istio-proxy/0.log"
Sep 09 21:06:09.581278 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:06:09.581249    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-xmj7p_109a883d-bde2-4d4b-ac9a-736ccb3a4daa/istio-proxy/0.log"
Sep 09 21:06:09.620426 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:06:09.620395    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-2d9km_ec17322b-e607-443b-9064-638d442fc550/discovery/0.log"
Sep 09 21:06:09.655838 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:06:09.655807    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7c789b6945-tvsmn_2d361c83-2db9-41f9-b1ae-2be0350ec754/kube-auth-proxy/0.log"
Sep 09 21:06:09.679928 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:06:09.679888    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-bdx8p_a3892e4a-facc-43ff-a868-f2388afe8ebd/istio-proxy/1.log"
Sep 09 21:06:09.680180 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:06:09.680163    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-bdx8p_a3892e4a-facc-43ff-a868-f2388afe8ebd/istio-proxy/0.log"
Sep 09 21:06:12.463196 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:06:12.463166    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-b8775_59769896-669a-4ae9-a788-1d7e89083416/migrator/0.log"
Sep 09 21:06:12.489442 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:06:12.489405    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-b8775_59769896-669a-4ae9-a788-1d7e89083416/graceful-termination/0.log"
Sep 09 21:06:12.904645 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:06:12.904612    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-mnzfm_513f5747-5c6e-4983-b573-1c3da7b2d8e2/kube-storage-version-migrator-operator/1.log"
Sep 09 21:06:12.905535 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:06:12.905516    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-mnzfm_513f5747-5c6e-4983-b573-1c3da7b2d8e2/kube-storage-version-migrator-operator/0.log"
Sep 09 21:06:14.412905 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:06:14.412872    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tc4lg_b0a2a693-cb2a-40be-ad01-e26c3bb5e4fb/kube-multus-additional-cni-plugins/0.log"
Sep 09 21:06:14.440273 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:06:14.440242    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tc4lg_b0a2a693-cb2a-40be-ad01-e26c3bb5e4fb/egress-router-binary-copy/0.log"
Sep 09 21:06:14.464892 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:06:14.464866    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tc4lg_b0a2a693-cb2a-40be-ad01-e26c3bb5e4fb/cni-plugins/0.log"
Sep 09 21:06:14.488453 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:06:14.488429    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tc4lg_b0a2a693-cb2a-40be-ad01-e26c3bb5e4fb/bond-cni-plugin/0.log"
Sep 09 21:06:14.511992 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:06:14.511968    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tc4lg_b0a2a693-cb2a-40be-ad01-e26c3bb5e4fb/routeoverride-cni/0.log"
Sep 09 21:06:14.539035 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:06:14.539013    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tc4lg_b0a2a693-cb2a-40be-ad01-e26c3bb5e4fb/whereabouts-cni-bincopy/0.log"
Sep 09 21:06:14.566019 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:06:14.565994    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tc4lg_b0a2a693-cb2a-40be-ad01-e26c3bb5e4fb/whereabouts-cni/0.log"
Sep 09 21:06:14.634058 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:06:14.634027    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-kn9rn_e788234a-a38c-4b9f-bcd3-a2fa9642b26c/kube-multus/0.log"
Sep 09 21:06:14.686077 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:06:14.685991    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-48bqr_e3794c68-57f8-4bf6-9a86-b564da84a425/network-metrics-daemon/0.log"
Sep 09 21:06:14.706312 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:06:14.706290    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-48bqr_e3794c68-57f8-4bf6-9a86-b564da84a425/kube-rbac-proxy/0.log"
Sep 09 21:06:15.042032 ip-10-0-140-70 kubenswrapper[2560]: I0909 21:06:15.042008    2560 scope.go:117] "RemoveContainer" containerID="c7888ff4b7da7337d3e5c4e9bccdceef758dd483cbb171ef292e3106a940e03e"