Jun 09 02:17:02.419533 ip-10-0-143-102 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 09 02:17:02.419546 ip-10-0-143-102 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 09 02:17:02.419554 ip-10-0-143-102 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 09 02:17:02.419759 ip-10-0-143-102 systemd[1]: Failed to start Kubernetes Kubelet. Jun 09 02:17:12.608663 ip-10-0-143-102 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 09 02:17:12.608680 ip-10-0-143-102 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 0fdbb509137444f0b4f03f6102ce3916 -- Jun 09 02:19:43.944331 ip-10-0-143-102 systemd[1]: Starting Kubernetes Kubelet... Jun 09 02:19:44.316260 ip-10-0-143-102 kubenswrapper[2573]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 02:19:44.316260 ip-10-0-143-102 kubenswrapper[2573]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 09 02:19:44.316260 ip-10-0-143-102 kubenswrapper[2573]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 02:19:44.316260 ip-10-0-143-102 kubenswrapper[2573]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 09 02:19:44.316260 ip-10-0-143-102 kubenswrapper[2573]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 02:19:44.317190 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.317090 2573 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 09 02:19:44.320959 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.320944 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 02:19:44.320959 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.320958 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 02:19:44.321015 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.320962 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 02:19:44.321015 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.320965 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 02:19:44.321015 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.320968 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 02:19:44.321015 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.320972 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 02:19:44.321015 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.320974 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 02:19:44.321015 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.320977 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 02:19:44.321015 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.320979 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 02:19:44.321015 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.320982 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 02:19:44.321015 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.320984 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 02:19:44.321015 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.320987 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 02:19:44.321015 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.320990 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 02:19:44.321015 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.320992 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 02:19:44.321015 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.320995 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 02:19:44.321015 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.320998 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 02:19:44.321015 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.321000 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 02:19:44.321015 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.321003 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 02:19:44.321015 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.321005 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 02:19:44.321015 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.321008 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 02:19:44.321015 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.321010 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 02:19:44.321481 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.321016 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 02:19:44.321481 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.321019 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 02:19:44.321481 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.321022 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 02:19:44.321481 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.321025 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 02:19:44.321481 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.321028 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 02:19:44.321481 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.321030 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 02:19:44.321481 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.321033 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 02:19:44.321481 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.321035 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 02:19:44.321481 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.321038 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 02:19:44.321481 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.321041 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 02:19:44.321481 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.321043 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 02:19:44.321481 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.321046 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 02:19:44.321481 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.321048 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 02:19:44.321481 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.321051 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 02:19:44.321481 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.321053 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 02:19:44.321481 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.321055 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 02:19:44.321481 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.321058 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 02:19:44.321481 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.321061 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 02:19:44.321481 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.321064 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 02:19:44.321481 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.321066 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 02:19:44.321945 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.321068 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 02:19:44.321945 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.321083 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 02:19:44.321945 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.321087 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 02:19:44.321945 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.321091 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 02:19:44.321945 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.321095 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 02:19:44.321945 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.321100 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 02:19:44.321945 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.321103 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 02:19:44.321945 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.321108 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 02:19:44.321945 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.321111 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 02:19:44.321945 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.321114 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 02:19:44.321945 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.321117 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 02:19:44.321945 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.321119 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 02:19:44.321945 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.321129 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 02:19:44.321945 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.321133 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 02:19:44.321945 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.321136 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 02:19:44.321945 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.321139 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 02:19:44.321945 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.321143 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 02:19:44.321945 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.321146 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 02:19:44.321945 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.321149 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 02:19:44.322702 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.321152 2573 feature_gate.go:328] unrecognized feature gate: Example Jun 09 02:19:44.322702 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.321155 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 02:19:44.322702 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.321158 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 02:19:44.322702 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.321160 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 02:19:44.322702 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.321163 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 02:19:44.322702 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.321166 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 02:19:44.322702 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.321168 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 02:19:44.322702 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.321170 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 02:19:44.322702 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.321173 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 02:19:44.322702 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.321175 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 02:19:44.322702 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.321179 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 02:19:44.322702 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.321181 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 02:19:44.322702 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.321184 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 02:19:44.322702 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.321187 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 02:19:44.322702 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.321189 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 02:19:44.322702 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.321192 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 02:19:44.322702 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.321194 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 02:19:44.322702 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.321197 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 02:19:44.322702 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.321199 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 02:19:44.322702 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.321202 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 02:19:44.323308 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.321204 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 02:19:44.323308 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.321207 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 02:19:44.323308 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.321210 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 02:19:44.323308 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.321213 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 02:19:44.323308 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.321215 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 02:19:44.323308 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.321218 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 02:19:44.323308 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.321221 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 02:19:44.323308 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.321224 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 02:19:44.323308 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.321227 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 02:19:44.323308 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.321230 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 02:19:44.323308 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.321233 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 02:19:44.323308 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.321236 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 02:19:44.323308 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.321239 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 02:19:44.323308 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.321241 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 02:19:44.323308 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.321244 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 02:19:44.323308 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.321246 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 02:19:44.323308 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.321248 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 02:19:44.323308 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.321251 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 02:19:44.323308 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.321254 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 02:19:44.323308 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.322658 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 02:19:44.323775 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.322676 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 02:19:44.323775 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.322681 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 02:19:44.323775 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.322686 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 02:19:44.323775 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.322690 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 02:19:44.323775 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.322695 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 02:19:44.323775 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.322704 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 02:19:44.323775 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.322708 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 02:19:44.323775 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.322712 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 02:19:44.323775 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.322717 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 02:19:44.323775 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.322721 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 02:19:44.323775 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.322725 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 02:19:44.323775 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.322729 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 02:19:44.323775 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.322733 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 02:19:44.323775 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.322737 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 02:19:44.323775 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.322743 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 02:19:44.323775 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.322747 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 02:19:44.323775 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.322752 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 02:19:44.323775 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.322755 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 02:19:44.323775 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.322764 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 02:19:44.323775 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.322768 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 02:19:44.324303 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.322773 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 02:19:44.324303 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.322779 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 02:19:44.324303 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.322786 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 02:19:44.324303 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.322791 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 02:19:44.324303 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.322795 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 02:19:44.324303 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.322799 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 02:19:44.324303 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.322805 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 02:19:44.324303 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.322811 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 02:19:44.324303 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.322816 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 02:19:44.324303 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.322820 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 02:19:44.324303 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.322832 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 02:19:44.324303 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.322838 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 02:19:44.324303 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.322844 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 02:19:44.324303 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.322848 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 02:19:44.324303 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.322851 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 02:19:44.324303 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.322853 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 02:19:44.324303 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.322856 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 02:19:44.324303 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.322859 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 02:19:44.324303 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.322862 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 02:19:44.324757 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.322864 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 02:19:44.324757 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.322867 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 02:19:44.324757 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.322870 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 02:19:44.324757 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.322874 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 02:19:44.324757 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.322878 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 02:19:44.324757 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.322886 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 02:19:44.324757 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.322890 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 02:19:44.324757 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.322894 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 02:19:44.324757 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.322898 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 02:19:44.324757 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.322902 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 02:19:44.324757 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.322906 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 02:19:44.324757 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.322925 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 02:19:44.324757 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.322939 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 02:19:44.324757 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.322952 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 02:19:44.324757 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.322956 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 02:19:44.324757 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.322959 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 02:19:44.324757 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.322963 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 02:19:44.324757 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.322981 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 02:19:44.324757 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.322995 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 02:19:44.324757 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323127 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 02:19:44.325258 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323135 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 02:19:44.325258 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323138 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 02:19:44.325258 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323141 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 02:19:44.325258 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323144 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 02:19:44.325258 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323147 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 02:19:44.325258 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323149 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 02:19:44.325258 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323152 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 02:19:44.325258 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323155 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 02:19:44.325258 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323158 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 02:19:44.325258 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323160 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 02:19:44.325258 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323164 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 02:19:44.325258 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323166 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 02:19:44.325258 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323172 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 02:19:44.325258 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323174 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 02:19:44.325258 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323177 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 02:19:44.325258 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323179 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 02:19:44.325258 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323182 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 02:19:44.325258 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323184 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 02:19:44.325258 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323187 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 02:19:44.325709 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323190 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 02:19:44.325709 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323193 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 02:19:44.325709 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323196 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 02:19:44.325709 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323200 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 02:19:44.325709 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323203 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 02:19:44.325709 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323206 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 02:19:44.325709 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323210 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 02:19:44.325709 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323212 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 02:19:44.325709 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323215 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 02:19:44.325709 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323217 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 02:19:44.325709 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323220 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 02:19:44.325709 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323222 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 02:19:44.325709 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323225 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 02:19:44.325709 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323228 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 02:19:44.325709 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323230 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 02:19:44.325709 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323232 2573 feature_gate.go:328] unrecognized feature gate: Example Jun 09 02:19:44.325709 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323235 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 02:19:44.325709 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323238 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 02:19:44.325709 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323240 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 02:19:44.325709 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323242 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 02:19:44.326205 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323624 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 02:19:44.326205 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323631 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 02:19:44.326205 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323634 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 02:19:44.326205 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323638 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 02:19:44.326205 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323642 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 02:19:44.326205 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323644 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 02:19:44.326205 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323647 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 02:19:44.326205 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323650 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 02:19:44.326205 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323652 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 02:19:44.326205 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323655 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 02:19:44.326205 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323658 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 02:19:44.326205 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323660 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 02:19:44.326205 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323663 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 02:19:44.326205 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323665 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 02:19:44.326205 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323668 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 02:19:44.326205 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323670 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 02:19:44.326205 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323673 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 02:19:44.326205 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323676 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 02:19:44.326205 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323679 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 02:19:44.326205 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323682 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 02:19:44.326691 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323684 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 02:19:44.326691 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323687 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 02:19:44.326691 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323690 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 02:19:44.326691 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323692 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 02:19:44.326691 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323695 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 02:19:44.326691 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323697 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 02:19:44.326691 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323699 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 02:19:44.326691 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323702 2573 feature_gate.go:328] unrecognized feature gate: Example Jun 09 02:19:44.326691 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323704 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 02:19:44.326691 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323707 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 02:19:44.326691 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323709 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 02:19:44.326691 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323712 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 02:19:44.326691 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323714 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 02:19:44.326691 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323717 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 02:19:44.326691 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323719 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 02:19:44.326691 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323721 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 02:19:44.326691 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323724 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 02:19:44.326691 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323726 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 02:19:44.326691 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323729 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 02:19:44.326691 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323731 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 02:19:44.327185 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323736 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 02:19:44.327185 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323739 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 02:19:44.327185 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323742 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 02:19:44.327185 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323745 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 02:19:44.327185 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323748 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 02:19:44.327185 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323750 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 02:19:44.327185 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323753 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 02:19:44.327185 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323756 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 02:19:44.327185 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323759 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 02:19:44.327185 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323763 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 02:19:44.327185 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323765 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 02:19:44.327185 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323768 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 02:19:44.327185 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323770 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 02:19:44.327185 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323773 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 02:19:44.327185 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323775 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 02:19:44.327185 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323778 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 02:19:44.327185 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323780 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 02:19:44.327185 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323783 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 02:19:44.327185 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323786 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 02:19:44.327670 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323788 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 02:19:44.327670 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323791 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 02:19:44.327670 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323793 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 02:19:44.327670 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323796 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 02:19:44.327670 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323798 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 02:19:44.327670 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323801 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 02:19:44.327670 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323803 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 02:19:44.327670 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323806 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 02:19:44.327670 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323809 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 02:19:44.327670 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323811 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 02:19:44.327670 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323814 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 02:19:44.327670 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323816 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 02:19:44.327670 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323818 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 02:19:44.327670 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323821 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 02:19:44.327670 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323823 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 02:19:44.327670 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323827 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 02:19:44.327670 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323830 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 02:19:44.327670 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323833 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 02:19:44.327670 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323835 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 02:19:44.328134 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323838 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 02:19:44.328134 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323840 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 02:19:44.328134 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323843 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 02:19:44.328134 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323846 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 02:19:44.328134 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323849 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 02:19:44.328134 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323851 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 02:19:44.328134 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323854 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 02:19:44.328134 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323856 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 02:19:44.328134 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323858 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 02:19:44.328134 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323861 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 02:19:44.328134 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323863 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 02:19:44.328134 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323866 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 02:19:44.328134 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323868 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 02:19:44.328134 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323871 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 02:19:44.328134 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323873 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 02:19:44.328134 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323875 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 02:19:44.328134 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323878 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 02:19:44.328134 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323880 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 02:19:44.328134 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323883 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 02:19:44.328594 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323885 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 02:19:44.328594 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.323887 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 02:19:44.328594 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.323947 2573 flags.go:64] FLAG: --address="0.0.0.0" Jun 09 02:19:44.328594 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.323954 2573 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 09 02:19:44.328594 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.323960 2573 flags.go:64] FLAG: --anonymous-auth="true" Jun 09 02:19:44.328594 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.323964 2573 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 09 02:19:44.328594 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.323967 2573 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 09 02:19:44.328594 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.323970 2573 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 09 02:19:44.328594 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.323974 2573 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 09 02:19:44.328594 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.323978 2573 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 09 02:19:44.328594 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.323981 2573 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 09 02:19:44.328594 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.323984 2573 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 09 02:19:44.328594 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.323987 2573 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 09 02:19:44.328594 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.323990 2573 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 09 02:19:44.328594 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.323993 2573 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 09 02:19:44.328594 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.323996 2573 flags.go:64] FLAG: --cgroup-root="" Jun 09 02:19:44.328594 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324001 2573 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 09 02:19:44.328594 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324004 2573 flags.go:64] FLAG: --client-ca-file="" Jun 09 02:19:44.328594 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324008 2573 flags.go:64] FLAG: --cloud-provider="external" Jun 09 02:19:44.328594 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324010 2573 flags.go:64] FLAG: --cluster-dns="[]" Jun 09 02:19:44.328594 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324014 2573 flags.go:64] FLAG: --cluster-domain="" Jun 09 02:19:44.328594 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324017 2573 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 09 02:19:44.328594 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324020 2573 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 09 02:19:44.329146 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324023 2573 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 09 02:19:44.329146 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324026 2573 flags.go:64] FLAG: --container-log-max-files="5" Jun 09 02:19:44.329146 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324029 2573 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 09 02:19:44.329146 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324032 2573 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 09 02:19:44.329146 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324035 2573 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 09 02:19:44.329146 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324038 2573 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 09 02:19:44.329146 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324041 2573 flags.go:64] FLAG: --contention-profiling="false" Jun 09 02:19:44.329146 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324044 2573 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 09 02:19:44.329146 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324046 2573 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 09 02:19:44.329146 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324050 2573 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 09 02:19:44.329146 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324053 2573 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 09 02:19:44.329146 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324061 2573 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 09 02:19:44.329146 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324064 2573 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 09 02:19:44.329146 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324067 2573 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 09 02:19:44.329146 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324069 2573 flags.go:64] FLAG: --enable-load-reader="false" Jun 09 02:19:44.329146 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324088 2573 flags.go:64] FLAG: --enable-server="true" Jun 09 02:19:44.329146 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324091 2573 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 09 02:19:44.329146 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324095 2573 flags.go:64] FLAG: --event-burst="100" Jun 09 02:19:44.329146 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324098 2573 flags.go:64] FLAG: --event-qps="50" Jun 09 02:19:44.329146 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324104 2573 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 09 02:19:44.329146 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324107 2573 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 09 02:19:44.329146 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324110 2573 flags.go:64] FLAG: --eviction-hard="" Jun 09 02:19:44.329146 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324113 2573 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 09 02:19:44.329146 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324116 2573 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 09 02:19:44.329703 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324119 2573 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 09 02:19:44.329703 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324123 2573 flags.go:64] FLAG: --eviction-soft="" Jun 09 02:19:44.329703 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324126 2573 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 09 02:19:44.329703 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324128 2573 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 09 02:19:44.329703 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324133 2573 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 09 02:19:44.329703 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324136 2573 flags.go:64] FLAG: --experimental-mounter-path="" Jun 09 02:19:44.329703 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324138 2573 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 09 02:19:44.329703 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324141 2573 flags.go:64] FLAG: --fail-swap-on="true" Jun 09 02:19:44.329703 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324144 2573 flags.go:64] FLAG: --feature-gates="" Jun 09 02:19:44.329703 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324152 2573 flags.go:64] FLAG: --file-check-frequency="20s" Jun 09 02:19:44.329703 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324155 2573 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 09 02:19:44.329703 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324158 2573 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 09 02:19:44.329703 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324161 2573 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 09 02:19:44.329703 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324164 2573 flags.go:64] FLAG: --healthz-port="10248" Jun 09 02:19:44.329703 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324166 2573 flags.go:64] FLAG: --help="false" Jun 09 02:19:44.329703 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324169 2573 flags.go:64] FLAG: --hostname-override="ip-10-0-143-102.ec2.internal" Jun 09 02:19:44.329703 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324172 2573 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 09 02:19:44.329703 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324175 2573 flags.go:64] FLAG: --http-check-frequency="20s" Jun 09 02:19:44.329703 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324178 2573 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 09 02:19:44.329703 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324181 2573 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 09 02:19:44.329703 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324184 2573 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 09 02:19:44.329703 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324187 2573 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 09 02:19:44.329703 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324189 2573 flags.go:64] FLAG: --image-service-endpoint="" Jun 09 02:19:44.330275 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324192 2573 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 09 02:19:44.330275 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324195 2573 flags.go:64] FLAG: --kube-api-burst="100" Jun 09 02:19:44.330275 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324197 2573 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 09 02:19:44.330275 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324200 2573 flags.go:64] FLAG: --kube-api-qps="50" Jun 09 02:19:44.330275 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324204 2573 flags.go:64] FLAG: --kube-reserved="" Jun 09 02:19:44.330275 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324207 2573 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 09 02:19:44.330275 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324209 2573 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 09 02:19:44.330275 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324212 2573 flags.go:64] FLAG: --kubelet-cgroups="" Jun 09 02:19:44.330275 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324215 2573 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 09 02:19:44.330275 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324218 2573 flags.go:64] FLAG: --lock-file="" Jun 09 02:19:44.330275 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324221 2573 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 09 02:19:44.330275 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324224 2573 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 09 02:19:44.330275 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324227 2573 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 09 02:19:44.330275 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324232 2573 flags.go:64] FLAG: --log-json-split-stream="false" Jun 09 02:19:44.330275 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324235 2573 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 09 02:19:44.330275 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324238 2573 flags.go:64] FLAG: --log-text-split-stream="false" Jun 09 02:19:44.330275 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324240 2573 flags.go:64] FLAG: --logging-format="text" Jun 09 02:19:44.330275 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324243 2573 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 09 02:19:44.330275 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324246 2573 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 09 02:19:44.330275 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324249 2573 flags.go:64] FLAG: --manifest-url="" Jun 09 02:19:44.330275 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324251 2573 flags.go:64] FLAG: --manifest-url-header="" Jun 09 02:19:44.330275 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324255 2573 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 09 02:19:44.330275 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324258 2573 flags.go:64] FLAG: --max-open-files="1000000" Jun 09 02:19:44.330275 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324262 2573 flags.go:64] FLAG: --max-pods="110" Jun 09 02:19:44.330275 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324264 2573 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 09 02:19:44.330874 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324267 2573 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 09 02:19:44.330874 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324270 2573 flags.go:64] FLAG: --memory-manager-policy="None" Jun 09 02:19:44.330874 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324272 2573 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 09 02:19:44.330874 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324275 2573 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 09 02:19:44.330874 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324278 2573 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 09 02:19:44.330874 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324281 2573 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 09 02:19:44.330874 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324287 2573 flags.go:64] FLAG: --node-status-max-images="50" Jun 09 02:19:44.330874 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324290 2573 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 09 02:19:44.330874 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324293 2573 flags.go:64] FLAG: --oom-score-adj="-999" Jun 09 02:19:44.330874 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324295 2573 flags.go:64] FLAG: --pod-cidr="" Jun 09 02:19:44.330874 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324298 2573 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 09 02:19:44.330874 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324303 2573 flags.go:64] FLAG: --pod-manifest-path="" Jun 09 02:19:44.330874 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324308 2573 flags.go:64] FLAG: --pod-max-pids="-1" Jun 09 02:19:44.330874 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324311 2573 flags.go:64] FLAG: --pods-per-core="0" Jun 09 02:19:44.330874 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324314 2573 flags.go:64] FLAG: --port="10250" Jun 09 02:19:44.330874 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324317 2573 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 09 02:19:44.330874 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324320 2573 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-05cfcaa5e11226374" Jun 09 02:19:44.330874 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324324 2573 flags.go:64] FLAG: --qos-reserved="" Jun 09 02:19:44.330874 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324327 2573 flags.go:64] FLAG: --read-only-port="10255" Jun 09 02:19:44.330874 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324329 2573 flags.go:64] FLAG: --register-node="true" Jun 09 02:19:44.330874 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324332 2573 flags.go:64] FLAG: --register-with-taints="" Jun 09 02:19:44.330874 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324336 2573 flags.go:64] FLAG: --registry-burst="10" Jun 09 02:19:44.330874 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324339 2573 flags.go:64] FLAG: --registry-qps="5" Jun 09 02:19:44.330874 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324341 2573 flags.go:64] FLAG: --reserved-cpus="" Jun 09 02:19:44.331502 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324344 2573 flags.go:64] FLAG: --reserved-memory="" Jun 09 02:19:44.331502 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324348 2573 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 09 02:19:44.331502 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324351 2573 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 09 02:19:44.331502 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324353 2573 flags.go:64] FLAG: --rotate-certificates="false" Jun 09 02:19:44.331502 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324356 2573 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 09 02:19:44.331502 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324359 2573 flags.go:64] FLAG: --runonce="false" Jun 09 02:19:44.331502 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324362 2573 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 09 02:19:44.331502 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324365 2573 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 09 02:19:44.331502 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324368 2573 flags.go:64] FLAG: --seccomp-default="false" Jun 09 02:19:44.331502 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324370 2573 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 09 02:19:44.331502 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324373 2573 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 09 02:19:44.331502 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324375 2573 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 09 02:19:44.331502 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324378 2573 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 09 02:19:44.331502 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324381 2573 flags.go:64] FLAG: --storage-driver-password="root" Jun 09 02:19:44.331502 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324384 2573 flags.go:64] FLAG: --storage-driver-secure="false" Jun 09 02:19:44.331502 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324387 2573 flags.go:64] FLAG: --storage-driver-table="stats" Jun 09 02:19:44.331502 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324389 2573 flags.go:64] FLAG: --storage-driver-user="root" Jun 09 02:19:44.331502 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324392 2573 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 09 02:19:44.331502 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324395 2573 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 09 02:19:44.331502 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324397 2573 flags.go:64] FLAG: --system-cgroups="" Jun 09 02:19:44.331502 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324401 2573 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 09 02:19:44.331502 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324406 2573 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 09 02:19:44.331502 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324409 2573 flags.go:64] FLAG: --tls-cert-file="" Jun 09 02:19:44.331502 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324412 2573 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 09 02:19:44.331502 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324415 2573 flags.go:64] FLAG: --tls-min-version="" Jun 09 02:19:44.332109 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324419 2573 flags.go:64] FLAG: --tls-private-key-file="" Jun 09 02:19:44.332109 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324422 2573 flags.go:64] FLAG: --topology-manager-policy="none" Jun 09 02:19:44.332109 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324425 2573 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 09 02:19:44.332109 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324427 2573 flags.go:64] FLAG: --topology-manager-scope="container" Jun 09 02:19:44.332109 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324430 2573 flags.go:64] FLAG: --v="2" Jun 09 02:19:44.332109 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324434 2573 flags.go:64] FLAG: --version="false" Jun 09 02:19:44.332109 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324438 2573 flags.go:64] FLAG: --vmodule="" Jun 09 02:19:44.332109 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324441 2573 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 09 02:19:44.332109 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.324444 2573 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 09 02:19:44.332109 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.324557 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 02:19:44.332109 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.324562 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 02:19:44.332109 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.324565 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 02:19:44.332109 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.324568 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 02:19:44.332109 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.324571 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 02:19:44.332109 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.324574 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 02:19:44.332109 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.324576 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 02:19:44.332109 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.324579 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 02:19:44.332109 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.324583 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 02:19:44.332109 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.324586 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 02:19:44.332109 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.324589 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 02:19:44.332109 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.324592 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 02:19:44.332609 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.324595 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 02:19:44.332609 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.324597 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 02:19:44.332609 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.324599 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 02:19:44.332609 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.324602 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 02:19:44.332609 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.324604 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 02:19:44.332609 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.324607 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 02:19:44.332609 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.324611 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 02:19:44.332609 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.324613 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 02:19:44.332609 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.324616 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 02:19:44.332609 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.324618 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 02:19:44.332609 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.324621 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 02:19:44.332609 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.324625 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 02:19:44.332609 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.324627 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 02:19:44.332609 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.324630 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 02:19:44.332609 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.324633 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 02:19:44.332609 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.324635 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 02:19:44.332609 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.324638 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 02:19:44.332609 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.324641 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 02:19:44.332609 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.324644 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 02:19:44.332609 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.324646 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 02:19:44.333093 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.324650 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 02:19:44.333093 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.324653 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 02:19:44.333093 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.324656 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 02:19:44.333093 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.324658 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 02:19:44.333093 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.324661 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 02:19:44.333093 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.324664 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 02:19:44.333093 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.324666 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 02:19:44.333093 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.324669 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 02:19:44.333093 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.324671 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 02:19:44.333093 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.324674 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 02:19:44.333093 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.324676 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 02:19:44.333093 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.324678 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 02:19:44.333093 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.324682 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 02:19:44.333093 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.324685 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 02:19:44.333093 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.324688 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 02:19:44.333093 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.324691 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 02:19:44.333093 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.324694 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 02:19:44.333093 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.324696 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 02:19:44.333093 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.324701 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 02:19:44.333559 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.324704 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 02:19:44.333559 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.324706 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 02:19:44.333559 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.324709 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 02:19:44.333559 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.324711 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 02:19:44.333559 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.324716 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 02:19:44.333559 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.324718 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 02:19:44.333559 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.324721 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 02:19:44.333559 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.324723 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 02:19:44.333559 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.324726 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 02:19:44.333559 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.324728 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 02:19:44.333559 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.324731 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 02:19:44.333559 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.324733 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 02:19:44.333559 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.324736 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 02:19:44.333559 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.324739 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 02:19:44.333559 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.324741 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 02:19:44.333559 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.324744 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 02:19:44.333559 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.324746 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 02:19:44.333559 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.324748 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 02:19:44.333559 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.324751 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 02:19:44.333559 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.324753 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 02:19:44.334043 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.324756 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 02:19:44.334043 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.324758 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 02:19:44.334043 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.324761 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 02:19:44.334043 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.324763 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 02:19:44.334043 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.324766 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 02:19:44.334043 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.324769 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 02:19:44.334043 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.324772 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 02:19:44.334043 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.324774 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 02:19:44.334043 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.324777 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 02:19:44.334043 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.324779 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 02:19:44.334043 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.324782 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 02:19:44.334043 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.324785 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 02:19:44.334043 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.324788 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 02:19:44.334043 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.324790 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 02:19:44.334043 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.324793 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 02:19:44.334043 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.324795 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 02:19:44.334043 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.324799 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 02:19:44.334043 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.324801 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 02:19:44.334043 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.324804 2573 feature_gate.go:328] unrecognized feature gate: Example Jun 09 02:19:44.334043 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.324806 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 02:19:44.334563 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.324809 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 02:19:44.334563 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.324811 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 02:19:44.334563 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.324814 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 02:19:44.334563 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.324816 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 02:19:44.334563 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.324819 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 02:19:44.334563 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.324821 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 02:19:44.334563 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.324824 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 02:19:44.334563 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.324826 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 02:19:44.334563 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.325401 2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 02:19:44.334563 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.331119 2573 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 09 02:19:44.334563 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.331132 2573 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 09 02:19:44.334563 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.331150 2573 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 09 02:19:44.334563 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.331159 2573 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 09 02:19:44.334563 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331210 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 02:19:44.334903 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331215 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 02:19:44.334903 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331220 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 02:19:44.334903 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331223 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 02:19:44.334903 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331226 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 02:19:44.334903 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331229 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 02:19:44.334903 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331232 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 02:19:44.334903 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331235 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 02:19:44.334903 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331237 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 02:19:44.334903 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331240 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 02:19:44.334903 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331242 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 02:19:44.334903 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331245 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 02:19:44.334903 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331247 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 02:19:44.334903 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331250 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 02:19:44.334903 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331253 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 02:19:44.334903 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331255 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 02:19:44.334903 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331258 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 02:19:44.334903 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331260 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 02:19:44.334903 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331263 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 02:19:44.334903 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331265 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 02:19:44.335459 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331268 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 02:19:44.335459 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331270 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 02:19:44.335459 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331272 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 02:19:44.335459 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331275 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 02:19:44.335459 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331279 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 02:19:44.335459 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331281 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 02:19:44.335459 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331284 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 02:19:44.335459 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331286 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 02:19:44.335459 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331289 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 02:19:44.335459 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331292 2573 feature_gate.go:328] unrecognized feature gate: Example Jun 09 02:19:44.335459 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331295 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 02:19:44.335459 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331298 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 02:19:44.335459 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331300 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 02:19:44.335459 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331303 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 02:19:44.335459 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331305 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 02:19:44.335459 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331308 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 02:19:44.335459 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331310 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 02:19:44.335459 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331313 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 02:19:44.335459 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331315 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 02:19:44.335459 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331318 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 02:19:44.335459 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331320 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 02:19:44.335962 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331323 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 02:19:44.335962 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331325 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 02:19:44.335962 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331328 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 02:19:44.335962 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331330 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 02:19:44.335962 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331333 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 02:19:44.335962 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331335 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 02:19:44.335962 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331337 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 02:19:44.335962 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331340 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 02:19:44.335962 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331342 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 02:19:44.335962 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331344 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 02:19:44.335962 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331347 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 02:19:44.335962 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331350 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 02:19:44.335962 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331352 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 02:19:44.335962 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331355 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 02:19:44.335962 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331357 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 02:19:44.335962 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331360 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 02:19:44.335962 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331362 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 02:19:44.335962 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331365 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 02:19:44.335962 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331367 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 02:19:44.335962 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331370 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 02:19:44.336451 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331373 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 02:19:44.336451 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331376 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 02:19:44.336451 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331379 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 02:19:44.336451 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331381 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 02:19:44.336451 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331383 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 02:19:44.336451 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331386 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 02:19:44.336451 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331388 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 02:19:44.336451 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331391 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 02:19:44.336451 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331394 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 02:19:44.336451 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331396 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 02:19:44.336451 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331398 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 02:19:44.336451 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331401 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 02:19:44.336451 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331403 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 02:19:44.336451 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331406 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 02:19:44.336451 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331409 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 02:19:44.336451 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331411 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 02:19:44.336451 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331414 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 02:19:44.336451 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331416 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 02:19:44.336451 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331418 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 02:19:44.336884 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331421 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 02:19:44.336884 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331423 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 02:19:44.336884 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331426 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 02:19:44.336884 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331428 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 02:19:44.336884 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331430 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 02:19:44.336884 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331433 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 02:19:44.336884 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331435 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 02:19:44.336884 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331437 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 02:19:44.336884 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331440 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 02:19:44.336884 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331444 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 02:19:44.336884 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331447 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 02:19:44.336884 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331450 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 02:19:44.336884 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331453 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 02:19:44.336884 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331457 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 02:19:44.336884 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331459 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 02:19:44.336884 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331463 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 02:19:44.336884 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331466 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 02:19:44.336884 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331469 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 02:19:44.336884 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331472 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 02:19:44.337355 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.331477 2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 02:19:44.337355 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331577 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 02:19:44.337355 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331582 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 02:19:44.337355 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331584 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 02:19:44.337355 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331587 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 02:19:44.337355 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331590 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 02:19:44.337355 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331593 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 02:19:44.337355 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331595 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 02:19:44.337355 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331599 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 02:19:44.337355 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331603 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 02:19:44.337355 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331606 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 02:19:44.337355 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331609 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 02:19:44.337355 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331611 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 02:19:44.337355 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331614 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 02:19:44.337698 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331616 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 02:19:44.337698 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331619 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 02:19:44.337698 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331621 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 02:19:44.337698 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331624 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 02:19:44.337698 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331626 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 02:19:44.337698 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331628 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 02:19:44.337698 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331631 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 02:19:44.337698 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331633 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 02:19:44.337698 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331636 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 02:19:44.337698 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331638 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 02:19:44.337698 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331641 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 02:19:44.337698 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331643 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 02:19:44.337698 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331646 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 02:19:44.337698 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331648 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 02:19:44.337698 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331651 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 02:19:44.337698 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331653 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 02:19:44.337698 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331656 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 02:19:44.337698 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331658 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 02:19:44.337698 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331661 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 02:19:44.337698 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331663 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 02:19:44.338180 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331666 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 02:19:44.338180 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331668 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 02:19:44.338180 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331670 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 02:19:44.338180 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331673 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 02:19:44.338180 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331675 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 02:19:44.338180 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331678 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 02:19:44.338180 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331680 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 02:19:44.338180 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331683 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 02:19:44.338180 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331685 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 02:19:44.338180 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331687 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 02:19:44.338180 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331690 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 02:19:44.338180 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331692 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 02:19:44.338180 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331695 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 02:19:44.338180 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331697 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 02:19:44.338180 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331700 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 02:19:44.338180 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331702 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 02:19:44.338180 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331704 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 02:19:44.338180 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331707 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 02:19:44.338180 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331709 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 02:19:44.338679 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331712 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 02:19:44.338679 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331714 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 02:19:44.338679 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331717 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 02:19:44.338679 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331719 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 02:19:44.338679 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331722 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 02:19:44.338679 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331724 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 02:19:44.338679 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331727 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 02:19:44.338679 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331729 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 02:19:44.338679 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331732 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 02:19:44.338679 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331734 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 02:19:44.338679 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331737 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 02:19:44.338679 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331739 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 02:19:44.338679 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331741 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 02:19:44.338679 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331744 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 02:19:44.338679 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331746 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 02:19:44.338679 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331750 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 02:19:44.338679 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331753 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 02:19:44.338679 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331756 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 02:19:44.338679 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331759 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 02:19:44.339301 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331761 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 02:19:44.339301 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331764 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 02:19:44.339301 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331767 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 02:19:44.339301 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331770 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 02:19:44.339301 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331773 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 02:19:44.339301 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331775 2573 feature_gate.go:328] unrecognized feature gate: Example Jun 09 02:19:44.339301 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331778 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 02:19:44.339301 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331780 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 02:19:44.339301 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331782 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 02:19:44.339301 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331785 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 02:19:44.339301 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331787 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 02:19:44.339301 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331789 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 02:19:44.339301 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331792 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 02:19:44.339301 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331794 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 02:19:44.339301 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331797 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 02:19:44.339301 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331799 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 02:19:44.339301 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331802 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 02:19:44.339301 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331804 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 02:19:44.339301 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331807 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 02:19:44.339301 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331810 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 02:19:44.339301 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331813 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 02:19:44.339801 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331815 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 02:19:44.339801 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331817 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 02:19:44.339801 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331820 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 02:19:44.339801 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331824 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 02:19:44.339801 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331827 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 02:19:44.339801 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331830 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 02:19:44.339801 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:44.331832 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 02:19:44.339801 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.331837 2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 02:19:44.339801 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.331921 2573 server.go:962] "Client rotation is on, will bootstrap in background" Jun 09 02:19:44.339801 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.333793 2573 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 09 02:19:44.339801 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.335087 2573 server.go:1019] "Starting client certificate rotation" Jun 09 02:19:44.339801 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.335188 2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 09 02:19:44.339801 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.335215 2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 09 02:19:44.340411 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.337588 2573 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 09 02:19:44.340411 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.338610 2573 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 09 02:19:44.349150 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.349131 2573 log.go:25] "Validated CRI v1 runtime API" Jun 09 02:19:44.354414 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.354399 2573 log.go:25] "Validated CRI v1 image API" Jun 09 02:19:44.355105 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.355083 2573 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 09 02:19:44.357262 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.357244 2573 fs.go:135] Filesystem UUIDs: map[779f4804-5520-475d-a8e8-1e92367ae53f:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 8433d80e-7905-4ba6-b441-a44455c66ffb:/dev/nvme0n1p3] Jun 09 02:19:44.357329 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.357261 2573 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 09 02:19:44.362308 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.362292 2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 09 02:19:44.363216 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.363115 2573 manager.go:216] Machine: {Timestamp:2026-06-09 02:19:44.361680715 +0000 UTC m=+0.308798049 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3188101 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2b28b97227a90f89b71d936dc7836b SystemUUID:ec2b28b9-7227-a90f-89b7-1d936dc7836b BootID:0fdbb509-1374-44f0-b4f0-3f6102ce3916 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:52:ad:67:47:d7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:52:ad:67:47:d7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:2e:e9:80:26:56:f2 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 09 02:19:44.363216 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.363215 2573 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 09 02:19:44.363319 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.363279 2573 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 09 02:19:44.366049 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.366026 2573 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 09 02:19:44.366185 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.366052 2573 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-102.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 09 02:19:44.366787 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.366778 2573 topology_manager.go:138] "Creating topology manager with none policy" Jun 09 02:19:44.366815 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.366790 2573 container_manager_linux.go:309] "Creating device plugin manager" Jun 09 02:19:44.366815 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.366797 2573 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 09 02:19:44.367549 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.367539 2573 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 09 02:19:44.368426 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.368416 2573 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 09 02:19:44.371238 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.371227 2573 state_mem.go:36] "Initialized new in-memory state store" Jun 09 02:19:44.371336 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.371327 2573 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 09 02:19:44.371366 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.371358 2573 kubelet.go:486] "Attempting to sync node with API server" Jun 09 02:19:44.371393 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.371370 2573 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 09 02:19:44.371393 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.371382 2573 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 09 02:19:44.371393 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.371391 2573 kubelet.go:398] "Adding apiserver pod source" Jun 09 02:19:44.371486 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.371399 2573 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 09 02:19:44.371679 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.371667 2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 09 02:19:44.371741 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.371687 2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 09 02:19:44.374010 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.373958 2573 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 09 02:19:44.375313 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.375295 2573 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 09 02:19:44.375395 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.375334 2573 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 09 02:19:44.376733 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.376719 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 09 02:19:44.376796 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.376739 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 09 02:19:44.376796 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.376748 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 09 02:19:44.376796 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.376755 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 09 02:19:44.376796 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.376768 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 09 02:19:44.376796 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.376775 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 09 02:19:44.376796 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.376786 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 09 02:19:44.376796 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.376794 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 09 02:19:44.377007 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.376803 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 09 02:19:44.377007 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.376811 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 09 02:19:44.377007 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.376828 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 09 02:19:44.377007 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.376836 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 09 02:19:44.377799 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.377788 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 09 02:19:44.377849 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.377801 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 09 02:19:44.378176 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.378155 2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mc828" Jun 09 02:19:44.380583 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.380567 2573 server.go:1268] "Started kubelet" Jun 09 02:19:44.380719 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.380675 2573 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 09 02:19:44.381258 ip-10-0-143-102 systemd[1]: Started Kubernetes Kubelet. Jun 09 02:19:44.381630 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.381265 2573 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 09 02:19:44.381630 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.381341 2573 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 09 02:19:44.382871 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.382842 2573 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-102.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 09 02:19:44.385399 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.385370 2573 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 09 02:19:44.385681 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.385658 2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mc828" Jun 09 02:19:44.386263 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:19:44.386237 2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-102.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 09 02:19:44.386359 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:19:44.386335 2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 09 02:19:44.386457 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.386442 2573 server.go:310] "Adding debug handlers to kubelet server" Jun 09 02:19:44.387462 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:19:44.387439 2573 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 09 02:19:44.389044 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:19:44.388289 2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-102.ec2.internal.18b74838521121e1 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-102.ec2.internal,UID:ip-10-0-143-102.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-102.ec2.internal,},FirstTimestamp:2026-06-09 02:19:44.380543457 +0000 UTC m=+0.327660790,LastTimestamp:2026-06-09 02:19:44.380543457 +0000 UTC m=+0.327660790,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-102.ec2.internal,}" Jun 09 02:19:44.391294 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.391280 2573 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 09 02:19:44.391294 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.391288 2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 09 02:19:44.391773 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:19:44.391401 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-102.ec2.internal\" not found" Jun 09 02:19:44.391999 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.391986 2573 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 09 02:19:44.392110 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.391988 2573 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 09 02:19:44.392198 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.392114 2573 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 09 02:19:44.392198 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.392038 2573 factory.go:55] Registering systemd factory Jun 09 02:19:44.392198 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.392167 2573 factory.go:223] Registration of the systemd container factory successfully Jun 09 02:19:44.392333 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.392249 2573 reconstruct.go:97] "Volume reconstruction finished" Jun 09 02:19:44.392333 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.392258 2573 reconciler.go:29] "Reconciler: start to sync state" Jun 09 02:19:44.392392 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.392338 2573 factory.go:153] Registering CRI-O factory Jun 09 02:19:44.392392 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.392350 2573 factory.go:223] Registration of the crio container factory successfully Jun 09 02:19:44.392448 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.392401 2573 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 09 02:19:44.392448 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.392423 2573 factory.go:103] Registering Raw factory Jun 09 02:19:44.392448 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.392437 2573 manager.go:1196] Started watching for new ooms in manager Jun 09 02:19:44.392880 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.392862 2573 manager.go:349] Starting recovery of all containers Jun 09 02:19:44.398471 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.398453 2573 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 02:19:44.402216 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.402091 2573 manager.go:354] Recovery completed Jun 09 02:19:44.402304 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:19:44.402254 2573 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-143-102.ec2.internal\" not found" node="ip-10-0-143-102.ec2.internal" Jun 09 02:19:44.403351 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:19:44.403301 2573 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jun 09 02:19:44.406026 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.406010 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 02:19:44.407713 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.407699 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-102.ec2.internal" event="NodeHasSufficientMemory" Jun 09 02:19:44.407766 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.407727 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-102.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 02:19:44.407766 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.407738 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-102.ec2.internal" event="NodeHasSufficientPID" Jun 09 02:19:44.408248 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.408235 2573 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 09 02:19:44.408248 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.408247 2573 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 09 02:19:44.408333 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.408262 2573 state_mem.go:36] "Initialized new in-memory state store" Jun 09 02:19:44.408333 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.408240 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 02:19:44.408860 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.408845 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-102.ec2.internal" event="NodeHasSufficientMemory" Jun 09 02:19:44.408905 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.408871 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-102.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 02:19:44.408905 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.408882 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-102.ec2.internal" event="NodeHasSufficientPID" Jun 09 02:19:44.409335 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.409323 2573 policy_none.go:49] "None policy: Start" Jun 09 02:19:44.409378 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.409337 2573 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 09 02:19:44.409378 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.409346 2573 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 09 02:19:44.410208 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.410199 2573 policy_none.go:47] "Start" Jun 09 02:19:44.445898 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.445885 2573 manager.go:337] "Starting Device Plugin manager" Jun 09 02:19:44.445984 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:19:44.445910 2573 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 09 02:19:44.445984 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.445918 2573 server.go:87] "Starting device plugin registration server" Jun 09 02:19:44.446199 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.446122 2573 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 09 02:19:44.446199 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.446135 2573 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 09 02:19:44.446420 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.446253 2573 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 09 02:19:44.446420 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.446324 2573 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 09 02:19:44.446420 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.446332 2573 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 09 02:19:44.449017 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:19:44.448999 2573 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 09 02:19:44.449291 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:19:44.449272 2573 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-102.ec2.internal\" not found" Jun 09 02:19:44.459337 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.459313 2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 09 02:19:44.460388 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.460370 2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 09 02:19:44.460448 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.460413 2573 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 09 02:19:44.460448 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.460432 2573 kubelet.go:2448] "Starting kubelet main sync loop" Jun 09 02:19:44.460549 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:19:44.460466 2573 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 09 02:19:44.462414 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.462399 2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 02:19:44.546467 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.546442 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 02:19:44.547154 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.547137 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-102.ec2.internal" event="NodeHasSufficientMemory" Jun 09 02:19:44.547234 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.547161 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-102.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 02:19:44.547234 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.547170 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-102.ec2.internal" event="NodeHasSufficientPID" Jun 09 02:19:44.547234 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.547187 2573 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-102.ec2.internal" Jun 09 02:19:44.553204 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.553190 2573 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-102.ec2.internal" Jun 09 02:19:44.553244 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:19:44.553209 2573 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-102.ec2.internal\": node \"ip-10-0-143-102.ec2.internal\" not found" Jun 09 02:19:44.561286 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.561266 2573 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-102.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-102.ec2.internal"] Jun 09 02:19:44.561358 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.561316 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 02:19:44.562472 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.562459 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-102.ec2.internal" event="NodeHasSufficientMemory" Jun 09 02:19:44.562528 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.562484 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-102.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 02:19:44.562528 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.562494 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-102.ec2.internal" event="NodeHasSufficientPID" Jun 09 02:19:44.563569 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.563556 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 02:19:44.563680 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.563665 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-102.ec2.internal" Jun 09 02:19:44.563715 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.563693 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 02:19:44.564632 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.564617 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-102.ec2.internal" event="NodeHasSufficientMemory" Jun 09 02:19:44.564727 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.564644 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-102.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 02:19:44.564727 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.564656 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-102.ec2.internal" event="NodeHasSufficientPID" Jun 09 02:19:44.564727 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.564708 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-102.ec2.internal" event="NodeHasSufficientMemory" Jun 09 02:19:44.564727 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.564726 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-102.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 02:19:44.564887 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.564740 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-102.ec2.internal" event="NodeHasSufficientPID" Jun 09 02:19:44.565967 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.565953 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-102.ec2.internal" Jun 09 02:19:44.566025 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.565976 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 02:19:44.566662 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.566606 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-102.ec2.internal" event="NodeHasSufficientMemory" Jun 09 02:19:44.566662 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.566643 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-102.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 02:19:44.566662 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.566658 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-102.ec2.internal" event="NodeHasSufficientPID" Jun 09 02:19:44.566794 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:19:44.566700 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-102.ec2.internal\" not found" Jun 09 02:19:44.582573 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:19:44.582558 2573 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-102.ec2.internal\" not found" node="ip-10-0-143-102.ec2.internal" Jun 09 02:19:44.586519 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:19:44.586504 2573 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-102.ec2.internal\" not found" node="ip-10-0-143-102.ec2.internal" Jun 09 02:19:44.593550 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.593531 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f7b9893f4c000cf925ee11f6b503c58b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-102.ec2.internal\" (UID: \"f7b9893f4c000cf925ee11f6b503c58b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-102.ec2.internal" Jun 09 02:19:44.593623 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.593562 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f7b9893f4c000cf925ee11f6b503c58b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-102.ec2.internal\" (UID: \"f7b9893f4c000cf925ee11f6b503c58b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-102.ec2.internal" Jun 09 02:19:44.593623 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.593586 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/34d10cebf6d68c8388770209edc1ad38-config\") pod \"kube-apiserver-proxy-ip-10-0-143-102.ec2.internal\" (UID: \"34d10cebf6d68c8388770209edc1ad38\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-102.ec2.internal" Jun 09 02:19:44.667376 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:19:44.667356 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-102.ec2.internal\" not found" Jun 09 02:19:44.694489 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.694468 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f7b9893f4c000cf925ee11f6b503c58b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-102.ec2.internal\" (UID: \"f7b9893f4c000cf925ee11f6b503c58b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-102.ec2.internal" Jun 09 02:19:44.694589 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.694496 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f7b9893f4c000cf925ee11f6b503c58b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-102.ec2.internal\" (UID: \"f7b9893f4c000cf925ee11f6b503c58b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-102.ec2.internal" Jun 09 02:19:44.694589 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.694519 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/34d10cebf6d68c8388770209edc1ad38-config\") pod \"kube-apiserver-proxy-ip-10-0-143-102.ec2.internal\" (UID: \"34d10cebf6d68c8388770209edc1ad38\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-102.ec2.internal" Jun 09 02:19:44.694589 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.694572 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/34d10cebf6d68c8388770209edc1ad38-config\") pod \"kube-apiserver-proxy-ip-10-0-143-102.ec2.internal\" (UID: \"34d10cebf6d68c8388770209edc1ad38\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-102.ec2.internal" Jun 09 02:19:44.694589 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.694576 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f7b9893f4c000cf925ee11f6b503c58b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-102.ec2.internal\" (UID: \"f7b9893f4c000cf925ee11f6b503c58b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-102.ec2.internal" Jun 09 02:19:44.694727 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.694574 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f7b9893f4c000cf925ee11f6b503c58b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-102.ec2.internal\" (UID: \"f7b9893f4c000cf925ee11f6b503c58b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-102.ec2.internal" Jun 09 02:19:44.768214 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:19:44.768180 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-102.ec2.internal\" not found" Jun 09 02:19:44.868738 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:19:44.868684 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-102.ec2.internal\" not found" Jun 09 02:19:44.886996 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.886974 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-102.ec2.internal" Jun 09 02:19:44.891066 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:44.891002 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-102.ec2.internal" Jun 09 02:19:44.968975 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:19:44.968945 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-102.ec2.internal\" not found" Jun 09 02:19:45.069483 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:19:45.069461 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-102.ec2.internal\" not found" Jun 09 02:19:45.170034 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:19:45.169980 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-102.ec2.internal\" not found" Jun 09 02:19:45.270499 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:19:45.270476 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-102.ec2.internal\" not found" Jun 09 02:19:45.335040 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:45.335021 2573 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 09 02:19:45.335493 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:45.335187 2573 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 09 02:19:45.335493 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:45.335198 2573 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 09 02:19:45.371362 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:19:45.371337 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-102.ec2.internal\" not found" Jun 09 02:19:45.391408 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:45.391366 2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-08 02:14:44 +0000 UTC" deadline="2027-12-24 04:07:51.109026386 +0000 UTC" Jun 09 02:19:45.391408 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:45.391407 2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13513h48m5.717622544s" Jun 09 02:19:45.407736 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:45.407710 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7b9893f4c000cf925ee11f6b503c58b.slice/crio-3895bed5f51ee9bc135cbdce30dd4c462e4f295ea83a02f28f40deaed8473656 WatchSource:0}: Error finding container 3895bed5f51ee9bc135cbdce30dd4c462e4f295ea83a02f28f40deaed8473656: Status 404 returned error can't find the container with id 3895bed5f51ee9bc135cbdce30dd4c462e4f295ea83a02f28f40deaed8473656 Jun 09 02:19:45.408217 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:45.408197 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34d10cebf6d68c8388770209edc1ad38.slice/crio-a39cda9f5f01922a3ae886d808578efaa004ad395df0ba7cebe752117339f05d WatchSource:0}: Error finding container a39cda9f5f01922a3ae886d808578efaa004ad395df0ba7cebe752117339f05d: Status 404 returned error can't find the container with id a39cda9f5f01922a3ae886d808578efaa004ad395df0ba7cebe752117339f05d Jun 09 02:19:45.412927 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:45.412913 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 02:19:45.443289 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:45.443248 2573 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 02:19:45.462901 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:45.462865 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-102.ec2.internal" event={"ID":"f7b9893f4c000cf925ee11f6b503c58b","Type":"ContainerStarted","Data":"3895bed5f51ee9bc135cbdce30dd4c462e4f295ea83a02f28f40deaed8473656"} Jun 09 02:19:45.463856 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:45.463839 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-102.ec2.internal" event={"ID":"34d10cebf6d68c8388770209edc1ad38","Type":"ContainerStarted","Data":"a39cda9f5f01922a3ae886d808578efaa004ad395df0ba7cebe752117339f05d"} Jun 09 02:19:45.491661 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:45.491644 2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-102.ec2.internal" Jun 09 02:19:45.502362 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:45.502346 2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 09 02:19:45.504334 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:45.504322 2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-102.ec2.internal" Jun 09 02:19:45.512564 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:45.512552 2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 09 02:19:45.864301 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:45.864280 2573 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 02:19:46.372558 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.372523 2573 apiserver.go:52] "Watching apiserver" Jun 09 02:19:46.381082 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.381043 2573 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 09 02:19:46.382230 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.382207 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-xfrxz","openshift-network-diagnostics/network-check-target-fzc2b","openshift-network-operator/iptables-alerter-qvvvx","openshift-ovn-kubernetes/ovnkube-node-jz2q7","kube-system/global-pull-secret-syncer-8gdb7","kube-system/konnectivity-agent-5hctt","kube-system/kube-apiserver-proxy-ip-10-0-143-102.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-64h95","openshift-multus/multus-additional-cni-plugins-c4qzg","openshift-multus/multus-nqmc9","openshift-cluster-node-tuning-operator/tuned-bvzwc","openshift-dns/node-resolver-btr7x","openshift-image-registry/node-ca-fgmlx","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-102.ec2.internal"] Jun 09 02:19:46.383859 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.383836 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-nqmc9" Jun 09 02:19:46.385006 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.384982 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-fgmlx" Jun 09 02:19:46.386575 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.386557 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qvvvx" Jun 09 02:19:46.386671 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.386610 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 09 02:19:46.387719 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.387178 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 09 02:19:46.388307 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.388100 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-lhbfv\"" Jun 09 02:19:46.388307 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.388187 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 09 02:19:46.388457 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.388356 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 09 02:19:46.388634 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.388616 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 09 02:19:46.388718 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.388663 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 09 02:19:46.388998 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.388980 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 09 02:19:46.389217 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.389202 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-884s2\"" Jun 09 02:19:46.389821 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.389571 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 09 02:19:46.390525 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.390111 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 09 02:19:46.390525 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.390180 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-xcx7l\"" Jun 09 02:19:46.390525 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.390263 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 09 02:19:46.390980 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.390963 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jz2q7" Jun 09 02:19:46.391746 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.391727 2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 09 02:19:46.392936 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.392913 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8gdb7" Jun 09 02:19:46.393028 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:19:46.392990 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8gdb7" podUID="d745eb48-8450-4c3b-8f93-c6ab1f3036a0" Jun 09 02:19:46.393469 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.393449 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 09 02:19:46.393740 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.393644 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 09 02:19:46.393740 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.393675 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 09 02:19:46.393972 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.393955 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 09 02:19:46.394552 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.394537 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5hctt" Jun 09 02:19:46.395269 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.395252 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-w4nqj\"" Jun 09 02:19:46.395269 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.395264 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 09 02:19:46.395532 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.395515 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 09 02:19:46.395596 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.395518 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-c4qzg" Jun 09 02:19:46.396712 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.396696 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-64h95" Jun 09 02:19:46.396942 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.396920 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-8qkmm\"" Jun 09 02:19:46.397260 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.397235 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 09 02:19:46.397887 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.397864 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 09 02:19:46.397974 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.397952 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 09 02:19:46.398031 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.397976 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-g9dqp\"" Jun 09 02:19:46.398101 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.398090 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fzc2b" Jun 09 02:19:46.398158 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:19:46.398141 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fzc2b" podUID="fb1c4057-f500-488c-a3c7-b9013471e88b" Jun 09 02:19:46.398287 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.398270 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 09 02:19:46.399174 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.399147 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-5njtt\"" Jun 09 02:19:46.399260 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.399249 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 09 02:19:46.399776 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.399749 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xfrxz" Jun 09 02:19:46.399860 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.399825 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 09 02:19:46.399860 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:19:46.399827 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xfrxz" podUID="866bea41-c522-452a-9430-a3461041d710" Jun 09 02:19:46.400066 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.400035 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 09 02:19:46.401014 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.400991 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bvzwc" Jun 09 02:19:46.402421 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.402067 2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 09 02:19:46.402421 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.402350 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-btr7x" Jun 09 02:19:46.403250 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.403231 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-h5sqm\"" Jun 09 02:19:46.403431 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.403415 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 09 02:19:46.403431 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.403425 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/21fe5491-feac-4749-adfa-a195bf173d83-multus-cni-dir\") pod \"multus-nqmc9\" (UID: \"21fe5491-feac-4749-adfa-a195bf173d83\") " pod="openshift-multus/multus-nqmc9" Jun 09 02:19:46.403539 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.403451 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/21fe5491-feac-4749-adfa-a195bf173d83-host-run-netns\") pod \"multus-nqmc9\" (UID: \"21fe5491-feac-4749-adfa-a195bf173d83\") " pod="openshift-multus/multus-nqmc9" Jun 09 02:19:46.403539 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.403474 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtdms\" (UniqueName: \"kubernetes.io/projected/21fe5491-feac-4749-adfa-a195bf173d83-kube-api-access-xtdms\") pod \"multus-nqmc9\" (UID: \"21fe5491-feac-4749-adfa-a195bf173d83\") " pod="openshift-multus/multus-nqmc9" Jun 09 02:19:46.403539 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.403496 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/37e9e0fa-4abd-4eeb-8671-934808ecdf78-host-kubelet\") pod \"ovnkube-node-jz2q7\" (UID: \"37e9e0fa-4abd-4eeb-8671-934808ecdf78\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2q7" Jun 09 02:19:46.403539 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.403519 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/37e9e0fa-4abd-4eeb-8671-934808ecdf78-host-run-netns\") pod \"ovnkube-node-jz2q7\" (UID: \"37e9e0fa-4abd-4eeb-8671-934808ecdf78\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2q7" Jun 09 02:19:46.403725 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.403559 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/37e9e0fa-4abd-4eeb-8671-934808ecdf78-host-run-ovn-kubernetes\") pod \"ovnkube-node-jz2q7\" (UID: \"37e9e0fa-4abd-4eeb-8671-934808ecdf78\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2q7" Jun 09 02:19:46.403725 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.403581 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d745eb48-8450-4c3b-8f93-c6ab1f3036a0-original-pull-secret\") pod \"global-pull-secret-syncer-8gdb7\" (UID: \"d745eb48-8450-4c3b-8f93-c6ab1f3036a0\") " pod="kube-system/global-pull-secret-syncer-8gdb7" Jun 09 02:19:46.403725 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.403604 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/21fe5491-feac-4749-adfa-a195bf173d83-system-cni-dir\") pod \"multus-nqmc9\" (UID: \"21fe5491-feac-4749-adfa-a195bf173d83\") " pod="openshift-multus/multus-nqmc9" Jun 09 02:19:46.403725 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.403626 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/21fe5491-feac-4749-adfa-a195bf173d83-host-run-multus-certs\") pod \"multus-nqmc9\" (UID: \"21fe5491-feac-4749-adfa-a195bf173d83\") " pod="openshift-multus/multus-nqmc9" Jun 09 02:19:46.403725 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.403646 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d745eb48-8450-4c3b-8f93-c6ab1f3036a0-dbus\") pod \"global-pull-secret-syncer-8gdb7\" (UID: \"d745eb48-8450-4c3b-8f93-c6ab1f3036a0\") " pod="kube-system/global-pull-secret-syncer-8gdb7" Jun 09 02:19:46.403725 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.403689 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 09 02:19:46.403725 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.403670 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/37e9e0fa-4abd-4eeb-8671-934808ecdf78-etc-openvswitch\") pod \"ovnkube-node-jz2q7\" (UID: \"37e9e0fa-4abd-4eeb-8671-934808ecdf78\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2q7" Jun 09 02:19:46.404029 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.403724 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/37e9e0fa-4abd-4eeb-8671-934808ecdf78-run-ovn\") pod \"ovnkube-node-jz2q7\" (UID: \"37e9e0fa-4abd-4eeb-8671-934808ecdf78\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2q7" Jun 09 02:19:46.404029 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.403755 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/37e9e0fa-4abd-4eeb-8671-934808ecdf78-log-socket\") pod \"ovnkube-node-jz2q7\" (UID: \"37e9e0fa-4abd-4eeb-8671-934808ecdf78\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2q7" Jun 09 02:19:46.404029 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.403775 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/37e9e0fa-4abd-4eeb-8671-934808ecdf78-host-cni-bin\") pod \"ovnkube-node-jz2q7\" (UID: \"37e9e0fa-4abd-4eeb-8671-934808ecdf78\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2q7" Jun 09 02:19:46.404029 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.403801 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/37e9e0fa-4abd-4eeb-8671-934808ecdf78-ovnkube-script-lib\") pod \"ovnkube-node-jz2q7\" (UID: \"37e9e0fa-4abd-4eeb-8671-934808ecdf78\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2q7" Jun 09 02:19:46.404029 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.403847 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jz9vc\" (UniqueName: \"kubernetes.io/projected/37e9e0fa-4abd-4eeb-8671-934808ecdf78-kube-api-access-jz9vc\") pod \"ovnkube-node-jz2q7\" (UID: \"37e9e0fa-4abd-4eeb-8671-934808ecdf78\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2q7" Jun 09 02:19:46.404029 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.403871 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d745eb48-8450-4c3b-8f93-c6ab1f3036a0-kubelet-config\") pod \"global-pull-secret-syncer-8gdb7\" (UID: \"d745eb48-8450-4c3b-8f93-c6ab1f3036a0\") " pod="kube-system/global-pull-secret-syncer-8gdb7" Jun 09 02:19:46.404029 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.403892 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/37e9e0fa-4abd-4eeb-8671-934808ecdf78-run-systemd\") pod \"ovnkube-node-jz2q7\" (UID: \"37e9e0fa-4abd-4eeb-8671-934808ecdf78\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2q7" Jun 09 02:19:46.404029 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.403923 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/37e9e0fa-4abd-4eeb-8671-934808ecdf78-var-lib-openvswitch\") pod \"ovnkube-node-jz2q7\" (UID: \"37e9e0fa-4abd-4eeb-8671-934808ecdf78\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2q7" Jun 09 02:19:46.404029 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.403959 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/37e9e0fa-4abd-4eeb-8671-934808ecdf78-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jz2q7\" (UID: \"37e9e0fa-4abd-4eeb-8671-934808ecdf78\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2q7" Jun 09 02:19:46.404029 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.403999 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/37e9e0fa-4abd-4eeb-8671-934808ecdf78-ovn-node-metrics-cert\") pod \"ovnkube-node-jz2q7\" (UID: \"37e9e0fa-4abd-4eeb-8671-934808ecdf78\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2q7" Jun 09 02:19:46.404489 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.404039 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/21fe5491-feac-4749-adfa-a195bf173d83-os-release\") pod \"multus-nqmc9\" (UID: \"21fe5491-feac-4749-adfa-a195bf173d83\") " pod="openshift-multus/multus-nqmc9" Jun 09 02:19:46.404489 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.404090 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/21fe5491-feac-4749-adfa-a195bf173d83-cni-binary-copy\") pod \"multus-nqmc9\" (UID: \"21fe5491-feac-4749-adfa-a195bf173d83\") " pod="openshift-multus/multus-nqmc9" Jun 09 02:19:46.404489 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.404116 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/37e9e0fa-4abd-4eeb-8671-934808ecdf78-host-slash\") pod \"ovnkube-node-jz2q7\" (UID: \"37e9e0fa-4abd-4eeb-8671-934808ecdf78\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2q7" Jun 09 02:19:46.404489 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.404173 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/21fe5491-feac-4749-adfa-a195bf173d83-host-run-k8s-cni-cncf-io\") pod \"multus-nqmc9\" (UID: \"21fe5491-feac-4749-adfa-a195bf173d83\") " pod="openshift-multus/multus-nqmc9" Jun 09 02:19:46.404489 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.404225 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/21fe5491-feac-4749-adfa-a195bf173d83-hostroot\") pod \"multus-nqmc9\" (UID: \"21fe5491-feac-4749-adfa-a195bf173d83\") " pod="openshift-multus/multus-nqmc9" Jun 09 02:19:46.404489 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.404261 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/21fe5491-feac-4749-adfa-a195bf173d83-etc-kubernetes\") pod \"multus-nqmc9\" (UID: \"21fe5491-feac-4749-adfa-a195bf173d83\") " pod="openshift-multus/multus-nqmc9" Jun 09 02:19:46.404489 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.404298 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjqx6\" (UniqueName: \"kubernetes.io/projected/6627f9b3-28ae-40b2-9ba9-fe6614fe60dc-kube-api-access-sjqx6\") pod \"node-ca-fgmlx\" (UID: \"6627f9b3-28ae-40b2-9ba9-fe6614fe60dc\") " pod="openshift-image-registry/node-ca-fgmlx" Jun 09 02:19:46.404489 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.404312 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 09 02:19:46.404489 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.404321 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/129b4aeb-af58-4b14-ae74-bf599054fd7f-host-slash\") pod \"iptables-alerter-qvvvx\" (UID: \"129b4aeb-af58-4b14-ae74-bf599054fd7f\") " pod="openshift-network-operator/iptables-alerter-qvvvx" Jun 09 02:19:46.404489 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.404341 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/37e9e0fa-4abd-4eeb-8671-934808ecdf78-host-cni-netd\") pod \"ovnkube-node-jz2q7\" (UID: \"37e9e0fa-4abd-4eeb-8671-934808ecdf78\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2q7" Jun 09 02:19:46.404489 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.404370 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/21fe5491-feac-4749-adfa-a195bf173d83-cnibin\") pod \"multus-nqmc9\" (UID: \"21fe5491-feac-4749-adfa-a195bf173d83\") " pod="openshift-multus/multus-nqmc9" Jun 09 02:19:46.404489 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.404398 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-5fmjz\"" Jun 09 02:19:46.404489 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.404400 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/21fe5491-feac-4749-adfa-a195bf173d83-host-var-lib-cni-multus\") pod \"multus-nqmc9\" (UID: \"21fe5491-feac-4749-adfa-a195bf173d83\") " pod="openshift-multus/multus-nqmc9" Jun 09 02:19:46.404489 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.404471 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/21fe5491-feac-4749-adfa-a195bf173d83-multus-conf-dir\") pod \"multus-nqmc9\" (UID: \"21fe5491-feac-4749-adfa-a195bf173d83\") " pod="openshift-multus/multus-nqmc9" Jun 09 02:19:46.404489 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.404494 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6627f9b3-28ae-40b2-9ba9-fe6614fe60dc-host\") pod \"node-ca-fgmlx\" (UID: \"6627f9b3-28ae-40b2-9ba9-fe6614fe60dc\") " pod="openshift-image-registry/node-ca-fgmlx" Jun 09 02:19:46.405186 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.404514 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6627f9b3-28ae-40b2-9ba9-fe6614fe60dc-serviceca\") pod \"node-ca-fgmlx\" (UID: \"6627f9b3-28ae-40b2-9ba9-fe6614fe60dc\") " pod="openshift-image-registry/node-ca-fgmlx" Jun 09 02:19:46.405186 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.404526 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 09 02:19:46.405186 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.404537 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/129b4aeb-af58-4b14-ae74-bf599054fd7f-iptables-alerter-script\") pod \"iptables-alerter-qvvvx\" (UID: \"129b4aeb-af58-4b14-ae74-bf599054fd7f\") " pod="openshift-network-operator/iptables-alerter-qvvvx" Jun 09 02:19:46.405186 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.404560 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/37e9e0fa-4abd-4eeb-8671-934808ecdf78-systemd-units\") pod \"ovnkube-node-jz2q7\" (UID: \"37e9e0fa-4abd-4eeb-8671-934808ecdf78\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2q7" Jun 09 02:19:46.405186 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.404585 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/37e9e0fa-4abd-4eeb-8671-934808ecdf78-run-openvswitch\") pod \"ovnkube-node-jz2q7\" (UID: \"37e9e0fa-4abd-4eeb-8671-934808ecdf78\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2q7" Jun 09 02:19:46.405186 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.404605 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/37e9e0fa-4abd-4eeb-8671-934808ecdf78-node-log\") pod \"ovnkube-node-jz2q7\" (UID: \"37e9e0fa-4abd-4eeb-8671-934808ecdf78\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2q7" Jun 09 02:19:46.405186 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.404628 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/37e9e0fa-4abd-4eeb-8671-934808ecdf78-env-overrides\") pod \"ovnkube-node-jz2q7\" (UID: \"37e9e0fa-4abd-4eeb-8671-934808ecdf78\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2q7" Jun 09 02:19:46.405186 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.404649 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/21fe5491-feac-4749-adfa-a195bf173d83-host-var-lib-cni-bin\") pod \"multus-nqmc9\" (UID: \"21fe5491-feac-4749-adfa-a195bf173d83\") " pod="openshift-multus/multus-nqmc9" Jun 09 02:19:46.405186 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.404673 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwjnl\" (UniqueName: \"kubernetes.io/projected/129b4aeb-af58-4b14-ae74-bf599054fd7f-kube-api-access-bwjnl\") pod \"iptables-alerter-qvvvx\" (UID: \"129b4aeb-af58-4b14-ae74-bf599054fd7f\") " pod="openshift-network-operator/iptables-alerter-qvvvx" Jun 09 02:19:46.405186 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.404695 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/37e9e0fa-4abd-4eeb-8671-934808ecdf78-ovnkube-config\") pod \"ovnkube-node-jz2q7\" (UID: \"37e9e0fa-4abd-4eeb-8671-934808ecdf78\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2q7" Jun 09 02:19:46.405186 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.404734 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/21fe5491-feac-4749-adfa-a195bf173d83-multus-socket-dir-parent\") pod \"multus-nqmc9\" (UID: \"21fe5491-feac-4749-adfa-a195bf173d83\") " pod="openshift-multus/multus-nqmc9" Jun 09 02:19:46.405186 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.404765 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/21fe5491-feac-4749-adfa-a195bf173d83-host-var-lib-kubelet\") pod \"multus-nqmc9\" (UID: \"21fe5491-feac-4749-adfa-a195bf173d83\") " pod="openshift-multus/multus-nqmc9" Jun 09 02:19:46.405186 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.404804 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/21fe5491-feac-4749-adfa-a195bf173d83-multus-daemon-config\") pod \"multus-nqmc9\" (UID: \"21fe5491-feac-4749-adfa-a195bf173d83\") " pod="openshift-multus/multus-nqmc9" Jun 09 02:19:46.423576 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.423556 2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-5s8qx" Jun 09 02:19:46.431757 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.431743 2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-5s8qx" Jun 09 02:19:46.444307 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.444286 2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 02:19:46.494002 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.493981 2573 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 09 02:19:46.505408 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.505384 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/21fe5491-feac-4749-adfa-a195bf173d83-etc-kubernetes\") pod \"multus-nqmc9\" (UID: \"21fe5491-feac-4749-adfa-a195bf173d83\") " pod="openshift-multus/multus-nqmc9" Jun 09 02:19:46.505408 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.505408 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/21fe5491-feac-4749-adfa-a195bf173d83-cnibin\") pod \"multus-nqmc9\" (UID: \"21fe5491-feac-4749-adfa-a195bf173d83\") " pod="openshift-multus/multus-nqmc9" Jun 09 02:19:46.505570 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.505425 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6627f9b3-28ae-40b2-9ba9-fe6614fe60dc-serviceca\") pod \"node-ca-fgmlx\" (UID: \"6627f9b3-28ae-40b2-9ba9-fe6614fe60dc\") " pod="openshift-image-registry/node-ca-fgmlx" Jun 09 02:19:46.505570 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.505451 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9ee7881a-36ac-45e4-80a2-d3fbdf30e2ae-cni-binary-copy\") pod \"multus-additional-cni-plugins-c4qzg\" (UID: \"9ee7881a-36ac-45e4-80a2-d3fbdf30e2ae\") " pod="openshift-multus/multus-additional-cni-plugins-c4qzg" Jun 09 02:19:46.505570 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.505474 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kn9fc\" (UniqueName: \"kubernetes.io/projected/866bea41-c522-452a-9430-a3461041d710-kube-api-access-kn9fc\") pod \"network-metrics-daemon-xfrxz\" (UID: \"866bea41-c522-452a-9430-a3461041d710\") " pod="openshift-multus/network-metrics-daemon-xfrxz" Jun 09 02:19:46.505570 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.505489 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4dad265a-b70a-4a80-b2da-d1901621c5a2-etc-systemd\") pod \"tuned-bvzwc\" (UID: \"4dad265a-b70a-4a80-b2da-d1901621c5a2\") " pod="openshift-cluster-node-tuning-operator/tuned-bvzwc" Jun 09 02:19:46.505570 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.505548 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/37e9e0fa-4abd-4eeb-8671-934808ecdf78-node-log\") pod \"ovnkube-node-jz2q7\" (UID: \"37e9e0fa-4abd-4eeb-8671-934808ecdf78\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2q7" Jun 09 02:19:46.505773 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.505570 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/21fe5491-feac-4749-adfa-a195bf173d83-cnibin\") pod \"multus-nqmc9\" (UID: \"21fe5491-feac-4749-adfa-a195bf173d83\") " pod="openshift-multus/multus-nqmc9" Jun 09 02:19:46.505773 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.505587 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/37e9e0fa-4abd-4eeb-8671-934808ecdf78-env-overrides\") pod \"ovnkube-node-jz2q7\" (UID: \"37e9e0fa-4abd-4eeb-8671-934808ecdf78\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2q7" Jun 09 02:19:46.505773 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.505630 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/37e9e0fa-4abd-4eeb-8671-934808ecdf78-node-log\") pod \"ovnkube-node-jz2q7\" (UID: \"37e9e0fa-4abd-4eeb-8671-934808ecdf78\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2q7" Jun 09 02:19:46.505773 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.505673 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/21fe5491-feac-4749-adfa-a195bf173d83-host-var-lib-cni-bin\") pod \"multus-nqmc9\" (UID: \"21fe5491-feac-4749-adfa-a195bf173d83\") " pod="openshift-multus/multus-nqmc9" Jun 09 02:19:46.505773 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.505696 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/21fe5491-feac-4749-adfa-a195bf173d83-etc-kubernetes\") pod \"multus-nqmc9\" (UID: \"21fe5491-feac-4749-adfa-a195bf173d83\") " pod="openshift-multus/multus-nqmc9" Jun 09 02:19:46.505773 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.505701 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwjnl\" (UniqueName: \"kubernetes.io/projected/129b4aeb-af58-4b14-ae74-bf599054fd7f-kube-api-access-bwjnl\") pod \"iptables-alerter-qvvvx\" (UID: \"129b4aeb-af58-4b14-ae74-bf599054fd7f\") " pod="openshift-network-operator/iptables-alerter-qvvvx" Jun 09 02:19:46.505773 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.505741 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/bb35575b-7a94-4bf7-be30-a083b9265c50-etc-selinux\") pod \"aws-ebs-csi-driver-node-64h95\" (UID: \"bb35575b-7a94-4bf7-be30-a083b9265c50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-64h95" Jun 09 02:19:46.505773 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.505767 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5pg6\" (UniqueName: \"kubernetes.io/projected/9ee7881a-36ac-45e4-80a2-d3fbdf30e2ae-kube-api-access-j5pg6\") pod \"multus-additional-cni-plugins-c4qzg\" (UID: \"9ee7881a-36ac-45e4-80a2-d3fbdf30e2ae\") " pod="openshift-multus/multus-additional-cni-plugins-c4qzg" Jun 09 02:19:46.506089 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.505794 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/21fe5491-feac-4749-adfa-a195bf173d83-multus-socket-dir-parent\") pod \"multus-nqmc9\" (UID: \"21fe5491-feac-4749-adfa-a195bf173d83\") " pod="openshift-multus/multus-nqmc9" Jun 09 02:19:46.506089 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.505820 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/bb35575b-7a94-4bf7-be30-a083b9265c50-socket-dir\") pod \"aws-ebs-csi-driver-node-64h95\" (UID: \"bb35575b-7a94-4bf7-be30-a083b9265c50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-64h95" Jun 09 02:19:46.506089 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.505863 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b8b26c95-6b25-462e-bbca-66eefe50f0bb-agent-certs\") pod \"konnectivity-agent-5hctt\" (UID: \"b8b26c95-6b25-462e-bbca-66eefe50f0bb\") " pod="kube-system/konnectivity-agent-5hctt" Jun 09 02:19:46.506089 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.505886 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvvcc\" (UniqueName: \"kubernetes.io/projected/4dad265a-b70a-4a80-b2da-d1901621c5a2-kube-api-access-rvvcc\") pod \"tuned-bvzwc\" (UID: \"4dad265a-b70a-4a80-b2da-d1901621c5a2\") " pod="openshift-cluster-node-tuning-operator/tuned-bvzwc" Jun 09 02:19:46.506089 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.505912 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/21fe5491-feac-4749-adfa-a195bf173d83-host-run-netns\") pod \"multus-nqmc9\" (UID: \"21fe5491-feac-4749-adfa-a195bf173d83\") " pod="openshift-multus/multus-nqmc9" Jun 09 02:19:46.506089 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.505937 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wj75\" (UniqueName: \"kubernetes.io/projected/fb1c4057-f500-488c-a3c7-b9013471e88b-kube-api-access-2wj75\") pod \"network-check-target-fzc2b\" (UID: \"fb1c4057-f500-488c-a3c7-b9013471e88b\") " pod="openshift-network-diagnostics/network-check-target-fzc2b" Jun 09 02:19:46.506089 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.505960 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4dad265a-b70a-4a80-b2da-d1901621c5a2-etc-sysctl-d\") pod \"tuned-bvzwc\" (UID: \"4dad265a-b70a-4a80-b2da-d1901621c5a2\") " pod="openshift-cluster-node-tuning-operator/tuned-bvzwc" Jun 09 02:19:46.506089 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.505986 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-787q5\" (UniqueName: \"kubernetes.io/projected/37660632-e407-412f-aa36-3e764febd673-kube-api-access-787q5\") pod \"node-resolver-btr7x\" (UID: \"37660632-e407-412f-aa36-3e764febd673\") " pod="openshift-dns/node-resolver-btr7x" Jun 09 02:19:46.506089 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.505993 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6627f9b3-28ae-40b2-9ba9-fe6614fe60dc-serviceca\") pod \"node-ca-fgmlx\" (UID: \"6627f9b3-28ae-40b2-9ba9-fe6614fe60dc\") " pod="openshift-image-registry/node-ca-fgmlx" Jun 09 02:19:46.506089 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.506009 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/37e9e0fa-4abd-4eeb-8671-934808ecdf78-host-run-netns\") pod \"ovnkube-node-jz2q7\" (UID: \"37e9e0fa-4abd-4eeb-8671-934808ecdf78\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2q7" Jun 09 02:19:46.506089 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.506015 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/37e9e0fa-4abd-4eeb-8671-934808ecdf78-env-overrides\") pod \"ovnkube-node-jz2q7\" (UID: \"37e9e0fa-4abd-4eeb-8671-934808ecdf78\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2q7" Jun 09 02:19:46.506089 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.506068 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d745eb48-8450-4c3b-8f93-c6ab1f3036a0-original-pull-secret\") pod \"global-pull-secret-syncer-8gdb7\" (UID: \"d745eb48-8450-4c3b-8f93-c6ab1f3036a0\") " pod="kube-system/global-pull-secret-syncer-8gdb7" Jun 09 02:19:46.506607 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.506104 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/21fe5491-feac-4749-adfa-a195bf173d83-multus-socket-dir-parent\") pod \"multus-nqmc9\" (UID: \"21fe5491-feac-4749-adfa-a195bf173d83\") " pod="openshift-multus/multus-nqmc9" Jun 09 02:19:46.506607 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.506118 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/21fe5491-feac-4749-adfa-a195bf173d83-system-cni-dir\") pod \"multus-nqmc9\" (UID: \"21fe5491-feac-4749-adfa-a195bf173d83\") " pod="openshift-multus/multus-nqmc9" Jun 09 02:19:46.506607 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.506142 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/21fe5491-feac-4749-adfa-a195bf173d83-host-var-lib-cni-multus\") pod \"multus-nqmc9\" (UID: \"21fe5491-feac-4749-adfa-a195bf173d83\") " pod="openshift-multus/multus-nqmc9" Jun 09 02:19:46.506607 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.506179 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/21fe5491-feac-4749-adfa-a195bf173d83-host-var-lib-cni-multus\") pod \"multus-nqmc9\" (UID: \"21fe5491-feac-4749-adfa-a195bf173d83\") " pod="openshift-multus/multus-nqmc9" Jun 09 02:19:46.506607 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.506179 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/21fe5491-feac-4749-adfa-a195bf173d83-host-run-netns\") pod \"multus-nqmc9\" (UID: \"21fe5491-feac-4749-adfa-a195bf173d83\") " pod="openshift-multus/multus-nqmc9" Jun 09 02:19:46.506607 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.506191 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/129b4aeb-af58-4b14-ae74-bf599054fd7f-iptables-alerter-script\") pod \"iptables-alerter-qvvvx\" (UID: \"129b4aeb-af58-4b14-ae74-bf599054fd7f\") " pod="openshift-network-operator/iptables-alerter-qvvvx" Jun 09 02:19:46.506607 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.506205 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/37e9e0fa-4abd-4eeb-8671-934808ecdf78-host-run-netns\") pod \"ovnkube-node-jz2q7\" (UID: \"37e9e0fa-4abd-4eeb-8671-934808ecdf78\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2q7" Jun 09 02:19:46.506607 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.506251 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/21fe5491-feac-4749-adfa-a195bf173d83-host-var-lib-cni-bin\") pod \"multus-nqmc9\" (UID: \"21fe5491-feac-4749-adfa-a195bf173d83\") " pod="openshift-multus/multus-nqmc9" Jun 09 02:19:46.506607 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:19:46.506306 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 02:19:46.506607 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.506322 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/bb35575b-7a94-4bf7-be30-a083b9265c50-sys-fs\") pod \"aws-ebs-csi-driver-node-64h95\" (UID: \"bb35575b-7a94-4bf7-be30-a083b9265c50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-64h95" Jun 09 02:19:46.506607 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.506324 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/21fe5491-feac-4749-adfa-a195bf173d83-system-cni-dir\") pod \"multus-nqmc9\" (UID: \"21fe5491-feac-4749-adfa-a195bf173d83\") " pod="openshift-multus/multus-nqmc9" Jun 09 02:19:46.506607 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:19:46.506369 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d745eb48-8450-4c3b-8f93-c6ab1f3036a0-original-pull-secret podName:d745eb48-8450-4c3b-8f93-c6ab1f3036a0 nodeName:}" failed. No retries permitted until 2026-06-09 02:19:47.006350813 +0000 UTC m=+2.953468137 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d745eb48-8450-4c3b-8f93-c6ab1f3036a0-original-pull-secret") pod "global-pull-secret-syncer-8gdb7" (UID: "d745eb48-8450-4c3b-8f93-c6ab1f3036a0") : object "kube-system"/"original-pull-secret" not registered Jun 09 02:19:46.506607 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.506389 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kfsxv\" (UniqueName: \"kubernetes.io/projected/bb35575b-7a94-4bf7-be30-a083b9265c50-kube-api-access-kfsxv\") pod \"aws-ebs-csi-driver-node-64h95\" (UID: \"bb35575b-7a94-4bf7-be30-a083b9265c50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-64h95" Jun 09 02:19:46.506607 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.506417 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d745eb48-8450-4c3b-8f93-c6ab1f3036a0-dbus\") pod \"global-pull-secret-syncer-8gdb7\" (UID: \"d745eb48-8450-4c3b-8f93-c6ab1f3036a0\") " pod="kube-system/global-pull-secret-syncer-8gdb7" Jun 09 02:19:46.506607 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.506445 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/37e9e0fa-4abd-4eeb-8671-934808ecdf78-etc-openvswitch\") pod \"ovnkube-node-jz2q7\" (UID: \"37e9e0fa-4abd-4eeb-8671-934808ecdf78\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2q7" Jun 09 02:19:46.506607 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.506467 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/37e9e0fa-4abd-4eeb-8671-934808ecdf78-run-ovn\") pod \"ovnkube-node-jz2q7\" (UID: \"37e9e0fa-4abd-4eeb-8671-934808ecdf78\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2q7" Jun 09 02:19:46.506607 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.506489 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/21fe5491-feac-4749-adfa-a195bf173d83-host-run-k8s-cni-cncf-io\") pod \"multus-nqmc9\" (UID: \"21fe5491-feac-4749-adfa-a195bf173d83\") " pod="openshift-multus/multus-nqmc9" Jun 09 02:19:46.507451 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.506527 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/37e9e0fa-4abd-4eeb-8671-934808ecdf78-etc-openvswitch\") pod \"ovnkube-node-jz2q7\" (UID: \"37e9e0fa-4abd-4eeb-8671-934808ecdf78\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2q7" Jun 09 02:19:46.507451 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.506536 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/21fe5491-feac-4749-adfa-a195bf173d83-host-run-k8s-cni-cncf-io\") pod \"multus-nqmc9\" (UID: \"21fe5491-feac-4749-adfa-a195bf173d83\") " pod="openshift-multus/multus-nqmc9" Jun 09 02:19:46.507451 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.506565 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/21fe5491-feac-4749-adfa-a195bf173d83-hostroot\") pod \"multus-nqmc9\" (UID: \"21fe5491-feac-4749-adfa-a195bf173d83\") " pod="openshift-multus/multus-nqmc9" Jun 09 02:19:46.507451 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.506591 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/37e9e0fa-4abd-4eeb-8671-934808ecdf78-log-socket\") pod \"ovnkube-node-jz2q7\" (UID: \"37e9e0fa-4abd-4eeb-8671-934808ecdf78\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2q7" Jun 09 02:19:46.507451 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.506613 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d745eb48-8450-4c3b-8f93-c6ab1f3036a0-dbus\") pod \"global-pull-secret-syncer-8gdb7\" (UID: \"d745eb48-8450-4c3b-8f93-c6ab1f3036a0\") " pod="kube-system/global-pull-secret-syncer-8gdb7" Jun 09 02:19:46.507451 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.506621 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/37e9e0fa-4abd-4eeb-8671-934808ecdf78-ovnkube-script-lib\") pod \"ovnkube-node-jz2q7\" (UID: \"37e9e0fa-4abd-4eeb-8671-934808ecdf78\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2q7" Jun 09 02:19:46.507451 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.506658 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jz9vc\" (UniqueName: \"kubernetes.io/projected/37e9e0fa-4abd-4eeb-8671-934808ecdf78-kube-api-access-jz9vc\") pod \"ovnkube-node-jz2q7\" (UID: \"37e9e0fa-4abd-4eeb-8671-934808ecdf78\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2q7" Jun 09 02:19:46.507451 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.506684 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d745eb48-8450-4c3b-8f93-c6ab1f3036a0-kubelet-config\") pod \"global-pull-secret-syncer-8gdb7\" (UID: \"d745eb48-8450-4c3b-8f93-c6ab1f3036a0\") " pod="kube-system/global-pull-secret-syncer-8gdb7" Jun 09 02:19:46.507451 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.506689 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/37e9e0fa-4abd-4eeb-8671-934808ecdf78-run-ovn\") pod \"ovnkube-node-jz2q7\" (UID: \"37e9e0fa-4abd-4eeb-8671-934808ecdf78\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2q7" Jun 09 02:19:46.507451 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.506721 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/37e9e0fa-4abd-4eeb-8671-934808ecdf78-run-systemd\") pod \"ovnkube-node-jz2q7\" (UID: \"37e9e0fa-4abd-4eeb-8671-934808ecdf78\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2q7" Jun 09 02:19:46.507451 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.506735 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d745eb48-8450-4c3b-8f93-c6ab1f3036a0-kubelet-config\") pod \"global-pull-secret-syncer-8gdb7\" (UID: \"d745eb48-8450-4c3b-8f93-c6ab1f3036a0\") " pod="kube-system/global-pull-secret-syncer-8gdb7" Jun 09 02:19:46.507451 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.506745 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/37e9e0fa-4abd-4eeb-8671-934808ecdf78-ovn-node-metrics-cert\") pod \"ovnkube-node-jz2q7\" (UID: \"37e9e0fa-4abd-4eeb-8671-934808ecdf78\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2q7" Jun 09 02:19:46.507451 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.506769 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/37e9e0fa-4abd-4eeb-8671-934808ecdf78-host-slash\") pod \"ovnkube-node-jz2q7\" (UID: \"37e9e0fa-4abd-4eeb-8671-934808ecdf78\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2q7" Jun 09 02:19:46.507451 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.506661 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/21fe5491-feac-4749-adfa-a195bf173d83-hostroot\") pod \"multus-nqmc9\" (UID: \"21fe5491-feac-4749-adfa-a195bf173d83\") " pod="openshift-multus/multus-nqmc9" Jun 09 02:19:46.507451 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.506793 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjqx6\" (UniqueName: \"kubernetes.io/projected/6627f9b3-28ae-40b2-9ba9-fe6614fe60dc-kube-api-access-sjqx6\") pod \"node-ca-fgmlx\" (UID: \"6627f9b3-28ae-40b2-9ba9-fe6614fe60dc\") " pod="openshift-image-registry/node-ca-fgmlx" Jun 09 02:19:46.507451 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.506813 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/37e9e0fa-4abd-4eeb-8671-934808ecdf78-log-socket\") pod \"ovnkube-node-jz2q7\" (UID: \"37e9e0fa-4abd-4eeb-8671-934808ecdf78\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2q7" Jun 09 02:19:46.507451 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.506818 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b8b26c95-6b25-462e-bbca-66eefe50f0bb-konnectivity-ca\") pod \"konnectivity-agent-5hctt\" (UID: \"b8b26c95-6b25-462e-bbca-66eefe50f0bb\") " pod="kube-system/konnectivity-agent-5hctt" Jun 09 02:19:46.508193 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.506842 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9ee7881a-36ac-45e4-80a2-d3fbdf30e2ae-os-release\") pod \"multus-additional-cni-plugins-c4qzg\" (UID: \"9ee7881a-36ac-45e4-80a2-d3fbdf30e2ae\") " pod="openshift-multus/multus-additional-cni-plugins-c4qzg" Jun 09 02:19:46.508193 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.506856 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/37e9e0fa-4abd-4eeb-8671-934808ecdf78-run-systemd\") pod \"ovnkube-node-jz2q7\" (UID: \"37e9e0fa-4abd-4eeb-8671-934808ecdf78\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2q7" Jun 09 02:19:46.508193 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.506866 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9ee7881a-36ac-45e4-80a2-d3fbdf30e2ae-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-c4qzg\" (UID: \"9ee7881a-36ac-45e4-80a2-d3fbdf30e2ae\") " pod="openshift-multus/multus-additional-cni-plugins-c4qzg" Jun 09 02:19:46.508193 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.506890 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4dad265a-b70a-4a80-b2da-d1901621c5a2-etc-sysconfig\") pod \"tuned-bvzwc\" (UID: \"4dad265a-b70a-4a80-b2da-d1901621c5a2\") " pod="openshift-cluster-node-tuning-operator/tuned-bvzwc" Jun 09 02:19:46.508193 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.506913 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4dad265a-b70a-4a80-b2da-d1901621c5a2-sys\") pod \"tuned-bvzwc\" (UID: \"4dad265a-b70a-4a80-b2da-d1901621c5a2\") " pod="openshift-cluster-node-tuning-operator/tuned-bvzwc" Jun 09 02:19:46.508193 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.506961 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/37e9e0fa-4abd-4eeb-8671-934808ecdf78-host-slash\") pod \"ovnkube-node-jz2q7\" (UID: \"37e9e0fa-4abd-4eeb-8671-934808ecdf78\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2q7" Jun 09 02:19:46.508193 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.507011 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/37e9e0fa-4abd-4eeb-8671-934808ecdf78-host-cni-netd\") pod \"ovnkube-node-jz2q7\" (UID: \"37e9e0fa-4abd-4eeb-8671-934808ecdf78\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2q7" Jun 09 02:19:46.508193 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.507019 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/37e9e0fa-4abd-4eeb-8671-934808ecdf78-ovnkube-script-lib\") pod \"ovnkube-node-jz2q7\" (UID: \"37e9e0fa-4abd-4eeb-8671-934808ecdf78\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2q7" Jun 09 02:19:46.508193 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.507035 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6627f9b3-28ae-40b2-9ba9-fe6614fe60dc-host\") pod \"node-ca-fgmlx\" (UID: \"6627f9b3-28ae-40b2-9ba9-fe6614fe60dc\") " pod="openshift-image-registry/node-ca-fgmlx" Jun 09 02:19:46.508193 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.507061 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/37e9e0fa-4abd-4eeb-8671-934808ecdf78-host-cni-netd\") pod \"ovnkube-node-jz2q7\" (UID: \"37e9e0fa-4abd-4eeb-8671-934808ecdf78\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2q7" Jun 09 02:19:46.508193 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.507064 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bb35575b-7a94-4bf7-be30-a083b9265c50-kubelet-dir\") pod \"aws-ebs-csi-driver-node-64h95\" (UID: \"bb35575b-7a94-4bf7-be30-a083b9265c50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-64h95" Jun 09 02:19:46.508193 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.507105 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6627f9b3-28ae-40b2-9ba9-fe6614fe60dc-host\") pod \"node-ca-fgmlx\" (UID: \"6627f9b3-28ae-40b2-9ba9-fe6614fe60dc\") " pod="openshift-image-registry/node-ca-fgmlx" Jun 09 02:19:46.508193 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.507108 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/21fe5491-feac-4749-adfa-a195bf173d83-cni-binary-copy\") pod \"multus-nqmc9\" (UID: \"21fe5491-feac-4749-adfa-a195bf173d83\") " pod="openshift-multus/multus-nqmc9" Jun 09 02:19:46.508193 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.506769 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/129b4aeb-af58-4b14-ae74-bf599054fd7f-iptables-alerter-script\") pod \"iptables-alerter-qvvvx\" (UID: \"129b4aeb-af58-4b14-ae74-bf599054fd7f\") " pod="openshift-network-operator/iptables-alerter-qvvvx" Jun 09 02:19:46.508193 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.507131 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4dad265a-b70a-4a80-b2da-d1901621c5a2-etc-modprobe-d\") pod \"tuned-bvzwc\" (UID: \"4dad265a-b70a-4a80-b2da-d1901621c5a2\") " pod="openshift-cluster-node-tuning-operator/tuned-bvzwc" Jun 09 02:19:46.508193 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.507166 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4dad265a-b70a-4a80-b2da-d1901621c5a2-lib-modules\") pod \"tuned-bvzwc\" (UID: \"4dad265a-b70a-4a80-b2da-d1901621c5a2\") " pod="openshift-cluster-node-tuning-operator/tuned-bvzwc" Jun 09 02:19:46.508193 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.507182 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4dad265a-b70a-4a80-b2da-d1901621c5a2-var-lib-kubelet\") pod \"tuned-bvzwc\" (UID: \"4dad265a-b70a-4a80-b2da-d1901621c5a2\") " pod="openshift-cluster-node-tuning-operator/tuned-bvzwc" Jun 09 02:19:46.508900 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.507168 2573 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 09 02:19:46.508900 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.507200 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4dad265a-b70a-4a80-b2da-d1901621c5a2-tmp\") pod \"tuned-bvzwc\" (UID: \"4dad265a-b70a-4a80-b2da-d1901621c5a2\") " pod="openshift-cluster-node-tuning-operator/tuned-bvzwc" Jun 09 02:19:46.508900 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.507216 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/37e9e0fa-4abd-4eeb-8671-934808ecdf78-systemd-units\") pod \"ovnkube-node-jz2q7\" (UID: \"37e9e0fa-4abd-4eeb-8671-934808ecdf78\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2q7" Jun 09 02:19:46.508900 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.507232 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/37e9e0fa-4abd-4eeb-8671-934808ecdf78-run-openvswitch\") pod \"ovnkube-node-jz2q7\" (UID: \"37e9e0fa-4abd-4eeb-8671-934808ecdf78\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2q7" Jun 09 02:19:46.508900 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.507254 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/bb35575b-7a94-4bf7-be30-a083b9265c50-registration-dir\") pod \"aws-ebs-csi-driver-node-64h95\" (UID: \"bb35575b-7a94-4bf7-be30-a083b9265c50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-64h95" Jun 09 02:19:46.508900 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.507295 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/37e9e0fa-4abd-4eeb-8671-934808ecdf78-systemd-units\") pod \"ovnkube-node-jz2q7\" (UID: \"37e9e0fa-4abd-4eeb-8671-934808ecdf78\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2q7" Jun 09 02:19:46.508900 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.507314 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/37e9e0fa-4abd-4eeb-8671-934808ecdf78-run-openvswitch\") pod \"ovnkube-node-jz2q7\" (UID: \"37e9e0fa-4abd-4eeb-8671-934808ecdf78\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2q7" Jun 09 02:19:46.508900 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.507320 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9ee7881a-36ac-45e4-80a2-d3fbdf30e2ae-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-c4qzg\" (UID: \"9ee7881a-36ac-45e4-80a2-d3fbdf30e2ae\") " pod="openshift-multus/multus-additional-cni-plugins-c4qzg" Jun 09 02:19:46.508900 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.507363 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4dad265a-b70a-4a80-b2da-d1901621c5a2-host\") pod \"tuned-bvzwc\" (UID: \"4dad265a-b70a-4a80-b2da-d1901621c5a2\") " pod="openshift-cluster-node-tuning-operator/tuned-bvzwc" Jun 09 02:19:46.508900 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.507386 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/37660632-e407-412f-aa36-3e764febd673-hosts-file\") pod \"node-resolver-btr7x\" (UID: \"37660632-e407-412f-aa36-3e764febd673\") " pod="openshift-dns/node-resolver-btr7x" Jun 09 02:19:46.508900 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.507411 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/37e9e0fa-4abd-4eeb-8671-934808ecdf78-ovnkube-config\") pod \"ovnkube-node-jz2q7\" (UID: \"37e9e0fa-4abd-4eeb-8671-934808ecdf78\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2q7" Jun 09 02:19:46.508900 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.507458 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/21fe5491-feac-4749-adfa-a195bf173d83-host-var-lib-kubelet\") pod \"multus-nqmc9\" (UID: \"21fe5491-feac-4749-adfa-a195bf173d83\") " pod="openshift-multus/multus-nqmc9" Jun 09 02:19:46.508900 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.507482 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/21fe5491-feac-4749-adfa-a195bf173d83-multus-daemon-config\") pod \"multus-nqmc9\" (UID: \"21fe5491-feac-4749-adfa-a195bf173d83\") " pod="openshift-multus/multus-nqmc9" Jun 09 02:19:46.508900 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.507508 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/21fe5491-feac-4749-adfa-a195bf173d83-multus-cni-dir\") pod \"multus-nqmc9\" (UID: \"21fe5491-feac-4749-adfa-a195bf173d83\") " pod="openshift-multus/multus-nqmc9" Jun 09 02:19:46.508900 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.507545 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtdms\" (UniqueName: \"kubernetes.io/projected/21fe5491-feac-4749-adfa-a195bf173d83-kube-api-access-xtdms\") pod \"multus-nqmc9\" (UID: \"21fe5491-feac-4749-adfa-a195bf173d83\") " pod="openshift-multus/multus-nqmc9" Jun 09 02:19:46.508900 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.507531 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/21fe5491-feac-4749-adfa-a195bf173d83-host-var-lib-kubelet\") pod \"multus-nqmc9\" (UID: \"21fe5491-feac-4749-adfa-a195bf173d83\") " pod="openshift-multus/multus-nqmc9" Jun 09 02:19:46.508900 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.507563 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9ee7881a-36ac-45e4-80a2-d3fbdf30e2ae-cnibin\") pod \"multus-additional-cni-plugins-c4qzg\" (UID: \"9ee7881a-36ac-45e4-80a2-d3fbdf30e2ae\") " pod="openshift-multus/multus-additional-cni-plugins-c4qzg" Jun 09 02:19:46.508900 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.507604 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/21fe5491-feac-4749-adfa-a195bf173d83-cni-binary-copy\") pod \"multus-nqmc9\" (UID: \"21fe5491-feac-4749-adfa-a195bf173d83\") " pod="openshift-multus/multus-nqmc9" Jun 09 02:19:46.509642 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.507624 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9ee7881a-36ac-45e4-80a2-d3fbdf30e2ae-tuning-conf-dir\") pod \"multus-additional-cni-plugins-c4qzg\" (UID: \"9ee7881a-36ac-45e4-80a2-d3fbdf30e2ae\") " pod="openshift-multus/multus-additional-cni-plugins-c4qzg" Jun 09 02:19:46.509642 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.507714 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4dad265a-b70a-4a80-b2da-d1901621c5a2-etc-kubernetes\") pod \"tuned-bvzwc\" (UID: \"4dad265a-b70a-4a80-b2da-d1901621c5a2\") " pod="openshift-cluster-node-tuning-operator/tuned-bvzwc" Jun 09 02:19:46.509642 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.507733 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4dad265a-b70a-4a80-b2da-d1901621c5a2-run\") pod \"tuned-bvzwc\" (UID: \"4dad265a-b70a-4a80-b2da-d1901621c5a2\") " pod="openshift-cluster-node-tuning-operator/tuned-bvzwc" Jun 09 02:19:46.509642 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.507767 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/37e9e0fa-4abd-4eeb-8671-934808ecdf78-host-kubelet\") pod \"ovnkube-node-jz2q7\" (UID: \"37e9e0fa-4abd-4eeb-8671-934808ecdf78\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2q7" Jun 09 02:19:46.509642 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.507783 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/37e9e0fa-4abd-4eeb-8671-934808ecdf78-host-run-ovn-kubernetes\") pod \"ovnkube-node-jz2q7\" (UID: \"37e9e0fa-4abd-4eeb-8671-934808ecdf78\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2q7" Jun 09 02:19:46.509642 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.507820 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/37e9e0fa-4abd-4eeb-8671-934808ecdf78-host-kubelet\") pod \"ovnkube-node-jz2q7\" (UID: \"37e9e0fa-4abd-4eeb-8671-934808ecdf78\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2q7" Jun 09 02:19:46.509642 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.507848 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/21fe5491-feac-4749-adfa-a195bf173d83-multus-cni-dir\") pod \"multus-nqmc9\" (UID: \"21fe5491-feac-4749-adfa-a195bf173d83\") " pod="openshift-multus/multus-nqmc9" Jun 09 02:19:46.509642 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.507854 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/37e9e0fa-4abd-4eeb-8671-934808ecdf78-host-run-ovn-kubernetes\") pod \"ovnkube-node-jz2q7\" (UID: \"37e9e0fa-4abd-4eeb-8671-934808ecdf78\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2q7" Jun 09 02:19:46.509642 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.507868 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/37e9e0fa-4abd-4eeb-8671-934808ecdf78-ovnkube-config\") pod \"ovnkube-node-jz2q7\" (UID: \"37e9e0fa-4abd-4eeb-8671-934808ecdf78\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2q7" Jun 09 02:19:46.509642 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.507873 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/21fe5491-feac-4749-adfa-a195bf173d83-host-run-multus-certs\") pod \"multus-nqmc9\" (UID: \"21fe5491-feac-4749-adfa-a195bf173d83\") " pod="openshift-multus/multus-nqmc9" Jun 09 02:19:46.509642 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.507898 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/21fe5491-feac-4749-adfa-a195bf173d83-host-run-multus-certs\") pod \"multus-nqmc9\" (UID: \"21fe5491-feac-4749-adfa-a195bf173d83\") " pod="openshift-multus/multus-nqmc9" Jun 09 02:19:46.509642 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.507911 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4dad265a-b70a-4a80-b2da-d1901621c5a2-etc-sysctl-conf\") pod \"tuned-bvzwc\" (UID: \"4dad265a-b70a-4a80-b2da-d1901621c5a2\") " pod="openshift-cluster-node-tuning-operator/tuned-bvzwc" Jun 09 02:19:46.509642 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.507933 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37660632-e407-412f-aa36-3e764febd673-tmp-dir\") pod \"node-resolver-btr7x\" (UID: \"37660632-e407-412f-aa36-3e764febd673\") " pod="openshift-dns/node-resolver-btr7x" Jun 09 02:19:46.509642 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.507942 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/21fe5491-feac-4749-adfa-a195bf173d83-multus-daemon-config\") pod \"multus-nqmc9\" (UID: \"21fe5491-feac-4749-adfa-a195bf173d83\") " pod="openshift-multus/multus-nqmc9" Jun 09 02:19:46.509642 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.507955 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/21fe5491-feac-4749-adfa-a195bf173d83-multus-conf-dir\") pod \"multus-nqmc9\" (UID: \"21fe5491-feac-4749-adfa-a195bf173d83\") " pod="openshift-multus/multus-nqmc9" Jun 09 02:19:46.509642 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.507975 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/bb35575b-7a94-4bf7-be30-a083b9265c50-device-dir\") pod \"aws-ebs-csi-driver-node-64h95\" (UID: \"bb35575b-7a94-4bf7-be30-a083b9265c50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-64h95" Jun 09 02:19:46.509642 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.507996 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/37e9e0fa-4abd-4eeb-8671-934808ecdf78-host-cni-bin\") pod \"ovnkube-node-jz2q7\" (UID: \"37e9e0fa-4abd-4eeb-8671-934808ecdf78\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2q7" Jun 09 02:19:46.510404 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.508014 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/21fe5491-feac-4749-adfa-a195bf173d83-os-release\") pod \"multus-nqmc9\" (UID: \"21fe5491-feac-4749-adfa-a195bf173d83\") " pod="openshift-multus/multus-nqmc9" Jun 09 02:19:46.510404 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.508020 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/21fe5491-feac-4749-adfa-a195bf173d83-multus-conf-dir\") pod \"multus-nqmc9\" (UID: \"21fe5491-feac-4749-adfa-a195bf173d83\") " pod="openshift-multus/multus-nqmc9" Jun 09 02:19:46.510404 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.508095 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/21fe5491-feac-4749-adfa-a195bf173d83-os-release\") pod \"multus-nqmc9\" (UID: \"21fe5491-feac-4749-adfa-a195bf173d83\") " pod="openshift-multus/multus-nqmc9" Jun 09 02:19:46.510404 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.508096 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/37e9e0fa-4abd-4eeb-8671-934808ecdf78-host-cni-bin\") pod \"ovnkube-node-jz2q7\" (UID: \"37e9e0fa-4abd-4eeb-8671-934808ecdf78\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2q7" Jun 09 02:19:46.510404 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.508115 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/866bea41-c522-452a-9430-a3461041d710-metrics-certs\") pod \"network-metrics-daemon-xfrxz\" (UID: \"866bea41-c522-452a-9430-a3461041d710\") " pod="openshift-multus/network-metrics-daemon-xfrxz" Jun 09 02:19:46.510404 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.508148 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4dad265a-b70a-4a80-b2da-d1901621c5a2-etc-tuned\") pod \"tuned-bvzwc\" (UID: \"4dad265a-b70a-4a80-b2da-d1901621c5a2\") " pod="openshift-cluster-node-tuning-operator/tuned-bvzwc" Jun 09 02:19:46.510404 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.508174 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/129b4aeb-af58-4b14-ae74-bf599054fd7f-host-slash\") pod \"iptables-alerter-qvvvx\" (UID: \"129b4aeb-af58-4b14-ae74-bf599054fd7f\") " pod="openshift-network-operator/iptables-alerter-qvvvx" Jun 09 02:19:46.510404 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.508204 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/37e9e0fa-4abd-4eeb-8671-934808ecdf78-var-lib-openvswitch\") pod \"ovnkube-node-jz2q7\" (UID: \"37e9e0fa-4abd-4eeb-8671-934808ecdf78\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2q7" Jun 09 02:19:46.510404 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.508229 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/37e9e0fa-4abd-4eeb-8671-934808ecdf78-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jz2q7\" (UID: \"37e9e0fa-4abd-4eeb-8671-934808ecdf78\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2q7" Jun 09 02:19:46.510404 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.508261 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/37e9e0fa-4abd-4eeb-8671-934808ecdf78-var-lib-openvswitch\") pod \"ovnkube-node-jz2q7\" (UID: \"37e9e0fa-4abd-4eeb-8671-934808ecdf78\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2q7" Jun 09 02:19:46.510404 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.508257 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9ee7881a-36ac-45e4-80a2-d3fbdf30e2ae-system-cni-dir\") pod \"multus-additional-cni-plugins-c4qzg\" (UID: \"9ee7881a-36ac-45e4-80a2-d3fbdf30e2ae\") " pod="openshift-multus/multus-additional-cni-plugins-c4qzg" Jun 09 02:19:46.510404 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.508297 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/37e9e0fa-4abd-4eeb-8671-934808ecdf78-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jz2q7\" (UID: \"37e9e0fa-4abd-4eeb-8671-934808ecdf78\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2q7" Jun 09 02:19:46.510404 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.508235 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/129b4aeb-af58-4b14-ae74-bf599054fd7f-host-slash\") pod \"iptables-alerter-qvvvx\" (UID: \"129b4aeb-af58-4b14-ae74-bf599054fd7f\") " pod="openshift-network-operator/iptables-alerter-qvvvx" Jun 09 02:19:46.510993 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.510725 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/37e9e0fa-4abd-4eeb-8671-934808ecdf78-ovn-node-metrics-cert\") pod \"ovnkube-node-jz2q7\" (UID: \"37e9e0fa-4abd-4eeb-8671-934808ecdf78\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2q7" Jun 09 02:19:46.519146 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.519124 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwjnl\" (UniqueName: \"kubernetes.io/projected/129b4aeb-af58-4b14-ae74-bf599054fd7f-kube-api-access-bwjnl\") pod \"iptables-alerter-qvvvx\" (UID: \"129b4aeb-af58-4b14-ae74-bf599054fd7f\") " pod="openshift-network-operator/iptables-alerter-qvvvx" Jun 09 02:19:46.519284 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.519262 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jz9vc\" (UniqueName: \"kubernetes.io/projected/37e9e0fa-4abd-4eeb-8671-934808ecdf78-kube-api-access-jz9vc\") pod \"ovnkube-node-jz2q7\" (UID: \"37e9e0fa-4abd-4eeb-8671-934808ecdf78\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2q7" Jun 09 02:19:46.520462 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.520426 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtdms\" (UniqueName: \"kubernetes.io/projected/21fe5491-feac-4749-adfa-a195bf173d83-kube-api-access-xtdms\") pod \"multus-nqmc9\" (UID: \"21fe5491-feac-4749-adfa-a195bf173d83\") " pod="openshift-multus/multus-nqmc9" Jun 09 02:19:46.520932 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.520908 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjqx6\" (UniqueName: \"kubernetes.io/projected/6627f9b3-28ae-40b2-9ba9-fe6614fe60dc-kube-api-access-sjqx6\") pod \"node-ca-fgmlx\" (UID: \"6627f9b3-28ae-40b2-9ba9-fe6614fe60dc\") " pod="openshift-image-registry/node-ca-fgmlx" Jun 09 02:19:46.608500 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.608477 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b8b26c95-6b25-462e-bbca-66eefe50f0bb-konnectivity-ca\") pod \"konnectivity-agent-5hctt\" (UID: \"b8b26c95-6b25-462e-bbca-66eefe50f0bb\") " pod="kube-system/konnectivity-agent-5hctt" Jun 09 02:19:46.608602 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.608505 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9ee7881a-36ac-45e4-80a2-d3fbdf30e2ae-os-release\") pod \"multus-additional-cni-plugins-c4qzg\" (UID: \"9ee7881a-36ac-45e4-80a2-d3fbdf30e2ae\") " pod="openshift-multus/multus-additional-cni-plugins-c4qzg" Jun 09 02:19:46.608602 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.608520 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9ee7881a-36ac-45e4-80a2-d3fbdf30e2ae-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-c4qzg\" (UID: \"9ee7881a-36ac-45e4-80a2-d3fbdf30e2ae\") " pod="openshift-multus/multus-additional-cni-plugins-c4qzg" Jun 09 02:19:46.608602 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.608536 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4dad265a-b70a-4a80-b2da-d1901621c5a2-etc-sysconfig\") pod \"tuned-bvzwc\" (UID: \"4dad265a-b70a-4a80-b2da-d1901621c5a2\") " pod="openshift-cluster-node-tuning-operator/tuned-bvzwc" Jun 09 02:19:46.608744 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.608620 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9ee7881a-36ac-45e4-80a2-d3fbdf30e2ae-os-release\") pod \"multus-additional-cni-plugins-c4qzg\" (UID: \"9ee7881a-36ac-45e4-80a2-d3fbdf30e2ae\") " pod="openshift-multus/multus-additional-cni-plugins-c4qzg" Jun 09 02:19:46.608744 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.608630 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4dad265a-b70a-4a80-b2da-d1901621c5a2-sys\") pod \"tuned-bvzwc\" (UID: \"4dad265a-b70a-4a80-b2da-d1901621c5a2\") " pod="openshift-cluster-node-tuning-operator/tuned-bvzwc" Jun 09 02:19:46.608744 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.608662 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bb35575b-7a94-4bf7-be30-a083b9265c50-kubelet-dir\") pod \"aws-ebs-csi-driver-node-64h95\" (UID: \"bb35575b-7a94-4bf7-be30-a083b9265c50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-64h95" Jun 09 02:19:46.608744 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.608680 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4dad265a-b70a-4a80-b2da-d1901621c5a2-etc-modprobe-d\") pod \"tuned-bvzwc\" (UID: \"4dad265a-b70a-4a80-b2da-d1901621c5a2\") " pod="openshift-cluster-node-tuning-operator/tuned-bvzwc" Jun 09 02:19:46.608744 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.608695 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4dad265a-b70a-4a80-b2da-d1901621c5a2-lib-modules\") pod \"tuned-bvzwc\" (UID: \"4dad265a-b70a-4a80-b2da-d1901621c5a2\") " pod="openshift-cluster-node-tuning-operator/tuned-bvzwc" Jun 09 02:19:46.608744 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.608692 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4dad265a-b70a-4a80-b2da-d1901621c5a2-etc-sysconfig\") pod \"tuned-bvzwc\" (UID: \"4dad265a-b70a-4a80-b2da-d1901621c5a2\") " pod="openshift-cluster-node-tuning-operator/tuned-bvzwc" Jun 09 02:19:46.608744 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.608710 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4dad265a-b70a-4a80-b2da-d1901621c5a2-var-lib-kubelet\") pod \"tuned-bvzwc\" (UID: \"4dad265a-b70a-4a80-b2da-d1901621c5a2\") " pod="openshift-cluster-node-tuning-operator/tuned-bvzwc" Jun 09 02:19:46.608744 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.608730 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4dad265a-b70a-4a80-b2da-d1901621c5a2-sys\") pod \"tuned-bvzwc\" (UID: \"4dad265a-b70a-4a80-b2da-d1901621c5a2\") " pod="openshift-cluster-node-tuning-operator/tuned-bvzwc" Jun 09 02:19:46.608744 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.608739 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4dad265a-b70a-4a80-b2da-d1901621c5a2-tmp\") pod \"tuned-bvzwc\" (UID: \"4dad265a-b70a-4a80-b2da-d1901621c5a2\") " pod="openshift-cluster-node-tuning-operator/tuned-bvzwc" Jun 09 02:19:46.609168 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.608764 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/bb35575b-7a94-4bf7-be30-a083b9265c50-registration-dir\") pod \"aws-ebs-csi-driver-node-64h95\" (UID: \"bb35575b-7a94-4bf7-be30-a083b9265c50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-64h95" Jun 09 02:19:46.609168 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.608773 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4dad265a-b70a-4a80-b2da-d1901621c5a2-var-lib-kubelet\") pod \"tuned-bvzwc\" (UID: \"4dad265a-b70a-4a80-b2da-d1901621c5a2\") " pod="openshift-cluster-node-tuning-operator/tuned-bvzwc" Jun 09 02:19:46.609168 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.608789 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9ee7881a-36ac-45e4-80a2-d3fbdf30e2ae-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-c4qzg\" (UID: \"9ee7881a-36ac-45e4-80a2-d3fbdf30e2ae\") " pod="openshift-multus/multus-additional-cni-plugins-c4qzg" Jun 09 02:19:46.609168 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.608794 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4dad265a-b70a-4a80-b2da-d1901621c5a2-etc-modprobe-d\") pod \"tuned-bvzwc\" (UID: \"4dad265a-b70a-4a80-b2da-d1901621c5a2\") " pod="openshift-cluster-node-tuning-operator/tuned-bvzwc" Jun 09 02:19:46.609168 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.608811 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4dad265a-b70a-4a80-b2da-d1901621c5a2-host\") pod \"tuned-bvzwc\" (UID: \"4dad265a-b70a-4a80-b2da-d1901621c5a2\") " pod="openshift-cluster-node-tuning-operator/tuned-bvzwc" Jun 09 02:19:46.609168 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.608830 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/37660632-e407-412f-aa36-3e764febd673-hosts-file\") pod \"node-resolver-btr7x\" (UID: \"37660632-e407-412f-aa36-3e764febd673\") " pod="openshift-dns/node-resolver-btr7x" Jun 09 02:19:46.609168 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.608855 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9ee7881a-36ac-45e4-80a2-d3fbdf30e2ae-cnibin\") pod \"multus-additional-cni-plugins-c4qzg\" (UID: \"9ee7881a-36ac-45e4-80a2-d3fbdf30e2ae\") " pod="openshift-multus/multus-additional-cni-plugins-c4qzg" Jun 09 02:19:46.609168 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.608866 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4dad265a-b70a-4a80-b2da-d1901621c5a2-host\") pod \"tuned-bvzwc\" (UID: \"4dad265a-b70a-4a80-b2da-d1901621c5a2\") " pod="openshift-cluster-node-tuning-operator/tuned-bvzwc" Jun 09 02:19:46.609168 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.608876 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4dad265a-b70a-4a80-b2da-d1901621c5a2-lib-modules\") pod \"tuned-bvzwc\" (UID: \"4dad265a-b70a-4a80-b2da-d1901621c5a2\") " pod="openshift-cluster-node-tuning-operator/tuned-bvzwc" Jun 09 02:19:46.609168 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.608880 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9ee7881a-36ac-45e4-80a2-d3fbdf30e2ae-tuning-conf-dir\") pod \"multus-additional-cni-plugins-c4qzg\" (UID: \"9ee7881a-36ac-45e4-80a2-d3fbdf30e2ae\") " pod="openshift-multus/multus-additional-cni-plugins-c4qzg" Jun 09 02:19:46.609168 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.608826 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bb35575b-7a94-4bf7-be30-a083b9265c50-kubelet-dir\") pod \"aws-ebs-csi-driver-node-64h95\" (UID: \"bb35575b-7a94-4bf7-be30-a083b9265c50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-64h95" Jun 09 02:19:46.609168 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.608903 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4dad265a-b70a-4a80-b2da-d1901621c5a2-etc-kubernetes\") pod \"tuned-bvzwc\" (UID: \"4dad265a-b70a-4a80-b2da-d1901621c5a2\") " pod="openshift-cluster-node-tuning-operator/tuned-bvzwc" Jun 09 02:19:46.609168 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.608918 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/bb35575b-7a94-4bf7-be30-a083b9265c50-registration-dir\") pod \"aws-ebs-csi-driver-node-64h95\" (UID: \"bb35575b-7a94-4bf7-be30-a083b9265c50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-64h95" Jun 09 02:19:46.609168 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.608925 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4dad265a-b70a-4a80-b2da-d1901621c5a2-run\") pod \"tuned-bvzwc\" (UID: \"4dad265a-b70a-4a80-b2da-d1901621c5a2\") " pod="openshift-cluster-node-tuning-operator/tuned-bvzwc" Jun 09 02:19:46.609168 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.608931 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/37660632-e407-412f-aa36-3e764febd673-hosts-file\") pod \"node-resolver-btr7x\" (UID: \"37660632-e407-412f-aa36-3e764febd673\") " pod="openshift-dns/node-resolver-btr7x" Jun 09 02:19:46.609168 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.608951 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4dad265a-b70a-4a80-b2da-d1901621c5a2-etc-sysctl-conf\") pod \"tuned-bvzwc\" (UID: \"4dad265a-b70a-4a80-b2da-d1901621c5a2\") " pod="openshift-cluster-node-tuning-operator/tuned-bvzwc" Jun 09 02:19:46.609168 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.608969 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9ee7881a-36ac-45e4-80a2-d3fbdf30e2ae-cnibin\") pod \"multus-additional-cni-plugins-c4qzg\" (UID: \"9ee7881a-36ac-45e4-80a2-d3fbdf30e2ae\") " pod="openshift-multus/multus-additional-cni-plugins-c4qzg" Jun 09 02:19:46.609914 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.608973 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37660632-e407-412f-aa36-3e764febd673-tmp-dir\") pod \"node-resolver-btr7x\" (UID: \"37660632-e407-412f-aa36-3e764febd673\") " pod="openshift-dns/node-resolver-btr7x" Jun 09 02:19:46.609914 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.608996 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/bb35575b-7a94-4bf7-be30-a083b9265c50-device-dir\") pod \"aws-ebs-csi-driver-node-64h95\" (UID: \"bb35575b-7a94-4bf7-be30-a083b9265c50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-64h95" Jun 09 02:19:46.609914 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.609019 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4dad265a-b70a-4a80-b2da-d1901621c5a2-etc-kubernetes\") pod \"tuned-bvzwc\" (UID: \"4dad265a-b70a-4a80-b2da-d1901621c5a2\") " pod="openshift-cluster-node-tuning-operator/tuned-bvzwc" Jun 09 02:19:46.609914 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.609022 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/866bea41-c522-452a-9430-a3461041d710-metrics-certs\") pod \"network-metrics-daemon-xfrxz\" (UID: \"866bea41-c522-452a-9430-a3461041d710\") " pod="openshift-multus/network-metrics-daemon-xfrxz" Jun 09 02:19:46.609914 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.609050 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4dad265a-b70a-4a80-b2da-d1901621c5a2-etc-tuned\") pod \"tuned-bvzwc\" (UID: \"4dad265a-b70a-4a80-b2da-d1901621c5a2\") " pod="openshift-cluster-node-tuning-operator/tuned-bvzwc" Jun 09 02:19:46.609914 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.609101 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9ee7881a-36ac-45e4-80a2-d3fbdf30e2ae-tuning-conf-dir\") pod \"multus-additional-cni-plugins-c4qzg\" (UID: \"9ee7881a-36ac-45e4-80a2-d3fbdf30e2ae\") " pod="openshift-multus/multus-additional-cni-plugins-c4qzg" Jun 09 02:19:46.609914 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.609105 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b8b26c95-6b25-462e-bbca-66eefe50f0bb-konnectivity-ca\") pod \"konnectivity-agent-5hctt\" (UID: \"b8b26c95-6b25-462e-bbca-66eefe50f0bb\") " pod="kube-system/konnectivity-agent-5hctt" Jun 09 02:19:46.609914 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:19:46.609125 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 02:19:46.609914 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:19:46.609173 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/866bea41-c522-452a-9430-a3461041d710-metrics-certs podName:866bea41-c522-452a-9430-a3461041d710 nodeName:}" failed. No retries permitted until 2026-06-09 02:19:47.109156136 +0000 UTC m=+3.056273459 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/866bea41-c522-452a-9430-a3461041d710-metrics-certs") pod "network-metrics-daemon-xfrxz" (UID: "866bea41-c522-452a-9430-a3461041d710") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 02:19:46.609914 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.609175 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9ee7881a-36ac-45e4-80a2-d3fbdf30e2ae-system-cni-dir\") pod \"multus-additional-cni-plugins-c4qzg\" (UID: \"9ee7881a-36ac-45e4-80a2-d3fbdf30e2ae\") " pod="openshift-multus/multus-additional-cni-plugins-c4qzg" Jun 09 02:19:46.609914 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.609182 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4dad265a-b70a-4a80-b2da-d1901621c5a2-run\") pod \"tuned-bvzwc\" (UID: \"4dad265a-b70a-4a80-b2da-d1901621c5a2\") " pod="openshift-cluster-node-tuning-operator/tuned-bvzwc" Jun 09 02:19:46.609914 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.609092 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9ee7881a-36ac-45e4-80a2-d3fbdf30e2ae-system-cni-dir\") pod \"multus-additional-cni-plugins-c4qzg\" (UID: \"9ee7881a-36ac-45e4-80a2-d3fbdf30e2ae\") " pod="openshift-multus/multus-additional-cni-plugins-c4qzg" Jun 09 02:19:46.609914 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.609223 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/bb35575b-7a94-4bf7-be30-a083b9265c50-device-dir\") pod \"aws-ebs-csi-driver-node-64h95\" (UID: \"bb35575b-7a94-4bf7-be30-a083b9265c50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-64h95" Jun 09 02:19:46.609914 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.609223 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9ee7881a-36ac-45e4-80a2-d3fbdf30e2ae-cni-binary-copy\") pod \"multus-additional-cni-plugins-c4qzg\" (UID: \"9ee7881a-36ac-45e4-80a2-d3fbdf30e2ae\") " pod="openshift-multus/multus-additional-cni-plugins-c4qzg" Jun 09 02:19:46.609914 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.609235 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4dad265a-b70a-4a80-b2da-d1901621c5a2-etc-sysctl-conf\") pod \"tuned-bvzwc\" (UID: \"4dad265a-b70a-4a80-b2da-d1901621c5a2\") " pod="openshift-cluster-node-tuning-operator/tuned-bvzwc" Jun 09 02:19:46.609914 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.609262 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9ee7881a-36ac-45e4-80a2-d3fbdf30e2ae-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-c4qzg\" (UID: \"9ee7881a-36ac-45e4-80a2-d3fbdf30e2ae\") " pod="openshift-multus/multus-additional-cni-plugins-c4qzg" Jun 09 02:19:46.609914 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.609269 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kn9fc\" (UniqueName: \"kubernetes.io/projected/866bea41-c522-452a-9430-a3461041d710-kube-api-access-kn9fc\") pod \"network-metrics-daemon-xfrxz\" (UID: \"866bea41-c522-452a-9430-a3461041d710\") " pod="openshift-multus/network-metrics-daemon-xfrxz" Jun 09 02:19:46.610397 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.609295 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4dad265a-b70a-4a80-b2da-d1901621c5a2-etc-systemd\") pod \"tuned-bvzwc\" (UID: \"4dad265a-b70a-4a80-b2da-d1901621c5a2\") " pod="openshift-cluster-node-tuning-operator/tuned-bvzwc" Jun 09 02:19:46.610397 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.609297 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9ee7881a-36ac-45e4-80a2-d3fbdf30e2ae-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-c4qzg\" (UID: \"9ee7881a-36ac-45e4-80a2-d3fbdf30e2ae\") " pod="openshift-multus/multus-additional-cni-plugins-c4qzg" Jun 09 02:19:46.610397 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.609322 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/bb35575b-7a94-4bf7-be30-a083b9265c50-etc-selinux\") pod \"aws-ebs-csi-driver-node-64h95\" (UID: \"bb35575b-7a94-4bf7-be30-a083b9265c50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-64h95" Jun 09 02:19:46.610397 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.609347 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5pg6\" (UniqueName: \"kubernetes.io/projected/9ee7881a-36ac-45e4-80a2-d3fbdf30e2ae-kube-api-access-j5pg6\") pod \"multus-additional-cni-plugins-c4qzg\" (UID: \"9ee7881a-36ac-45e4-80a2-d3fbdf30e2ae\") " pod="openshift-multus/multus-additional-cni-plugins-c4qzg" Jun 09 02:19:46.610397 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.609368 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4dad265a-b70a-4a80-b2da-d1901621c5a2-etc-systemd\") pod \"tuned-bvzwc\" (UID: \"4dad265a-b70a-4a80-b2da-d1901621c5a2\") " pod="openshift-cluster-node-tuning-operator/tuned-bvzwc" Jun 09 02:19:46.610397 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.609374 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/bb35575b-7a94-4bf7-be30-a083b9265c50-socket-dir\") pod \"aws-ebs-csi-driver-node-64h95\" (UID: \"bb35575b-7a94-4bf7-be30-a083b9265c50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-64h95" Jun 09 02:19:46.610397 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.609457 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37660632-e407-412f-aa36-3e764febd673-tmp-dir\") pod \"node-resolver-btr7x\" (UID: \"37660632-e407-412f-aa36-3e764febd673\") " pod="openshift-dns/node-resolver-btr7x" Jun 09 02:19:46.610397 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.609462 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/bb35575b-7a94-4bf7-be30-a083b9265c50-etc-selinux\") pod \"aws-ebs-csi-driver-node-64h95\" (UID: \"bb35575b-7a94-4bf7-be30-a083b9265c50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-64h95" Jun 09 02:19:46.610397 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.609483 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/bb35575b-7a94-4bf7-be30-a083b9265c50-socket-dir\") pod \"aws-ebs-csi-driver-node-64h95\" (UID: \"bb35575b-7a94-4bf7-be30-a083b9265c50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-64h95" Jun 09 02:19:46.610397 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.609503 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b8b26c95-6b25-462e-bbca-66eefe50f0bb-agent-certs\") pod \"konnectivity-agent-5hctt\" (UID: \"b8b26c95-6b25-462e-bbca-66eefe50f0bb\") " pod="kube-system/konnectivity-agent-5hctt" Jun 09 02:19:46.610397 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.609532 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvvcc\" (UniqueName: \"kubernetes.io/projected/4dad265a-b70a-4a80-b2da-d1901621c5a2-kube-api-access-rvvcc\") pod \"tuned-bvzwc\" (UID: \"4dad265a-b70a-4a80-b2da-d1901621c5a2\") " pod="openshift-cluster-node-tuning-operator/tuned-bvzwc" Jun 09 02:19:46.610397 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.609565 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wj75\" (UniqueName: \"kubernetes.io/projected/fb1c4057-f500-488c-a3c7-b9013471e88b-kube-api-access-2wj75\") pod \"network-check-target-fzc2b\" (UID: \"fb1c4057-f500-488c-a3c7-b9013471e88b\") " pod="openshift-network-diagnostics/network-check-target-fzc2b" Jun 09 02:19:46.610397 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.609590 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4dad265a-b70a-4a80-b2da-d1901621c5a2-etc-sysctl-d\") pod \"tuned-bvzwc\" (UID: \"4dad265a-b70a-4a80-b2da-d1901621c5a2\") " pod="openshift-cluster-node-tuning-operator/tuned-bvzwc" Jun 09 02:19:46.610397 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.609623 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-787q5\" (UniqueName: \"kubernetes.io/projected/37660632-e407-412f-aa36-3e764febd673-kube-api-access-787q5\") pod \"node-resolver-btr7x\" (UID: \"37660632-e407-412f-aa36-3e764febd673\") " pod="openshift-dns/node-resolver-btr7x" Jun 09 02:19:46.610397 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.609658 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/bb35575b-7a94-4bf7-be30-a083b9265c50-sys-fs\") pod \"aws-ebs-csi-driver-node-64h95\" (UID: \"bb35575b-7a94-4bf7-be30-a083b9265c50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-64h95" Jun 09 02:19:46.610397 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.609678 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kfsxv\" (UniqueName: \"kubernetes.io/projected/bb35575b-7a94-4bf7-be30-a083b9265c50-kube-api-access-kfsxv\") pod \"aws-ebs-csi-driver-node-64h95\" (UID: \"bb35575b-7a94-4bf7-be30-a083b9265c50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-64h95" Jun 09 02:19:46.610397 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.609623 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9ee7881a-36ac-45e4-80a2-d3fbdf30e2ae-cni-binary-copy\") pod \"multus-additional-cni-plugins-c4qzg\" (UID: \"9ee7881a-36ac-45e4-80a2-d3fbdf30e2ae\") " pod="openshift-multus/multus-additional-cni-plugins-c4qzg" Jun 09 02:19:46.610878 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.609710 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4dad265a-b70a-4a80-b2da-d1901621c5a2-etc-sysctl-d\") pod \"tuned-bvzwc\" (UID: \"4dad265a-b70a-4a80-b2da-d1901621c5a2\") " pod="openshift-cluster-node-tuning-operator/tuned-bvzwc" Jun 09 02:19:46.610878 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.609747 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/bb35575b-7a94-4bf7-be30-a083b9265c50-sys-fs\") pod \"aws-ebs-csi-driver-node-64h95\" (UID: \"bb35575b-7a94-4bf7-be30-a083b9265c50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-64h95" Jun 09 02:19:46.611324 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.611303 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4dad265a-b70a-4a80-b2da-d1901621c5a2-tmp\") pod \"tuned-bvzwc\" (UID: \"4dad265a-b70a-4a80-b2da-d1901621c5a2\") " pod="openshift-cluster-node-tuning-operator/tuned-bvzwc" Jun 09 02:19:46.611513 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.611498 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4dad265a-b70a-4a80-b2da-d1901621c5a2-etc-tuned\") pod \"tuned-bvzwc\" (UID: \"4dad265a-b70a-4a80-b2da-d1901621c5a2\") " pod="openshift-cluster-node-tuning-operator/tuned-bvzwc" Jun 09 02:19:46.611698 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.611680 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b8b26c95-6b25-462e-bbca-66eefe50f0bb-agent-certs\") pod \"konnectivity-agent-5hctt\" (UID: \"b8b26c95-6b25-462e-bbca-66eefe50f0bb\") " pod="kube-system/konnectivity-agent-5hctt" Jun 09 02:19:46.615678 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:19:46.615662 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 02:19:46.615771 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:19:46.615684 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 02:19:46.615771 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:19:46.615697 2573 projected.go:196] Error preparing data for projected volume kube-api-access-2wj75 for pod openshift-network-diagnostics/network-check-target-fzc2b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 02:19:46.615771 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:19:46.615763 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fb1c4057-f500-488c-a3c7-b9013471e88b-kube-api-access-2wj75 podName:fb1c4057-f500-488c-a3c7-b9013471e88b nodeName:}" failed. No retries permitted until 2026-06-09 02:19:47.115746381 +0000 UTC m=+3.062863716 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-2wj75" (UniqueName: "kubernetes.io/projected/fb1c4057-f500-488c-a3c7-b9013471e88b-kube-api-access-2wj75") pod "network-check-target-fzc2b" (UID: "fb1c4057-f500-488c-a3c7-b9013471e88b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 02:19:46.619281 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.618915 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-787q5\" (UniqueName: \"kubernetes.io/projected/37660632-e407-412f-aa36-3e764febd673-kube-api-access-787q5\") pod \"node-resolver-btr7x\" (UID: \"37660632-e407-412f-aa36-3e764febd673\") " pod="openshift-dns/node-resolver-btr7x" Jun 09 02:19:46.619281 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.619245 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kn9fc\" (UniqueName: \"kubernetes.io/projected/866bea41-c522-452a-9430-a3461041d710-kube-api-access-kn9fc\") pod \"network-metrics-daemon-xfrxz\" (UID: \"866bea41-c522-452a-9430-a3461041d710\") " pod="openshift-multus/network-metrics-daemon-xfrxz" Jun 09 02:19:46.619452 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.619327 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfsxv\" (UniqueName: \"kubernetes.io/projected/bb35575b-7a94-4bf7-be30-a083b9265c50-kube-api-access-kfsxv\") pod \"aws-ebs-csi-driver-node-64h95\" (UID: \"bb35575b-7a94-4bf7-be30-a083b9265c50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-64h95" Jun 09 02:19:46.619513 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.619481 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvvcc\" (UniqueName: \"kubernetes.io/projected/4dad265a-b70a-4a80-b2da-d1901621c5a2-kube-api-access-rvvcc\") pod \"tuned-bvzwc\" (UID: \"4dad265a-b70a-4a80-b2da-d1901621c5a2\") " pod="openshift-cluster-node-tuning-operator/tuned-bvzwc" Jun 09 02:19:46.619726 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.619709 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5pg6\" (UniqueName: \"kubernetes.io/projected/9ee7881a-36ac-45e4-80a2-d3fbdf30e2ae-kube-api-access-j5pg6\") pod \"multus-additional-cni-plugins-c4qzg\" (UID: \"9ee7881a-36ac-45e4-80a2-d3fbdf30e2ae\") " pod="openshift-multus/multus-additional-cni-plugins-c4qzg" Jun 09 02:19:46.698761 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.698699 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-nqmc9" Jun 09 02:19:46.706342 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.706322 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-fgmlx" Jun 09 02:19:46.716016 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.715996 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qvvvx" Jun 09 02:19:46.721696 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.721678 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jz2q7" Jun 09 02:19:46.729128 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.729102 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5hctt" Jun 09 02:19:46.736518 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.736493 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-c4qzg" Jun 09 02:19:46.744061 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.744040 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-64h95" Jun 09 02:19:46.751533 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.751514 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bvzwc" Jun 09 02:19:46.757010 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.756990 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-btr7x" Jun 09 02:19:46.800884 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:46.800865 2573 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 02:19:47.012799 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:47.012729 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d745eb48-8450-4c3b-8f93-c6ab1f3036a0-original-pull-secret\") pod \"global-pull-secret-syncer-8gdb7\" (UID: \"d745eb48-8450-4c3b-8f93-c6ab1f3036a0\") " pod="kube-system/global-pull-secret-syncer-8gdb7" Jun 09 02:19:47.012913 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:19:47.012869 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 02:19:47.012976 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:19:47.012947 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d745eb48-8450-4c3b-8f93-c6ab1f3036a0-original-pull-secret podName:d745eb48-8450-4c3b-8f93-c6ab1f3036a0 nodeName:}" failed. No retries permitted until 2026-06-09 02:19:48.012923947 +0000 UTC m=+3.960041284 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d745eb48-8450-4c3b-8f93-c6ab1f3036a0-original-pull-secret") pod "global-pull-secret-syncer-8gdb7" (UID: "d745eb48-8450-4c3b-8f93-c6ab1f3036a0") : object "kube-system"/"original-pull-secret" not registered Jun 09 02:19:47.113216 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:47.113191 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/866bea41-c522-452a-9430-a3461041d710-metrics-certs\") pod \"network-metrics-daemon-xfrxz\" (UID: \"866bea41-c522-452a-9430-a3461041d710\") " pod="openshift-multus/network-metrics-daemon-xfrxz" Jun 09 02:19:47.113360 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:19:47.113325 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 02:19:47.113411 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:19:47.113375 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/866bea41-c522-452a-9430-a3461041d710-metrics-certs podName:866bea41-c522-452a-9430-a3461041d710 nodeName:}" failed. No retries permitted until 2026-06-09 02:19:48.113362473 +0000 UTC m=+4.060479797 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/866bea41-c522-452a-9430-a3461041d710-metrics-certs") pod "network-metrics-daemon-xfrxz" (UID: "866bea41-c522-452a-9430-a3461041d710") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 02:19:47.214039 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:47.214003 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wj75\" (UniqueName: \"kubernetes.io/projected/fb1c4057-f500-488c-a3c7-b9013471e88b-kube-api-access-2wj75\") pod \"network-check-target-fzc2b\" (UID: \"fb1c4057-f500-488c-a3c7-b9013471e88b\") " pod="openshift-network-diagnostics/network-check-target-fzc2b" Jun 09 02:19:47.214218 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:19:47.214198 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 02:19:47.214298 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:19:47.214225 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 02:19:47.214298 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:19:47.214238 2573 projected.go:196] Error preparing data for projected volume kube-api-access-2wj75 for pod openshift-network-diagnostics/network-check-target-fzc2b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 02:19:47.214298 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:19:47.214298 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fb1c4057-f500-488c-a3c7-b9013471e88b-kube-api-access-2wj75 podName:fb1c4057-f500-488c-a3c7-b9013471e88b nodeName:}" failed. No retries permitted until 2026-06-09 02:19:48.214279391 +0000 UTC m=+4.161396731 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-2wj75" (UniqueName: "kubernetes.io/projected/fb1c4057-f500-488c-a3c7-b9013471e88b-kube-api-access-2wj75") pod "network-check-target-fzc2b" (UID: "fb1c4057-f500-488c-a3c7-b9013471e88b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 02:19:47.380959 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:47.380789 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21fe5491_feac_4749_adfa_a195bf173d83.slice/crio-b6d08f47acccee6eb53923a62cb345c8e4ef6ea4ea51f41dc5ca7fc0aab49ca9 WatchSource:0}: Error finding container b6d08f47acccee6eb53923a62cb345c8e4ef6ea4ea51f41dc5ca7fc0aab49ca9: Status 404 returned error can't find the container with id b6d08f47acccee6eb53923a62cb345c8e4ef6ea4ea51f41dc5ca7fc0aab49ca9 Jun 09 02:19:47.381738 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:47.381715 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb35575b_7a94_4bf7_be30_a083b9265c50.slice/crio-d1aaf3ee9b82dee98085d335ef096a1ee67786a0548f9322b3b1798dd97467e6 WatchSource:0}: Error finding container d1aaf3ee9b82dee98085d335ef096a1ee67786a0548f9322b3b1798dd97467e6: Status 404 returned error can't find the container with id d1aaf3ee9b82dee98085d335ef096a1ee67786a0548f9322b3b1798dd97467e6 Jun 09 02:19:47.385597 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:47.385578 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37e9e0fa_4abd_4eeb_8671_934808ecdf78.slice/crio-137970dfffdfa81e67ffaff9590e15e48792d4eaccb35ac58866dffdafeb5dc7 WatchSource:0}: Error finding container 137970dfffdfa81e67ffaff9590e15e48792d4eaccb35ac58866dffdafeb5dc7: Status 404 returned error can't find the container with id 137970dfffdfa81e67ffaff9590e15e48792d4eaccb35ac58866dffdafeb5dc7 Jun 09 02:19:47.386228 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:47.386202 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ee7881a_36ac_45e4_80a2_d3fbdf30e2ae.slice/crio-27f1e6aa2fe1e3b398a7703fe0bd50f11467a3c28c7813f3e8a1c6df7c0ffed4 WatchSource:0}: Error finding container 27f1e6aa2fe1e3b398a7703fe0bd50f11467a3c28c7813f3e8a1c6df7c0ffed4: Status 404 returned error can't find the container with id 27f1e6aa2fe1e3b398a7703fe0bd50f11467a3c28c7813f3e8a1c6df7c0ffed4 Jun 09 02:19:47.388301 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:47.388253 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8b26c95_6b25_462e_bbca_66eefe50f0bb.slice/crio-081e4b662aadb3dd192af4db0a561a6debf4f7833a35c5a5e7be605aaf45f657 WatchSource:0}: Error finding container 081e4b662aadb3dd192af4db0a561a6debf4f7833a35c5a5e7be605aaf45f657: Status 404 returned error can't find the container with id 081e4b662aadb3dd192af4db0a561a6debf4f7833a35c5a5e7be605aaf45f657 Jun 09 02:19:47.388718 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:47.388696 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37660632_e407_412f_aa36_3e764febd673.slice/crio-5e2593547124d3a0fd5af222a57e85f11895ccf6e8be6d19a57421e5fd1f814c WatchSource:0}: Error finding container 5e2593547124d3a0fd5af222a57e85f11895ccf6e8be6d19a57421e5fd1f814c: Status 404 returned error can't find the container with id 5e2593547124d3a0fd5af222a57e85f11895ccf6e8be6d19a57421e5fd1f814c Jun 09 02:19:47.389631 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:47.389392 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod129b4aeb_af58_4b14_ae74_bf599054fd7f.slice/crio-20f63fe676b4835ac506636f779f3e8fe1b7cc9956746113ccbf366153ce4057 WatchSource:0}: Error finding container 20f63fe676b4835ac506636f779f3e8fe1b7cc9956746113ccbf366153ce4057: Status 404 returned error can't find the container with id 20f63fe676b4835ac506636f779f3e8fe1b7cc9956746113ccbf366153ce4057 Jun 09 02:19:47.391341 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:47.391318 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4dad265a_b70a_4a80_b2da_d1901621c5a2.slice/crio-3aa2c9429d665355d3f905601e9549023dab7d5e2da6a88dec5c0c9ee91df761 WatchSource:0}: Error finding container 3aa2c9429d665355d3f905601e9549023dab7d5e2da6a88dec5c0c9ee91df761: Status 404 returned error can't find the container with id 3aa2c9429d665355d3f905601e9549023dab7d5e2da6a88dec5c0c9ee91df761 Jun 09 02:19:47.392144 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:19:47.392122 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6627f9b3_28ae_40b2_9ba9_fe6614fe60dc.slice/crio-1d964659726dcfa49ac1639255ca788172995d978eaca8f27aa1a29e896ad440 WatchSource:0}: Error finding container 1d964659726dcfa49ac1639255ca788172995d978eaca8f27aa1a29e896ad440: Status 404 returned error can't find the container with id 1d964659726dcfa49ac1639255ca788172995d978eaca8f27aa1a29e896ad440 Jun 09 02:19:47.433976 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:47.433936 2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-08 02:14:46 +0000 UTC" deadline="2028-03-21 18:39:36.201885844 +0000 UTC" Jun 09 02:19:47.433976 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:47.433976 2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15640h19m48.767914206s" Jun 09 02:19:47.467922 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:47.467896 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c4qzg" event={"ID":"9ee7881a-36ac-45e4-80a2-d3fbdf30e2ae","Type":"ContainerStarted","Data":"27f1e6aa2fe1e3b398a7703fe0bd50f11467a3c28c7813f3e8a1c6df7c0ffed4"} Jun 09 02:19:47.470331 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:47.470306 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-102.ec2.internal" event={"ID":"34d10cebf6d68c8388770209edc1ad38","Type":"ContainerStarted","Data":"ffb2e610e2b84002e9c1f94e30ed0693871f4eceeb84664dd83a72484d4a839c"} Jun 09 02:19:47.471684 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:47.471665 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qvvvx" event={"ID":"129b4aeb-af58-4b14-ae74-bf599054fd7f","Type":"ContainerStarted","Data":"20f63fe676b4835ac506636f779f3e8fe1b7cc9956746113ccbf366153ce4057"} Jun 09 02:19:47.472623 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:47.472606 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bvzwc" event={"ID":"4dad265a-b70a-4a80-b2da-d1901621c5a2","Type":"ContainerStarted","Data":"3aa2c9429d665355d3f905601e9549023dab7d5e2da6a88dec5c0c9ee91df761"} Jun 09 02:19:47.473674 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:47.473654 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-btr7x" event={"ID":"37660632-e407-412f-aa36-3e764febd673","Type":"ContainerStarted","Data":"5e2593547124d3a0fd5af222a57e85f11895ccf6e8be6d19a57421e5fd1f814c"} Jun 09 02:19:47.474631 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:47.474613 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5hctt" event={"ID":"b8b26c95-6b25-462e-bbca-66eefe50f0bb","Type":"ContainerStarted","Data":"081e4b662aadb3dd192af4db0a561a6debf4f7833a35c5a5e7be605aaf45f657"} Jun 09 02:19:47.475597 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:47.475578 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jz2q7" event={"ID":"37e9e0fa-4abd-4eeb-8671-934808ecdf78","Type":"ContainerStarted","Data":"137970dfffdfa81e67ffaff9590e15e48792d4eaccb35ac58866dffdafeb5dc7"} Jun 09 02:19:47.476521 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:47.476504 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-64h95" event={"ID":"bb35575b-7a94-4bf7-be30-a083b9265c50","Type":"ContainerStarted","Data":"d1aaf3ee9b82dee98085d335ef096a1ee67786a0548f9322b3b1798dd97467e6"} Jun 09 02:19:47.477520 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:47.477497 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-nqmc9" event={"ID":"21fe5491-feac-4749-adfa-a195bf173d83","Type":"ContainerStarted","Data":"b6d08f47acccee6eb53923a62cb345c8e4ef6ea4ea51f41dc5ca7fc0aab49ca9"} Jun 09 02:19:47.478710 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:47.478689 2573 generic.go:356] "Generic (PLEG): container finished" podID="f7b9893f4c000cf925ee11f6b503c58b" containerID="53e3f1f026bd504dc0a90aef882449b1c52b8f2189342273c63e0d56ce221cbc" exitCode=0 Jun 09 02:19:47.478778 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:47.478749 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-102.ec2.internal" event={"ID":"f7b9893f4c000cf925ee11f6b503c58b","Type":"ContainerDied","Data":"53e3f1f026bd504dc0a90aef882449b1c52b8f2189342273c63e0d56ce221cbc"} Jun 09 02:19:47.479774 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:47.479756 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-fgmlx" event={"ID":"6627f9b3-28ae-40b2-9ba9-fe6614fe60dc","Type":"ContainerStarted","Data":"1d964659726dcfa49ac1639255ca788172995d978eaca8f27aa1a29e896ad440"} Jun 09 02:19:47.494831 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:47.494787 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-102.ec2.internal" podStartSLOduration=2.494774637 podStartE2EDuration="2.494774637s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 02:19:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:19:47.481902993 +0000 UTC m=+3.429020335" watchObservedRunningTime="2026-06-09 02:19:47.494774637 +0000 UTC m=+3.441891979" Jun 09 02:19:48.020724 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:48.020687 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d745eb48-8450-4c3b-8f93-c6ab1f3036a0-original-pull-secret\") pod \"global-pull-secret-syncer-8gdb7\" (UID: \"d745eb48-8450-4c3b-8f93-c6ab1f3036a0\") " pod="kube-system/global-pull-secret-syncer-8gdb7" Jun 09 02:19:48.020959 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:19:48.020814 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 02:19:48.020959 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:19:48.020871 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d745eb48-8450-4c3b-8f93-c6ab1f3036a0-original-pull-secret podName:d745eb48-8450-4c3b-8f93-c6ab1f3036a0 nodeName:}" failed. No retries permitted until 2026-06-09 02:19:50.020853505 +0000 UTC m=+5.967970830 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d745eb48-8450-4c3b-8f93-c6ab1f3036a0-original-pull-secret") pod "global-pull-secret-syncer-8gdb7" (UID: "d745eb48-8450-4c3b-8f93-c6ab1f3036a0") : object "kube-system"/"original-pull-secret" not registered Jun 09 02:19:48.121683 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:48.121480 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/866bea41-c522-452a-9430-a3461041d710-metrics-certs\") pod \"network-metrics-daemon-xfrxz\" (UID: \"866bea41-c522-452a-9430-a3461041d710\") " pod="openshift-multus/network-metrics-daemon-xfrxz" Jun 09 02:19:48.121683 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:19:48.121643 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 02:19:48.121920 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:19:48.121701 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/866bea41-c522-452a-9430-a3461041d710-metrics-certs podName:866bea41-c522-452a-9430-a3461041d710 nodeName:}" failed. No retries permitted until 2026-06-09 02:19:50.121680921 +0000 UTC m=+6.068798247 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/866bea41-c522-452a-9430-a3461041d710-metrics-certs") pod "network-metrics-daemon-xfrxz" (UID: "866bea41-c522-452a-9430-a3461041d710") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 02:19:48.222787 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:48.222754 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wj75\" (UniqueName: \"kubernetes.io/projected/fb1c4057-f500-488c-a3c7-b9013471e88b-kube-api-access-2wj75\") pod \"network-check-target-fzc2b\" (UID: \"fb1c4057-f500-488c-a3c7-b9013471e88b\") " pod="openshift-network-diagnostics/network-check-target-fzc2b" Jun 09 02:19:48.222956 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:19:48.222923 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 02:19:48.222956 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:19:48.222941 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 02:19:48.222956 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:19:48.222953 2573 projected.go:196] Error preparing data for projected volume kube-api-access-2wj75 for pod openshift-network-diagnostics/network-check-target-fzc2b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 02:19:48.223154 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:19:48.223003 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fb1c4057-f500-488c-a3c7-b9013471e88b-kube-api-access-2wj75 podName:fb1c4057-f500-488c-a3c7-b9013471e88b nodeName:}" failed. No retries permitted until 2026-06-09 02:19:50.222985632 +0000 UTC m=+6.170102957 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-2wj75" (UniqueName: "kubernetes.io/projected/fb1c4057-f500-488c-a3c7-b9013471e88b-kube-api-access-2wj75") pod "network-check-target-fzc2b" (UID: "fb1c4057-f500-488c-a3c7-b9013471e88b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 02:19:48.434740 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:48.434671 2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-08 02:14:46 +0000 UTC" deadline="2027-11-16 14:16:47.108585799 +0000 UTC" Jun 09 02:19:48.434740 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:48.434738 2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12611h56m58.673851833s" Jun 09 02:19:48.463584 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:48.462603 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8gdb7" Jun 09 02:19:48.463584 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:19:48.462730 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8gdb7" podUID="d745eb48-8450-4c3b-8f93-c6ab1f3036a0" Jun 09 02:19:48.463584 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:48.463105 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fzc2b" Jun 09 02:19:48.463584 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:19:48.463188 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fzc2b" podUID="fb1c4057-f500-488c-a3c7-b9013471e88b" Jun 09 02:19:48.463584 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:48.463254 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xfrxz" Jun 09 02:19:48.463584 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:19:48.463331 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xfrxz" podUID="866bea41-c522-452a-9430-a3461041d710" Jun 09 02:19:48.499560 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:48.499132 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-102.ec2.internal" event={"ID":"f7b9893f4c000cf925ee11f6b503c58b","Type":"ContainerStarted","Data":"2f4a41f4a718ed8b87416a0d7b5262325f5f77e02794ecbb1c99c01963955a8b"} Jun 09 02:19:48.512107 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:48.512045 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-102.ec2.internal" podStartSLOduration=3.512025418 podStartE2EDuration="3.512025418s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 02:19:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:19:48.512006911 +0000 UTC m=+4.459124254" watchObservedRunningTime="2026-06-09 02:19:48.512025418 +0000 UTC m=+4.459142762" Jun 09 02:19:50.037201 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:50.037163 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d745eb48-8450-4c3b-8f93-c6ab1f3036a0-original-pull-secret\") pod \"global-pull-secret-syncer-8gdb7\" (UID: \"d745eb48-8450-4c3b-8f93-c6ab1f3036a0\") " pod="kube-system/global-pull-secret-syncer-8gdb7" Jun 09 02:19:50.037688 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:19:50.037359 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 02:19:50.037688 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:19:50.037425 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d745eb48-8450-4c3b-8f93-c6ab1f3036a0-original-pull-secret podName:d745eb48-8450-4c3b-8f93-c6ab1f3036a0 nodeName:}" failed. No retries permitted until 2026-06-09 02:19:54.037406351 +0000 UTC m=+9.984523678 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d745eb48-8450-4c3b-8f93-c6ab1f3036a0-original-pull-secret") pod "global-pull-secret-syncer-8gdb7" (UID: "d745eb48-8450-4c3b-8f93-c6ab1f3036a0") : object "kube-system"/"original-pull-secret" not registered Jun 09 02:19:50.138634 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:50.138601 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/866bea41-c522-452a-9430-a3461041d710-metrics-certs\") pod \"network-metrics-daemon-xfrxz\" (UID: \"866bea41-c522-452a-9430-a3461041d710\") " pod="openshift-multus/network-metrics-daemon-xfrxz" Jun 09 02:19:50.138794 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:19:50.138779 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 02:19:50.138861 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:19:50.138840 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/866bea41-c522-452a-9430-a3461041d710-metrics-certs podName:866bea41-c522-452a-9430-a3461041d710 nodeName:}" failed. No retries permitted until 2026-06-09 02:19:54.138823034 +0000 UTC m=+10.085940361 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/866bea41-c522-452a-9430-a3461041d710-metrics-certs") pod "network-metrics-daemon-xfrxz" (UID: "866bea41-c522-452a-9430-a3461041d710") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 02:19:50.239411 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:50.239347 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wj75\" (UniqueName: \"kubernetes.io/projected/fb1c4057-f500-488c-a3c7-b9013471e88b-kube-api-access-2wj75\") pod \"network-check-target-fzc2b\" (UID: \"fb1c4057-f500-488c-a3c7-b9013471e88b\") " pod="openshift-network-diagnostics/network-check-target-fzc2b" Jun 09 02:19:50.239580 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:19:50.239555 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 02:19:50.239580 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:19:50.239572 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 02:19:50.239691 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:19:50.239584 2573 projected.go:196] Error preparing data for projected volume kube-api-access-2wj75 for pod openshift-network-diagnostics/network-check-target-fzc2b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 02:19:50.239691 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:19:50.239638 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fb1c4057-f500-488c-a3c7-b9013471e88b-kube-api-access-2wj75 podName:fb1c4057-f500-488c-a3c7-b9013471e88b nodeName:}" failed. No retries permitted until 2026-06-09 02:19:54.239620865 +0000 UTC m=+10.186738202 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-2wj75" (UniqueName: "kubernetes.io/projected/fb1c4057-f500-488c-a3c7-b9013471e88b-kube-api-access-2wj75") pod "network-check-target-fzc2b" (UID: "fb1c4057-f500-488c-a3c7-b9013471e88b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 02:19:50.461011 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:50.460917 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xfrxz" Jun 09 02:19:50.461011 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:50.460951 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8gdb7" Jun 09 02:19:50.461011 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:50.460982 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fzc2b" Jun 09 02:19:50.461276 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:19:50.461125 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8gdb7" podUID="d745eb48-8450-4c3b-8f93-c6ab1f3036a0" Jun 09 02:19:50.461521 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:19:50.461467 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xfrxz" podUID="866bea41-c522-452a-9430-a3461041d710" Jun 09 02:19:50.461612 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:19:50.461552 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fzc2b" podUID="fb1c4057-f500-488c-a3c7-b9013471e88b" Jun 09 02:19:52.461204 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:52.460906 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fzc2b" Jun 09 02:19:52.461204 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:52.460924 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8gdb7" Jun 09 02:19:52.461204 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:19:52.461037 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fzc2b" podUID="fb1c4057-f500-488c-a3c7-b9013471e88b" Jun 09 02:19:52.461204 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:52.461102 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xfrxz" Jun 09 02:19:52.461204 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:19:52.461198 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8gdb7" podUID="d745eb48-8450-4c3b-8f93-c6ab1f3036a0" Jun 09 02:19:52.461820 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:19:52.461271 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xfrxz" podUID="866bea41-c522-452a-9430-a3461041d710" Jun 09 02:19:54.068457 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:54.068420 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d745eb48-8450-4c3b-8f93-c6ab1f3036a0-original-pull-secret\") pod \"global-pull-secret-syncer-8gdb7\" (UID: \"d745eb48-8450-4c3b-8f93-c6ab1f3036a0\") " pod="kube-system/global-pull-secret-syncer-8gdb7" Jun 09 02:19:54.068914 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:19:54.068597 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 02:19:54.068914 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:19:54.068664 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d745eb48-8450-4c3b-8f93-c6ab1f3036a0-original-pull-secret podName:d745eb48-8450-4c3b-8f93-c6ab1f3036a0 nodeName:}" failed. No retries permitted until 2026-06-09 02:20:02.068644885 +0000 UTC m=+18.015762224 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d745eb48-8450-4c3b-8f93-c6ab1f3036a0-original-pull-secret") pod "global-pull-secret-syncer-8gdb7" (UID: "d745eb48-8450-4c3b-8f93-c6ab1f3036a0") : object "kube-system"/"original-pull-secret" not registered Jun 09 02:19:54.169716 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:54.169625 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/866bea41-c522-452a-9430-a3461041d710-metrics-certs\") pod \"network-metrics-daemon-xfrxz\" (UID: \"866bea41-c522-452a-9430-a3461041d710\") " pod="openshift-multus/network-metrics-daemon-xfrxz" Jun 09 02:19:54.169901 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:19:54.169772 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 02:19:54.169901 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:19:54.169850 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/866bea41-c522-452a-9430-a3461041d710-metrics-certs podName:866bea41-c522-452a-9430-a3461041d710 nodeName:}" failed. No retries permitted until 2026-06-09 02:20:02.169829516 +0000 UTC m=+18.116946852 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/866bea41-c522-452a-9430-a3461041d710-metrics-certs") pod "network-metrics-daemon-xfrxz" (UID: "866bea41-c522-452a-9430-a3461041d710") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 02:19:54.270887 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:54.270853 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wj75\" (UniqueName: \"kubernetes.io/projected/fb1c4057-f500-488c-a3c7-b9013471e88b-kube-api-access-2wj75\") pod \"network-check-target-fzc2b\" (UID: \"fb1c4057-f500-488c-a3c7-b9013471e88b\") " pod="openshift-network-diagnostics/network-check-target-fzc2b" Jun 09 02:19:54.271099 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:19:54.271055 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 02:19:54.271099 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:19:54.271092 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 02:19:54.271217 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:19:54.271106 2573 projected.go:196] Error preparing data for projected volume kube-api-access-2wj75 for pod openshift-network-diagnostics/network-check-target-fzc2b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 02:19:54.271217 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:19:54.271164 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fb1c4057-f500-488c-a3c7-b9013471e88b-kube-api-access-2wj75 podName:fb1c4057-f500-488c-a3c7-b9013471e88b nodeName:}" failed. No retries permitted until 2026-06-09 02:20:02.271145674 +0000 UTC m=+18.218262999 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-2wj75" (UniqueName: "kubernetes.io/projected/fb1c4057-f500-488c-a3c7-b9013471e88b-kube-api-access-2wj75") pod "network-check-target-fzc2b" (UID: "fb1c4057-f500-488c-a3c7-b9013471e88b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 02:19:54.464642 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:54.464181 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xfrxz" Jun 09 02:19:54.464642 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:19:54.464300 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xfrxz" podUID="866bea41-c522-452a-9430-a3461041d710" Jun 09 02:19:54.464642 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:54.464323 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8gdb7" Jun 09 02:19:54.464642 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:19:54.464391 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8gdb7" podUID="d745eb48-8450-4c3b-8f93-c6ab1f3036a0" Jun 09 02:19:54.464642 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:54.464432 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fzc2b" Jun 09 02:19:54.464642 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:19:54.464487 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fzc2b" podUID="fb1c4057-f500-488c-a3c7-b9013471e88b" Jun 09 02:19:56.463317 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:56.463286 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8gdb7" Jun 09 02:19:56.463725 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:56.463286 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xfrxz" Jun 09 02:19:56.463725 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:19:56.463386 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8gdb7" podUID="d745eb48-8450-4c3b-8f93-c6ab1f3036a0" Jun 09 02:19:56.463725 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:19:56.463511 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xfrxz" podUID="866bea41-c522-452a-9430-a3461041d710" Jun 09 02:19:56.463725 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:56.463296 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fzc2b" Jun 09 02:19:56.463725 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:19:56.463616 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fzc2b" podUID="fb1c4057-f500-488c-a3c7-b9013471e88b" Jun 09 02:19:58.461503 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:58.461467 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8gdb7" Jun 09 02:19:58.461920 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:58.461512 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xfrxz" Jun 09 02:19:58.461920 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:19:58.461479 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fzc2b" Jun 09 02:19:58.461920 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:19:58.461592 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8gdb7" podUID="d745eb48-8450-4c3b-8f93-c6ab1f3036a0" Jun 09 02:19:58.461920 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:19:58.461684 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fzc2b" podUID="fb1c4057-f500-488c-a3c7-b9013471e88b" Jun 09 02:19:58.461920 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:19:58.461772 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xfrxz" podUID="866bea41-c522-452a-9430-a3461041d710" Jun 09 02:20:00.461503 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:00.461470 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fzc2b" Jun 09 02:20:00.462018 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:00.461473 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xfrxz" Jun 09 02:20:00.462018 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:20:00.461587 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fzc2b" podUID="fb1c4057-f500-488c-a3c7-b9013471e88b" Jun 09 02:20:00.462018 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:00.461477 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8gdb7" Jun 09 02:20:00.462018 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:20:00.461684 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xfrxz" podUID="866bea41-c522-452a-9430-a3461041d710" Jun 09 02:20:00.462018 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:20:00.461763 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8gdb7" podUID="d745eb48-8450-4c3b-8f93-c6ab1f3036a0" Jun 09 02:20:02.133408 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:02.133370 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d745eb48-8450-4c3b-8f93-c6ab1f3036a0-original-pull-secret\") pod \"global-pull-secret-syncer-8gdb7\" (UID: \"d745eb48-8450-4c3b-8f93-c6ab1f3036a0\") " pod="kube-system/global-pull-secret-syncer-8gdb7" Jun 09 02:20:02.133863 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:20:02.133502 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 02:20:02.133863 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:20:02.133570 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d745eb48-8450-4c3b-8f93-c6ab1f3036a0-original-pull-secret podName:d745eb48-8450-4c3b-8f93-c6ab1f3036a0 nodeName:}" failed. No retries permitted until 2026-06-09 02:20:18.133548726 +0000 UTC m=+34.080666049 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d745eb48-8450-4c3b-8f93-c6ab1f3036a0-original-pull-secret") pod "global-pull-secret-syncer-8gdb7" (UID: "d745eb48-8450-4c3b-8f93-c6ab1f3036a0") : object "kube-system"/"original-pull-secret" not registered Jun 09 02:20:02.234454 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:02.234421 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/866bea41-c522-452a-9430-a3461041d710-metrics-certs\") pod \"network-metrics-daemon-xfrxz\" (UID: \"866bea41-c522-452a-9430-a3461041d710\") " pod="openshift-multus/network-metrics-daemon-xfrxz" Jun 09 02:20:02.234607 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:20:02.234546 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 02:20:02.234662 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:20:02.234609 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/866bea41-c522-452a-9430-a3461041d710-metrics-certs podName:866bea41-c522-452a-9430-a3461041d710 nodeName:}" failed. No retries permitted until 2026-06-09 02:20:18.234591214 +0000 UTC m=+34.181708535 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/866bea41-c522-452a-9430-a3461041d710-metrics-certs") pod "network-metrics-daemon-xfrxz" (UID: "866bea41-c522-452a-9430-a3461041d710") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 02:20:02.334898 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:02.334869 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wj75\" (UniqueName: \"kubernetes.io/projected/fb1c4057-f500-488c-a3c7-b9013471e88b-kube-api-access-2wj75\") pod \"network-check-target-fzc2b\" (UID: \"fb1c4057-f500-488c-a3c7-b9013471e88b\") " pod="openshift-network-diagnostics/network-check-target-fzc2b" Jun 09 02:20:02.335039 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:20:02.335023 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 02:20:02.335138 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:20:02.335042 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 02:20:02.335138 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:20:02.335054 2573 projected.go:196] Error preparing data for projected volume kube-api-access-2wj75 for pod openshift-network-diagnostics/network-check-target-fzc2b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 02:20:02.335138 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:20:02.335131 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fb1c4057-f500-488c-a3c7-b9013471e88b-kube-api-access-2wj75 podName:fb1c4057-f500-488c-a3c7-b9013471e88b nodeName:}" failed. No retries permitted until 2026-06-09 02:20:18.335112421 +0000 UTC m=+34.282229757 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-2wj75" (UniqueName: "kubernetes.io/projected/fb1c4057-f500-488c-a3c7-b9013471e88b-kube-api-access-2wj75") pod "network-check-target-fzc2b" (UID: "fb1c4057-f500-488c-a3c7-b9013471e88b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 02:20:02.463859 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:02.463790 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xfrxz" Jun 09 02:20:02.463995 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:02.463788 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fzc2b" Jun 09 02:20:02.463995 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:20:02.463910 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xfrxz" podUID="866bea41-c522-452a-9430-a3461041d710" Jun 09 02:20:02.463995 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:02.463796 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8gdb7" Jun 09 02:20:02.463995 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:20:02.463960 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fzc2b" podUID="fb1c4057-f500-488c-a3c7-b9013471e88b" Jun 09 02:20:02.464212 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:20:02.464041 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8gdb7" podUID="d745eb48-8450-4c3b-8f93-c6ab1f3036a0" Jun 09 02:20:04.461923 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:04.461890 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fzc2b" Jun 09 02:20:04.462370 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:20:04.461982 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fzc2b" podUID="fb1c4057-f500-488c-a3c7-b9013471e88b" Jun 09 02:20:04.462370 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:04.462066 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8gdb7" Jun 09 02:20:04.462370 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:20:04.462188 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8gdb7" podUID="d745eb48-8450-4c3b-8f93-c6ab1f3036a0" Jun 09 02:20:04.462370 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:04.462218 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xfrxz" Jun 09 02:20:04.462370 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:20:04.462302 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xfrxz" podUID="866bea41-c522-452a-9430-a3461041d710" Jun 09 02:20:05.533661 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:05.533636 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-nqmc9" event={"ID":"21fe5491-feac-4749-adfa-a195bf173d83","Type":"ContainerStarted","Data":"80fd3728b476a4a19e0fb091720e5e138ae405c553d842a6dac1d5a422ad0bd9"} Jun 09 02:20:05.534953 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:05.534934 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-fgmlx" event={"ID":"6627f9b3-28ae-40b2-9ba9-fe6614fe60dc","Type":"ContainerStarted","Data":"057be6cbe8c233b894f427f27ea0a95585fe1047a520ad20561d10f656a1f01c"} Jun 09 02:20:05.536305 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:05.536274 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c4qzg" event={"ID":"9ee7881a-36ac-45e4-80a2-d3fbdf30e2ae","Type":"ContainerStarted","Data":"6e62d3df4e620b4cd2e1a1c6db1fff279d546f0d2ec3536121cb64bebe4a6399"} Jun 09 02:20:05.537643 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:05.537617 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bvzwc" event={"ID":"4dad265a-b70a-4a80-b2da-d1901621c5a2","Type":"ContainerStarted","Data":"1c82a271614a04784eb080ebb77541fe604bc9b0a6a14f7c44fa21146e51923c"} Jun 09 02:20:05.538915 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:05.538898 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-btr7x" event={"ID":"37660632-e407-412f-aa36-3e764febd673","Type":"ContainerStarted","Data":"2e1471156870c1e9e6e1f34fb29550399170a8cd20fd62ee97315f404ea49a71"} Jun 09 02:20:05.540293 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:05.540266 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5hctt" event={"ID":"b8b26c95-6b25-462e-bbca-66eefe50f0bb","Type":"ContainerStarted","Data":"0d4e160151f1102ef04428a8e2d17cf3d1b9c4575f3178e64e486941df1f9e48"} Jun 09 02:20:05.542341 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:05.542318 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jz2q7" event={"ID":"37e9e0fa-4abd-4eeb-8671-934808ecdf78","Type":"ContainerStarted","Data":"da26529c42d28e0ebeffcb7ff12f36a17f14ca231bec7e950e9ff1004e5cd788"} Jun 09 02:20:05.543842 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:05.543824 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-64h95" event={"ID":"bb35575b-7a94-4bf7-be30-a083b9265c50","Type":"ContainerStarted","Data":"5ad5cd5fe7de23e73b0f6c88e069f61858cbe759c9f0cfaf87fd78d7e53b4f9f"} Jun 09 02:20:05.547319 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:05.547282 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-nqmc9" podStartSLOduration=3.714133372 podStartE2EDuration="21.547270939s" totalImagesPullingTime="17.833137567s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 02:19:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:20:05.547030174 +0000 UTC m=+21.494147516" watchObservedRunningTime="2026-06-09 02:20:05.547270939 +0000 UTC m=+21.494388281" Jun 09 02:20:05.562068 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:05.562034 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-bvzwc" podStartSLOduration=3.776250847 podStartE2EDuration="21.562023084s" totalImagesPullingTime="17.785772237s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 02:19:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:20:05.56184949 +0000 UTC m=+21.508966832" watchObservedRunningTime="2026-06-09 02:20:05.562023084 +0000 UTC m=+21.509140451" Jun 09 02:20:05.573820 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:05.573786 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-btr7x" podStartSLOduration=3.785290843 podStartE2EDuration="21.573774387s" totalImagesPullingTime="17.788483544s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 02:19:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:20:05.573528768 +0000 UTC m=+21.520646111" watchObservedRunningTime="2026-06-09 02:20:05.573774387 +0000 UTC m=+21.520891728" Jun 09 02:20:05.600057 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:05.600017 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-fgmlx" podStartSLOduration=3.814774236 podStartE2EDuration="21.600002521s" totalImagesPullingTime="17.785228285s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 02:19:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:20:05.585016659 +0000 UTC m=+21.532134003" watchObservedRunningTime="2026-06-09 02:20:05.600002521 +0000 UTC m=+21.547119920" Jun 09 02:20:05.619927 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:05.619889 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-5hctt" podStartSLOduration=11.990487861 podStartE2EDuration="21.619876106s" totalImagesPullingTime="9.629388245s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:19:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:20:05.59985951 +0000 UTC m=+21.546976854" watchObservedRunningTime="2026-06-09 02:20:05.619876106 +0000 UTC m=+21.566993549" Jun 09 02:20:06.461794 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:06.461634 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fzc2b" Jun 09 02:20:06.461871 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:20:06.461846 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fzc2b" podUID="fb1c4057-f500-488c-a3c7-b9013471e88b" Jun 09 02:20:06.461871 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:06.461650 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8gdb7" Jun 09 02:20:06.461937 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:20:06.461912 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8gdb7" podUID="d745eb48-8450-4c3b-8f93-c6ab1f3036a0" Jun 09 02:20:06.461937 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:06.461650 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xfrxz" Jun 09 02:20:06.461998 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:20:06.461990 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xfrxz" podUID="866bea41-c522-452a-9430-a3461041d710" Jun 09 02:20:06.547531 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:06.547505 2573 generic.go:356] "Generic (PLEG): container finished" podID="9ee7881a-36ac-45e4-80a2-d3fbdf30e2ae" containerID="6e62d3df4e620b4cd2e1a1c6db1fff279d546f0d2ec3536121cb64bebe4a6399" exitCode=0 Jun 09 02:20:06.547959 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:06.547570 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c4qzg" event={"ID":"9ee7881a-36ac-45e4-80a2-d3fbdf30e2ae","Type":"ContainerDied","Data":"6e62d3df4e620b4cd2e1a1c6db1fff279d546f0d2ec3536121cb64bebe4a6399"} Jun 09 02:20:06.549023 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:06.549003 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qvvvx" event={"ID":"129b4aeb-af58-4b14-ae74-bf599054fd7f","Type":"ContainerStarted","Data":"96c02528b92e2c3eb96f6e317e67a45c91b8a6a2b3df97ab4856dcbba579f6d2"} Jun 09 02:20:06.551891 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:06.551863 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jz2q7_37e9e0fa-4abd-4eeb-8671-934808ecdf78/ovn-acl-logging/0.log" Jun 09 02:20:06.552261 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:06.552242 2573 generic.go:356] "Generic (PLEG): container finished" podID="37e9e0fa-4abd-4eeb-8671-934808ecdf78" containerID="e0dd9d8cbf7d9fa4f89e84bfd95e1be04b4d69cc2f27b9d7c073f1806f254d34" exitCode=1 Jun 09 02:20:06.552353 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:06.552333 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jz2q7" event={"ID":"37e9e0fa-4abd-4eeb-8671-934808ecdf78","Type":"ContainerStarted","Data":"ab4e7ea581e626ea737bf2dfe216f95a136e8f6617630090b28f158a106a700c"} Jun 09 02:20:06.552433 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:06.552419 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jz2q7" event={"ID":"37e9e0fa-4abd-4eeb-8671-934808ecdf78","Type":"ContainerStarted","Data":"fcd065adf8380649089fe213035152ad88a4abb11e426f64a44028bc1e439463"} Jun 09 02:20:06.552485 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:06.552473 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jz2q7" event={"ID":"37e9e0fa-4abd-4eeb-8671-934808ecdf78","Type":"ContainerStarted","Data":"62dfa028bab077be442df1648d1a45c7d97848fccf23a18c3f3920965f57f8f7"} Jun 09 02:20:06.552533 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:06.552521 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jz2q7" event={"ID":"37e9e0fa-4abd-4eeb-8671-934808ecdf78","Type":"ContainerStarted","Data":"9925aa5420c315fe619d408957b0445c8ffa4b5ea54140f77397f7e7ea9919d2"} Jun 09 02:20:06.552576 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:06.552566 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jz2q7" event={"ID":"37e9e0fa-4abd-4eeb-8671-934808ecdf78","Type":"ContainerDied","Data":"e0dd9d8cbf7d9fa4f89e84bfd95e1be04b4d69cc2f27b9d7c073f1806f254d34"} Jun 09 02:20:06.564647 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:06.564627 2573 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 09 02:20:06.609927 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:06.609891 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-qvvvx" podStartSLOduration=4.822079543 podStartE2EDuration="22.609878648s" totalImagesPullingTime="17.787799105s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 02:19:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:20:06.609610602 +0000 UTC m=+22.556727932" watchObservedRunningTime="2026-06-09 02:20:06.609878648 +0000 UTC m=+22.556995991" Jun 09 02:20:07.456061 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:07.455968 2573 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-09T02:20:06.564643599Z","UUID":"c0740084-485c-4851-914a-338de46f438a","Handler":null,"Name":"","Endpoint":""} Jun 09 02:20:07.457464 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:07.457416 2573 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 09 02:20:07.457464 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:07.457457 2573 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 09 02:20:07.557018 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:07.556985 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-64h95" event={"ID":"bb35575b-7a94-4bf7-be30-a083b9265c50","Type":"ContainerStarted","Data":"059d9047b026180c437e6b89d877d034d4a4023751bee69b972055ec7f1925ec"} Jun 09 02:20:07.557390 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:07.557043 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-64h95" event={"ID":"bb35575b-7a94-4bf7-be30-a083b9265c50","Type":"ContainerStarted","Data":"4cae95935291fca98c2dd57a67af28e37cff4d2a16b006ca68628af42e0e94ae"} Jun 09 02:20:07.594477 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:07.594454 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-5hctt" Jun 09 02:20:07.595045 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:07.595024 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-5hctt" Jun 09 02:20:08.461381 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:08.461130 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fzc2b" Jun 09 02:20:08.461533 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:20:08.461440 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fzc2b" podUID="fb1c4057-f500-488c-a3c7-b9013471e88b" Jun 09 02:20:08.461533 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:08.461130 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xfrxz" Jun 09 02:20:08.461533 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:08.461130 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8gdb7" Jun 09 02:20:08.461736 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:20:08.461528 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xfrxz" podUID="866bea41-c522-452a-9430-a3461041d710" Jun 09 02:20:08.461736 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:20:08.461636 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8gdb7" podUID="d745eb48-8450-4c3b-8f93-c6ab1f3036a0" Jun 09 02:20:08.561514 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:08.561490 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jz2q7_37e9e0fa-4abd-4eeb-8671-934808ecdf78/ovn-acl-logging/0.log" Jun 09 02:20:08.561885 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:08.561841 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jz2q7" event={"ID":"37e9e0fa-4abd-4eeb-8671-934808ecdf78","Type":"ContainerStarted","Data":"4ace2dcc9c3df8fc8bc7379558d4f08372a785317acff285f17fd2879ac81008"} Jun 09 02:20:08.562016 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:08.562000 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-5hctt" Jun 09 02:20:08.562494 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:08.562476 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-5hctt" Jun 09 02:20:08.567385 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:08.567358 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:20:08.579148 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:08.579111 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-64h95" podStartSLOduration=4.931987123 podStartE2EDuration="24.57910004s" totalImagesPullingTime="19.647112917s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 02:19:44 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:20:08.57872313 +0000 UTC m=+24.525840474" watchObservedRunningTime="2026-06-09 02:20:08.57910004 +0000 UTC m=+24.526217381" Jun 09 02:20:08.696517 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:08.696493 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:20:10.461059 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:10.460993 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fzc2b" Jun 09 02:20:10.461681 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:10.461138 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xfrxz" Jun 09 02:20:10.461681 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:20:10.461128 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fzc2b" podUID="fb1c4057-f500-488c-a3c7-b9013471e88b" Jun 09 02:20:10.461681 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:10.461189 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8gdb7" Jun 09 02:20:10.461681 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:20:10.461259 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8gdb7" podUID="d745eb48-8450-4c3b-8f93-c6ab1f3036a0" Jun 09 02:20:10.461681 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:20:10.461357 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xfrxz" podUID="866bea41-c522-452a-9430-a3461041d710" Jun 09 02:20:10.981133 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:10.980997 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:20:11.081491 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:11.081463 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:20:11.570053 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:11.570019 2573 generic.go:356] "Generic (PLEG): container finished" podID="9ee7881a-36ac-45e4-80a2-d3fbdf30e2ae" containerID="4d6dabe979a04362643f1083beaf4ccb032d3cb003e2d2649fc5529366bce03c" exitCode=0 Jun 09 02:20:11.570682 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:11.570111 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c4qzg" event={"ID":"9ee7881a-36ac-45e4-80a2-d3fbdf30e2ae","Type":"ContainerDied","Data":"4d6dabe979a04362643f1083beaf4ccb032d3cb003e2d2649fc5529366bce03c"} Jun 09 02:20:11.574132 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:11.574114 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jz2q7_37e9e0fa-4abd-4eeb-8671-934808ecdf78/ovn-acl-logging/0.log" Jun 09 02:20:11.574556 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:11.574527 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jz2q7" event={"ID":"37e9e0fa-4abd-4eeb-8671-934808ecdf78","Type":"ContainerStarted","Data":"31e937f25226c4cb9bd0b16a9b35f6adf0d926d27a54d5c5689c65e5dfb0e9f5"} Jun 09 02:20:11.574827 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:11.574802 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jz2q7" Jun 09 02:20:11.574953 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:11.574863 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jz2q7" Jun 09 02:20:11.575038 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:11.575018 2573 scope.go:117] "RemoveContainer" containerID="e0dd9d8cbf7d9fa4f89e84bfd95e1be04b4d69cc2f27b9d7c073f1806f254d34" Jun 09 02:20:11.591760 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:11.591741 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jz2q7" Jun 09 02:20:12.461027 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:12.460967 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xfrxz" Jun 09 02:20:12.461256 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:12.460970 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8gdb7" Jun 09 02:20:12.461256 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:12.460970 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fzc2b" Jun 09 02:20:12.461337 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:20:12.461246 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8gdb7" podUID="d745eb48-8450-4c3b-8f93-c6ab1f3036a0" Jun 09 02:20:12.461337 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:20:12.461259 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fzc2b" podUID="fb1c4057-f500-488c-a3c7-b9013471e88b" Jun 09 02:20:12.461337 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:20:12.461092 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xfrxz" podUID="866bea41-c522-452a-9430-a3461041d710" Jun 09 02:20:12.581311 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:12.581286 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jz2q7_37e9e0fa-4abd-4eeb-8671-934808ecdf78/ovn-acl-logging/0.log" Jun 09 02:20:12.581756 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:12.581716 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jz2q7" event={"ID":"37e9e0fa-4abd-4eeb-8671-934808ecdf78","Type":"ContainerStarted","Data":"2da00e0161e770d3a16d5baef865561d9a389ff49708ca75341b052c356c6b6d"} Jun 09 02:20:12.582062 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:12.582038 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jz2q7" Jun 09 02:20:12.584268 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:12.584243 2573 generic.go:356] "Generic (PLEG): container finished" podID="9ee7881a-36ac-45e4-80a2-d3fbdf30e2ae" containerID="0f65a665416421903a7c7939c384acad9a0cf227307869d9e2f39f0540bf835f" exitCode=0 Jun 09 02:20:12.584372 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:12.584277 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c4qzg" event={"ID":"9ee7881a-36ac-45e4-80a2-d3fbdf30e2ae","Type":"ContainerDied","Data":"0f65a665416421903a7c7939c384acad9a0cf227307869d9e2f39f0540bf835f"} Jun 09 02:20:12.598583 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:12.598559 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jz2q7" Jun 09 02:20:12.610607 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:12.610567 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-jz2q7" podStartSLOduration=10.740023722 podStartE2EDuration="28.610555623s" totalImagesPullingTime="17.870531901s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 02:19:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:20:12.60899006 +0000 UTC m=+28.556107441" watchObservedRunningTime="2026-06-09 02:20:12.610555623 +0000 UTC m=+28.557672971" Jun 09 02:20:12.824999 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:12.824966 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8gdb7"] Jun 09 02:20:12.825125 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:12.825111 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8gdb7" Jun 09 02:20:12.825222 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:20:12.825204 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8gdb7" podUID="d745eb48-8450-4c3b-8f93-c6ab1f3036a0" Jun 09 02:20:12.828150 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:12.828127 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xfrxz"] Jun 09 02:20:12.828242 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:12.828229 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xfrxz" Jun 09 02:20:12.828343 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:20:12.828321 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xfrxz" podUID="866bea41-c522-452a-9430-a3461041d710" Jun 09 02:20:12.828889 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:12.828867 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-fzc2b"] Jun 09 02:20:12.828972 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:12.828964 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fzc2b" Jun 09 02:20:12.829090 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:20:12.829050 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fzc2b" podUID="fb1c4057-f500-488c-a3c7-b9013471e88b" Jun 09 02:20:13.589308 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:13.589273 2573 generic.go:356] "Generic (PLEG): container finished" podID="9ee7881a-36ac-45e4-80a2-d3fbdf30e2ae" containerID="4d2ead0781fda8ccc0e52548d3cc3c49a1bd0cd974561c14a62c74e817df5485" exitCode=0 Jun 09 02:20:13.589727 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:13.589375 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c4qzg" event={"ID":"9ee7881a-36ac-45e4-80a2-d3fbdf30e2ae","Type":"ContainerDied","Data":"4d2ead0781fda8ccc0e52548d3cc3c49a1bd0cd974561c14a62c74e817df5485"} Jun 09 02:20:13.875346 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:13.875277 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:20:13.929801 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:13.929772 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:20:14.464050 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:14.464008 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8gdb7" Jun 09 02:20:14.465221 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:14.464313 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fzc2b" Jun 09 02:20:14.465221 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:20:14.464670 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8gdb7" podUID="d745eb48-8450-4c3b-8f93-c6ab1f3036a0" Jun 09 02:20:14.465402 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:20:14.465248 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fzc2b" podUID="fb1c4057-f500-488c-a3c7-b9013471e88b" Jun 09 02:20:14.465944 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:14.465922 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xfrxz" Jun 09 02:20:14.466113 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:20:14.466064 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xfrxz" podUID="866bea41-c522-452a-9430-a3461041d710" Jun 09 02:20:16.460879 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:16.460663 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fzc2b" Jun 09 02:20:16.461420 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:16.460663 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8gdb7" Jun 09 02:20:16.461420 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:20:16.460966 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fzc2b" podUID="fb1c4057-f500-488c-a3c7-b9013471e88b" Jun 09 02:20:16.461420 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:16.460718 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xfrxz" Jun 09 02:20:16.461420 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:20:16.461029 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8gdb7" podUID="d745eb48-8450-4c3b-8f93-c6ab1f3036a0" Jun 09 02:20:16.461420 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:20:16.461172 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xfrxz" podUID="866bea41-c522-452a-9430-a3461041d710" Jun 09 02:20:16.728338 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:16.728263 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:20:16.828356 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:16.828319 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:20:18.169296 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:18.169258 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d745eb48-8450-4c3b-8f93-c6ab1f3036a0-original-pull-secret\") pod \"global-pull-secret-syncer-8gdb7\" (UID: \"d745eb48-8450-4c3b-8f93-c6ab1f3036a0\") " pod="kube-system/global-pull-secret-syncer-8gdb7" Jun 09 02:20:18.169745 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:20:18.169375 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 02:20:18.169745 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:20:18.169433 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d745eb48-8450-4c3b-8f93-c6ab1f3036a0-original-pull-secret podName:d745eb48-8450-4c3b-8f93-c6ab1f3036a0 nodeName:}" failed. No retries permitted until 2026-06-09 02:20:50.16941806 +0000 UTC m=+66.116535382 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d745eb48-8450-4c3b-8f93-c6ab1f3036a0-original-pull-secret") pod "global-pull-secret-syncer-8gdb7" (UID: "d745eb48-8450-4c3b-8f93-c6ab1f3036a0") : object "kube-system"/"original-pull-secret" not registered Jun 09 02:20:18.269801 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:18.269775 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/866bea41-c522-452a-9430-a3461041d710-metrics-certs\") pod \"network-metrics-daemon-xfrxz\" (UID: \"866bea41-c522-452a-9430-a3461041d710\") " pod="openshift-multus/network-metrics-daemon-xfrxz" Jun 09 02:20:18.269911 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:20:18.269895 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 02:20:18.269959 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:20:18.269948 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/866bea41-c522-452a-9430-a3461041d710-metrics-certs podName:866bea41-c522-452a-9430-a3461041d710 nodeName:}" failed. No retries permitted until 2026-06-09 02:20:50.269931255 +0000 UTC m=+66.217048591 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/866bea41-c522-452a-9430-a3461041d710-metrics-certs") pod "network-metrics-daemon-xfrxz" (UID: "866bea41-c522-452a-9430-a3461041d710") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 02:20:18.370553 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:18.370525 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wj75\" (UniqueName: \"kubernetes.io/projected/fb1c4057-f500-488c-a3c7-b9013471e88b-kube-api-access-2wj75\") pod \"network-check-target-fzc2b\" (UID: \"fb1c4057-f500-488c-a3c7-b9013471e88b\") " pod="openshift-network-diagnostics/network-check-target-fzc2b" Jun 09 02:20:18.370662 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:20:18.370637 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 02:20:18.370662 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:20:18.370650 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 02:20:18.370662 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:20:18.370659 2573 projected.go:196] Error preparing data for projected volume kube-api-access-2wj75 for pod openshift-network-diagnostics/network-check-target-fzc2b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 02:20:18.370798 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:20:18.370705 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fb1c4057-f500-488c-a3c7-b9013471e88b-kube-api-access-2wj75 podName:fb1c4057-f500-488c-a3c7-b9013471e88b nodeName:}" failed. No retries permitted until 2026-06-09 02:20:50.370692669 +0000 UTC m=+66.317809991 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-2wj75" (UniqueName: "kubernetes.io/projected/fb1c4057-f500-488c-a3c7-b9013471e88b-kube-api-access-2wj75") pod "network-check-target-fzc2b" (UID: "fb1c4057-f500-488c-a3c7-b9013471e88b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 02:20:18.464562 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:18.464512 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xfrxz" Jun 09 02:20:18.464683 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:18.464606 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8gdb7" Jun 09 02:20:18.464683 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:18.464617 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fzc2b" Jun 09 02:20:18.464772 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:20:18.464605 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xfrxz" podUID="866bea41-c522-452a-9430-a3461041d710" Jun 09 02:20:18.464772 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:20:18.464694 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8gdb7" podUID="d745eb48-8450-4c3b-8f93-c6ab1f3036a0" Jun 09 02:20:18.464772 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:20:18.464752 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fzc2b" podUID="fb1c4057-f500-488c-a3c7-b9013471e88b" Jun 09 02:20:18.601999 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:18.601971 2573 generic.go:356] "Generic (PLEG): container finished" podID="9ee7881a-36ac-45e4-80a2-d3fbdf30e2ae" containerID="94a77a8c9b971178de4ead114c03aa44eebe85b510026b3d9d58e3fc0b2715a9" exitCode=0 Jun 09 02:20:18.602122 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:18.602030 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c4qzg" event={"ID":"9ee7881a-36ac-45e4-80a2-d3fbdf30e2ae","Type":"ContainerDied","Data":"94a77a8c9b971178de4ead114c03aa44eebe85b510026b3d9d58e3fc0b2715a9"} Jun 09 02:20:19.391321 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:19.391296 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-102.ec2.internal" event="NodeReady" Jun 09 02:20:19.391836 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:19.391397 2573 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 09 02:20:19.432186 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:19.432155 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-r5vqq"] Jun 09 02:20:19.447460 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:19.447439 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-hzfpk"] Jun 09 02:20:19.447590 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:19.447569 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-r5vqq" Jun 09 02:20:19.449827 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:19.449803 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 09 02:20:19.449938 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:19.449827 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 09 02:20:19.449938 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:19.449852 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5xqfr\"" Jun 09 02:20:19.458311 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:19.458293 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hzfpk"] Jun 09 02:20:19.458398 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:19.458318 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-r5vqq"] Jun 09 02:20:19.458441 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:19.458398 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hzfpk" Jun 09 02:20:19.460421 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:19.460400 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 09 02:20:19.460567 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:19.460547 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-5dvgs\"" Jun 09 02:20:19.460703 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:19.460547 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 09 02:20:19.460703 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:19.460557 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 09 02:20:19.535495 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:19.535454 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:20:19.580356 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:19.580331 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szh2l\" (UniqueName: \"kubernetes.io/projected/7d40cc8c-039c-4f1a-9460-f601e7d4b00d-kube-api-access-szh2l\") pod \"ingress-canary-hzfpk\" (UID: \"7d40cc8c-039c-4f1a-9460-f601e7d4b00d\") " pod="openshift-ingress-canary/ingress-canary-hzfpk" Jun 09 02:20:19.580430 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:19.580364 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9c20a1c4-e1eb-4851-8379-b0138b0a1389-metrics-tls\") pod \"dns-default-r5vqq\" (UID: \"9c20a1c4-e1eb-4851-8379-b0138b0a1389\") " pod="openshift-dns/dns-default-r5vqq" Jun 09 02:20:19.580430 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:19.580381 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nj4hx\" (UniqueName: \"kubernetes.io/projected/9c20a1c4-e1eb-4851-8379-b0138b0a1389-kube-api-access-nj4hx\") pod \"dns-default-r5vqq\" (UID: \"9c20a1c4-e1eb-4851-8379-b0138b0a1389\") " pod="openshift-dns/dns-default-r5vqq" Jun 09 02:20:19.580430 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:19.580399 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7d40cc8c-039c-4f1a-9460-f601e7d4b00d-cert\") pod \"ingress-canary-hzfpk\" (UID: \"7d40cc8c-039c-4f1a-9460-f601e7d4b00d\") " pod="openshift-ingress-canary/ingress-canary-hzfpk" Jun 09 02:20:19.580534 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:19.580487 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c20a1c4-e1eb-4851-8379-b0138b0a1389-tmp-dir\") pod \"dns-default-r5vqq\" (UID: \"9c20a1c4-e1eb-4851-8379-b0138b0a1389\") " pod="openshift-dns/dns-default-r5vqq" Jun 09 02:20:19.580534 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:19.580528 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9c20a1c4-e1eb-4851-8379-b0138b0a1389-config-volume\") pod \"dns-default-r5vqq\" (UID: \"9c20a1c4-e1eb-4851-8379-b0138b0a1389\") " pod="openshift-dns/dns-default-r5vqq" Jun 09 02:20:19.584255 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:19.584231 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:20:19.607530 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:19.607503 2573 generic.go:356] "Generic (PLEG): container finished" podID="9ee7881a-36ac-45e4-80a2-d3fbdf30e2ae" containerID="ec42a452159cb34be8c5eea21ee2a1813b5b5c3d82ee9343d6994176b5204889" exitCode=0 Jun 09 02:20:19.607604 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:19.607559 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c4qzg" event={"ID":"9ee7881a-36ac-45e4-80a2-d3fbdf30e2ae","Type":"ContainerDied","Data":"ec42a452159cb34be8c5eea21ee2a1813b5b5c3d82ee9343d6994176b5204889"} Jun 09 02:20:19.681242 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:19.681220 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7d40cc8c-039c-4f1a-9460-f601e7d4b00d-cert\") pod \"ingress-canary-hzfpk\" (UID: \"7d40cc8c-039c-4f1a-9460-f601e7d4b00d\") " pod="openshift-ingress-canary/ingress-canary-hzfpk" Jun 09 02:20:19.681334 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:19.681261 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c20a1c4-e1eb-4851-8379-b0138b0a1389-tmp-dir\") pod \"dns-default-r5vqq\" (UID: \"9c20a1c4-e1eb-4851-8379-b0138b0a1389\") " pod="openshift-dns/dns-default-r5vqq" Jun 09 02:20:19.681334 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:19.681280 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9c20a1c4-e1eb-4851-8379-b0138b0a1389-config-volume\") pod \"dns-default-r5vqq\" (UID: \"9c20a1c4-e1eb-4851-8379-b0138b0a1389\") " pod="openshift-dns/dns-default-r5vqq" Jun 09 02:20:19.681438 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:19.681370 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-szh2l\" (UniqueName: \"kubernetes.io/projected/7d40cc8c-039c-4f1a-9460-f601e7d4b00d-kube-api-access-szh2l\") pod \"ingress-canary-hzfpk\" (UID: \"7d40cc8c-039c-4f1a-9460-f601e7d4b00d\") " pod="openshift-ingress-canary/ingress-canary-hzfpk" Jun 09 02:20:19.681438 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:19.681414 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9c20a1c4-e1eb-4851-8379-b0138b0a1389-metrics-tls\") pod \"dns-default-r5vqq\" (UID: \"9c20a1c4-e1eb-4851-8379-b0138b0a1389\") " pod="openshift-dns/dns-default-r5vqq" Jun 09 02:20:19.681539 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:19.681441 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nj4hx\" (UniqueName: \"kubernetes.io/projected/9c20a1c4-e1eb-4851-8379-b0138b0a1389-kube-api-access-nj4hx\") pod \"dns-default-r5vqq\" (UID: \"9c20a1c4-e1eb-4851-8379-b0138b0a1389\") " pod="openshift-dns/dns-default-r5vqq" Jun 09 02:20:19.681589 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:20:19.681534 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 02:20:19.681639 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:20:19.681603 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c20a1c4-e1eb-4851-8379-b0138b0a1389-metrics-tls podName:9c20a1c4-e1eb-4851-8379-b0138b0a1389 nodeName:}" failed. No retries permitted until 2026-06-09 02:20:20.181584881 +0000 UTC m=+36.128702230 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9c20a1c4-e1eb-4851-8379-b0138b0a1389-metrics-tls") pod "dns-default-r5vqq" (UID: "9c20a1c4-e1eb-4851-8379-b0138b0a1389") : secret "dns-default-metrics-tls" not found Jun 09 02:20:19.681804 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:19.681786 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9c20a1c4-e1eb-4851-8379-b0138b0a1389-config-volume\") pod \"dns-default-r5vqq\" (UID: \"9c20a1c4-e1eb-4851-8379-b0138b0a1389\") " pod="openshift-dns/dns-default-r5vqq" Jun 09 02:20:19.681804 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:19.681792 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c20a1c4-e1eb-4851-8379-b0138b0a1389-tmp-dir\") pod \"dns-default-r5vqq\" (UID: \"9c20a1c4-e1eb-4851-8379-b0138b0a1389\") " pod="openshift-dns/dns-default-r5vqq" Jun 09 02:20:19.685184 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:19.685159 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7d40cc8c-039c-4f1a-9460-f601e7d4b00d-cert\") pod \"ingress-canary-hzfpk\" (UID: \"7d40cc8c-039c-4f1a-9460-f601e7d4b00d\") " pod="openshift-ingress-canary/ingress-canary-hzfpk" Jun 09 02:20:19.689619 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:19.689599 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nj4hx\" (UniqueName: \"kubernetes.io/projected/9c20a1c4-e1eb-4851-8379-b0138b0a1389-kube-api-access-nj4hx\") pod \"dns-default-r5vqq\" (UID: \"9c20a1c4-e1eb-4851-8379-b0138b0a1389\") " pod="openshift-dns/dns-default-r5vqq" Jun 09 02:20:19.689693 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:19.689657 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-szh2l\" (UniqueName: \"kubernetes.io/projected/7d40cc8c-039c-4f1a-9460-f601e7d4b00d-kube-api-access-szh2l\") pod \"ingress-canary-hzfpk\" (UID: \"7d40cc8c-039c-4f1a-9460-f601e7d4b00d\") " pod="openshift-ingress-canary/ingress-canary-hzfpk" Jun 09 02:20:19.768523 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:19.768506 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hzfpk" Jun 09 02:20:19.944333 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:19.944197 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hzfpk"] Jun 09 02:20:19.947786 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:20:19.947760 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d40cc8c_039c_4f1a_9460_f601e7d4b00d.slice/crio-14ad610a03a08c968a411e97958760b91b4866f1d4203eff2cbf999b20efb0c5 WatchSource:0}: Error finding container 14ad610a03a08c968a411e97958760b91b4866f1d4203eff2cbf999b20efb0c5: Status 404 returned error can't find the container with id 14ad610a03a08c968a411e97958760b91b4866f1d4203eff2cbf999b20efb0c5 Jun 09 02:20:20.184477 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:20.184429 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9c20a1c4-e1eb-4851-8379-b0138b0a1389-metrics-tls\") pod \"dns-default-r5vqq\" (UID: \"9c20a1c4-e1eb-4851-8379-b0138b0a1389\") " pod="openshift-dns/dns-default-r5vqq" Jun 09 02:20:20.184591 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:20:20.184567 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 02:20:20.184634 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:20:20.184619 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c20a1c4-e1eb-4851-8379-b0138b0a1389-metrics-tls podName:9c20a1c4-e1eb-4851-8379-b0138b0a1389 nodeName:}" failed. No retries permitted until 2026-06-09 02:20:21.184604584 +0000 UTC m=+37.131721909 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9c20a1c4-e1eb-4851-8379-b0138b0a1389-metrics-tls") pod "dns-default-r5vqq" (UID: "9c20a1c4-e1eb-4851-8379-b0138b0a1389") : secret "dns-default-metrics-tls" not found Jun 09 02:20:20.465426 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:20.465364 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fzc2b" Jun 09 02:20:20.465956 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:20.465471 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8gdb7" Jun 09 02:20:20.465956 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:20.465486 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xfrxz" Jun 09 02:20:20.467751 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:20.467733 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 09 02:20:20.468698 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:20.468676 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-cv87r\"" Jun 09 02:20:20.468793 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:20.468709 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 09 02:20:20.468793 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:20.468750 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-tmz9z\"" Jun 09 02:20:20.468899 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:20.468865 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 09 02:20:20.468968 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:20.468947 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 09 02:20:20.613565 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:20.613531 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c4qzg" event={"ID":"9ee7881a-36ac-45e4-80a2-d3fbdf30e2ae","Type":"ContainerStarted","Data":"cf42b2cf024ca33e9de0471f9116f7220378e4aa24a6f655e2dc3f34c6894dba"} Jun 09 02:20:20.614677 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:20.614654 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hzfpk" event={"ID":"7d40cc8c-039c-4f1a-9460-f601e7d4b00d","Type":"ContainerStarted","Data":"14ad610a03a08c968a411e97958760b91b4866f1d4203eff2cbf999b20efb0c5"} Jun 09 02:20:20.635025 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:20.634935 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-c4qzg" podStartSLOduration=9.335051825 podStartE2EDuration="36.634916929s" totalImagesPullingTime="27.299865104s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 02:19:44 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:20:20.633404367 +0000 UTC m=+36.580521710" watchObservedRunningTime="2026-06-09 02:20:20.634916929 +0000 UTC m=+36.582034270" Jun 09 02:20:20.753295 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:20.753224 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:20:20.855404 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:20.855357 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:20:21.192131 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:21.192101 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9c20a1c4-e1eb-4851-8379-b0138b0a1389-metrics-tls\") pod \"dns-default-r5vqq\" (UID: \"9c20a1c4-e1eb-4851-8379-b0138b0a1389\") " pod="openshift-dns/dns-default-r5vqq" Jun 09 02:20:21.192281 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:20:21.192263 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 02:20:21.192399 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:20:21.192333 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c20a1c4-e1eb-4851-8379-b0138b0a1389-metrics-tls podName:9c20a1c4-e1eb-4851-8379-b0138b0a1389 nodeName:}" failed. No retries permitted until 2026-06-09 02:20:23.192318621 +0000 UTC m=+39.139435942 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9c20a1c4-e1eb-4851-8379-b0138b0a1389-metrics-tls") pod "dns-default-r5vqq" (UID: "9c20a1c4-e1eb-4851-8379-b0138b0a1389") : secret "dns-default-metrics-tls" not found Jun 09 02:20:22.620568 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:22.620372 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hzfpk" event={"ID":"7d40cc8c-039c-4f1a-9460-f601e7d4b00d","Type":"ContainerStarted","Data":"afe9f6e7e3df2f511821b964e091af437668ba8224580b5adf868729f2479f2c"} Jun 09 02:20:22.634108 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:22.634046 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-hzfpk" podStartSLOduration=1.5059322640000001 podStartE2EDuration="3.634033296s" totalImagesPullingTime="2.128101032s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:20:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:20:22.633849997 +0000 UTC m=+38.580967341" watchObservedRunningTime="2026-06-09 02:20:22.634033296 +0000 UTC m=+38.581150638" Jun 09 02:20:23.208363 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:23.208334 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9c20a1c4-e1eb-4851-8379-b0138b0a1389-metrics-tls\") pod \"dns-default-r5vqq\" (UID: \"9c20a1c4-e1eb-4851-8379-b0138b0a1389\") " pod="openshift-dns/dns-default-r5vqq" Jun 09 02:20:23.208532 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:20:23.208480 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 02:20:23.208581 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:20:23.208546 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c20a1c4-e1eb-4851-8379-b0138b0a1389-metrics-tls podName:9c20a1c4-e1eb-4851-8379-b0138b0a1389 nodeName:}" failed. No retries permitted until 2026-06-09 02:20:27.208531387 +0000 UTC m=+43.155648708 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9c20a1c4-e1eb-4851-8379-b0138b0a1389-metrics-tls") pod "dns-default-r5vqq" (UID: "9c20a1c4-e1eb-4851-8379-b0138b0a1389") : secret "dns-default-metrics-tls" not found Jun 09 02:20:23.455448 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:23.455420 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:20:25.243675 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:25.243622 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:20:25.344029 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:25.343996 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:20:26.227655 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:26.227617 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:20:26.326151 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:26.326123 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:20:27.237939 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:27.237912 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9c20a1c4-e1eb-4851-8379-b0138b0a1389-metrics-tls\") pod \"dns-default-r5vqq\" (UID: \"9c20a1c4-e1eb-4851-8379-b0138b0a1389\") " pod="openshift-dns/dns-default-r5vqq" Jun 09 02:20:27.238111 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:20:27.238088 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 02:20:27.238172 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:20:27.238155 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c20a1c4-e1eb-4851-8379-b0138b0a1389-metrics-tls podName:9c20a1c4-e1eb-4851-8379-b0138b0a1389 nodeName:}" failed. No retries permitted until 2026-06-09 02:20:35.238139234 +0000 UTC m=+51.185256560 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9c20a1c4-e1eb-4851-8379-b0138b0a1389-metrics-tls") pod "dns-default-r5vqq" (UID: "9c20a1c4-e1eb-4851-8379-b0138b0a1389") : secret "dns-default-metrics-tls" not found Jun 09 02:20:33.959349 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:33.959304 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:20:34.059440 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:34.059404 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:20:35.284520 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:35.284481 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9c20a1c4-e1eb-4851-8379-b0138b0a1389-metrics-tls\") pod \"dns-default-r5vqq\" (UID: \"9c20a1c4-e1eb-4851-8379-b0138b0a1389\") " pod="openshift-dns/dns-default-r5vqq" Jun 09 02:20:35.284914 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:20:35.284627 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 02:20:35.284914 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:20:35.284713 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c20a1c4-e1eb-4851-8379-b0138b0a1389-metrics-tls podName:9c20a1c4-e1eb-4851-8379-b0138b0a1389 nodeName:}" failed. No retries permitted until 2026-06-09 02:20:51.284685431 +0000 UTC m=+67.231802752 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9c20a1c4-e1eb-4851-8379-b0138b0a1389-metrics-tls") pod "dns-default-r5vqq" (UID: "9c20a1c4-e1eb-4851-8379-b0138b0a1389") : secret "dns-default-metrics-tls" not found Jun 09 02:20:38.077685 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:38.077656 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:20:40.302582 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:40.302544 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:20:40.351316 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:40.351294 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:20:42.255065 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:42.255030 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:20:42.356028 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:42.355992 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:20:44.602185 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:44.602160 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jz2q7" Jun 09 02:20:44.747725 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:44.747693 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:20:44.847695 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:44.847657 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:20:50.190016 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:50.189981 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d745eb48-8450-4c3b-8f93-c6ab1f3036a0-original-pull-secret\") pod \"global-pull-secret-syncer-8gdb7\" (UID: \"d745eb48-8450-4c3b-8f93-c6ab1f3036a0\") " pod="kube-system/global-pull-secret-syncer-8gdb7" Jun 09 02:20:50.193107 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:50.193066 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 09 02:20:50.204186 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:50.204159 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d745eb48-8450-4c3b-8f93-c6ab1f3036a0-original-pull-secret\") pod \"global-pull-secret-syncer-8gdb7\" (UID: \"d745eb48-8450-4c3b-8f93-c6ab1f3036a0\") " pod="kube-system/global-pull-secret-syncer-8gdb7" Jun 09 02:20:50.290959 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:50.290929 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/866bea41-c522-452a-9430-a3461041d710-metrics-certs\") pod \"network-metrics-daemon-xfrxz\" (UID: \"866bea41-c522-452a-9430-a3461041d710\") " pod="openshift-multus/network-metrics-daemon-xfrxz" Jun 09 02:20:50.293412 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:50.293395 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 09 02:20:50.301082 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:20:50.301058 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 02:20:50.301143 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:20:50.301130 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/866bea41-c522-452a-9430-a3461041d710-metrics-certs podName:866bea41-c522-452a-9430-a3461041d710 nodeName:}" failed. No retries permitted until 2026-06-09 02:21:54.301112521 +0000 UTC m=+130.248229846 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/866bea41-c522-452a-9430-a3461041d710-metrics-certs") pod "network-metrics-daemon-xfrxz" (UID: "866bea41-c522-452a-9430-a3461041d710") : secret "metrics-daemon-secret" not found Jun 09 02:20:50.391136 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:50.391110 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wj75\" (UniqueName: \"kubernetes.io/projected/fb1c4057-f500-488c-a3c7-b9013471e88b-kube-api-access-2wj75\") pod \"network-check-target-fzc2b\" (UID: \"fb1c4057-f500-488c-a3c7-b9013471e88b\") " pod="openshift-network-diagnostics/network-check-target-fzc2b" Jun 09 02:20:50.393664 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:50.393647 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 09 02:20:50.403575 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:50.403556 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 09 02:20:50.414226 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:50.414206 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wj75\" (UniqueName: \"kubernetes.io/projected/fb1c4057-f500-488c-a3c7-b9013471e88b-kube-api-access-2wj75\") pod \"network-check-target-fzc2b\" (UID: \"fb1c4057-f500-488c-a3c7-b9013471e88b\") " pod="openshift-network-diagnostics/network-check-target-fzc2b" Jun 09 02:20:50.480216 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:50.480163 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-tmz9z\"" Jun 09 02:20:50.484056 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:50.484040 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8gdb7" Jun 09 02:20:50.488745 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:50.488720 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fzc2b" Jun 09 02:20:50.611345 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:50.611313 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8gdb7"] Jun 09 02:20:50.614358 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:20:50.614333 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd745eb48_8450_4c3b_8f93_c6ab1f3036a0.slice/crio-76e828bc2fe794fc1788b3cd37f11b45068eef7bbddbefdbf059f891601b0543 WatchSource:0}: Error finding container 76e828bc2fe794fc1788b3cd37f11b45068eef7bbddbefdbf059f891601b0543: Status 404 returned error can't find the container with id 76e828bc2fe794fc1788b3cd37f11b45068eef7bbddbefdbf059f891601b0543 Jun 09 02:20:50.624036 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:50.624016 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-fzc2b"] Jun 09 02:20:50.626782 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:20:50.626761 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb1c4057_f500_488c_a3c7_b9013471e88b.slice/crio-bf19b19e3757d677265854213f6eb16ff3989444d6ad3da211d78782b509d51c WatchSource:0}: Error finding container bf19b19e3757d677265854213f6eb16ff3989444d6ad3da211d78782b509d51c: Status 404 returned error can't find the container with id bf19b19e3757d677265854213f6eb16ff3989444d6ad3da211d78782b509d51c Jun 09 02:20:50.680053 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:50.680022 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-fzc2b" event={"ID":"fb1c4057-f500-488c-a3c7-b9013471e88b","Type":"ContainerStarted","Data":"bf19b19e3757d677265854213f6eb16ff3989444d6ad3da211d78782b509d51c"} Jun 09 02:20:50.680994 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:50.680971 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8gdb7" event={"ID":"d745eb48-8450-4c3b-8f93-c6ab1f3036a0","Type":"ContainerStarted","Data":"76e828bc2fe794fc1788b3cd37f11b45068eef7bbddbefdbf059f891601b0543"} Jun 09 02:20:51.297920 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:51.297855 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9c20a1c4-e1eb-4851-8379-b0138b0a1389-metrics-tls\") pod \"dns-default-r5vqq\" (UID: \"9c20a1c4-e1eb-4851-8379-b0138b0a1389\") " pod="openshift-dns/dns-default-r5vqq" Jun 09 02:20:51.298356 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:20:51.297985 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 02:20:51.298356 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:20:51.298052 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c20a1c4-e1eb-4851-8379-b0138b0a1389-metrics-tls podName:9c20a1c4-e1eb-4851-8379-b0138b0a1389 nodeName:}" failed. No retries permitted until 2026-06-09 02:21:23.298030505 +0000 UTC m=+99.245147839 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9c20a1c4-e1eb-4851-8379-b0138b0a1389-metrics-tls") pod "dns-default-r5vqq" (UID: "9c20a1c4-e1eb-4851-8379-b0138b0a1389") : secret "dns-default-metrics-tls" not found Jun 09 02:20:55.695771 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:55.695725 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-fzc2b" event={"ID":"fb1c4057-f500-488c-a3c7-b9013471e88b","Type":"ContainerStarted","Data":"d5e79d62106016fa016a4163a4257c47e748c1cdc039e448fe9d117af5604634"} Jun 09 02:20:55.696279 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:55.695876 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-fzc2b" Jun 09 02:20:55.697549 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:55.697520 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8gdb7" event={"ID":"d745eb48-8450-4c3b-8f93-c6ab1f3036a0","Type":"ContainerStarted","Data":"4f3d614b9c052d4fc3b0d14d769e19f122fb0de9923b99c1a0cdb565b8d4b42a"} Jun 09 02:20:55.711047 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:55.711000 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-fzc2b" podStartSLOduration=67.633005334 podStartE2EDuration="1m11.710987138s" totalImagesPullingTime="4.077981804s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:19:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:20:55.709608706 +0000 UTC m=+71.656726048" watchObservedRunningTime="2026-06-09 02:20:55.710987138 +0000 UTC m=+71.658104482" Jun 09 02:20:55.722308 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:20:55.722266 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-8gdb7" podStartSLOduration=67.628280661 podStartE2EDuration="1m11.722253658s" totalImagesPullingTime="4.093972997s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 02:19:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:20:55.722057643 +0000 UTC m=+71.669174987" watchObservedRunningTime="2026-06-09 02:20:55.722253658 +0000 UTC m=+71.669371001" Jun 09 02:21:04.250149 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:21:04.249999 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:21:04.350962 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:21:04.350928 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:21:04.399139 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:21:04.399107 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:21:23.397409 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:21:23.397377 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9c20a1c4-e1eb-4851-8379-b0138b0a1389-metrics-tls\") pod \"dns-default-r5vqq\" (UID: \"9c20a1c4-e1eb-4851-8379-b0138b0a1389\") " pod="openshift-dns/dns-default-r5vqq" Jun 09 02:21:23.397856 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:21:23.397525 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 02:21:23.397856 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:21:23.397607 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c20a1c4-e1eb-4851-8379-b0138b0a1389-metrics-tls podName:9c20a1c4-e1eb-4851-8379-b0138b0a1389 nodeName:}" failed. No retries permitted until 2026-06-09 02:22:27.397591266 +0000 UTC m=+163.344708587 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9c20a1c4-e1eb-4851-8379-b0138b0a1389-metrics-tls") pod "dns-default-r5vqq" (UID: "9c20a1c4-e1eb-4851-8379-b0138b0a1389") : secret "dns-default-metrics-tls" not found Jun 09 02:21:26.702456 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:21:26.702425 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-fzc2b" Jun 09 02:21:54.393700 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:21:54.393657 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/866bea41-c522-452a-9430-a3461041d710-metrics-certs\") pod \"network-metrics-daemon-xfrxz\" (UID: \"866bea41-c522-452a-9430-a3461041d710\") " pod="openshift-multus/network-metrics-daemon-xfrxz" Jun 09 02:21:54.394307 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:21:54.393851 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 02:21:54.394307 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:21:54.393938 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/866bea41-c522-452a-9430-a3461041d710-metrics-certs podName:866bea41-c522-452a-9430-a3461041d710 nodeName:}" failed. No retries permitted until 2026-06-09 02:23:56.393913901 +0000 UTC m=+252.341031235 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/866bea41-c522-452a-9430-a3461041d710-metrics-certs") pod "network-metrics-daemon-xfrxz" (UID: "866bea41-c522-452a-9430-a3461041d710") : secret "metrics-daemon-secret" not found Jun 09 02:22:22.457085 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:22:22.457030 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-r5vqq" podUID="9c20a1c4-e1eb-4851-8379-b0138b0a1389" Jun 09 02:22:22.878206 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:22.878180 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-r5vqq" Jun 09 02:22:23.489854 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:22:23.489808 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-xfrxz" podUID="866bea41-c522-452a-9430-a3461041d710" Jun 09 02:22:27.494964 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:27.494926 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9c20a1c4-e1eb-4851-8379-b0138b0a1389-metrics-tls\") pod \"dns-default-r5vqq\" (UID: \"9c20a1c4-e1eb-4851-8379-b0138b0a1389\") " pod="openshift-dns/dns-default-r5vqq" Jun 09 02:22:27.495360 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:22:27.495024 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 02:22:27.495360 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:22:27.495097 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c20a1c4-e1eb-4851-8379-b0138b0a1389-metrics-tls podName:9c20a1c4-e1eb-4851-8379-b0138b0a1389 nodeName:}" failed. No retries permitted until 2026-06-09 02:24:29.495069421 +0000 UTC m=+285.442186742 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9c20a1c4-e1eb-4851-8379-b0138b0a1389-metrics-tls") pod "dns-default-r5vqq" (UID: "9c20a1c4-e1eb-4851-8379-b0138b0a1389") : secret "dns-default-metrics-tls" not found Jun 09 02:22:36.460881 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:36.460792 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xfrxz" Jun 09 02:22:48.114651 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:48.114618 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-lrnzj"] Jun 09 02:22:48.116452 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:48.116432 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-lrnzj" Jun 09 02:22:48.118775 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:48.118746 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rhlw9"] Jun 09 02:22:48.119465 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:48.119429 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-tqmxf\"" Jun 09 02:22:48.120703 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:48.120682 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-lpwbs"] Jun 09 02:22:48.120828 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:48.120797 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rhlw9" Jun 09 02:22:48.122464 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:48.122442 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-lpwbs" Jun 09 02:22:48.123204 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:48.123184 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 09 02:22:48.123204 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:48.123193 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 09 02:22:48.123395 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:48.123229 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 09 02:22:48.124340 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:48.123991 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-rkfhl\"" Jun 09 02:22:48.124502 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:48.124478 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 09 02:22:48.125328 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:48.125300 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 09 02:22:48.125451 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:48.125391 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-hwt8x\"" Jun 09 02:22:48.125451 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:48.125437 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 09 02:22:48.125559 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:48.125397 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 09 02:22:48.126245 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:48.126222 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-lrnzj"] Jun 09 02:22:48.135201 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:48.135178 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rhlw9"] Jun 09 02:22:48.135962 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:48.135938 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-lpwbs"] Jun 09 02:22:48.218050 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:48.218023 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-896549976-mqg6m"] Jun 09 02:22:48.222575 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:48.222553 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-9hfq7"] Jun 09 02:22:48.222695 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:48.222677 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-mqg6m" Jun 09 02:22:48.224399 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:48.224382 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-9hfq7" Jun 09 02:22:48.224900 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:48.224879 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 09 02:22:48.225048 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:48.224880 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 09 02:22:48.225048 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:48.224976 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-wcz7j\"" Jun 09 02:22:48.225197 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:48.225182 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 09 02:22:48.225265 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:48.225248 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 09 02:22:48.227638 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:48.227616 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8js26\" (UniqueName: \"kubernetes.io/projected/4fedd3d3-404f-4e0a-b965-c5cc70b36896-kube-api-access-8js26\") pod \"cluster-monitoring-operator-74bbf69bbb-rhlw9\" (UID: \"4fedd3d3-404f-4e0a-b965-c5cc70b36896\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rhlw9" Jun 09 02:22:48.227735 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:48.227679 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdl78\" (UniqueName: \"kubernetes.io/projected/8cb34f2b-056b-4fda-b736-1746249ac279-kube-api-access-sdl78\") pod \"cluster-samples-operator-854f8b96b6-lpwbs\" (UID: \"8cb34f2b-056b-4fda-b736-1746249ac279\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-lpwbs" Jun 09 02:22:48.227800 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:48.227745 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/4fedd3d3-404f-4e0a-b965-c5cc70b36896-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-rhlw9\" (UID: \"4fedd3d3-404f-4e0a-b965-c5cc70b36896\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rhlw9" Jun 09 02:22:48.227800 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:48.227779 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8cb34f2b-056b-4fda-b736-1746249ac279-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-lpwbs\" (UID: \"8cb34f2b-056b-4fda-b736-1746249ac279\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-lpwbs" Jun 09 02:22:48.227800 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:48.227761 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 09 02:22:48.227938 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:48.227834 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m89n4\" (UniqueName: \"kubernetes.io/projected/b932972d-147b-4d1f-97e7-ef3e4720421f-kube-api-access-m89n4\") pod \"network-check-source-dbd9cf844-lrnzj\" (UID: \"b932972d-147b-4d1f-97e7-ef3e4720421f\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-lrnzj" Jun 09 02:22:48.227938 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:48.227888 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4fedd3d3-404f-4e0a-b965-c5cc70b36896-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-rhlw9\" (UID: \"4fedd3d3-404f-4e0a-b965-c5cc70b36896\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rhlw9" Jun 09 02:22:48.228050 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:48.228034 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 09 02:22:48.228218 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:48.228199 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 09 02:22:48.228325 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:48.228302 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-kppwf\"" Jun 09 02:22:48.228665 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:48.228643 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 09 02:22:48.232859 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:48.232842 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 09 02:22:48.233576 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:48.233557 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 09 02:22:48.237335 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:48.237316 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-mqg6m"] Jun 09 02:22:48.238279 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:48.238259 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-9hfq7"] Jun 09 02:22:48.314742 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:48.314724 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-sbmsx"] Jun 09 02:22:48.316580 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:48.316564 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-sbmsx" Jun 09 02:22:48.318713 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:48.318699 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 09 02:22:48.318791 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:48.318777 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 09 02:22:48.318854 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:48.318834 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-g5dkg\"" Jun 09 02:22:48.325831 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:48.325813 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-sbmsx"] Jun 09 02:22:48.328221 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:48.328202 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/4fedd3d3-404f-4e0a-b965-c5cc70b36896-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-rhlw9\" (UID: \"4fedd3d3-404f-4e0a-b965-c5cc70b36896\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rhlw9" Jun 09 02:22:48.328311 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:48.328227 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8cb34f2b-056b-4fda-b736-1746249ac279-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-lpwbs\" (UID: \"8cb34f2b-056b-4fda-b736-1746249ac279\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-lpwbs" Jun 09 02:22:48.328311 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:48.328253 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/41d0740b-ac9d-47bd-92c3-8c89c459ae7c-serving-cert\") pod \"console-operator-668fdbf85c-9hfq7\" (UID: \"41d0740b-ac9d-47bd-92c3-8c89c459ae7c\") " pod="openshift-console-operator/console-operator-668fdbf85c-9hfq7" Jun 09 02:22:48.328311 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:48.328267 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ksvh\" (UniqueName: \"kubernetes.io/projected/41d0740b-ac9d-47bd-92c3-8c89c459ae7c-kube-api-access-7ksvh\") pod \"console-operator-668fdbf85c-9hfq7\" (UID: \"41d0740b-ac9d-47bd-92c3-8c89c459ae7c\") " pod="openshift-console-operator/console-operator-668fdbf85c-9hfq7" Jun 09 02:22:48.328311 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:48.328293 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m89n4\" (UniqueName: \"kubernetes.io/projected/b932972d-147b-4d1f-97e7-ef3e4720421f-kube-api-access-m89n4\") pod \"network-check-source-dbd9cf844-lrnzj\" (UID: \"b932972d-147b-4d1f-97e7-ef3e4720421f\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-lrnzj" Jun 09 02:22:48.328519 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:48.328315 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/5d258435-31f4-4819-82bd-85477f02a5e5-snapshots\") pod \"insights-operator-896549976-mqg6m\" (UID: \"5d258435-31f4-4819-82bd-85477f02a5e5\") " pod="openshift-insights/insights-operator-896549976-mqg6m" Jun 09 02:22:48.328519 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:48.328342 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/41d0740b-ac9d-47bd-92c3-8c89c459ae7c-trusted-ca\") pod \"console-operator-668fdbf85c-9hfq7\" (UID: \"41d0740b-ac9d-47bd-92c3-8c89c459ae7c\") " pod="openshift-console-operator/console-operator-668fdbf85c-9hfq7" Jun 09 02:22:48.328519 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:22:48.328351 2573 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 09 02:22:48.328519 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:48.328364 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d258435-31f4-4819-82bd-85477f02a5e5-service-ca-bundle\") pod \"insights-operator-896549976-mqg6m\" (UID: \"5d258435-31f4-4819-82bd-85477f02a5e5\") " pod="openshift-insights/insights-operator-896549976-mqg6m" Jun 09 02:22:48.328519 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:48.328400 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/41d0740b-ac9d-47bd-92c3-8c89c459ae7c-config\") pod \"console-operator-668fdbf85c-9hfq7\" (UID: \"41d0740b-ac9d-47bd-92c3-8c89c459ae7c\") " pod="openshift-console-operator/console-operator-668fdbf85c-9hfq7" Jun 09 02:22:48.328519 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:22:48.328419 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8cb34f2b-056b-4fda-b736-1746249ac279-samples-operator-tls podName:8cb34f2b-056b-4fda-b736-1746249ac279 nodeName:}" failed. No retries permitted until 2026-06-09 02:22:48.828400273 +0000 UTC m=+184.775517609 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8cb34f2b-056b-4fda-b736-1746249ac279-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-lpwbs" (UID: "8cb34f2b-056b-4fda-b736-1746249ac279") : secret "samples-operator-tls" not found Jun 09 02:22:48.328519 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:48.328477 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4fedd3d3-404f-4e0a-b965-c5cc70b36896-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-rhlw9\" (UID: \"4fedd3d3-404f-4e0a-b965-c5cc70b36896\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rhlw9" Jun 09 02:22:48.328519 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:48.328507 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5d258435-31f4-4819-82bd-85477f02a5e5-tmp\") pod \"insights-operator-896549976-mqg6m\" (UID: \"5d258435-31f4-4819-82bd-85477f02a5e5\") " pod="openshift-insights/insights-operator-896549976-mqg6m" Jun 09 02:22:48.328905 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:48.328528 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5d258435-31f4-4819-82bd-85477f02a5e5-serving-cert\") pod \"insights-operator-896549976-mqg6m\" (UID: \"5d258435-31f4-4819-82bd-85477f02a5e5\") " pod="openshift-insights/insights-operator-896549976-mqg6m" Jun 09 02:22:48.328905 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:48.328551 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fc7jn\" (UniqueName: \"kubernetes.io/projected/5d258435-31f4-4819-82bd-85477f02a5e5-kube-api-access-fc7jn\") pod \"insights-operator-896549976-mqg6m\" (UID: \"5d258435-31f4-4819-82bd-85477f02a5e5\") " pod="openshift-insights/insights-operator-896549976-mqg6m" Jun 09 02:22:48.328905 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:22:48.328572 2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 02:22:48.328905 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:48.328621 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8js26\" (UniqueName: \"kubernetes.io/projected/4fedd3d3-404f-4e0a-b965-c5cc70b36896-kube-api-access-8js26\") pod \"cluster-monitoring-operator-74bbf69bbb-rhlw9\" (UID: \"4fedd3d3-404f-4e0a-b965-c5cc70b36896\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rhlw9" Jun 09 02:22:48.328905 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:22:48.328635 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fedd3d3-404f-4e0a-b965-c5cc70b36896-cluster-monitoring-operator-tls podName:4fedd3d3-404f-4e0a-b965-c5cc70b36896 nodeName:}" failed. No retries permitted until 2026-06-09 02:22:48.82861931 +0000 UTC m=+184.775736635 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4fedd3d3-404f-4e0a-b965-c5cc70b36896-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-rhlw9" (UID: "4fedd3d3-404f-4e0a-b965-c5cc70b36896") : secret "cluster-monitoring-operator-tls" not found Jun 09 02:22:48.328905 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:48.328666 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdl78\" (UniqueName: \"kubernetes.io/projected/8cb34f2b-056b-4fda-b736-1746249ac279-kube-api-access-sdl78\") pod \"cluster-samples-operator-854f8b96b6-lpwbs\" (UID: \"8cb34f2b-056b-4fda-b736-1746249ac279\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-lpwbs" Jun 09 02:22:48.328905 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:48.328699 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d258435-31f4-4819-82bd-85477f02a5e5-trusted-ca-bundle\") pod \"insights-operator-896549976-mqg6m\" (UID: \"5d258435-31f4-4819-82bd-85477f02a5e5\") " pod="openshift-insights/insights-operator-896549976-mqg6m" Jun 09 02:22:48.328905 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:48.328897 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/4fedd3d3-404f-4e0a-b965-c5cc70b36896-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-rhlw9\" (UID: \"4fedd3d3-404f-4e0a-b965-c5cc70b36896\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rhlw9" Jun 09 02:22:48.339343 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:48.339322 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m89n4\" (UniqueName: \"kubernetes.io/projected/b932972d-147b-4d1f-97e7-ef3e4720421f-kube-api-access-m89n4\") pod \"network-check-source-dbd9cf844-lrnzj\" (UID: \"b932972d-147b-4d1f-97e7-ef3e4720421f\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-lrnzj" Jun 09 02:22:48.339343 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:48.339334 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8js26\" (UniqueName: \"kubernetes.io/projected/4fedd3d3-404f-4e0a-b965-c5cc70b36896-kube-api-access-8js26\") pod \"cluster-monitoring-operator-74bbf69bbb-rhlw9\" (UID: \"4fedd3d3-404f-4e0a-b965-c5cc70b36896\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rhlw9" Jun 09 02:22:48.341593 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:48.341573 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdl78\" (UniqueName: \"kubernetes.io/projected/8cb34f2b-056b-4fda-b736-1746249ac279-kube-api-access-sdl78\") pod \"cluster-samples-operator-854f8b96b6-lpwbs\" (UID: \"8cb34f2b-056b-4fda-b736-1746249ac279\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-lpwbs" Jun 09 02:22:48.371643 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:48.371589 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:22:48.426486 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:48.426459 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:22:48.428316 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:48.428300 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-lrnzj" Jun 09 02:22:48.429487 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:48.429470 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/5d258435-31f4-4819-82bd-85477f02a5e5-snapshots\") pod \"insights-operator-896549976-mqg6m\" (UID: \"5d258435-31f4-4819-82bd-85477f02a5e5\") " pod="openshift-insights/insights-operator-896549976-mqg6m" Jun 09 02:22:48.429543 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:48.429494 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/41d0740b-ac9d-47bd-92c3-8c89c459ae7c-trusted-ca\") pod \"console-operator-668fdbf85c-9hfq7\" (UID: \"41d0740b-ac9d-47bd-92c3-8c89c459ae7c\") " pod="openshift-console-operator/console-operator-668fdbf85c-9hfq7" Jun 09 02:22:48.429543 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:48.429511 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d258435-31f4-4819-82bd-85477f02a5e5-service-ca-bundle\") pod \"insights-operator-896549976-mqg6m\" (UID: \"5d258435-31f4-4819-82bd-85477f02a5e5\") " pod="openshift-insights/insights-operator-896549976-mqg6m" Jun 09 02:22:48.429543 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:48.429537 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/41d0740b-ac9d-47bd-92c3-8c89c459ae7c-config\") pod \"console-operator-668fdbf85c-9hfq7\" (UID: \"41d0740b-ac9d-47bd-92c3-8c89c459ae7c\") " pod="openshift-console-operator/console-operator-668fdbf85c-9hfq7" Jun 09 02:22:48.429661 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:48.429567 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6678acb6-6bca-47c4-be4f-acb6f2c1c530-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-sbmsx\" (UID: \"6678acb6-6bca-47c4-be4f-acb6f2c1c530\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-sbmsx" Jun 09 02:22:48.429661 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:48.429606 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5d258435-31f4-4819-82bd-85477f02a5e5-tmp\") pod \"insights-operator-896549976-mqg6m\" (UID: \"5d258435-31f4-4819-82bd-85477f02a5e5\") " pod="openshift-insights/insights-operator-896549976-mqg6m" Jun 09 02:22:48.429661 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:48.429627 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5d258435-31f4-4819-82bd-85477f02a5e5-serving-cert\") pod \"insights-operator-896549976-mqg6m\" (UID: \"5d258435-31f4-4819-82bd-85477f02a5e5\") " pod="openshift-insights/insights-operator-896549976-mqg6m" Jun 09 02:22:48.429661 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:48.429653 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fc7jn\" (UniqueName: \"kubernetes.io/projected/5d258435-31f4-4819-82bd-85477f02a5e5-kube-api-access-fc7jn\") pod \"insights-operator-896549976-mqg6m\" (UID: \"5d258435-31f4-4819-82bd-85477f02a5e5\") " pod="openshift-insights/insights-operator-896549976-mqg6m" Jun 09 02:22:48.429846 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:48.429696 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d258435-31f4-4819-82bd-85477f02a5e5-trusted-ca-bundle\") pod \"insights-operator-896549976-mqg6m\" (UID: \"5d258435-31f4-4819-82bd-85477f02a5e5\") " pod="openshift-insights/insights-operator-896549976-mqg6m" Jun 09 02:22:48.429846 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:48.429780 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/41d0740b-ac9d-47bd-92c3-8c89c459ae7c-serving-cert\") pod \"console-operator-668fdbf85c-9hfq7\" (UID: \"41d0740b-ac9d-47bd-92c3-8c89c459ae7c\") " pod="openshift-console-operator/console-operator-668fdbf85c-9hfq7" Jun 09 02:22:48.429846 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:48.429810 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7ksvh\" (UniqueName: \"kubernetes.io/projected/41d0740b-ac9d-47bd-92c3-8c89c459ae7c-kube-api-access-7ksvh\") pod \"console-operator-668fdbf85c-9hfq7\" (UID: \"41d0740b-ac9d-47bd-92c3-8c89c459ae7c\") " pod="openshift-console-operator/console-operator-668fdbf85c-9hfq7" Jun 09 02:22:48.429846 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:48.429837 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6678acb6-6bca-47c4-be4f-acb6f2c1c530-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-sbmsx\" (UID: \"6678acb6-6bca-47c4-be4f-acb6f2c1c530\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-sbmsx" Jun 09 02:22:48.430601 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:48.430425 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/5d258435-31f4-4819-82bd-85477f02a5e5-snapshots\") pod \"insights-operator-896549976-mqg6m\" (UID: \"5d258435-31f4-4819-82bd-85477f02a5e5\") " pod="openshift-insights/insights-operator-896549976-mqg6m" Jun 09 02:22:48.430601 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:48.430462 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d258435-31f4-4819-82bd-85477f02a5e5-service-ca-bundle\") pod \"insights-operator-896549976-mqg6m\" (UID: \"5d258435-31f4-4819-82bd-85477f02a5e5\") " pod="openshift-insights/insights-operator-896549976-mqg6m" Jun 09 02:22:48.430601 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:48.430496 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/41d0740b-ac9d-47bd-92c3-8c89c459ae7c-config\") pod \"console-operator-668fdbf85c-9hfq7\" (UID: \"41d0740b-ac9d-47bd-92c3-8c89c459ae7c\") " pod="openshift-console-operator/console-operator-668fdbf85c-9hfq7" Jun 09 02:22:48.431131 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:48.431105 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d258435-31f4-4819-82bd-85477f02a5e5-trusted-ca-bundle\") pod \"insights-operator-896549976-mqg6m\" (UID: \"5d258435-31f4-4819-82bd-85477f02a5e5\") " pod="openshift-insights/insights-operator-896549976-mqg6m" Jun 09 02:22:48.431233 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:48.431200 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/41d0740b-ac9d-47bd-92c3-8c89c459ae7c-trusted-ca\") pod \"console-operator-668fdbf85c-9hfq7\" (UID: \"41d0740b-ac9d-47bd-92c3-8c89c459ae7c\") " pod="openshift-console-operator/console-operator-668fdbf85c-9hfq7" Jun 09 02:22:48.431294 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:48.431260 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5d258435-31f4-4819-82bd-85477f02a5e5-tmp\") pod \"insights-operator-896549976-mqg6m\" (UID: \"5d258435-31f4-4819-82bd-85477f02a5e5\") " pod="openshift-insights/insights-operator-896549976-mqg6m" Jun 09 02:22:48.432333 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:48.432312 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/41d0740b-ac9d-47bd-92c3-8c89c459ae7c-serving-cert\") pod \"console-operator-668fdbf85c-9hfq7\" (UID: \"41d0740b-ac9d-47bd-92c3-8c89c459ae7c\") " pod="openshift-console-operator/console-operator-668fdbf85c-9hfq7" Jun 09 02:22:48.432410 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:48.432395 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5d258435-31f4-4819-82bd-85477f02a5e5-serving-cert\") pod \"insights-operator-896549976-mqg6m\" (UID: \"5d258435-31f4-4819-82bd-85477f02a5e5\") " pod="openshift-insights/insights-operator-896549976-mqg6m" Jun 09 02:22:48.437685 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:48.437660 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ksvh\" (UniqueName: \"kubernetes.io/projected/41d0740b-ac9d-47bd-92c3-8c89c459ae7c-kube-api-access-7ksvh\") pod \"console-operator-668fdbf85c-9hfq7\" (UID: \"41d0740b-ac9d-47bd-92c3-8c89c459ae7c\") " pod="openshift-console-operator/console-operator-668fdbf85c-9hfq7" Jun 09 02:22:48.437817 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:48.437800 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fc7jn\" (UniqueName: \"kubernetes.io/projected/5d258435-31f4-4819-82bd-85477f02a5e5-kube-api-access-fc7jn\") pod \"insights-operator-896549976-mqg6m\" (UID: \"5d258435-31f4-4819-82bd-85477f02a5e5\") " pod="openshift-insights/insights-operator-896549976-mqg6m" Jun 09 02:22:48.530605 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:48.530579 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6678acb6-6bca-47c4-be4f-acb6f2c1c530-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-sbmsx\" (UID: \"6678acb6-6bca-47c4-be4f-acb6f2c1c530\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-sbmsx" Jun 09 02:22:48.530727 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:48.530635 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6678acb6-6bca-47c4-be4f-acb6f2c1c530-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-sbmsx\" (UID: \"6678acb6-6bca-47c4-be4f-acb6f2c1c530\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-sbmsx" Jun 09 02:22:48.530785 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:22:48.530737 2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 02:22:48.530834 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:22:48.530812 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6678acb6-6bca-47c4-be4f-acb6f2c1c530-networking-console-plugin-cert podName:6678acb6-6bca-47c4-be4f-acb6f2c1c530 nodeName:}" failed. No retries permitted until 2026-06-09 02:22:49.030792393 +0000 UTC m=+184.977909733 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6678acb6-6bca-47c4-be4f-acb6f2c1c530-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-sbmsx" (UID: "6678acb6-6bca-47c4-be4f-acb6f2c1c530") : secret "networking-console-plugin-cert" not found Jun 09 02:22:48.531189 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:48.531169 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6678acb6-6bca-47c4-be4f-acb6f2c1c530-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-sbmsx\" (UID: \"6678acb6-6bca-47c4-be4f-acb6f2c1c530\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-sbmsx" Jun 09 02:22:48.532556 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:48.532531 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-mqg6m" Jun 09 02:22:48.536589 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:48.536574 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-9hfq7" Jun 09 02:22:48.538190 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:48.538157 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-lrnzj"] Jun 09 02:22:48.542892 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:22:48.542870 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb932972d_147b_4d1f_97e7_ef3e4720421f.slice/crio-d668d2618e3807d67188cc018df6d1595fc490e3eec484a524249333db8bdc48 WatchSource:0}: Error finding container d668d2618e3807d67188cc018df6d1595fc490e3eec484a524249333db8bdc48: Status 404 returned error can't find the container with id d668d2618e3807d67188cc018df6d1595fc490e3eec484a524249333db8bdc48 Jun 09 02:22:48.659707 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:48.659681 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-9hfq7"] Jun 09 02:22:48.662670 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:22:48.662649 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41d0740b_ac9d_47bd_92c3_8c89c459ae7c.slice/crio-268eb422a540d18353ef7dae9cddf38fd6e1825fcd174c43b9c5d5d401e81c54 WatchSource:0}: Error finding container 268eb422a540d18353ef7dae9cddf38fd6e1825fcd174c43b9c5d5d401e81c54: Status 404 returned error can't find the container with id 268eb422a540d18353ef7dae9cddf38fd6e1825fcd174c43b9c5d5d401e81c54 Jun 09 02:22:48.671316 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:48.671294 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-mqg6m"] Jun 09 02:22:48.673700 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:22:48.673678 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d258435_31f4_4819_82bd_85477f02a5e5.slice/crio-12ecf041e2b2be92e60cc62748c1ced96f81d659eef35768741b3d4b01afaa0c WatchSource:0}: Error finding container 12ecf041e2b2be92e60cc62748c1ced96f81d659eef35768741b3d4b01afaa0c: Status 404 returned error can't find the container with id 12ecf041e2b2be92e60cc62748c1ced96f81d659eef35768741b3d4b01afaa0c Jun 09 02:22:48.833589 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:48.833567 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8cb34f2b-056b-4fda-b736-1746249ac279-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-lpwbs\" (UID: \"8cb34f2b-056b-4fda-b736-1746249ac279\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-lpwbs" Jun 09 02:22:48.833697 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:48.833634 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4fedd3d3-404f-4e0a-b965-c5cc70b36896-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-rhlw9\" (UID: \"4fedd3d3-404f-4e0a-b965-c5cc70b36896\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rhlw9" Jun 09 02:22:48.833759 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:22:48.833712 2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 02:22:48.833759 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:22:48.833713 2573 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 09 02:22:48.833759 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:22:48.833753 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fedd3d3-404f-4e0a-b965-c5cc70b36896-cluster-monitoring-operator-tls podName:4fedd3d3-404f-4e0a-b965-c5cc70b36896 nodeName:}" failed. No retries permitted until 2026-06-09 02:22:49.83374092 +0000 UTC m=+185.780858241 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4fedd3d3-404f-4e0a-b965-c5cc70b36896-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-rhlw9" (UID: "4fedd3d3-404f-4e0a-b965-c5cc70b36896") : secret "cluster-monitoring-operator-tls" not found Jun 09 02:22:48.833910 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:22:48.833764 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8cb34f2b-056b-4fda-b736-1746249ac279-samples-operator-tls podName:8cb34f2b-056b-4fda-b736-1746249ac279 nodeName:}" failed. No retries permitted until 2026-06-09 02:22:49.833759084 +0000 UTC m=+185.780876405 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8cb34f2b-056b-4fda-b736-1746249ac279-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-lpwbs" (UID: "8cb34f2b-056b-4fda-b736-1746249ac279") : secret "samples-operator-tls" not found Jun 09 02:22:48.936610 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:48.936562 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-9hfq7" event={"ID":"41d0740b-ac9d-47bd-92c3-8c89c459ae7c","Type":"ContainerStarted","Data":"268eb422a540d18353ef7dae9cddf38fd6e1825fcd174c43b9c5d5d401e81c54"} Jun 09 02:22:48.937612 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:48.937593 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-mqg6m" event={"ID":"5d258435-31f4-4819-82bd-85477f02a5e5","Type":"ContainerStarted","Data":"12ecf041e2b2be92e60cc62748c1ced96f81d659eef35768741b3d4b01afaa0c"} Jun 09 02:22:48.938862 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:48.938844 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-lrnzj" event={"ID":"b932972d-147b-4d1f-97e7-ef3e4720421f","Type":"ContainerStarted","Data":"d565c481495a1997873d3fd64146c5350794d7149804cf3641bdb97c86a3802e"} Jun 09 02:22:48.938949 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:48.938878 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-lrnzj" event={"ID":"b932972d-147b-4d1f-97e7-ef3e4720421f","Type":"ContainerStarted","Data":"d668d2618e3807d67188cc018df6d1595fc490e3eec484a524249333db8bdc48"} Jun 09 02:22:48.951878 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:48.951843 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-lrnzj" podStartSLOduration=0.951828436 podStartE2EDuration="951.828436ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:22:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:22:48.951527294 +0000 UTC m=+184.898644635" watchObservedRunningTime="2026-06-09 02:22:48.951828436 +0000 UTC m=+184.898945781" Jun 09 02:22:49.034447 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:49.034424 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6678acb6-6bca-47c4-be4f-acb6f2c1c530-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-sbmsx\" (UID: \"6678acb6-6bca-47c4-be4f-acb6f2c1c530\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-sbmsx" Jun 09 02:22:49.034526 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:22:49.034517 2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 02:22:49.034563 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:22:49.034558 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6678acb6-6bca-47c4-be4f-acb6f2c1c530-networking-console-plugin-cert podName:6678acb6-6bca-47c4-be4f-acb6f2c1c530 nodeName:}" failed. No retries permitted until 2026-06-09 02:22:50.034547841 +0000 UTC m=+185.981665162 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6678acb6-6bca-47c4-be4f-acb6f2c1c530-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-sbmsx" (UID: "6678acb6-6bca-47c4-be4f-acb6f2c1c530") : secret "networking-console-plugin-cert" not found Jun 09 02:22:49.839604 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:49.839563 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8cb34f2b-056b-4fda-b736-1746249ac279-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-lpwbs\" (UID: \"8cb34f2b-056b-4fda-b736-1746249ac279\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-lpwbs" Jun 09 02:22:49.839952 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:49.839674 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4fedd3d3-404f-4e0a-b965-c5cc70b36896-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-rhlw9\" (UID: \"4fedd3d3-404f-4e0a-b965-c5cc70b36896\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rhlw9" Jun 09 02:22:49.839952 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:22:49.839802 2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 02:22:49.839952 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:22:49.839870 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fedd3d3-404f-4e0a-b965-c5cc70b36896-cluster-monitoring-operator-tls podName:4fedd3d3-404f-4e0a-b965-c5cc70b36896 nodeName:}" failed. No retries permitted until 2026-06-09 02:22:51.839853715 +0000 UTC m=+187.786971036 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4fedd3d3-404f-4e0a-b965-c5cc70b36896-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-rhlw9" (UID: "4fedd3d3-404f-4e0a-b965-c5cc70b36896") : secret "cluster-monitoring-operator-tls" not found Jun 09 02:22:49.840123 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:22:49.840096 2573 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 09 02:22:49.840180 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:22:49.840161 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8cb34f2b-056b-4fda-b736-1746249ac279-samples-operator-tls podName:8cb34f2b-056b-4fda-b736-1746249ac279 nodeName:}" failed. No retries permitted until 2026-06-09 02:22:51.840147357 +0000 UTC m=+187.787264694 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8cb34f2b-056b-4fda-b736-1746249ac279-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-lpwbs" (UID: "8cb34f2b-056b-4fda-b736-1746249ac279") : secret "samples-operator-tls" not found Jun 09 02:22:50.041218 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:50.041181 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6678acb6-6bca-47c4-be4f-acb6f2c1c530-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-sbmsx\" (UID: \"6678acb6-6bca-47c4-be4f-acb6f2c1c530\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-sbmsx" Jun 09 02:22:50.041400 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:22:50.041337 2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 02:22:50.041473 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:22:50.041416 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6678acb6-6bca-47c4-be4f-acb6f2c1c530-networking-console-plugin-cert podName:6678acb6-6bca-47c4-be4f-acb6f2c1c530 nodeName:}" failed. No retries permitted until 2026-06-09 02:22:52.041397198 +0000 UTC m=+187.988514532 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6678acb6-6bca-47c4-be4f-acb6f2c1c530-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-sbmsx" (UID: "6678acb6-6bca-47c4-be4f-acb6f2c1c530") : secret "networking-console-plugin-cert" not found Jun 09 02:22:50.538057 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:50.538006 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:22:50.586350 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:50.586319 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:22:51.856718 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:51.855879 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8cb34f2b-056b-4fda-b736-1746249ac279-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-lpwbs\" (UID: \"8cb34f2b-056b-4fda-b736-1746249ac279\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-lpwbs" Jun 09 02:22:51.856718 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:51.855976 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4fedd3d3-404f-4e0a-b965-c5cc70b36896-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-rhlw9\" (UID: \"4fedd3d3-404f-4e0a-b965-c5cc70b36896\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rhlw9" Jun 09 02:22:51.856718 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:22:51.856129 2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 02:22:51.856718 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:22:51.856208 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fedd3d3-404f-4e0a-b965-c5cc70b36896-cluster-monitoring-operator-tls podName:4fedd3d3-404f-4e0a-b965-c5cc70b36896 nodeName:}" failed. No retries permitted until 2026-06-09 02:22:55.856185781 +0000 UTC m=+191.803303146 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4fedd3d3-404f-4e0a-b965-c5cc70b36896-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-rhlw9" (UID: "4fedd3d3-404f-4e0a-b965-c5cc70b36896") : secret "cluster-monitoring-operator-tls" not found Jun 09 02:22:51.856718 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:22:51.856638 2573 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 09 02:22:51.856718 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:22:51.856688 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8cb34f2b-056b-4fda-b736-1746249ac279-samples-operator-tls podName:8cb34f2b-056b-4fda-b736-1746249ac279 nodeName:}" failed. No retries permitted until 2026-06-09 02:22:55.856670499 +0000 UTC m=+191.803787829 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8cb34f2b-056b-4fda-b736-1746249ac279-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-lpwbs" (UID: "8cb34f2b-056b-4fda-b736-1746249ac279") : secret "samples-operator-tls" not found Jun 09 02:22:51.932522 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:51.932490 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:22:51.948982 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:51.948963 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-9hfq7_41d0740b-ac9d-47bd-92c3-8c89c459ae7c/console-operator/0.log" Jun 09 02:22:51.949169 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:51.949018 2573 generic.go:356] "Generic (PLEG): container finished" podID="41d0740b-ac9d-47bd-92c3-8c89c459ae7c" containerID="da7c287b9e23081f4467b08f4808edecfffec7ce9d15189034f8184660b9c92b" exitCode=255 Jun 09 02:22:51.949169 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:51.949116 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-9hfq7" event={"ID":"41d0740b-ac9d-47bd-92c3-8c89c459ae7c","Type":"ContainerDied","Data":"da7c287b9e23081f4467b08f4808edecfffec7ce9d15189034f8184660b9c92b"} Jun 09 02:22:51.949385 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:51.949372 2573 scope.go:117] "RemoveContainer" containerID="da7c287b9e23081f4467b08f4808edecfffec7ce9d15189034f8184660b9c92b" Jun 09 02:22:51.950644 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:51.950622 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-mqg6m" event={"ID":"5d258435-31f4-4819-82bd-85477f02a5e5","Type":"ContainerStarted","Data":"e3e3b71fbe05d2672a7e9f2021d0095552e301637a6da78f46667a29570b51fd"} Jun 09 02:22:51.980861 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:51.980813 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-896549976-mqg6m" podStartSLOduration=1.471087597 podStartE2EDuration="3.980800685s" totalImagesPullingTime="2.509713088s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:22:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:22:51.98020049 +0000 UTC m=+187.927317833" watchObservedRunningTime="2026-06-09 02:22:51.980800685 +0000 UTC m=+187.927918063" Jun 09 02:22:52.057402 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:52.057372 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6678acb6-6bca-47c4-be4f-acb6f2c1c530-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-sbmsx\" (UID: \"6678acb6-6bca-47c4-be4f-acb6f2c1c530\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-sbmsx" Jun 09 02:22:52.057555 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:22:52.057531 2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 02:22:52.057628 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:22:52.057616 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6678acb6-6bca-47c4-be4f-acb6f2c1c530-networking-console-plugin-cert podName:6678acb6-6bca-47c4-be4f-acb6f2c1c530 nodeName:}" failed. No retries permitted until 2026-06-09 02:22:56.057596272 +0000 UTC m=+192.004713614 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6678acb6-6bca-47c4-be4f-acb6f2c1c530-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-sbmsx" (UID: "6678acb6-6bca-47c4-be4f-acb6f2c1c530") : secret "networking-console-plugin-cert" not found Jun 09 02:22:52.955889 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:52.955865 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-9hfq7_41d0740b-ac9d-47bd-92c3-8c89c459ae7c/console-operator/1.log" Jun 09 02:22:52.956380 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:52.956360 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-9hfq7_41d0740b-ac9d-47bd-92c3-8c89c459ae7c/console-operator/0.log" Jun 09 02:22:52.956438 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:52.956399 2573 generic.go:356] "Generic (PLEG): container finished" podID="41d0740b-ac9d-47bd-92c3-8c89c459ae7c" containerID="948f37345712c8658816706a85a71f5584e85d58e56612022df68d3affb6a1a1" exitCode=255 Jun 09 02:22:52.956514 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:52.956489 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-9hfq7" event={"ID":"41d0740b-ac9d-47bd-92c3-8c89c459ae7c","Type":"ContainerDied","Data":"948f37345712c8658816706a85a71f5584e85d58e56612022df68d3affb6a1a1"} Jun 09 02:22:52.956565 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:52.956550 2573 scope.go:117] "RemoveContainer" containerID="da7c287b9e23081f4467b08f4808edecfffec7ce9d15189034f8184660b9c92b" Jun 09 02:22:52.956723 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:52.956706 2573 scope.go:117] "RemoveContainer" containerID="948f37345712c8658816706a85a71f5584e85d58e56612022df68d3affb6a1a1" Jun 09 02:22:52.956936 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:22:52.956901 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-9hfq7_openshift-console-operator(41d0740b-ac9d-47bd-92c3-8c89c459ae7c)\"" pod="openshift-console-operator/console-operator-668fdbf85c-9hfq7" podUID="41d0740b-ac9d-47bd-92c3-8c89c459ae7c" Jun 09 02:22:53.046906 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:53.046873 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:22:53.156530 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:53.156500 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:22:53.234472 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:53.234404 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:22:53.287321 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:53.287295 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:22:53.333271 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:53.333244 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:22:53.754971 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:53.754947 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:22:53.855197 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:53.855164 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:22:53.859514 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:53.859496 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-btr7x_37660632-e407-412f-aa36-3e764febd673/dns-node-resolver/0.log" Jun 09 02:22:53.966005 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:53.965983 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-9hfq7_41d0740b-ac9d-47bd-92c3-8c89c459ae7c/console-operator/1.log" Jun 09 02:22:53.966343 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:53.966321 2573 scope.go:117] "RemoveContainer" containerID="948f37345712c8658816706a85a71f5584e85d58e56612022df68d3affb6a1a1" Jun 09 02:22:53.966483 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:22:53.966465 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-9hfq7_openshift-console-operator(41d0740b-ac9d-47bd-92c3-8c89c459ae7c)\"" pod="openshift-console-operator/console-operator-668fdbf85c-9hfq7" podUID="41d0740b-ac9d-47bd-92c3-8c89c459ae7c" Jun 09 02:22:54.857131 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:54.857110 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-fgmlx_6627f9b3-28ae-40b2-9ba9-fe6614fe60dc/node-ca/0.log" Jun 09 02:22:55.351243 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:55.351216 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-hd78h"] Jun 09 02:22:55.353898 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:55.353879 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-hd78h" Jun 09 02:22:55.356020 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:55.355999 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-rmwp4\"" Jun 09 02:22:55.356160 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:55.355997 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 09 02:22:55.356993 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:55.356964 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 09 02:22:55.357134 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:55.356967 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 09 02:22:55.357134 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:55.356997 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 09 02:22:55.360428 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:55.360405 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-hd78h"] Jun 09 02:22:55.455718 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:55.455687 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:22:55.482802 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:55.482775 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/6d125529-a49b-4de9-a84d-d2ea106d7f30-signing-key\") pod \"service-ca-7d74d578b8-hd78h\" (UID: \"6d125529-a49b-4de9-a84d-d2ea106d7f30\") " pod="openshift-service-ca/service-ca-7d74d578b8-hd78h" Jun 09 02:22:55.482896 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:55.482807 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/6d125529-a49b-4de9-a84d-d2ea106d7f30-signing-cabundle\") pod \"service-ca-7d74d578b8-hd78h\" (UID: \"6d125529-a49b-4de9-a84d-d2ea106d7f30\") " pod="openshift-service-ca/service-ca-7d74d578b8-hd78h" Jun 09 02:22:55.482896 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:55.482855 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7g284\" (UniqueName: \"kubernetes.io/projected/6d125529-a49b-4de9-a84d-d2ea106d7f30-kube-api-access-7g284\") pod \"service-ca-7d74d578b8-hd78h\" (UID: \"6d125529-a49b-4de9-a84d-d2ea106d7f30\") " pod="openshift-service-ca/service-ca-7d74d578b8-hd78h" Jun 09 02:22:55.503579 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:55.503548 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:22:55.569812 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:55.569770 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:22:55.583758 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:55.583739 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/6d125529-a49b-4de9-a84d-d2ea106d7f30-signing-key\") pod \"service-ca-7d74d578b8-hd78h\" (UID: \"6d125529-a49b-4de9-a84d-d2ea106d7f30\") " pod="openshift-service-ca/service-ca-7d74d578b8-hd78h" Jun 09 02:22:55.583841 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:55.583766 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/6d125529-a49b-4de9-a84d-d2ea106d7f30-signing-cabundle\") pod \"service-ca-7d74d578b8-hd78h\" (UID: \"6d125529-a49b-4de9-a84d-d2ea106d7f30\") " pod="openshift-service-ca/service-ca-7d74d578b8-hd78h" Jun 09 02:22:55.583841 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:55.583802 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7g284\" (UniqueName: \"kubernetes.io/projected/6d125529-a49b-4de9-a84d-d2ea106d7f30-kube-api-access-7g284\") pod \"service-ca-7d74d578b8-hd78h\" (UID: \"6d125529-a49b-4de9-a84d-d2ea106d7f30\") " pod="openshift-service-ca/service-ca-7d74d578b8-hd78h" Jun 09 02:22:55.584397 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:55.584374 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/6d125529-a49b-4de9-a84d-d2ea106d7f30-signing-cabundle\") pod \"service-ca-7d74d578b8-hd78h\" (UID: \"6d125529-a49b-4de9-a84d-d2ea106d7f30\") " pod="openshift-service-ca/service-ca-7d74d578b8-hd78h" Jun 09 02:22:55.586526 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:55.586500 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/6d125529-a49b-4de9-a84d-d2ea106d7f30-signing-key\") pod \"service-ca-7d74d578b8-hd78h\" (UID: \"6d125529-a49b-4de9-a84d-d2ea106d7f30\") " pod="openshift-service-ca/service-ca-7d74d578b8-hd78h" Jun 09 02:22:55.591286 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:55.591256 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7g284\" (UniqueName: \"kubernetes.io/projected/6d125529-a49b-4de9-a84d-d2ea106d7f30-kube-api-access-7g284\") pod \"service-ca-7d74d578b8-hd78h\" (UID: \"6d125529-a49b-4de9-a84d-d2ea106d7f30\") " pod="openshift-service-ca/service-ca-7d74d578b8-hd78h" Jun 09 02:22:55.617670 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:55.617613 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:22:55.663718 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:55.663695 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-hd78h" Jun 09 02:22:55.778697 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:55.778672 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-hd78h"] Jun 09 02:22:55.781608 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:22:55.781583 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d125529_a49b_4de9_a84d_d2ea106d7f30.slice/crio-a32f3bbc33e60deb02577944b1a7f0f66953cb52d2ab8e8d47fbc95e1ab4cc14 WatchSource:0}: Error finding container a32f3bbc33e60deb02577944b1a7f0f66953cb52d2ab8e8d47fbc95e1ab4cc14: Status 404 returned error can't find the container with id a32f3bbc33e60deb02577944b1a7f0f66953cb52d2ab8e8d47fbc95e1ab4cc14 Jun 09 02:22:55.857649 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:55.857624 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hzfpk_7d40cc8c-039c-4f1a-9460-f601e7d4b00d/serve-healthcheck-canary/0.log" Jun 09 02:22:55.886171 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:55.886106 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4fedd3d3-404f-4e0a-b965-c5cc70b36896-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-rhlw9\" (UID: \"4fedd3d3-404f-4e0a-b965-c5cc70b36896\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rhlw9" Jun 09 02:22:55.886261 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:55.886187 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8cb34f2b-056b-4fda-b736-1746249ac279-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-lpwbs\" (UID: \"8cb34f2b-056b-4fda-b736-1746249ac279\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-lpwbs" Jun 09 02:22:55.886304 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:22:55.886263 2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 02:22:55.886337 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:22:55.886313 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fedd3d3-404f-4e0a-b965-c5cc70b36896-cluster-monitoring-operator-tls podName:4fedd3d3-404f-4e0a-b965-c5cc70b36896 nodeName:}" failed. No retries permitted until 2026-06-09 02:23:03.886300671 +0000 UTC m=+199.833417994 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4fedd3d3-404f-4e0a-b965-c5cc70b36896-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-rhlw9" (UID: "4fedd3d3-404f-4e0a-b965-c5cc70b36896") : secret "cluster-monitoring-operator-tls" not found Jun 09 02:22:55.886392 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:22:55.886264 2573 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 09 02:22:55.886424 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:22:55.886392 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8cb34f2b-056b-4fda-b736-1746249ac279-samples-operator-tls podName:8cb34f2b-056b-4fda-b736-1746249ac279 nodeName:}" failed. No retries permitted until 2026-06-09 02:23:03.886380068 +0000 UTC m=+199.833497401 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8cb34f2b-056b-4fda-b736-1746249ac279-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-lpwbs" (UID: "8cb34f2b-056b-4fda-b736-1746249ac279") : secret "samples-operator-tls" not found Jun 09 02:22:55.973453 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:55.973431 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-hd78h" event={"ID":"6d125529-a49b-4de9-a84d-d2ea106d7f30","Type":"ContainerStarted","Data":"a32f3bbc33e60deb02577944b1a7f0f66953cb52d2ab8e8d47fbc95e1ab4cc14"} Jun 09 02:22:56.087141 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:56.087119 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6678acb6-6bca-47c4-be4f-acb6f2c1c530-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-sbmsx\" (UID: \"6678acb6-6bca-47c4-be4f-acb6f2c1c530\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-sbmsx" Jun 09 02:22:56.087283 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:22:56.087267 2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 02:22:56.087344 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:22:56.087329 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6678acb6-6bca-47c4-be4f-acb6f2c1c530-networking-console-plugin-cert podName:6678acb6-6bca-47c4-be4f-acb6f2c1c530 nodeName:}" failed. No retries permitted until 2026-06-09 02:23:04.087311376 +0000 UTC m=+200.034428717 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6678acb6-6bca-47c4-be4f-acb6f2c1c530-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-sbmsx" (UID: "6678acb6-6bca-47c4-be4f-acb6f2c1c530") : secret "networking-console-plugin-cert" not found Jun 09 02:22:56.226433 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:56.226366 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:22:56.753691 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:56.753655 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:22:57.981018 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:57.980987 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-hd78h" event={"ID":"6d125529-a49b-4de9-a84d-d2ea106d7f30","Type":"ContainerStarted","Data":"81753e7880dcc379f469e8a7676771db17b3cbbf89b3abf695984104aa4d70eb"} Jun 09 02:22:58.001940 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:57.998998 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7d74d578b8-hd78h" podStartSLOduration=1.3248012519999999 podStartE2EDuration="2.998979313s" totalImagesPullingTime="1.674178061s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:22:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:22:57.996853894 +0000 UTC m=+193.943971239" watchObservedRunningTime="2026-06-09 02:22:57.998979313 +0000 UTC m=+193.946096656" Jun 09 02:22:58.537931 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:58.537908 2573 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-9hfq7" Jun 09 02:22:58.538035 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:58.537954 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-9hfq7" Jun 09 02:22:58.538320 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:58.538308 2573 scope.go:117] "RemoveContainer" containerID="948f37345712c8658816706a85a71f5584e85d58e56612022df68d3affb6a1a1" Jun 09 02:22:58.538481 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:22:58.538462 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-9hfq7_openshift-console-operator(41d0740b-ac9d-47bd-92c3-8c89c459ae7c)\"" pod="openshift-console-operator/console-operator-668fdbf85c-9hfq7" podUID="41d0740b-ac9d-47bd-92c3-8c89c459ae7c" Jun 09 02:22:58.848144 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:58.848044 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:22:59.008516 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:59.008483 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:22:59.113178 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:59.113120 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:22:59.213450 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:59.213425 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:22:59.317523 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:59.317487 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:22:59.410033 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:59.409968 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:22:59.741893 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:22:59.741842 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:23:00.350601 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:00.350577 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:23:00.947779 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:00.947754 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:23:01.143095 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:01.143061 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:23:01.550840 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:01.550810 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:23:01.733900 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:01.733879 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:23:01.783421 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:01.783401 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:23:02.346950 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:02.346926 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:23:02.468569 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:02.468516 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:23:02.742583 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:02.742490 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:23:02.842846 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:02.842818 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:23:02.944084 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:02.944056 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:23:03.155381 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:03.155354 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:23:03.542762 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:03.542741 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:23:03.589656 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:03.589634 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:23:03.741574 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:03.741551 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:23:03.948536 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:03.948490 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8cb34f2b-056b-4fda-b736-1746249ac279-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-lpwbs\" (UID: \"8cb34f2b-056b-4fda-b736-1746249ac279\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-lpwbs" Jun 09 02:23:03.948818 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:03.948549 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4fedd3d3-404f-4e0a-b965-c5cc70b36896-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-rhlw9\" (UID: \"4fedd3d3-404f-4e0a-b965-c5cc70b36896\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rhlw9" Jun 09 02:23:03.948818 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:23:03.948639 2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 02:23:03.948818 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:23:03.948714 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fedd3d3-404f-4e0a-b965-c5cc70b36896-cluster-monitoring-operator-tls podName:4fedd3d3-404f-4e0a-b965-c5cc70b36896 nodeName:}" failed. No retries permitted until 2026-06-09 02:23:19.948697193 +0000 UTC m=+215.895814518 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4fedd3d3-404f-4e0a-b965-c5cc70b36896-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-rhlw9" (UID: "4fedd3d3-404f-4e0a-b965-c5cc70b36896") : secret "cluster-monitoring-operator-tls" not found Jun 09 02:23:03.950610 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:03.950593 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8cb34f2b-056b-4fda-b736-1746249ac279-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-lpwbs\" (UID: \"8cb34f2b-056b-4fda-b736-1746249ac279\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-lpwbs" Jun 09 02:23:04.042087 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:04.042052 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-lpwbs" Jun 09 02:23:04.146944 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:04.146914 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:23:04.150024 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:04.150001 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6678acb6-6bca-47c4-be4f-acb6f2c1c530-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-sbmsx\" (UID: \"6678acb6-6bca-47c4-be4f-acb6f2c1c530\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-sbmsx" Jun 09 02:23:04.150166 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:23:04.150146 2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 02:23:04.150229 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:23:04.150206 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6678acb6-6bca-47c4-be4f-acb6f2c1c530-networking-console-plugin-cert podName:6678acb6-6bca-47c4-be4f-acb6f2c1c530 nodeName:}" failed. No retries permitted until 2026-06-09 02:23:20.150192781 +0000 UTC m=+216.097310102 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6678acb6-6bca-47c4-be4f-acb6f2c1c530-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-sbmsx" (UID: "6678acb6-6bca-47c4-be4f-acb6f2c1c530") : secret "networking-console-plugin-cert" not found Jun 09 02:23:04.157705 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:04.157679 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-lpwbs"] Jun 09 02:23:04.743937 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:04.743860 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:23:05.002974 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:05.002899 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-lpwbs" event={"ID":"8cb34f2b-056b-4fda-b736-1746249ac279","Type":"ContainerStarted","Data":"aa35b6ee369234425101b6cb6733066753bc18375ac81656783a43b92376b387"} Jun 09 02:23:05.348429 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:05.348401 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:23:05.448462 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:05.448436 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:23:05.549471 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:05.549449 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:23:05.745707 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:05.745643 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:23:06.146339 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:06.146304 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:23:06.747543 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:06.747512 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:23:07.010672 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:07.010607 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-lpwbs" event={"ID":"8cb34f2b-056b-4fda-b736-1746249ac279","Type":"ContainerStarted","Data":"f18085771fdda5a194f958eb217f41701006d3c87d3d80fc769785070384d7f6"} Jun 09 02:23:07.010672 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:07.010663 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-lpwbs" event={"ID":"8cb34f2b-056b-4fda-b736-1746249ac279","Type":"ContainerStarted","Data":"1e119d3836792ec21a316765d7345d79e799384147e47c64cc2e5c8aebfd068f"} Jun 09 02:23:07.026158 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:07.026113 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-lpwbs" podStartSLOduration=17.071471357 podStartE2EDuration="19.026097691s" totalImagesPullingTime="1.954626334s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:22:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:23:07.025261816 +0000 UTC m=+202.972379158" watchObservedRunningTime="2026-06-09 02:23:07.026097691 +0000 UTC m=+202.973215031" Jun 09 02:23:07.141147 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:07.141122 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:23:07.544768 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:07.544735 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:23:07.941430 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:07.941365 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:23:08.143070 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:08.143041 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:23:08.542466 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:08.542425 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:23:09.143708 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:09.143679 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:23:09.345095 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:09.345027 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:23:09.461182 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:09.461130 2573 scope.go:117] "RemoveContainer" containerID="948f37345712c8658816706a85a71f5584e85d58e56612022df68d3affb6a1a1" Jun 09 02:23:09.547450 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:09.547424 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:23:10.020511 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:10.020493 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-9hfq7_41d0740b-ac9d-47bd-92c3-8c89c459ae7c/console-operator/1.log" Jun 09 02:23:10.020602 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:10.020533 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-9hfq7" event={"ID":"41d0740b-ac9d-47bd-92c3-8c89c459ae7c","Type":"ContainerStarted","Data":"7f05058c87322bb207e64906a247ea80b3a28de78875bcf09876ff6ad3000851"} Jun 09 02:23:10.020862 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:10.020841 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-9hfq7" Jun 09 02:23:10.036383 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:10.036335 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-668fdbf85c-9hfq7" podStartSLOduration=19.515970115000002 podStartE2EDuration="22.036319416s" totalImagesPullingTime="2.520349301s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:22:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:23:10.035144651 +0000 UTC m=+205.982261994" watchObservedRunningTime="2026-06-09 02:23:10.036319416 +0000 UTC m=+205.983436758" Jun 09 02:23:10.157752 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:10.157730 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-668fdbf85c-9hfq7" Jun 09 02:23:10.334758 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:10.334725 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:23:10.440791 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:10.440760 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:23:10.657484 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:10.657408 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:23:10.818942 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:10.818905 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:23:11.006244 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:11.006182 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:23:11.057608 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:11.057578 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:23:11.406334 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:11.406303 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:23:11.608941 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:11.608917 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:23:11.658002 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:11.657932 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:23:12.230037 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:12.230003 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:23:12.417860 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:12.417833 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:23:13.040302 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:13.040281 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:23:13.435880 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:13.435826 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:23:16.738475 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:16.738432 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-jk6f4"] Jun 09 02:23:16.746186 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:16.746159 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jk6f4" Jun 09 02:23:16.748570 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:16.748539 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 09 02:23:16.748570 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:16.748539 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-zzznw\"" Jun 09 02:23:16.749472 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:16.749448 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 09 02:23:16.756994 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:16.756970 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jk6f4"] Jun 09 02:23:16.762900 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:16.762876 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6657875f97-q5gzn"] Jun 09 02:23:16.766411 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:16.766386 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:23:16.767006 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:16.766991 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-q5gzn" Jun 09 02:23:16.770375 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:16.770352 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 09 02:23:16.770478 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:16.770380 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 09 02:23:16.770478 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:16.770399 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-g6fns\"" Jun 09 02:23:16.784124 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:16.784097 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-q5gzn"] Jun 09 02:23:16.807756 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:16.807738 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6b6f4b68db-772wg"] Jun 09 02:23:16.811346 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:16.811333 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b6f4b68db-772wg" Jun 09 02:23:16.813762 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:16.813741 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 09 02:23:16.813863 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:16.813780 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 09 02:23:16.813863 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:16.813805 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-mhf5x\"" Jun 09 02:23:16.813863 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:16.813809 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 09 02:23:16.819026 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:16.819008 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 09 02:23:16.823570 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:16.823553 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6b6f4b68db-772wg"] Jun 09 02:23:16.842749 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:16.842728 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xn97\" (UniqueName: \"kubernetes.io/projected/4042c7a9-0fef-4d82-8f08-11601e40928f-kube-api-access-6xn97\") pod \"image-registry-6b6f4b68db-772wg\" (UID: \"4042c7a9-0fef-4d82-8f08-11601e40928f\") " pod="openshift-image-registry/image-registry-6b6f4b68db-772wg" Jun 09 02:23:16.842927 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:16.842756 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75hsv\" (UniqueName: \"kubernetes.io/projected/6c83b986-fb5e-4664-85aa-e78a5c0e9de1-kube-api-access-75hsv\") pod \"downloads-6657875f97-q5gzn\" (UID: \"6c83b986-fb5e-4664-85aa-e78a5c0e9de1\") " pod="openshift-console/downloads-6657875f97-q5gzn" Jun 09 02:23:16.842927 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:16.842778 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4042c7a9-0fef-4d82-8f08-11601e40928f-registry-tls\") pod \"image-registry-6b6f4b68db-772wg\" (UID: \"4042c7a9-0fef-4d82-8f08-11601e40928f\") " pod="openshift-image-registry/image-registry-6b6f4b68db-772wg" Jun 09 02:23:16.842927 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:16.842795 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4042c7a9-0fef-4d82-8f08-11601e40928f-registry-certificates\") pod \"image-registry-6b6f4b68db-772wg\" (UID: \"4042c7a9-0fef-4d82-8f08-11601e40928f\") " pod="openshift-image-registry/image-registry-6b6f4b68db-772wg" Jun 09 02:23:16.842927 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:16.842869 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4042c7a9-0fef-4d82-8f08-11601e40928f-trusted-ca\") pod \"image-registry-6b6f4b68db-772wg\" (UID: \"4042c7a9-0fef-4d82-8f08-11601e40928f\") " pod="openshift-image-registry/image-registry-6b6f4b68db-772wg" Jun 09 02:23:16.843121 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:16.842936 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4042c7a9-0fef-4d82-8f08-11601e40928f-ca-trust-extracted\") pod \"image-registry-6b6f4b68db-772wg\" (UID: \"4042c7a9-0fef-4d82-8f08-11601e40928f\") " pod="openshift-image-registry/image-registry-6b6f4b68db-772wg" Jun 09 02:23:16.843121 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:16.842966 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4042c7a9-0fef-4d82-8f08-11601e40928f-image-registry-private-configuration\") pod \"image-registry-6b6f4b68db-772wg\" (UID: \"4042c7a9-0fef-4d82-8f08-11601e40928f\") " pod="openshift-image-registry/image-registry-6b6f4b68db-772wg" Jun 09 02:23:16.843121 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:16.842990 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/13b89d17-5f8e-4e70-9e34-e8d4d4cd90c4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jk6f4\" (UID: \"13b89d17-5f8e-4e70-9e34-e8d4d4cd90c4\") " pod="openshift-insights/insights-runtime-extractor-jk6f4" Jun 09 02:23:16.843121 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:16.843019 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4042c7a9-0fef-4d82-8f08-11601e40928f-installation-pull-secrets\") pod \"image-registry-6b6f4b68db-772wg\" (UID: \"4042c7a9-0fef-4d82-8f08-11601e40928f\") " pod="openshift-image-registry/image-registry-6b6f4b68db-772wg" Jun 09 02:23:16.843121 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:16.843042 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/13b89d17-5f8e-4e70-9e34-e8d4d4cd90c4-crio-socket\") pod \"insights-runtime-extractor-jk6f4\" (UID: \"13b89d17-5f8e-4e70-9e34-e8d4d4cd90c4\") " pod="openshift-insights/insights-runtime-extractor-jk6f4" Jun 09 02:23:16.843121 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:16.843066 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6f9jn\" (UniqueName: \"kubernetes.io/projected/13b89d17-5f8e-4e70-9e34-e8d4d4cd90c4-kube-api-access-6f9jn\") pod \"insights-runtime-extractor-jk6f4\" (UID: \"13b89d17-5f8e-4e70-9e34-e8d4d4cd90c4\") " pod="openshift-insights/insights-runtime-extractor-jk6f4" Jun 09 02:23:16.843404 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:16.843136 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/13b89d17-5f8e-4e70-9e34-e8d4d4cd90c4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jk6f4\" (UID: \"13b89d17-5f8e-4e70-9e34-e8d4d4cd90c4\") " pod="openshift-insights/insights-runtime-extractor-jk6f4" Jun 09 02:23:16.843404 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:16.843175 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4042c7a9-0fef-4d82-8f08-11601e40928f-bound-sa-token\") pod \"image-registry-6b6f4b68db-772wg\" (UID: \"4042c7a9-0fef-4d82-8f08-11601e40928f\") " pod="openshift-image-registry/image-registry-6b6f4b68db-772wg" Jun 09 02:23:16.843404 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:16.843236 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/13b89d17-5f8e-4e70-9e34-e8d4d4cd90c4-data-volume\") pod \"insights-runtime-extractor-jk6f4\" (UID: \"13b89d17-5f8e-4e70-9e34-e8d4d4cd90c4\") " pod="openshift-insights/insights-runtime-extractor-jk6f4" Jun 09 02:23:16.853634 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:16.853612 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:23:16.943600 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:16.943580 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/13b89d17-5f8e-4e70-9e34-e8d4d4cd90c4-data-volume\") pod \"insights-runtime-extractor-jk6f4\" (UID: \"13b89d17-5f8e-4e70-9e34-e8d4d4cd90c4\") " pod="openshift-insights/insights-runtime-extractor-jk6f4" Jun 09 02:23:16.943701 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:16.943606 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xn97\" (UniqueName: \"kubernetes.io/projected/4042c7a9-0fef-4d82-8f08-11601e40928f-kube-api-access-6xn97\") pod \"image-registry-6b6f4b68db-772wg\" (UID: \"4042c7a9-0fef-4d82-8f08-11601e40928f\") " pod="openshift-image-registry/image-registry-6b6f4b68db-772wg" Jun 09 02:23:16.943701 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:16.943625 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75hsv\" (UniqueName: \"kubernetes.io/projected/6c83b986-fb5e-4664-85aa-e78a5c0e9de1-kube-api-access-75hsv\") pod \"downloads-6657875f97-q5gzn\" (UID: \"6c83b986-fb5e-4664-85aa-e78a5c0e9de1\") " pod="openshift-console/downloads-6657875f97-q5gzn" Jun 09 02:23:16.943701 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:16.943641 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4042c7a9-0fef-4d82-8f08-11601e40928f-registry-tls\") pod \"image-registry-6b6f4b68db-772wg\" (UID: \"4042c7a9-0fef-4d82-8f08-11601e40928f\") " pod="openshift-image-registry/image-registry-6b6f4b68db-772wg" Jun 09 02:23:16.943701 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:16.943664 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4042c7a9-0fef-4d82-8f08-11601e40928f-registry-certificates\") pod \"image-registry-6b6f4b68db-772wg\" (UID: \"4042c7a9-0fef-4d82-8f08-11601e40928f\") " pod="openshift-image-registry/image-registry-6b6f4b68db-772wg" Jun 09 02:23:16.943701 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:16.943701 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4042c7a9-0fef-4d82-8f08-11601e40928f-trusted-ca\") pod \"image-registry-6b6f4b68db-772wg\" (UID: \"4042c7a9-0fef-4d82-8f08-11601e40928f\") " pod="openshift-image-registry/image-registry-6b6f4b68db-772wg" Jun 09 02:23:16.943955 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:16.943728 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4042c7a9-0fef-4d82-8f08-11601e40928f-ca-trust-extracted\") pod \"image-registry-6b6f4b68db-772wg\" (UID: \"4042c7a9-0fef-4d82-8f08-11601e40928f\") " pod="openshift-image-registry/image-registry-6b6f4b68db-772wg" Jun 09 02:23:16.943955 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:16.943751 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4042c7a9-0fef-4d82-8f08-11601e40928f-image-registry-private-configuration\") pod \"image-registry-6b6f4b68db-772wg\" (UID: \"4042c7a9-0fef-4d82-8f08-11601e40928f\") " pod="openshift-image-registry/image-registry-6b6f4b68db-772wg" Jun 09 02:23:16.943955 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:16.943774 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/13b89d17-5f8e-4e70-9e34-e8d4d4cd90c4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jk6f4\" (UID: \"13b89d17-5f8e-4e70-9e34-e8d4d4cd90c4\") " pod="openshift-insights/insights-runtime-extractor-jk6f4" Jun 09 02:23:16.943955 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:16.943803 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4042c7a9-0fef-4d82-8f08-11601e40928f-installation-pull-secrets\") pod \"image-registry-6b6f4b68db-772wg\" (UID: \"4042c7a9-0fef-4d82-8f08-11601e40928f\") " pod="openshift-image-registry/image-registry-6b6f4b68db-772wg" Jun 09 02:23:16.943955 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:16.943850 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/13b89d17-5f8e-4e70-9e34-e8d4d4cd90c4-crio-socket\") pod \"insights-runtime-extractor-jk6f4\" (UID: \"13b89d17-5f8e-4e70-9e34-e8d4d4cd90c4\") " pod="openshift-insights/insights-runtime-extractor-jk6f4" Jun 09 02:23:16.943955 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:16.943908 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6f9jn\" (UniqueName: \"kubernetes.io/projected/13b89d17-5f8e-4e70-9e34-e8d4d4cd90c4-kube-api-access-6f9jn\") pod \"insights-runtime-extractor-jk6f4\" (UID: \"13b89d17-5f8e-4e70-9e34-e8d4d4cd90c4\") " pod="openshift-insights/insights-runtime-extractor-jk6f4" Jun 09 02:23:16.944252 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:16.943972 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/13b89d17-5f8e-4e70-9e34-e8d4d4cd90c4-crio-socket\") pod \"insights-runtime-extractor-jk6f4\" (UID: \"13b89d17-5f8e-4e70-9e34-e8d4d4cd90c4\") " pod="openshift-insights/insights-runtime-extractor-jk6f4" Jun 09 02:23:16.944252 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:16.943982 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/13b89d17-5f8e-4e70-9e34-e8d4d4cd90c4-data-volume\") pod \"insights-runtime-extractor-jk6f4\" (UID: \"13b89d17-5f8e-4e70-9e34-e8d4d4cd90c4\") " pod="openshift-insights/insights-runtime-extractor-jk6f4" Jun 09 02:23:16.944252 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:16.944006 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/13b89d17-5f8e-4e70-9e34-e8d4d4cd90c4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jk6f4\" (UID: \"13b89d17-5f8e-4e70-9e34-e8d4d4cd90c4\") " pod="openshift-insights/insights-runtime-extractor-jk6f4" Jun 09 02:23:16.944252 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:16.944040 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4042c7a9-0fef-4d82-8f08-11601e40928f-bound-sa-token\") pod \"image-registry-6b6f4b68db-772wg\" (UID: \"4042c7a9-0fef-4d82-8f08-11601e40928f\") " pod="openshift-image-registry/image-registry-6b6f4b68db-772wg" Jun 09 02:23:16.944252 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:16.944163 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4042c7a9-0fef-4d82-8f08-11601e40928f-ca-trust-extracted\") pod \"image-registry-6b6f4b68db-772wg\" (UID: \"4042c7a9-0fef-4d82-8f08-11601e40928f\") " pod="openshift-image-registry/image-registry-6b6f4b68db-772wg" Jun 09 02:23:16.944583 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:16.944562 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/13b89d17-5f8e-4e70-9e34-e8d4d4cd90c4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jk6f4\" (UID: \"13b89d17-5f8e-4e70-9e34-e8d4d4cd90c4\") " pod="openshift-insights/insights-runtime-extractor-jk6f4" Jun 09 02:23:16.944805 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:16.944783 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4042c7a9-0fef-4d82-8f08-11601e40928f-trusted-ca\") pod \"image-registry-6b6f4b68db-772wg\" (UID: \"4042c7a9-0fef-4d82-8f08-11601e40928f\") " pod="openshift-image-registry/image-registry-6b6f4b68db-772wg" Jun 09 02:23:16.944985 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:16.944968 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4042c7a9-0fef-4d82-8f08-11601e40928f-registry-certificates\") pod \"image-registry-6b6f4b68db-772wg\" (UID: \"4042c7a9-0fef-4d82-8f08-11601e40928f\") " pod="openshift-image-registry/image-registry-6b6f4b68db-772wg" Jun 09 02:23:16.946351 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:16.946333 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4042c7a9-0fef-4d82-8f08-11601e40928f-image-registry-private-configuration\") pod \"image-registry-6b6f4b68db-772wg\" (UID: \"4042c7a9-0fef-4d82-8f08-11601e40928f\") " pod="openshift-image-registry/image-registry-6b6f4b68db-772wg" Jun 09 02:23:16.946609 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:16.946587 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4042c7a9-0fef-4d82-8f08-11601e40928f-installation-pull-secrets\") pod \"image-registry-6b6f4b68db-772wg\" (UID: \"4042c7a9-0fef-4d82-8f08-11601e40928f\") " pod="openshift-image-registry/image-registry-6b6f4b68db-772wg" Jun 09 02:23:16.946735 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:16.946715 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/13b89d17-5f8e-4e70-9e34-e8d4d4cd90c4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jk6f4\" (UID: \"13b89d17-5f8e-4e70-9e34-e8d4d4cd90c4\") " pod="openshift-insights/insights-runtime-extractor-jk6f4" Jun 09 02:23:16.946958 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:16.946940 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4042c7a9-0fef-4d82-8f08-11601e40928f-registry-tls\") pod \"image-registry-6b6f4b68db-772wg\" (UID: \"4042c7a9-0fef-4d82-8f08-11601e40928f\") " pod="openshift-image-registry/image-registry-6b6f4b68db-772wg" Jun 09 02:23:16.953720 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:16.953582 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:23:16.955218 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:16.955196 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6f9jn\" (UniqueName: \"kubernetes.io/projected/13b89d17-5f8e-4e70-9e34-e8d4d4cd90c4-kube-api-access-6f9jn\") pod \"insights-runtime-extractor-jk6f4\" (UID: \"13b89d17-5f8e-4e70-9e34-e8d4d4cd90c4\") " pod="openshift-insights/insights-runtime-extractor-jk6f4" Jun 09 02:23:16.955449 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:16.955430 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xn97\" (UniqueName: \"kubernetes.io/projected/4042c7a9-0fef-4d82-8f08-11601e40928f-kube-api-access-6xn97\") pod \"image-registry-6b6f4b68db-772wg\" (UID: \"4042c7a9-0fef-4d82-8f08-11601e40928f\") " pod="openshift-image-registry/image-registry-6b6f4b68db-772wg" Jun 09 02:23:16.955545 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:16.955524 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-75hsv\" (UniqueName: \"kubernetes.io/projected/6c83b986-fb5e-4664-85aa-e78a5c0e9de1-kube-api-access-75hsv\") pod \"downloads-6657875f97-q5gzn\" (UID: \"6c83b986-fb5e-4664-85aa-e78a5c0e9de1\") " pod="openshift-console/downloads-6657875f97-q5gzn" Jun 09 02:23:16.955666 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:16.955645 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4042c7a9-0fef-4d82-8f08-11601e40928f-bound-sa-token\") pod \"image-registry-6b6f4b68db-772wg\" (UID: \"4042c7a9-0fef-4d82-8f08-11601e40928f\") " pod="openshift-image-registry/image-registry-6b6f4b68db-772wg" Jun 09 02:23:17.056180 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:17.056164 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jk6f4" Jun 09 02:23:17.075178 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:17.075160 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-q5gzn" Jun 09 02:23:17.119760 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:17.119733 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b6f4b68db-772wg" Jun 09 02:23:17.197655 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:17.197625 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jk6f4"] Jun 09 02:23:17.199858 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:23:17.199829 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13b89d17_5f8e_4e70_9e34_e8d4d4cd90c4.slice/crio-8b225f12d02c57480a45948d0eacac9e75203b043fa206a16ecec8287f0711e4 WatchSource:0}: Error finding container 8b225f12d02c57480a45948d0eacac9e75203b043fa206a16ecec8287f0711e4: Status 404 returned error can't find the container with id 8b225f12d02c57480a45948d0eacac9e75203b043fa206a16ecec8287f0711e4 Jun 09 02:23:17.226399 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:17.226372 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-q5gzn"] Jun 09 02:23:17.243268 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:23:17.243238 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c83b986_fb5e_4664_85aa_e78a5c0e9de1.slice/crio-78bb8a5b7e6e99655ca507700191959ef001a65f62fc86e3717629bc18f5eeb1 WatchSource:0}: Error finding container 78bb8a5b7e6e99655ca507700191959ef001a65f62fc86e3717629bc18f5eeb1: Status 404 returned error can't find the container with id 78bb8a5b7e6e99655ca507700191959ef001a65f62fc86e3717629bc18f5eeb1 Jun 09 02:23:17.260543 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:17.260456 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6b6f4b68db-772wg"] Jun 09 02:23:17.262513 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:23:17.262494 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4042c7a9_0fef_4d82_8f08_11601e40928f.slice/crio-ca330b66f6a0e0432aae6ef71467ef63917e39c85662159a2fd8799a604a746d WatchSource:0}: Error finding container ca330b66f6a0e0432aae6ef71467ef63917e39c85662159a2fd8799a604a746d: Status 404 returned error can't find the container with id ca330b66f6a0e0432aae6ef71467ef63917e39c85662159a2fd8799a604a746d Jun 09 02:23:18.051952 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:18.051922 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6b6f4b68db-772wg" event={"ID":"4042c7a9-0fef-4d82-8f08-11601e40928f","Type":"ContainerStarted","Data":"db986d89dbc5b215286eab96a5aa96ebcf9e20e6820b7e4771876cc6e533b620"} Jun 09 02:23:18.052344 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:18.052002 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6b6f4b68db-772wg" event={"ID":"4042c7a9-0fef-4d82-8f08-11601e40928f","Type":"ContainerStarted","Data":"ca330b66f6a0e0432aae6ef71467ef63917e39c85662159a2fd8799a604a746d"} Jun 09 02:23:18.052344 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:18.052033 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6b6f4b68db-772wg" Jun 09 02:23:18.053795 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:18.053766 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jk6f4" event={"ID":"13b89d17-5f8e-4e70-9e34-e8d4d4cd90c4","Type":"ContainerStarted","Data":"51dd1852f37e394fa6d3ae6bdda4c6f477a85472f8d081a63e2194d9c7eda9db"} Jun 09 02:23:18.053909 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:18.053822 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jk6f4" event={"ID":"13b89d17-5f8e-4e70-9e34-e8d4d4cd90c4","Type":"ContainerStarted","Data":"8a5b38ff6ca09740050ad03ad890e5ba35c3ff4c9670b828a3d3e14d1bb58f1d"} Jun 09 02:23:18.053909 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:18.053848 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jk6f4" event={"ID":"13b89d17-5f8e-4e70-9e34-e8d4d4cd90c4","Type":"ContainerStarted","Data":"8b225f12d02c57480a45948d0eacac9e75203b043fa206a16ecec8287f0711e4"} Jun 09 02:23:18.054915 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:18.054886 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-q5gzn" event={"ID":"6c83b986-fb5e-4664-85aa-e78a5c0e9de1","Type":"ContainerStarted","Data":"78bb8a5b7e6e99655ca507700191959ef001a65f62fc86e3717629bc18f5eeb1"} Jun 09 02:23:18.070159 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:18.070122 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6b6f4b68db-772wg" podStartSLOduration=2.07011014 podStartE2EDuration="2.07011014s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:23:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:23:18.069624433 +0000 UTC m=+214.016741776" watchObservedRunningTime="2026-06-09 02:23:18.07011014 +0000 UTC m=+214.017227482" Jun 09 02:23:19.969906 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:19.969871 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4fedd3d3-404f-4e0a-b965-c5cc70b36896-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-rhlw9\" (UID: \"4fedd3d3-404f-4e0a-b965-c5cc70b36896\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rhlw9" Jun 09 02:23:19.972435 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:19.972401 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4fedd3d3-404f-4e0a-b965-c5cc70b36896-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-rhlw9\" (UID: \"4fedd3d3-404f-4e0a-b965-c5cc70b36896\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rhlw9" Jun 09 02:23:20.066301 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:20.066267 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jk6f4" event={"ID":"13b89d17-5f8e-4e70-9e34-e8d4d4cd90c4","Type":"ContainerStarted","Data":"8a768cb61bab280508fb8ad6c937a66fe3623dae31619cc5ee87c9915af0bb73"} Jun 09 02:23:20.083480 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:20.083429 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-jk6f4" podStartSLOduration=2.0211251 podStartE2EDuration="4.083415112s" totalImagesPullingTime="2.062290012s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 02:23:16 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:23:20.082684844 +0000 UTC m=+216.029802187" watchObservedRunningTime="2026-06-09 02:23:20.083415112 +0000 UTC m=+216.030532453" Jun 09 02:23:20.171454 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:20.171420 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6678acb6-6bca-47c4-be4f-acb6f2c1c530-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-sbmsx\" (UID: \"6678acb6-6bca-47c4-be4f-acb6f2c1c530\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-sbmsx" Jun 09 02:23:20.173923 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:20.173892 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6678acb6-6bca-47c4-be4f-acb6f2c1c530-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-sbmsx\" (UID: \"6678acb6-6bca-47c4-be4f-acb6f2c1c530\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-sbmsx" Jun 09 02:23:20.236034 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:20.235981 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rhlw9" Jun 09 02:23:20.390255 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:20.390231 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rhlw9"] Jun 09 02:23:20.392786 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:23:20.392750 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fedd3d3_404f_4e0a_b965_c5cc70b36896.slice/crio-a0cd698ba2014a8f23aba3c4467ca73beca156d572c3cae0eaed6bbcd18e1ee1 WatchSource:0}: Error finding container a0cd698ba2014a8f23aba3c4467ca73beca156d572c3cae0eaed6bbcd18e1ee1: Status 404 returned error can't find the container with id a0cd698ba2014a8f23aba3c4467ca73beca156d572c3cae0eaed6bbcd18e1ee1 Jun 09 02:23:20.423708 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:20.423684 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-sbmsx" Jun 09 02:23:20.595064 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:20.595033 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-sbmsx"] Jun 09 02:23:20.597674 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:23:20.597644 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6678acb6_6bca_47c4_be4f_acb6f2c1c530.slice/crio-045bd9d861b79d22d07dbe3ae098e8e7970316cff22da00b03b25d92516c7e25 WatchSource:0}: Error finding container 045bd9d861b79d22d07dbe3ae098e8e7970316cff22da00b03b25d92516c7e25: Status 404 returned error can't find the container with id 045bd9d861b79d22d07dbe3ae098e8e7970316cff22da00b03b25d92516c7e25 Jun 09 02:23:21.072209 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:21.072169 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rhlw9" event={"ID":"4fedd3d3-404f-4e0a-b965-c5cc70b36896","Type":"ContainerStarted","Data":"a0cd698ba2014a8f23aba3c4467ca73beca156d572c3cae0eaed6bbcd18e1ee1"} Jun 09 02:23:21.073490 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:21.073456 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-sbmsx" event={"ID":"6678acb6-6bca-47c4-be4f-acb6f2c1c530","Type":"ContainerStarted","Data":"045bd9d861b79d22d07dbe3ae098e8e7970316cff22da00b03b25d92516c7e25"} Jun 09 02:23:21.746364 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:21.746298 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:23:21.795893 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:21.795815 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:23:22.847224 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:22.847188 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:23:22.947493 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:22.947455 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:23:23.009002 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:23.008969 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:23:23.082446 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:23.082399 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rhlw9" event={"ID":"4fedd3d3-404f-4e0a-b965-c5cc70b36896","Type":"ContainerStarted","Data":"842764c6d4864121ee1c44aa68915e6df2740bbaa98201bba2dbb39d42635699"} Jun 09 02:23:23.083966 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:23.083926 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-sbmsx" event={"ID":"6678acb6-6bca-47c4-be4f-acb6f2c1c530","Type":"ContainerStarted","Data":"0bb02e197235be9cd8a00e3929a4eeef54a850589836a7df07aebd8661704ca3"} Jun 09 02:23:23.099789 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:23.099707 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rhlw9" podStartSLOduration=32.985385882 podStartE2EDuration="35.099691997s" totalImagesPullingTime="2.114306115s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:22:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:23:23.098968578 +0000 UTC m=+219.046085916" watchObservedRunningTime="2026-06-09 02:23:23.099691997 +0000 UTC m=+219.046809335" Jun 09 02:23:23.115506 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:23.115471 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-sbmsx" podStartSLOduration=33.209810799 podStartE2EDuration="35.115390933s" totalImagesPullingTime="1.905580134s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:22:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:23:23.114616504 +0000 UTC m=+219.061733846" watchObservedRunningTime="2026-06-09 02:23:23.115390933 +0000 UTC m=+219.062508283" Jun 09 02:23:23.213908 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:23.213874 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:23:23.314883 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:23.314856 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:23:23.362905 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:23.362814 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:23:26.036561 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:26.036529 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:23:26.080774 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:26.080743 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-v95hd"] Jun 09 02:23:26.085381 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:26.085357 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-v95hd" Jun 09 02:23:26.088761 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:26.088698 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 09 02:23:26.088761 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:26.088698 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 09 02:23:26.088761 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:26.088739 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-gh9rk\"" Jun 09 02:23:26.088979 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:26.088742 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 09 02:23:26.091949 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:26.091924 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-v95hd"] Jun 09 02:23:26.107143 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:26.107117 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:23:26.156028 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:26.155997 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:23:26.217769 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:26.217740 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/6ff45181-5685-4291-a424-b27f49e1e659-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-v95hd\" (UID: \"6ff45181-5685-4291-a424-b27f49e1e659\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-v95hd" Jun 09 02:23:26.217873 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:26.217785 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6ff45181-5685-4291-a424-b27f49e1e659-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-v95hd\" (UID: \"6ff45181-5685-4291-a424-b27f49e1e659\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-v95hd" Jun 09 02:23:26.217873 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:26.217841 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6ff45181-5685-4291-a424-b27f49e1e659-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-v95hd\" (UID: \"6ff45181-5685-4291-a424-b27f49e1e659\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-v95hd" Jun 09 02:23:26.217982 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:26.217890 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbrqd\" (UniqueName: \"kubernetes.io/projected/6ff45181-5685-4291-a424-b27f49e1e659-kube-api-access-fbrqd\") pod \"prometheus-operator-7f7d445d84-v95hd\" (UID: \"6ff45181-5685-4291-a424-b27f49e1e659\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-v95hd" Jun 09 02:23:26.318853 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:26.318806 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/6ff45181-5685-4291-a424-b27f49e1e659-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-v95hd\" (UID: \"6ff45181-5685-4291-a424-b27f49e1e659\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-v95hd" Jun 09 02:23:26.318853 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:26.318834 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6ff45181-5685-4291-a424-b27f49e1e659-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-v95hd\" (UID: \"6ff45181-5685-4291-a424-b27f49e1e659\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-v95hd" Jun 09 02:23:26.318853 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:26.318856 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6ff45181-5685-4291-a424-b27f49e1e659-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-v95hd\" (UID: \"6ff45181-5685-4291-a424-b27f49e1e659\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-v95hd" Jun 09 02:23:26.318999 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:26.318884 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbrqd\" (UniqueName: \"kubernetes.io/projected/6ff45181-5685-4291-a424-b27f49e1e659-kube-api-access-fbrqd\") pod \"prometheus-operator-7f7d445d84-v95hd\" (UID: \"6ff45181-5685-4291-a424-b27f49e1e659\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-v95hd" Jun 09 02:23:26.319450 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:26.319426 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6ff45181-5685-4291-a424-b27f49e1e659-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-v95hd\" (UID: \"6ff45181-5685-4291-a424-b27f49e1e659\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-v95hd" Jun 09 02:23:26.321165 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:26.321139 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/6ff45181-5685-4291-a424-b27f49e1e659-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-v95hd\" (UID: \"6ff45181-5685-4291-a424-b27f49e1e659\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-v95hd" Jun 09 02:23:26.321260 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:26.321196 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6ff45181-5685-4291-a424-b27f49e1e659-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-v95hd\" (UID: \"6ff45181-5685-4291-a424-b27f49e1e659\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-v95hd" Jun 09 02:23:26.326046 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:26.326025 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbrqd\" (UniqueName: \"kubernetes.io/projected/6ff45181-5685-4291-a424-b27f49e1e659-kube-api-access-fbrqd\") pod \"prometheus-operator-7f7d445d84-v95hd\" (UID: \"6ff45181-5685-4291-a424-b27f49e1e659\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-v95hd" Jun 09 02:23:26.395710 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:26.395689 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-v95hd" Jun 09 02:23:26.530762 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:26.530734 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-v95hd"] Jun 09 02:23:26.533058 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:23:26.533028 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ff45181_5685_4291_a424_b27f49e1e659.slice/crio-5c7c7fa1288b4ddc69ecd9a9ba1c4bc69f999986c6e6638a1657873b5b32beb6 WatchSource:0}: Error finding container 5c7c7fa1288b4ddc69ecd9a9ba1c4bc69f999986c6e6638a1657873b5b32beb6: Status 404 returned error can't find the container with id 5c7c7fa1288b4ddc69ecd9a9ba1c4bc69f999986c6e6638a1657873b5b32beb6 Jun 09 02:23:27.098586 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:27.098557 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-v95hd" event={"ID":"6ff45181-5685-4291-a424-b27f49e1e659","Type":"ContainerStarted","Data":"5c7c7fa1288b4ddc69ecd9a9ba1c4bc69f999986c6e6638a1657873b5b32beb6"} Jun 09 02:23:28.254507 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:28.254477 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8b56b9b76-q826m"] Jun 09 02:23:28.257701 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:28.257674 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8b56b9b76-q826m" Jun 09 02:23:28.260342 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:28.260270 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 09 02:23:28.260342 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:28.260329 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 09 02:23:28.261258 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:28.261202 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 09 02:23:28.261258 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:28.261227 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 09 02:23:28.261258 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:28.261238 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 09 02:23:28.261529 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:28.261505 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-kvtl6\"" Jun 09 02:23:28.264716 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:28.264616 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8b56b9b76-q826m"] Jun 09 02:23:28.336186 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:28.336162 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e6408c7a-c84c-4aa0-abee-ad9eb93d2ea6-console-config\") pod \"console-8b56b9b76-q826m\" (UID: \"e6408c7a-c84c-4aa0-abee-ad9eb93d2ea6\") " pod="openshift-console/console-8b56b9b76-q826m" Jun 09 02:23:28.336308 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:28.336197 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e6408c7a-c84c-4aa0-abee-ad9eb93d2ea6-oauth-serving-cert\") pod \"console-8b56b9b76-q826m\" (UID: \"e6408c7a-c84c-4aa0-abee-ad9eb93d2ea6\") " pod="openshift-console/console-8b56b9b76-q826m" Jun 09 02:23:28.336308 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:28.336224 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e6408c7a-c84c-4aa0-abee-ad9eb93d2ea6-console-serving-cert\") pod \"console-8b56b9b76-q826m\" (UID: \"e6408c7a-c84c-4aa0-abee-ad9eb93d2ea6\") " pod="openshift-console/console-8b56b9b76-q826m" Jun 09 02:23:28.336406 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:28.336343 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e6408c7a-c84c-4aa0-abee-ad9eb93d2ea6-service-ca\") pod \"console-8b56b9b76-q826m\" (UID: \"e6408c7a-c84c-4aa0-abee-ad9eb93d2ea6\") " pod="openshift-console/console-8b56b9b76-q826m" Jun 09 02:23:28.336451 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:28.336400 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e6408c7a-c84c-4aa0-abee-ad9eb93d2ea6-console-oauth-config\") pod \"console-8b56b9b76-q826m\" (UID: \"e6408c7a-c84c-4aa0-abee-ad9eb93d2ea6\") " pod="openshift-console/console-8b56b9b76-q826m" Jun 09 02:23:28.336497 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:28.336462 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4jvs\" (UniqueName: \"kubernetes.io/projected/e6408c7a-c84c-4aa0-abee-ad9eb93d2ea6-kube-api-access-l4jvs\") pod \"console-8b56b9b76-q826m\" (UID: \"e6408c7a-c84c-4aa0-abee-ad9eb93d2ea6\") " pod="openshift-console/console-8b56b9b76-q826m" Jun 09 02:23:28.437302 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:28.437270 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e6408c7a-c84c-4aa0-abee-ad9eb93d2ea6-console-config\") pod \"console-8b56b9b76-q826m\" (UID: \"e6408c7a-c84c-4aa0-abee-ad9eb93d2ea6\") " pod="openshift-console/console-8b56b9b76-q826m" Jun 09 02:23:28.437434 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:28.437319 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e6408c7a-c84c-4aa0-abee-ad9eb93d2ea6-oauth-serving-cert\") pod \"console-8b56b9b76-q826m\" (UID: \"e6408c7a-c84c-4aa0-abee-ad9eb93d2ea6\") " pod="openshift-console/console-8b56b9b76-q826m" Jun 09 02:23:28.437434 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:28.437349 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e6408c7a-c84c-4aa0-abee-ad9eb93d2ea6-console-serving-cert\") pod \"console-8b56b9b76-q826m\" (UID: \"e6408c7a-c84c-4aa0-abee-ad9eb93d2ea6\") " pod="openshift-console/console-8b56b9b76-q826m" Jun 09 02:23:28.437434 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:28.437384 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e6408c7a-c84c-4aa0-abee-ad9eb93d2ea6-service-ca\") pod \"console-8b56b9b76-q826m\" (UID: \"e6408c7a-c84c-4aa0-abee-ad9eb93d2ea6\") " pod="openshift-console/console-8b56b9b76-q826m" Jun 09 02:23:28.437434 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:28.437430 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e6408c7a-c84c-4aa0-abee-ad9eb93d2ea6-console-oauth-config\") pod \"console-8b56b9b76-q826m\" (UID: \"e6408c7a-c84c-4aa0-abee-ad9eb93d2ea6\") " pod="openshift-console/console-8b56b9b76-q826m" Jun 09 02:23:28.437647 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:28.437478 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4jvs\" (UniqueName: \"kubernetes.io/projected/e6408c7a-c84c-4aa0-abee-ad9eb93d2ea6-kube-api-access-l4jvs\") pod \"console-8b56b9b76-q826m\" (UID: \"e6408c7a-c84c-4aa0-abee-ad9eb93d2ea6\") " pod="openshift-console/console-8b56b9b76-q826m" Jun 09 02:23:28.438031 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:28.438010 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e6408c7a-c84c-4aa0-abee-ad9eb93d2ea6-console-config\") pod \"console-8b56b9b76-q826m\" (UID: \"e6408c7a-c84c-4aa0-abee-ad9eb93d2ea6\") " pod="openshift-console/console-8b56b9b76-q826m" Jun 09 02:23:28.438133 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:28.438108 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e6408c7a-c84c-4aa0-abee-ad9eb93d2ea6-oauth-serving-cert\") pod \"console-8b56b9b76-q826m\" (UID: \"e6408c7a-c84c-4aa0-abee-ad9eb93d2ea6\") " pod="openshift-console/console-8b56b9b76-q826m" Jun 09 02:23:28.438197 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:28.438107 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e6408c7a-c84c-4aa0-abee-ad9eb93d2ea6-service-ca\") pod \"console-8b56b9b76-q826m\" (UID: \"e6408c7a-c84c-4aa0-abee-ad9eb93d2ea6\") " pod="openshift-console/console-8b56b9b76-q826m" Jun 09 02:23:28.440006 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:28.439985 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e6408c7a-c84c-4aa0-abee-ad9eb93d2ea6-console-oauth-config\") pod \"console-8b56b9b76-q826m\" (UID: \"e6408c7a-c84c-4aa0-abee-ad9eb93d2ea6\") " pod="openshift-console/console-8b56b9b76-q826m" Jun 09 02:23:28.440153 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:28.440130 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e6408c7a-c84c-4aa0-abee-ad9eb93d2ea6-console-serving-cert\") pod \"console-8b56b9b76-q826m\" (UID: \"e6408c7a-c84c-4aa0-abee-ad9eb93d2ea6\") " pod="openshift-console/console-8b56b9b76-q826m" Jun 09 02:23:28.444452 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:28.444433 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4jvs\" (UniqueName: \"kubernetes.io/projected/e6408c7a-c84c-4aa0-abee-ad9eb93d2ea6-kube-api-access-l4jvs\") pod \"console-8b56b9b76-q826m\" (UID: \"e6408c7a-c84c-4aa0-abee-ad9eb93d2ea6\") " pod="openshift-console/console-8b56b9b76-q826m" Jun 09 02:23:28.570661 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:28.570635 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8b56b9b76-q826m" Jun 09 02:23:31.442849 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:31.442797 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:23:31.542840 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:31.542809 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:23:34.243022 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:34.242979 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:23:34.292056 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:34.292020 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:23:34.987048 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:34.987023 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8b56b9b76-q826m"] Jun 09 02:23:34.990026 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:23:34.989989 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6408c7a_c84c_4aa0_abee_ad9eb93d2ea6.slice/crio-75f191b2d790333543b5c8c69ed844876fb140629ae076c0aebcd7c61b804a04 WatchSource:0}: Error finding container 75f191b2d790333543b5c8c69ed844876fb140629ae076c0aebcd7c61b804a04: Status 404 returned error can't find the container with id 75f191b2d790333543b5c8c69ed844876fb140629ae076c0aebcd7c61b804a04 Jun 09 02:23:35.125480 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:35.125399 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:23:35.130209 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:35.130177 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-q5gzn" event={"ID":"6c83b986-fb5e-4664-85aa-e78a5c0e9de1","Type":"ContainerStarted","Data":"75794c6195f6ac92e18d9330563d57a20d609429231eef86a375cd2c354f3957"} Jun 09 02:23:35.130369 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:35.130348 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6657875f97-q5gzn" Jun 09 02:23:35.131460 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:35.131434 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8b56b9b76-q826m" event={"ID":"e6408c7a-c84c-4aa0-abee-ad9eb93d2ea6","Type":"ContainerStarted","Data":"75f191b2d790333543b5c8c69ed844876fb140629ae076c0aebcd7c61b804a04"} Jun 09 02:23:35.131681 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:35.131590 2573 patch_prober.go:28] interesting pod/downloads-6657875f97-q5gzn container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.133.0.16:8080/\": dial tcp 10.133.0.16:8080: connect: connection refused" start-of-body= Jun 09 02:23:35.131681 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:35.131637 2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-6657875f97-q5gzn" podUID="6c83b986-fb5e-4664-85aa-e78a5c0e9de1" containerName="download-server" probeResult="failure" output="Get \"http://10.133.0.16:8080/\": dial tcp 10.133.0.16:8080: connect: connection refused" Jun 09 02:23:35.133500 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:35.133474 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-v95hd" event={"ID":"6ff45181-5685-4291-a424-b27f49e1e659","Type":"ContainerStarted","Data":"9c9071e41888ae189c207adb8921be7c592c95529e9781c8f16b915848724af6"} Jun 09 02:23:35.133590 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:35.133527 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-v95hd" event={"ID":"6ff45181-5685-4291-a424-b27f49e1e659","Type":"ContainerStarted","Data":"c46a41e76778d2a900b54ed08a576d9704c57609c24a5e2625d3d67066eba3c3"} Jun 09 02:23:35.144395 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:35.144345 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6657875f97-q5gzn" podStartSLOduration=1.4723565 podStartE2EDuration="19.144331294s" totalImagesPullingTime="17.671974794s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:23:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:23:35.143982128 +0000 UTC m=+231.091099481" watchObservedRunningTime="2026-06-09 02:23:35.144331294 +0000 UTC m=+231.091448635" Jun 09 02:23:35.158235 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:35.158200 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7f7d445d84-v95hd" podStartSLOduration=0.830421163 podStartE2EDuration="9.158187651s" totalImagesPullingTime="8.327766488s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:23:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:23:35.157301407 +0000 UTC m=+231.104418780" watchObservedRunningTime="2026-06-09 02:23:35.158187651 +0000 UTC m=+231.105304993" Jun 09 02:23:36.150018 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:36.149989 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6657875f97-q5gzn" Jun 09 02:23:37.127026 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:37.126825 2573 patch_prober.go:28] interesting pod/image-registry-6b6f4b68db-772wg container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 02:23:37.127026 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:37.126885 2573 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6b6f4b68db-772wg" podUID="4042c7a9-0fef-4d82-8f08-11601e40928f" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 02:23:37.167713 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:37.167636 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:23:37.381515 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:37.381369 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:23:37.426136 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:37.424954 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-97ltg"] Jun 09 02:23:37.460473 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:37.458818 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-97ltg"] Jun 09 02:23:37.460473 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:37.458867 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-kbljc"] Jun 09 02:23:37.460473 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:37.459026 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-97ltg" Jun 09 02:23:37.462499 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:37.461998 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 09 02:23:37.462499 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:37.462256 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 09 02:23:37.463963 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:37.462811 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 09 02:23:37.463963 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:37.463064 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-69ngm\"" Jun 09 02:23:37.474236 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:37.473317 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kbljc" Jun 09 02:23:37.479960 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:37.476450 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 09 02:23:37.479960 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:37.476687 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 09 02:23:37.479960 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:37.476985 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-bstpg\"" Jun 09 02:23:37.479960 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:37.477313 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 09 02:23:37.484866 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:37.484579 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:23:37.546724 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:37.545909 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:23:37.618093 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:37.617946 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5a863693-b258-4a61-8fa6-6991f66fc566-node-exporter-accelerators-collector-config\") pod \"node-exporter-kbljc\" (UID: \"5a863693-b258-4a61-8fa6-6991f66fc566\") " pod="openshift-monitoring/node-exporter-kbljc" Jun 09 02:23:37.618093 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:37.617987 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwshc\" (UniqueName: \"kubernetes.io/projected/5a863693-b258-4a61-8fa6-6991f66fc566-kube-api-access-zwshc\") pod \"node-exporter-kbljc\" (UID: \"5a863693-b258-4a61-8fa6-6991f66fc566\") " pod="openshift-monitoring/node-exporter-kbljc" Jun 09 02:23:37.618093 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:37.618015 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/4fa30d51-ae8f-402a-9929-6e7047eb8243-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-97ltg\" (UID: \"4fa30d51-ae8f-402a-9929-6e7047eb8243\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-97ltg" Jun 09 02:23:37.618093 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:37.618087 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5a863693-b258-4a61-8fa6-6991f66fc566-node-exporter-tls\") pod \"node-exporter-kbljc\" (UID: \"5a863693-b258-4a61-8fa6-6991f66fc566\") " pod="openshift-monitoring/node-exporter-kbljc" Jun 09 02:23:37.618374 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:37.618127 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5a863693-b258-4a61-8fa6-6991f66fc566-metrics-client-ca\") pod \"node-exporter-kbljc\" (UID: \"5a863693-b258-4a61-8fa6-6991f66fc566\") " pod="openshift-monitoring/node-exporter-kbljc" Jun 09 02:23:37.618374 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:37.618152 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8v9n\" (UniqueName: \"kubernetes.io/projected/4fa30d51-ae8f-402a-9929-6e7047eb8243-kube-api-access-f8v9n\") pod \"kube-state-metrics-57bbf8bfb5-97ltg\" (UID: \"4fa30d51-ae8f-402a-9929-6e7047eb8243\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-97ltg" Jun 09 02:23:37.618374 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:37.618182 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5a863693-b258-4a61-8fa6-6991f66fc566-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kbljc\" (UID: \"5a863693-b258-4a61-8fa6-6991f66fc566\") " pod="openshift-monitoring/node-exporter-kbljc" Jun 09 02:23:37.618374 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:37.618228 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5a863693-b258-4a61-8fa6-6991f66fc566-node-exporter-textfile\") pod \"node-exporter-kbljc\" (UID: \"5a863693-b258-4a61-8fa6-6991f66fc566\") " pod="openshift-monitoring/node-exporter-kbljc" Jun 09 02:23:37.618374 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:37.618255 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5a863693-b258-4a61-8fa6-6991f66fc566-sys\") pod \"node-exporter-kbljc\" (UID: \"5a863693-b258-4a61-8fa6-6991f66fc566\") " pod="openshift-monitoring/node-exporter-kbljc" Jun 09 02:23:37.618374 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:37.618278 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5a863693-b258-4a61-8fa6-6991f66fc566-root\") pod \"node-exporter-kbljc\" (UID: \"5a863693-b258-4a61-8fa6-6991f66fc566\") " pod="openshift-monitoring/node-exporter-kbljc" Jun 09 02:23:37.618374 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:37.618313 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5a863693-b258-4a61-8fa6-6991f66fc566-node-exporter-wtmp\") pod \"node-exporter-kbljc\" (UID: \"5a863693-b258-4a61-8fa6-6991f66fc566\") " pod="openshift-monitoring/node-exporter-kbljc" Jun 09 02:23:37.618374 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:37.618342 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4fa30d51-ae8f-402a-9929-6e7047eb8243-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-97ltg\" (UID: \"4fa30d51-ae8f-402a-9929-6e7047eb8243\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-97ltg" Jun 09 02:23:37.618374 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:37.618367 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4fa30d51-ae8f-402a-9929-6e7047eb8243-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-97ltg\" (UID: \"4fa30d51-ae8f-402a-9929-6e7047eb8243\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-97ltg" Jun 09 02:23:37.618764 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:37.618399 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4fa30d51-ae8f-402a-9929-6e7047eb8243-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-97ltg\" (UID: \"4fa30d51-ae8f-402a-9929-6e7047eb8243\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-97ltg" Jun 09 02:23:37.618764 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:37.618427 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/4fa30d51-ae8f-402a-9929-6e7047eb8243-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-97ltg\" (UID: \"4fa30d51-ae8f-402a-9929-6e7047eb8243\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-97ltg" Jun 09 02:23:37.656633 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:37.656555 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:23:37.720333 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:37.720141 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5a863693-b258-4a61-8fa6-6991f66fc566-node-exporter-textfile\") pod \"node-exporter-kbljc\" (UID: \"5a863693-b258-4a61-8fa6-6991f66fc566\") " pod="openshift-monitoring/node-exporter-kbljc" Jun 09 02:23:37.720333 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:37.720192 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5a863693-b258-4a61-8fa6-6991f66fc566-sys\") pod \"node-exporter-kbljc\" (UID: \"5a863693-b258-4a61-8fa6-6991f66fc566\") " pod="openshift-monitoring/node-exporter-kbljc" Jun 09 02:23:37.720333 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:37.720236 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5a863693-b258-4a61-8fa6-6991f66fc566-root\") pod \"node-exporter-kbljc\" (UID: \"5a863693-b258-4a61-8fa6-6991f66fc566\") " pod="openshift-monitoring/node-exporter-kbljc" Jun 09 02:23:37.720333 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:37.720292 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5a863693-b258-4a61-8fa6-6991f66fc566-node-exporter-wtmp\") pod \"node-exporter-kbljc\" (UID: \"5a863693-b258-4a61-8fa6-6991f66fc566\") " pod="openshift-monitoring/node-exporter-kbljc" Jun 09 02:23:37.720333 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:37.720328 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4fa30d51-ae8f-402a-9929-6e7047eb8243-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-97ltg\" (UID: \"4fa30d51-ae8f-402a-9929-6e7047eb8243\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-97ltg" Jun 09 02:23:37.720653 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:37.720356 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4fa30d51-ae8f-402a-9929-6e7047eb8243-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-97ltg\" (UID: \"4fa30d51-ae8f-402a-9929-6e7047eb8243\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-97ltg" Jun 09 02:23:37.720653 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:37.720408 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4fa30d51-ae8f-402a-9929-6e7047eb8243-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-97ltg\" (UID: \"4fa30d51-ae8f-402a-9929-6e7047eb8243\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-97ltg" Jun 09 02:23:37.720653 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:37.720440 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/4fa30d51-ae8f-402a-9929-6e7047eb8243-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-97ltg\" (UID: \"4fa30d51-ae8f-402a-9929-6e7047eb8243\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-97ltg" Jun 09 02:23:37.720653 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:37.720491 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5a863693-b258-4a61-8fa6-6991f66fc566-node-exporter-accelerators-collector-config\") pod \"node-exporter-kbljc\" (UID: \"5a863693-b258-4a61-8fa6-6991f66fc566\") " pod="openshift-monitoring/node-exporter-kbljc" Jun 09 02:23:37.720653 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:37.720518 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwshc\" (UniqueName: \"kubernetes.io/projected/5a863693-b258-4a61-8fa6-6991f66fc566-kube-api-access-zwshc\") pod \"node-exporter-kbljc\" (UID: \"5a863693-b258-4a61-8fa6-6991f66fc566\") " pod="openshift-monitoring/node-exporter-kbljc" Jun 09 02:23:37.720653 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:37.720557 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/4fa30d51-ae8f-402a-9929-6e7047eb8243-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-97ltg\" (UID: \"4fa30d51-ae8f-402a-9929-6e7047eb8243\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-97ltg" Jun 09 02:23:37.720653 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:37.720618 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5a863693-b258-4a61-8fa6-6991f66fc566-node-exporter-tls\") pod \"node-exporter-kbljc\" (UID: \"5a863693-b258-4a61-8fa6-6991f66fc566\") " pod="openshift-monitoring/node-exporter-kbljc" Jun 09 02:23:37.720984 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:37.720676 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5a863693-b258-4a61-8fa6-6991f66fc566-metrics-client-ca\") pod \"node-exporter-kbljc\" (UID: \"5a863693-b258-4a61-8fa6-6991f66fc566\") " pod="openshift-monitoring/node-exporter-kbljc" Jun 09 02:23:37.720984 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:37.720701 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8v9n\" (UniqueName: \"kubernetes.io/projected/4fa30d51-ae8f-402a-9929-6e7047eb8243-kube-api-access-f8v9n\") pod \"kube-state-metrics-57bbf8bfb5-97ltg\" (UID: \"4fa30d51-ae8f-402a-9929-6e7047eb8243\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-97ltg" Jun 09 02:23:37.720984 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:37.720751 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5a863693-b258-4a61-8fa6-6991f66fc566-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kbljc\" (UID: \"5a863693-b258-4a61-8fa6-6991f66fc566\") " pod="openshift-monitoring/node-exporter-kbljc" Jun 09 02:23:37.722138 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:37.722113 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/4fa30d51-ae8f-402a-9929-6e7047eb8243-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-97ltg\" (UID: \"4fa30d51-ae8f-402a-9929-6e7047eb8243\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-97ltg" Jun 09 02:23:37.723750 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:37.722822 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/4fa30d51-ae8f-402a-9929-6e7047eb8243-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-97ltg\" (UID: \"4fa30d51-ae8f-402a-9929-6e7047eb8243\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-97ltg" Jun 09 02:23:37.723750 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:23:37.722914 2573 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 09 02:23:37.723750 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:37.722936 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5a863693-b258-4a61-8fa6-6991f66fc566-metrics-client-ca\") pod \"node-exporter-kbljc\" (UID: \"5a863693-b258-4a61-8fa6-6991f66fc566\") " pod="openshift-monitoring/node-exporter-kbljc" Jun 09 02:23:37.723750 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:23:37.722964 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a863693-b258-4a61-8fa6-6991f66fc566-node-exporter-tls podName:5a863693-b258-4a61-8fa6-6991f66fc566 nodeName:}" failed. No retries permitted until 2026-06-09 02:23:38.222947188 +0000 UTC m=+234.170064515 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/5a863693-b258-4a61-8fa6-6991f66fc566-node-exporter-tls") pod "node-exporter-kbljc" (UID: "5a863693-b258-4a61-8fa6-6991f66fc566") : secret "node-exporter-tls" not found Jun 09 02:23:37.723750 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:37.723051 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5a863693-b258-4a61-8fa6-6991f66fc566-root\") pod \"node-exporter-kbljc\" (UID: \"5a863693-b258-4a61-8fa6-6991f66fc566\") " pod="openshift-monitoring/node-exporter-kbljc" Jun 09 02:23:37.723750 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:37.723151 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5a863693-b258-4a61-8fa6-6991f66fc566-sys\") pod \"node-exporter-kbljc\" (UID: \"5a863693-b258-4a61-8fa6-6991f66fc566\") " pod="openshift-monitoring/node-exporter-kbljc" Jun 09 02:23:37.723750 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:37.723337 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5a863693-b258-4a61-8fa6-6991f66fc566-node-exporter-textfile\") pod \"node-exporter-kbljc\" (UID: \"5a863693-b258-4a61-8fa6-6991f66fc566\") " pod="openshift-monitoring/node-exporter-kbljc" Jun 09 02:23:37.723750 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:23:37.723425 2573 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jun 09 02:23:37.723750 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:23:37.723487 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fa30d51-ae8f-402a-9929-6e7047eb8243-kube-state-metrics-tls podName:4fa30d51-ae8f-402a-9929-6e7047eb8243 nodeName:}" failed. No retries permitted until 2026-06-09 02:23:38.223456989 +0000 UTC m=+234.170574312 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/4fa30d51-ae8f-402a-9929-6e7047eb8243-kube-state-metrics-tls") pod "kube-state-metrics-57bbf8bfb5-97ltg" (UID: "4fa30d51-ae8f-402a-9929-6e7047eb8243") : secret "kube-state-metrics-tls" not found Jun 09 02:23:37.723750 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:37.723628 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5a863693-b258-4a61-8fa6-6991f66fc566-node-exporter-wtmp\") pod \"node-exporter-kbljc\" (UID: \"5a863693-b258-4a61-8fa6-6991f66fc566\") " pod="openshift-monitoring/node-exporter-kbljc" Jun 09 02:23:37.723750 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:37.723701 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4fa30d51-ae8f-402a-9929-6e7047eb8243-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-97ltg\" (UID: \"4fa30d51-ae8f-402a-9929-6e7047eb8243\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-97ltg" Jun 09 02:23:37.724772 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:37.724731 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5a863693-b258-4a61-8fa6-6991f66fc566-node-exporter-accelerators-collector-config\") pod \"node-exporter-kbljc\" (UID: \"5a863693-b258-4a61-8fa6-6991f66fc566\") " pod="openshift-monitoring/node-exporter-kbljc" Jun 09 02:23:37.728149 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:37.728106 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4fa30d51-ae8f-402a-9929-6e7047eb8243-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-97ltg\" (UID: \"4fa30d51-ae8f-402a-9929-6e7047eb8243\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-97ltg" Jun 09 02:23:37.731859 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:37.731822 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwshc\" (UniqueName: \"kubernetes.io/projected/5a863693-b258-4a61-8fa6-6991f66fc566-kube-api-access-zwshc\") pod \"node-exporter-kbljc\" (UID: \"5a863693-b258-4a61-8fa6-6991f66fc566\") " pod="openshift-monitoring/node-exporter-kbljc" Jun 09 02:23:37.736353 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:37.736314 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5a863693-b258-4a61-8fa6-6991f66fc566-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kbljc\" (UID: \"5a863693-b258-4a61-8fa6-6991f66fc566\") " pod="openshift-monitoring/node-exporter-kbljc" Jun 09 02:23:37.737409 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:37.737351 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8v9n\" (UniqueName: \"kubernetes.io/projected/4fa30d51-ae8f-402a-9929-6e7047eb8243-kube-api-access-f8v9n\") pod \"kube-state-metrics-57bbf8bfb5-97ltg\" (UID: \"4fa30d51-ae8f-402a-9929-6e7047eb8243\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-97ltg" Jun 09 02:23:37.761451 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:37.760303 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:23:37.856522 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:37.856431 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:23:37.959053 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:37.958968 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:23:38.008269 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:38.008240 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:23:38.116040 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:38.116009 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:23:38.179151 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:38.179116 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:23:38.226262 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:38.225733 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4fa30d51-ae8f-402a-9929-6e7047eb8243-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-97ltg\" (UID: \"4fa30d51-ae8f-402a-9929-6e7047eb8243\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-97ltg" Jun 09 02:23:38.226262 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:38.225809 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5a863693-b258-4a61-8fa6-6991f66fc566-node-exporter-tls\") pod \"node-exporter-kbljc\" (UID: \"5a863693-b258-4a61-8fa6-6991f66fc566\") " pod="openshift-monitoring/node-exporter-kbljc" Jun 09 02:23:38.228997 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:38.228975 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4fa30d51-ae8f-402a-9929-6e7047eb8243-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-97ltg\" (UID: \"4fa30d51-ae8f-402a-9929-6e7047eb8243\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-97ltg" Jun 09 02:23:38.229777 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:38.229758 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5a863693-b258-4a61-8fa6-6991f66fc566-node-exporter-tls\") pod \"node-exporter-kbljc\" (UID: \"5a863693-b258-4a61-8fa6-6991f66fc566\") " pod="openshift-monitoring/node-exporter-kbljc" Jun 09 02:23:38.259100 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:38.258823 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:23:38.362114 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:38.361823 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:23:38.375921 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:38.375772 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-97ltg" Jun 09 02:23:38.403094 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:38.401253 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kbljc" Jun 09 02:23:38.459672 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:38.459643 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:23:38.524672 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:38.524490 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:23:38.994664 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:23:38.994058 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a863693_b258_4a61_8fa6_6991f66fc566.slice/crio-e04217ac5e15415c6217bb4c57db1c3b2d55e41fe6c149844e256c42d05a1891 WatchSource:0}: Error finding container e04217ac5e15415c6217bb4c57db1c3b2d55e41fe6c149844e256c42d05a1891: Status 404 returned error can't find the container with id e04217ac5e15415c6217bb4c57db1c3b2d55e41fe6c149844e256c42d05a1891 Jun 09 02:23:39.071325 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:39.068648 2573 patch_prober.go:28] interesting pod/image-registry-6b6f4b68db-772wg container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 02:23:39.071325 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:39.068708 2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6b6f4b68db-772wg" podUID="4042c7a9-0fef-4d82-8f08-11601e40928f" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 02:23:39.150988 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:39.150939 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-97ltg"] Jun 09 02:23:39.151952 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:39.151922 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kbljc" event={"ID":"5a863693-b258-4a61-8fa6-6991f66fc566","Type":"ContainerStarted","Data":"e04217ac5e15415c6217bb4c57db1c3b2d55e41fe6c149844e256c42d05a1891"} Jun 09 02:23:39.156506 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:23:39.156474 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fa30d51_ae8f_402a_9929_6e7047eb8243.slice/crio-60e3c17b2eea248b568ffbc54f6a1379265009410205694c632271361d506818 WatchSource:0}: Error finding container 60e3c17b2eea248b568ffbc54f6a1379265009410205694c632271361d506818: Status 404 returned error can't find the container with id 60e3c17b2eea248b568ffbc54f6a1379265009410205694c632271361d506818 Jun 09 02:23:39.658476 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:39.658383 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:23:40.158378 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:40.158287 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8b56b9b76-q826m" event={"ID":"e6408c7a-c84c-4aa0-abee-ad9eb93d2ea6","Type":"ContainerStarted","Data":"e718e6097dc0fd0c4db989c90084eba56a73f9c42199f110cae3bba6b0d9f63e"} Jun 09 02:23:40.159789 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:40.159745 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-97ltg" event={"ID":"4fa30d51-ae8f-402a-9929-6e7047eb8243","Type":"ContainerStarted","Data":"60e3c17b2eea248b568ffbc54f6a1379265009410205694c632271361d506818"} Jun 09 02:23:40.173735 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:40.173654 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8b56b9b76-q826m" podStartSLOduration=7.80027049 podStartE2EDuration="12.173636907s" totalImagesPullingTime="4.373366417s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:23:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:23:40.173580176 +0000 UTC m=+236.120697520" watchObservedRunningTime="2026-06-09 02:23:40.173636907 +0000 UTC m=+236.120754250" Jun 09 02:23:40.337101 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:40.335183 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:23:40.407278 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:40.407210 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:23:40.410964 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:40.410837 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-8947bf746-nddpw"] Jun 09 02:23:40.434146 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:40.434122 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-8947bf746-nddpw"] Jun 09 02:23:40.434303 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:40.434289 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-8947bf746-nddpw" Jun 09 02:23:40.438431 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:40.438409 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-bjbi74hukljhv\"" Jun 09 02:23:40.438540 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:40.438460 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 09 02:23:40.438695 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:40.438677 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-jjlpx\"" Jun 09 02:23:40.439000 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:40.438986 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 09 02:23:40.439314 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:40.439301 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 09 02:23:40.439600 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:40.439587 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 09 02:23:40.440005 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:40.439831 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 09 02:23:40.550739 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:40.550712 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/e8420c3f-7b6f-4934-9f14-d3a454dacc8c-secret-thanos-querier-tls\") pod \"thanos-querier-8947bf746-nddpw\" (UID: \"e8420c3f-7b6f-4934-9f14-d3a454dacc8c\") " pod="openshift-monitoring/thanos-querier-8947bf746-nddpw" Jun 09 02:23:40.551023 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:40.551006 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drbhl\" (UniqueName: \"kubernetes.io/projected/e8420c3f-7b6f-4934-9f14-d3a454dacc8c-kube-api-access-drbhl\") pod \"thanos-querier-8947bf746-nddpw\" (UID: \"e8420c3f-7b6f-4934-9f14-d3a454dacc8c\") " pod="openshift-monitoring/thanos-querier-8947bf746-nddpw" Jun 09 02:23:40.551223 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:40.551200 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e8420c3f-7b6f-4934-9f14-d3a454dacc8c-metrics-client-ca\") pod \"thanos-querier-8947bf746-nddpw\" (UID: \"e8420c3f-7b6f-4934-9f14-d3a454dacc8c\") " pod="openshift-monitoring/thanos-querier-8947bf746-nddpw" Jun 09 02:23:40.551379 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:40.551357 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e8420c3f-7b6f-4934-9f14-d3a454dacc8c-secret-grpc-tls\") pod \"thanos-querier-8947bf746-nddpw\" (UID: \"e8420c3f-7b6f-4934-9f14-d3a454dacc8c\") " pod="openshift-monitoring/thanos-querier-8947bf746-nddpw" Jun 09 02:23:40.551470 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:40.551451 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/e8420c3f-7b6f-4934-9f14-d3a454dacc8c-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-8947bf746-nddpw\" (UID: \"e8420c3f-7b6f-4934-9f14-d3a454dacc8c\") " pod="openshift-monitoring/thanos-querier-8947bf746-nddpw" Jun 09 02:23:40.551585 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:40.551569 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/e8420c3f-7b6f-4934-9f14-d3a454dacc8c-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-8947bf746-nddpw\" (UID: \"e8420c3f-7b6f-4934-9f14-d3a454dacc8c\") " pod="openshift-monitoring/thanos-querier-8947bf746-nddpw" Jun 09 02:23:40.551768 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:40.551746 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e8420c3f-7b6f-4934-9f14-d3a454dacc8c-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-8947bf746-nddpw\" (UID: \"e8420c3f-7b6f-4934-9f14-d3a454dacc8c\") " pod="openshift-monitoring/thanos-querier-8947bf746-nddpw" Jun 09 02:23:40.551858 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:40.551778 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e8420c3f-7b6f-4934-9f14-d3a454dacc8c-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-8947bf746-nddpw\" (UID: \"e8420c3f-7b6f-4934-9f14-d3a454dacc8c\") " pod="openshift-monitoring/thanos-querier-8947bf746-nddpw" Jun 09 02:23:40.653411 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:40.652659 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/e8420c3f-7b6f-4934-9f14-d3a454dacc8c-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-8947bf746-nddpw\" (UID: \"e8420c3f-7b6f-4934-9f14-d3a454dacc8c\") " pod="openshift-monitoring/thanos-querier-8947bf746-nddpw" Jun 09 02:23:40.653411 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:40.652714 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/e8420c3f-7b6f-4934-9f14-d3a454dacc8c-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-8947bf746-nddpw\" (UID: \"e8420c3f-7b6f-4934-9f14-d3a454dacc8c\") " pod="openshift-monitoring/thanos-querier-8947bf746-nddpw" Jun 09 02:23:40.653411 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:40.652776 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e8420c3f-7b6f-4934-9f14-d3a454dacc8c-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-8947bf746-nddpw\" (UID: \"e8420c3f-7b6f-4934-9f14-d3a454dacc8c\") " pod="openshift-monitoring/thanos-querier-8947bf746-nddpw" Jun 09 02:23:40.653411 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:40.652802 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e8420c3f-7b6f-4934-9f14-d3a454dacc8c-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-8947bf746-nddpw\" (UID: \"e8420c3f-7b6f-4934-9f14-d3a454dacc8c\") " pod="openshift-monitoring/thanos-querier-8947bf746-nddpw" Jun 09 02:23:40.653411 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:40.652842 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/e8420c3f-7b6f-4934-9f14-d3a454dacc8c-secret-thanos-querier-tls\") pod \"thanos-querier-8947bf746-nddpw\" (UID: \"e8420c3f-7b6f-4934-9f14-d3a454dacc8c\") " pod="openshift-monitoring/thanos-querier-8947bf746-nddpw" Jun 09 02:23:40.653411 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:40.652874 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drbhl\" (UniqueName: \"kubernetes.io/projected/e8420c3f-7b6f-4934-9f14-d3a454dacc8c-kube-api-access-drbhl\") pod \"thanos-querier-8947bf746-nddpw\" (UID: \"e8420c3f-7b6f-4934-9f14-d3a454dacc8c\") " pod="openshift-monitoring/thanos-querier-8947bf746-nddpw" Jun 09 02:23:40.653411 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:40.652902 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e8420c3f-7b6f-4934-9f14-d3a454dacc8c-metrics-client-ca\") pod \"thanos-querier-8947bf746-nddpw\" (UID: \"e8420c3f-7b6f-4934-9f14-d3a454dacc8c\") " pod="openshift-monitoring/thanos-querier-8947bf746-nddpw" Jun 09 02:23:40.653411 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:40.652924 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e8420c3f-7b6f-4934-9f14-d3a454dacc8c-secret-grpc-tls\") pod \"thanos-querier-8947bf746-nddpw\" (UID: \"e8420c3f-7b6f-4934-9f14-d3a454dacc8c\") " pod="openshift-monitoring/thanos-querier-8947bf746-nddpw" Jun 09 02:23:40.653875 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:40.653830 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e8420c3f-7b6f-4934-9f14-d3a454dacc8c-metrics-client-ca\") pod \"thanos-querier-8947bf746-nddpw\" (UID: \"e8420c3f-7b6f-4934-9f14-d3a454dacc8c\") " pod="openshift-monitoring/thanos-querier-8947bf746-nddpw" Jun 09 02:23:40.665573 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:40.658962 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e8420c3f-7b6f-4934-9f14-d3a454dacc8c-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-8947bf746-nddpw\" (UID: \"e8420c3f-7b6f-4934-9f14-d3a454dacc8c\") " pod="openshift-monitoring/thanos-querier-8947bf746-nddpw" Jun 09 02:23:40.665573 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:40.659329 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e8420c3f-7b6f-4934-9f14-d3a454dacc8c-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-8947bf746-nddpw\" (UID: \"e8420c3f-7b6f-4934-9f14-d3a454dacc8c\") " pod="openshift-monitoring/thanos-querier-8947bf746-nddpw" Jun 09 02:23:40.665573 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:40.659451 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/e8420c3f-7b6f-4934-9f14-d3a454dacc8c-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-8947bf746-nddpw\" (UID: \"e8420c3f-7b6f-4934-9f14-d3a454dacc8c\") " pod="openshift-monitoring/thanos-querier-8947bf746-nddpw" Jun 09 02:23:40.665573 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:40.660232 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/e8420c3f-7b6f-4934-9f14-d3a454dacc8c-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-8947bf746-nddpw\" (UID: \"e8420c3f-7b6f-4934-9f14-d3a454dacc8c\") " pod="openshift-monitoring/thanos-querier-8947bf746-nddpw" Jun 09 02:23:40.665573 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:40.660750 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e8420c3f-7b6f-4934-9f14-d3a454dacc8c-secret-grpc-tls\") pod \"thanos-querier-8947bf746-nddpw\" (UID: \"e8420c3f-7b6f-4934-9f14-d3a454dacc8c\") " pod="openshift-monitoring/thanos-querier-8947bf746-nddpw" Jun 09 02:23:40.665573 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:40.662500 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/e8420c3f-7b6f-4934-9f14-d3a454dacc8c-secret-thanos-querier-tls\") pod \"thanos-querier-8947bf746-nddpw\" (UID: \"e8420c3f-7b6f-4934-9f14-d3a454dacc8c\") " pod="openshift-monitoring/thanos-querier-8947bf746-nddpw" Jun 09 02:23:40.665573 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:40.664715 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-drbhl\" (UniqueName: \"kubernetes.io/projected/e8420c3f-7b6f-4934-9f14-d3a454dacc8c-kube-api-access-drbhl\") pod \"thanos-querier-8947bf746-nddpw\" (UID: \"e8420c3f-7b6f-4934-9f14-d3a454dacc8c\") " pod="openshift-monitoring/thanos-querier-8947bf746-nddpw" Jun 09 02:23:40.748380 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:40.748350 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-8947bf746-nddpw" Jun 09 02:23:40.917730 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:40.917616 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:23:41.125162 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:41.125105 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:23:41.447594 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:41.447504 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-8947bf746-nddpw"] Jun 09 02:23:41.452573 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:23:41.452472 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8420c3f_7b6f_4934_9f14_d3a454dacc8c.slice/crio-e86df5334dcdd7fb64e6a2e97973b0f65a7164b632c937860070f544ba1b28c2 WatchSource:0}: Error finding container e86df5334dcdd7fb64e6a2e97973b0f65a7164b632c937860070f544ba1b28c2: Status 404 returned error can't find the container with id e86df5334dcdd7fb64e6a2e97973b0f65a7164b632c937860070f544ba1b28c2 Jun 09 02:23:42.171599 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:42.171560 2573 generic.go:356] "Generic (PLEG): container finished" podID="5a863693-b258-4a61-8fa6-6991f66fc566" containerID="c16d23124b5522a22752424734f6ae5fc6d12ea75660b8c04663406860915f34" exitCode=0 Jun 09 02:23:42.172133 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:42.171654 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kbljc" event={"ID":"5a863693-b258-4a61-8fa6-6991f66fc566","Type":"ContainerDied","Data":"c16d23124b5522a22752424734f6ae5fc6d12ea75660b8c04663406860915f34"} Jun 09 02:23:42.181030 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:42.180398 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-97ltg" event={"ID":"4fa30d51-ae8f-402a-9929-6e7047eb8243","Type":"ContainerStarted","Data":"bb3e2bd9fa302bb467a4e1b6751a64b3461aa598b03643b397e3ff69701c3c5c"} Jun 09 02:23:42.181030 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:42.180458 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-97ltg" event={"ID":"4fa30d51-ae8f-402a-9929-6e7047eb8243","Type":"ContainerStarted","Data":"1b28cf53c67b15d9632787c22b43a3a576cea52dabb2a02059054fe3b2bc45cc"} Jun 09 02:23:42.181030 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:42.180488 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-97ltg" event={"ID":"4fa30d51-ae8f-402a-9929-6e7047eb8243","Type":"ContainerStarted","Data":"a793984d6bc5bf02b3358e96856af72d12ebc27554f1f571f3934bdb93d74c2a"} Jun 09 02:23:42.182914 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:42.182883 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8947bf746-nddpw" event={"ID":"e8420c3f-7b6f-4934-9f14-d3a454dacc8c","Type":"ContainerStarted","Data":"e86df5334dcdd7fb64e6a2e97973b0f65a7164b632c937860070f544ba1b28c2"} Jun 09 02:23:42.215374 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:42.215108 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-97ltg" podStartSLOduration=3.070860542 podStartE2EDuration="5.215090638s" totalImagesPullingTime="2.144230096s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:23:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:23:42.213584913 +0000 UTC m=+238.160702256" watchObservedRunningTime="2026-06-09 02:23:42.215090638 +0000 UTC m=+238.162207976" Jun 09 02:23:42.224135 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:42.223557 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8b56b9b76-q826m"] Jun 09 02:23:42.226085 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:42.225999 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:23:42.286655 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:42.286574 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:23:42.630457 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:42.630401 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7bb67db84c-cbxq7"] Jun 09 02:23:42.647110 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:42.645860 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7bb67db84c-cbxq7" Jun 09 02:23:42.647467 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:42.645762 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7bb67db84c-cbxq7"] Jun 09 02:23:42.648534 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:42.648515 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 09 02:23:42.649294 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:42.649274 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 09 02:23:42.650866 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:42.649657 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-t6xd8\"" Jun 09 02:23:42.651204 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:42.649721 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 09 02:23:42.651782 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:42.649801 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 09 02:23:42.651782 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:42.651358 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 09 02:23:42.654898 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:42.654878 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 09 02:23:42.765355 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:42.765282 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:23:42.776197 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:42.776167 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/774ec8f7-5fec-40ab-a338-7c799704c30e-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7bb67db84c-cbxq7\" (UID: \"774ec8f7-5fec-40ab-a338-7c799704c30e\") " pod="openshift-monitoring/telemeter-client-7bb67db84c-cbxq7" Jun 09 02:23:42.776316 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:42.776212 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/774ec8f7-5fec-40ab-a338-7c799704c30e-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7bb67db84c-cbxq7\" (UID: \"774ec8f7-5fec-40ab-a338-7c799704c30e\") " pod="openshift-monitoring/telemeter-client-7bb67db84c-cbxq7" Jun 09 02:23:42.776316 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:42.776238 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/774ec8f7-5fec-40ab-a338-7c799704c30e-federate-client-tls\") pod \"telemeter-client-7bb67db84c-cbxq7\" (UID: \"774ec8f7-5fec-40ab-a338-7c799704c30e\") " pod="openshift-monitoring/telemeter-client-7bb67db84c-cbxq7" Jun 09 02:23:42.776316 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:42.776267 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ch5hq\" (UniqueName: \"kubernetes.io/projected/774ec8f7-5fec-40ab-a338-7c799704c30e-kube-api-access-ch5hq\") pod \"telemeter-client-7bb67db84c-cbxq7\" (UID: \"774ec8f7-5fec-40ab-a338-7c799704c30e\") " pod="openshift-monitoring/telemeter-client-7bb67db84c-cbxq7" Jun 09 02:23:42.776472 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:42.776326 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/774ec8f7-5fec-40ab-a338-7c799704c30e-serving-certs-ca-bundle\") pod \"telemeter-client-7bb67db84c-cbxq7\" (UID: \"774ec8f7-5fec-40ab-a338-7c799704c30e\") " pod="openshift-monitoring/telemeter-client-7bb67db84c-cbxq7" Jun 09 02:23:42.776472 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:42.776377 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/774ec8f7-5fec-40ab-a338-7c799704c30e-telemeter-client-tls\") pod \"telemeter-client-7bb67db84c-cbxq7\" (UID: \"774ec8f7-5fec-40ab-a338-7c799704c30e\") " pod="openshift-monitoring/telemeter-client-7bb67db84c-cbxq7" Jun 09 02:23:42.776472 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:42.776427 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/774ec8f7-5fec-40ab-a338-7c799704c30e-secret-telemeter-client\") pod \"telemeter-client-7bb67db84c-cbxq7\" (UID: \"774ec8f7-5fec-40ab-a338-7c799704c30e\") " pod="openshift-monitoring/telemeter-client-7bb67db84c-cbxq7" Jun 09 02:23:42.776472 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:42.776450 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/774ec8f7-5fec-40ab-a338-7c799704c30e-metrics-client-ca\") pod \"telemeter-client-7bb67db84c-cbxq7\" (UID: \"774ec8f7-5fec-40ab-a338-7c799704c30e\") " pod="openshift-monitoring/telemeter-client-7bb67db84c-cbxq7" Jun 09 02:23:42.877467 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:42.877432 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/774ec8f7-5fec-40ab-a338-7c799704c30e-telemeter-client-tls\") pod \"telemeter-client-7bb67db84c-cbxq7\" (UID: \"774ec8f7-5fec-40ab-a338-7c799704c30e\") " pod="openshift-monitoring/telemeter-client-7bb67db84c-cbxq7" Jun 09 02:23:42.877593 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:42.877499 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/774ec8f7-5fec-40ab-a338-7c799704c30e-secret-telemeter-client\") pod \"telemeter-client-7bb67db84c-cbxq7\" (UID: \"774ec8f7-5fec-40ab-a338-7c799704c30e\") " pod="openshift-monitoring/telemeter-client-7bb67db84c-cbxq7" Jun 09 02:23:42.877593 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:42.877525 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/774ec8f7-5fec-40ab-a338-7c799704c30e-metrics-client-ca\") pod \"telemeter-client-7bb67db84c-cbxq7\" (UID: \"774ec8f7-5fec-40ab-a338-7c799704c30e\") " pod="openshift-monitoring/telemeter-client-7bb67db84c-cbxq7" Jun 09 02:23:42.877593 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:42.877555 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/774ec8f7-5fec-40ab-a338-7c799704c30e-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7bb67db84c-cbxq7\" (UID: \"774ec8f7-5fec-40ab-a338-7c799704c30e\") " pod="openshift-monitoring/telemeter-client-7bb67db84c-cbxq7" Jun 09 02:23:42.877593 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:42.877589 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/774ec8f7-5fec-40ab-a338-7c799704c30e-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7bb67db84c-cbxq7\" (UID: \"774ec8f7-5fec-40ab-a338-7c799704c30e\") " pod="openshift-monitoring/telemeter-client-7bb67db84c-cbxq7" Jun 09 02:23:42.877797 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:42.877608 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/774ec8f7-5fec-40ab-a338-7c799704c30e-federate-client-tls\") pod \"telemeter-client-7bb67db84c-cbxq7\" (UID: \"774ec8f7-5fec-40ab-a338-7c799704c30e\") " pod="openshift-monitoring/telemeter-client-7bb67db84c-cbxq7" Jun 09 02:23:42.877797 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:42.877640 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ch5hq\" (UniqueName: \"kubernetes.io/projected/774ec8f7-5fec-40ab-a338-7c799704c30e-kube-api-access-ch5hq\") pod \"telemeter-client-7bb67db84c-cbxq7\" (UID: \"774ec8f7-5fec-40ab-a338-7c799704c30e\") " pod="openshift-monitoring/telemeter-client-7bb67db84c-cbxq7" Jun 09 02:23:42.877797 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:42.877777 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/774ec8f7-5fec-40ab-a338-7c799704c30e-serving-certs-ca-bundle\") pod \"telemeter-client-7bb67db84c-cbxq7\" (UID: \"774ec8f7-5fec-40ab-a338-7c799704c30e\") " pod="openshift-monitoring/telemeter-client-7bb67db84c-cbxq7" Jun 09 02:23:42.879327 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:42.879301 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/774ec8f7-5fec-40ab-a338-7c799704c30e-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7bb67db84c-cbxq7\" (UID: \"774ec8f7-5fec-40ab-a338-7c799704c30e\") " pod="openshift-monitoring/telemeter-client-7bb67db84c-cbxq7" Jun 09 02:23:42.880389 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:42.880369 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/774ec8f7-5fec-40ab-a338-7c799704c30e-serving-certs-ca-bundle\") pod \"telemeter-client-7bb67db84c-cbxq7\" (UID: \"774ec8f7-5fec-40ab-a338-7c799704c30e\") " pod="openshift-monitoring/telemeter-client-7bb67db84c-cbxq7" Jun 09 02:23:42.880930 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:42.880876 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/774ec8f7-5fec-40ab-a338-7c799704c30e-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7bb67db84c-cbxq7\" (UID: \"774ec8f7-5fec-40ab-a338-7c799704c30e\") " pod="openshift-monitoring/telemeter-client-7bb67db84c-cbxq7" Jun 09 02:23:42.880930 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:42.880882 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/774ec8f7-5fec-40ab-a338-7c799704c30e-metrics-client-ca\") pod \"telemeter-client-7bb67db84c-cbxq7\" (UID: \"774ec8f7-5fec-40ab-a338-7c799704c30e\") " pod="openshift-monitoring/telemeter-client-7bb67db84c-cbxq7" Jun 09 02:23:42.882678 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:42.882577 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/774ec8f7-5fec-40ab-a338-7c799704c30e-federate-client-tls\") pod \"telemeter-client-7bb67db84c-cbxq7\" (UID: \"774ec8f7-5fec-40ab-a338-7c799704c30e\") " pod="openshift-monitoring/telemeter-client-7bb67db84c-cbxq7" Jun 09 02:23:42.882949 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:42.882926 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/774ec8f7-5fec-40ab-a338-7c799704c30e-secret-telemeter-client\") pod \"telemeter-client-7bb67db84c-cbxq7\" (UID: \"774ec8f7-5fec-40ab-a338-7c799704c30e\") " pod="openshift-monitoring/telemeter-client-7bb67db84c-cbxq7" Jun 09 02:23:42.883497 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:42.883459 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/774ec8f7-5fec-40ab-a338-7c799704c30e-telemeter-client-tls\") pod \"telemeter-client-7bb67db84c-cbxq7\" (UID: \"774ec8f7-5fec-40ab-a338-7c799704c30e\") " pod="openshift-monitoring/telemeter-client-7bb67db84c-cbxq7" Jun 09 02:23:42.885469 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:42.885447 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ch5hq\" (UniqueName: \"kubernetes.io/projected/774ec8f7-5fec-40ab-a338-7c799704c30e-kube-api-access-ch5hq\") pod \"telemeter-client-7bb67db84c-cbxq7\" (UID: \"774ec8f7-5fec-40ab-a338-7c799704c30e\") " pod="openshift-monitoring/telemeter-client-7bb67db84c-cbxq7" Jun 09 02:23:42.960849 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:42.960822 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7bb67db84c-cbxq7" Jun 09 02:23:43.133406 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:43.133376 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7bb67db84c-cbxq7"] Jun 09 02:23:43.136592 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:23:43.136564 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod774ec8f7_5fec_40ab_a338_7c799704c30e.slice/crio-8a074354492b6c86a8335691a86e0ec82b1e36aae21857cd6b6a487a029e5b77 WatchSource:0}: Error finding container 8a074354492b6c86a8335691a86e0ec82b1e36aae21857cd6b6a487a029e5b77: Status 404 returned error can't find the container with id 8a074354492b6c86a8335691a86e0ec82b1e36aae21857cd6b6a487a029e5b77 Jun 09 02:23:43.189496 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:43.189463 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7bb67db84c-cbxq7" event={"ID":"774ec8f7-5fec-40ab-a338-7c799704c30e","Type":"ContainerStarted","Data":"8a074354492b6c86a8335691a86e0ec82b1e36aae21857cd6b6a487a029e5b77"} Jun 09 02:23:43.191749 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:43.191720 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kbljc" event={"ID":"5a863693-b258-4a61-8fa6-6991f66fc566","Type":"ContainerStarted","Data":"4f79dac9502b9fe0bdee42d51bb3de1b04368b1842f04140192bac7accf26f59"} Jun 09 02:23:43.191861 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:43.191776 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kbljc" event={"ID":"5a863693-b258-4a61-8fa6-6991f66fc566","Type":"ContainerStarted","Data":"0ffc03cb755e5cc2e685cb329fa0cdc536f87fd7f958e934678f14d342fe98dc"} Jun 09 02:23:43.209928 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:43.209880 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-kbljc" podStartSLOduration=3.806597219 podStartE2EDuration="6.209865144s" totalImagesPullingTime="2.301726517s" totalInitContainerRuntime="101.541408ms" isStatefulPod=true podCreationTimestamp="2026-06-09 02:23:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:23:43.20842121 +0000 UTC m=+239.155538551" watchObservedRunningTime="2026-06-09 02:23:43.209865144 +0000 UTC m=+239.156982486" Jun 09 02:23:43.588937 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:43.588902 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:23:45.201613 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:45.201581 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8947bf746-nddpw" event={"ID":"e8420c3f-7b6f-4934-9f14-d3a454dacc8c","Type":"ContainerStarted","Data":"42e2bf1b5f991347e207395e5889a0c9c5287e41ddaf823c3926ad214f85b7c9"} Jun 09 02:23:45.201969 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:45.201669 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8947bf746-nddpw" event={"ID":"e8420c3f-7b6f-4934-9f14-d3a454dacc8c","Type":"ContainerStarted","Data":"6bd747fad5b80e5b93842b55a763992f485ba3d72b2d846049643199c1dcebd5"} Jun 09 02:23:45.201969 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:45.201709 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8947bf746-nddpw" event={"ID":"e8420c3f-7b6f-4934-9f14-d3a454dacc8c","Type":"ContainerStarted","Data":"b9357139ca5a8386859e870644967e38b582beb66cdd65efd84b273b773a416c"} Jun 09 02:23:46.208263 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:46.208194 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8947bf746-nddpw" event={"ID":"e8420c3f-7b6f-4934-9f14-d3a454dacc8c","Type":"ContainerStarted","Data":"95ccd625852e200e46729ba66ef4a6115a9e986ddf872d1d0495ee504233b9a1"} Jun 09 02:23:47.124547 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:47.124518 2573 patch_prober.go:28] interesting pod/image-registry-6b6f4b68db-772wg container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 02:23:47.124685 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:47.124569 2573 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6b6f4b68db-772wg" podUID="4042c7a9-0fef-4d82-8f08-11601e40928f" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 02:23:47.215490 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:47.215458 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8947bf746-nddpw" event={"ID":"e8420c3f-7b6f-4934-9f14-d3a454dacc8c","Type":"ContainerStarted","Data":"c926976277d54e98b82e815e5f9c8387fe798b9d1fc591e81b21006d597a0a6e"} Jun 09 02:23:47.215848 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:47.215548 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8947bf746-nddpw" event={"ID":"e8420c3f-7b6f-4934-9f14-d3a454dacc8c","Type":"ContainerStarted","Data":"1684084b751aea29423560c1c1cb6e7f11cf9000da879a8f294c42e8ea9febe2"} Jun 09 02:23:47.215848 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:47.215597 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-8947bf746-nddpw" Jun 09 02:23:47.217029 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:47.217001 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7bb67db84c-cbxq7" event={"ID":"774ec8f7-5fec-40ab-a338-7c799704c30e","Type":"ContainerStarted","Data":"cfa1b8316f6096c7ceebb3bd4f31f9f830c03dcea0d16fd58e8c6a9b8b6d793d"} Jun 09 02:23:47.238448 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:47.238403 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-8947bf746-nddpw" podStartSLOduration=3.272102032 podStartE2EDuration="7.23838779s" totalImagesPullingTime="3.966285758s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:23:40 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:23:47.236025532 +0000 UTC m=+243.183142876" watchObservedRunningTime="2026-06-09 02:23:47.23838779 +0000 UTC m=+243.185505450" Jun 09 02:23:47.585809 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:47.585776 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:23:47.688263 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:47.688232 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:23:47.787740 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:47.787707 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:23:48.571535 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:48.571505 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8b56b9b76-q826m" Jun 09 02:23:49.063605 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:49.063577 2573 patch_prober.go:28] interesting pod/image-registry-6b6f4b68db-772wg container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 02:23:49.063748 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:49.063625 2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6b6f4b68db-772wg" podUID="4042c7a9-0fef-4d82-8f08-11601e40928f" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 02:23:49.228055 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:49.228009 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7bb67db84c-cbxq7" event={"ID":"774ec8f7-5fec-40ab-a338-7c799704c30e","Type":"ContainerStarted","Data":"33cc81426e531d737f2f607d1ae6f7c5fdbe74e58ef6287f3999ef3d91e9cc28"} Jun 09 02:23:49.228228 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:49.228131 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7bb67db84c-cbxq7" event={"ID":"774ec8f7-5fec-40ab-a338-7c799704c30e","Type":"ContainerStarted","Data":"d9f7c49c64a52711f1d6508f5ef019b684853691b32a6b74c3b0c81d646caa41"} Jun 09 02:23:49.249531 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:49.249478 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7bb67db84c-cbxq7" podStartSLOduration=2.256759677 podStartE2EDuration="7.249463513s" totalImagesPullingTime="4.992703836s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:23:42 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:23:49.247629576 +0000 UTC m=+245.194746917" watchObservedRunningTime="2026-06-09 02:23:49.249463513 +0000 UTC m=+245.196580855" Jun 09 02:23:49.366292 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:49.366233 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-cdbd67b4d-684h8"] Jun 09 02:23:49.388876 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:49.388856 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-cdbd67b4d-684h8"] Jun 09 02:23:49.388969 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:49.388938 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cdbd67b4d-684h8" Jun 09 02:23:49.395397 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:49.395381 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 09 02:23:49.534237 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:49.534211 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0b59afb6-e169-4253-b26c-3ccd823d4c72-console-config\") pod \"console-cdbd67b4d-684h8\" (UID: \"0b59afb6-e169-4253-b26c-3ccd823d4c72\") " pod="openshift-console/console-cdbd67b4d-684h8" Jun 09 02:23:49.534336 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:49.534245 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0b59afb6-e169-4253-b26c-3ccd823d4c72-console-serving-cert\") pod \"console-cdbd67b4d-684h8\" (UID: \"0b59afb6-e169-4253-b26c-3ccd823d4c72\") " pod="openshift-console/console-cdbd67b4d-684h8" Jun 09 02:23:49.534336 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:49.534283 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mpmcp\" (UniqueName: \"kubernetes.io/projected/0b59afb6-e169-4253-b26c-3ccd823d4c72-kube-api-access-mpmcp\") pod \"console-cdbd67b4d-684h8\" (UID: \"0b59afb6-e169-4253-b26c-3ccd823d4c72\") " pod="openshift-console/console-cdbd67b4d-684h8" Jun 09 02:23:49.534446 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:49.534352 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0b59afb6-e169-4253-b26c-3ccd823d4c72-oauth-serving-cert\") pod \"console-cdbd67b4d-684h8\" (UID: \"0b59afb6-e169-4253-b26c-3ccd823d4c72\") " pod="openshift-console/console-cdbd67b4d-684h8" Jun 09 02:23:49.534446 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:49.534395 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b59afb6-e169-4253-b26c-3ccd823d4c72-trusted-ca-bundle\") pod \"console-cdbd67b4d-684h8\" (UID: \"0b59afb6-e169-4253-b26c-3ccd823d4c72\") " pod="openshift-console/console-cdbd67b4d-684h8" Jun 09 02:23:49.534446 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:49.534427 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0b59afb6-e169-4253-b26c-3ccd823d4c72-console-oauth-config\") pod \"console-cdbd67b4d-684h8\" (UID: \"0b59afb6-e169-4253-b26c-3ccd823d4c72\") " pod="openshift-console/console-cdbd67b4d-684h8" Jun 09 02:23:49.534537 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:49.534501 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0b59afb6-e169-4253-b26c-3ccd823d4c72-service-ca\") pod \"console-cdbd67b4d-684h8\" (UID: \"0b59afb6-e169-4253-b26c-3ccd823d4c72\") " pod="openshift-console/console-cdbd67b4d-684h8" Jun 09 02:23:49.635478 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:49.635423 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mpmcp\" (UniqueName: \"kubernetes.io/projected/0b59afb6-e169-4253-b26c-3ccd823d4c72-kube-api-access-mpmcp\") pod \"console-cdbd67b4d-684h8\" (UID: \"0b59afb6-e169-4253-b26c-3ccd823d4c72\") " pod="openshift-console/console-cdbd67b4d-684h8" Jun 09 02:23:49.635478 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:49.635459 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0b59afb6-e169-4253-b26c-3ccd823d4c72-oauth-serving-cert\") pod \"console-cdbd67b4d-684h8\" (UID: \"0b59afb6-e169-4253-b26c-3ccd823d4c72\") " pod="openshift-console/console-cdbd67b4d-684h8" Jun 09 02:23:49.635782 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:49.635485 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b59afb6-e169-4253-b26c-3ccd823d4c72-trusted-ca-bundle\") pod \"console-cdbd67b4d-684h8\" (UID: \"0b59afb6-e169-4253-b26c-3ccd823d4c72\") " pod="openshift-console/console-cdbd67b4d-684h8" Jun 09 02:23:49.635782 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:49.635720 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0b59afb6-e169-4253-b26c-3ccd823d4c72-console-oauth-config\") pod \"console-cdbd67b4d-684h8\" (UID: \"0b59afb6-e169-4253-b26c-3ccd823d4c72\") " pod="openshift-console/console-cdbd67b4d-684h8" Jun 09 02:23:49.635782 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:49.635766 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0b59afb6-e169-4253-b26c-3ccd823d4c72-service-ca\") pod \"console-cdbd67b4d-684h8\" (UID: \"0b59afb6-e169-4253-b26c-3ccd823d4c72\") " pod="openshift-console/console-cdbd67b4d-684h8" Jun 09 02:23:49.635893 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:49.635829 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0b59afb6-e169-4253-b26c-3ccd823d4c72-console-config\") pod \"console-cdbd67b4d-684h8\" (UID: \"0b59afb6-e169-4253-b26c-3ccd823d4c72\") " pod="openshift-console/console-cdbd67b4d-684h8" Jun 09 02:23:49.635893 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:49.635869 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0b59afb6-e169-4253-b26c-3ccd823d4c72-console-serving-cert\") pod \"console-cdbd67b4d-684h8\" (UID: \"0b59afb6-e169-4253-b26c-3ccd823d4c72\") " pod="openshift-console/console-cdbd67b4d-684h8" Jun 09 02:23:49.636211 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:49.636188 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0b59afb6-e169-4253-b26c-3ccd823d4c72-oauth-serving-cert\") pod \"console-cdbd67b4d-684h8\" (UID: \"0b59afb6-e169-4253-b26c-3ccd823d4c72\") " pod="openshift-console/console-cdbd67b4d-684h8" Jun 09 02:23:49.636498 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:49.636475 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b59afb6-e169-4253-b26c-3ccd823d4c72-trusted-ca-bundle\") pod \"console-cdbd67b4d-684h8\" (UID: \"0b59afb6-e169-4253-b26c-3ccd823d4c72\") " pod="openshift-console/console-cdbd67b4d-684h8" Jun 09 02:23:49.636594 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:49.636488 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0b59afb6-e169-4253-b26c-3ccd823d4c72-service-ca\") pod \"console-cdbd67b4d-684h8\" (UID: \"0b59afb6-e169-4253-b26c-3ccd823d4c72\") " pod="openshift-console/console-cdbd67b4d-684h8" Jun 09 02:23:49.636594 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:49.636498 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0b59afb6-e169-4253-b26c-3ccd823d4c72-console-config\") pod \"console-cdbd67b4d-684h8\" (UID: \"0b59afb6-e169-4253-b26c-3ccd823d4c72\") " pod="openshift-console/console-cdbd67b4d-684h8" Jun 09 02:23:49.638256 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:49.638236 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0b59afb6-e169-4253-b26c-3ccd823d4c72-console-serving-cert\") pod \"console-cdbd67b4d-684h8\" (UID: \"0b59afb6-e169-4253-b26c-3ccd823d4c72\") " pod="openshift-console/console-cdbd67b4d-684h8" Jun 09 02:23:49.638554 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:49.638533 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0b59afb6-e169-4253-b26c-3ccd823d4c72-console-oauth-config\") pod \"console-cdbd67b4d-684h8\" (UID: \"0b59afb6-e169-4253-b26c-3ccd823d4c72\") " pod="openshift-console/console-cdbd67b4d-684h8" Jun 09 02:23:49.643237 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:49.643218 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mpmcp\" (UniqueName: \"kubernetes.io/projected/0b59afb6-e169-4253-b26c-3ccd823d4c72-kube-api-access-mpmcp\") pod \"console-cdbd67b4d-684h8\" (UID: \"0b59afb6-e169-4253-b26c-3ccd823d4c72\") " pod="openshift-console/console-cdbd67b4d-684h8" Jun 09 02:23:49.698180 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:49.698153 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cdbd67b4d-684h8" Jun 09 02:23:49.855565 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:49.855543 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-cdbd67b4d-684h8"] Jun 09 02:23:49.858190 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:23:49.858153 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b59afb6_e169_4253_b26c_3ccd823d4c72.slice/crio-e1324b7b0f46ca9a756c0cfd3a83aa9ae75139f5873593003e629585fc3bad66 WatchSource:0}: Error finding container e1324b7b0f46ca9a756c0cfd3a83aa9ae75139f5873593003e629585fc3bad66: Status 404 returned error can't find the container with id e1324b7b0f46ca9a756c0cfd3a83aa9ae75139f5873593003e629585fc3bad66 Jun 09 02:23:50.233165 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:50.233041 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cdbd67b4d-684h8" event={"ID":"0b59afb6-e169-4253-b26c-3ccd823d4c72","Type":"ContainerStarted","Data":"7ef41b3230b408c872a36958389a104cc4b5ae86b4c02cfa7227194b214e2a17"} Jun 09 02:23:50.233165 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:50.233140 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cdbd67b4d-684h8" event={"ID":"0b59afb6-e169-4253-b26c-3ccd823d4c72","Type":"ContainerStarted","Data":"e1324b7b0f46ca9a756c0cfd3a83aa9ae75139f5873593003e629585fc3bad66"} Jun 09 02:23:50.249421 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:50.249376 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-cdbd67b4d-684h8" podStartSLOduration=1.249362717 podStartE2EDuration="1.249362717s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:23:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:23:50.248390122 +0000 UTC m=+246.195507472" watchObservedRunningTime="2026-06-09 02:23:50.249362717 +0000 UTC m=+246.196480058" Jun 09 02:23:51.107278 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:51.107250 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:23:51.155052 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:51.155019 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:23:53.227925 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:53.227893 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-8947bf746-nddpw" Jun 09 02:23:56.489244 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:56.489208 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/866bea41-c522-452a-9430-a3461041d710-metrics-certs\") pod \"network-metrics-daemon-xfrxz\" (UID: \"866bea41-c522-452a-9430-a3461041d710\") " pod="openshift-multus/network-metrics-daemon-xfrxz" Jun 09 02:23:56.491581 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:56.491557 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/866bea41-c522-452a-9430-a3461041d710-metrics-certs\") pod \"network-metrics-daemon-xfrxz\" (UID: \"866bea41-c522-452a-9430-a3461041d710\") " pod="openshift-multus/network-metrics-daemon-xfrxz" Jun 09 02:23:56.563760 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:56.563739 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-cv87r\"" Jun 09 02:23:56.571560 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:56.571538 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xfrxz" Jun 09 02:23:56.732380 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:56.732338 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xfrxz"] Jun 09 02:23:56.734832 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:23:56.734805 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod866bea41_c522_452a_9430_a3461041d710.slice/crio-51e7bfc38fa4bbbacab06273dae551016eec96d8450254c9a058beca7c01b57c WatchSource:0}: Error finding container 51e7bfc38fa4bbbacab06273dae551016eec96d8450254c9a058beca7c01b57c: Status 404 returned error can't find the container with id 51e7bfc38fa4bbbacab06273dae551016eec96d8450254c9a058beca7c01b57c Jun 09 02:23:57.126324 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:57.125008 2573 patch_prober.go:28] interesting pod/image-registry-6b6f4b68db-772wg container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 02:23:57.126324 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:57.125095 2573 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6b6f4b68db-772wg" podUID="4042c7a9-0fef-4d82-8f08-11601e40928f" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 02:23:57.126324 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:57.125172 2573 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-6b6f4b68db-772wg" Jun 09 02:23:57.126324 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:57.125823 2573 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"db986d89dbc5b215286eab96a5aa96ebcf9e20e6820b7e4771876cc6e533b620"} pod="openshift-image-registry/image-registry-6b6f4b68db-772wg" containerMessage="Container registry failed liveness probe, will be restarted" Jun 09 02:23:57.130733 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:57.130703 2573 patch_prober.go:28] interesting pod/image-registry-6b6f4b68db-772wg container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 02:23:57.130827 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:57.130746 2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6b6f4b68db-772wg" podUID="4042c7a9-0fef-4d82-8f08-11601e40928f" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 02:23:57.267236 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:57.267201 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xfrxz" event={"ID":"866bea41-c522-452a-9430-a3461041d710","Type":"ContainerStarted","Data":"51e7bfc38fa4bbbacab06273dae551016eec96d8450254c9a058beca7c01b57c"} Jun 09 02:23:57.297859 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:57.297830 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:23:57.347653 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:57.347630 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:23:58.272376 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:58.272345 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xfrxz" event={"ID":"866bea41-c522-452a-9430-a3461041d710","Type":"ContainerStarted","Data":"6eeeae2cfa666bc3cac687045dbe94387a7788346d56dda202e9b0172fb20c90"} Jun 09 02:23:58.272785 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:58.272404 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xfrxz" event={"ID":"866bea41-c522-452a-9430-a3461041d710","Type":"ContainerStarted","Data":"7fcc2342390c5b4f753320c801555b4a22cd1ea6a933e089defd64a048df786a"} Jun 09 02:23:58.287329 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:58.287290 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-xfrxz" podStartSLOduration=253.088613937 podStartE2EDuration="4m14.287278135s" totalImagesPullingTime="1.198664198s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:19:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:23:58.28628202 +0000 UTC m=+254.233399367" watchObservedRunningTime="2026-06-09 02:23:58.287278135 +0000 UTC m=+254.234395753" Jun 09 02:23:58.370742 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:58.370714 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:23:58.419904 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:58.419869 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:23:59.698995 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:59.698962 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-cdbd67b4d-684h8" Jun 09 02:23:59.699459 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:59.699009 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-cdbd67b4d-684h8" Jun 09 02:23:59.700486 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:59.700459 2573 patch_prober.go:28] interesting pod/console-cdbd67b4d-684h8 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.23:8443/health\": dial tcp 10.133.0.23:8443: connect: connection refused" start-of-body= Jun 09 02:23:59.700586 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:23:59.700503 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-cdbd67b4d-684h8" podUID="0b59afb6-e169-4253-b26c-3ccd823d4c72" containerName="console" probeResult="failure" output="Get \"https://10.133.0.23:8443/health\": dial tcp 10.133.0.23:8443: connect: connection refused" Jun 09 02:24:01.735679 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:01.735646 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:24:01.784873 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:01.784835 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:24:06.668361 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:06.668326 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:24:06.715511 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:06.715461 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:24:07.130384 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:07.130349 2573 patch_prober.go:28] interesting pod/image-registry-6b6f4b68db-772wg container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 02:24:07.130522 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:07.130401 2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6b6f4b68db-772wg" podUID="4042c7a9-0fef-4d82-8f08-11601e40928f" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 02:24:07.255130 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:07.255071 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-8b56b9b76-q826m" podUID="e6408c7a-c84c-4aa0-abee-ad9eb93d2ea6" containerName="console" containerID="cri-o://e718e6097dc0fd0c4db989c90084eba56a73f9c42199f110cae3bba6b0d9f63e" gracePeriod=15 Jun 09 02:24:09.699256 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:09.699224 2573 patch_prober.go:28] interesting pod/console-cdbd67b4d-684h8 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.23:8443/health\": dial tcp 10.133.0.23:8443: connect: connection refused" start-of-body= Jun 09 02:24:09.699626 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:09.699278 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-cdbd67b4d-684h8" podUID="0b59afb6-e169-4253-b26c-3ccd823d4c72" containerName="console" probeResult="failure" output="Get \"https://10.133.0.23:8443/health\": dial tcp 10.133.0.23:8443: connect: connection refused" Jun 09 02:24:12.328397 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:12.328363 2573 generic.go:356] "Generic (PLEG): container finished" podID="5d258435-31f4-4819-82bd-85477f02a5e5" containerID="e3e3b71fbe05d2672a7e9f2021d0095552e301637a6da78f46667a29570b51fd" exitCode=0 Jun 09 02:24:12.328792 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:12.328433 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-mqg6m" event={"ID":"5d258435-31f4-4819-82bd-85477f02a5e5","Type":"ContainerDied","Data":"e3e3b71fbe05d2672a7e9f2021d0095552e301637a6da78f46667a29570b51fd"} Jun 09 02:24:12.328792 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:12.328731 2573 scope.go:117] "RemoveContainer" containerID="e3e3b71fbe05d2672a7e9f2021d0095552e301637a6da78f46667a29570b51fd" Jun 09 02:24:13.335097 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:13.335049 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-mqg6m" event={"ID":"5d258435-31f4-4819-82bd-85477f02a5e5","Type":"ContainerStarted","Data":"594379b8f96ce46abb55f780ab3cbb12fce52ccc413fce5025a0db1c8122c1c8"} Jun 09 02:24:16.206487 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:16.206449 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:24:16.250939 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:16.250908 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:24:16.447124 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:16.447097 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-rhlw9_4fedd3d3-404f-4e0a-b965-c5cc70b36896/cluster-monitoring-operator/0.log" Jun 09 02:24:16.644470 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:16.644448 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-97ltg_4fa30d51-ae8f-402a-9929-6e7047eb8243/kube-state-metrics/0.log" Jun 09 02:24:16.843823 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:16.843799 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-97ltg_4fa30d51-ae8f-402a-9929-6e7047eb8243/kube-rbac-proxy-main/0.log" Jun 09 02:24:16.909726 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:16.909671 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:24:16.964049 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:16.964027 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:24:17.048981 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:17.048961 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-97ltg_4fa30d51-ae8f-402a-9929-6e7047eb8243/kube-rbac-proxy-self/0.log" Jun 09 02:24:17.129983 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:17.129957 2573 patch_prober.go:28] interesting pod/image-registry-6b6f4b68db-772wg container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 02:24:17.130108 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:17.129999 2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6b6f4b68db-772wg" podUID="4042c7a9-0fef-4d82-8f08-11601e40928f" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 02:24:18.244043 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:18.244022 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kbljc_5a863693-b258-4a61-8fa6-6991f66fc566/init-textfile/0.log" Jun 09 02:24:18.445235 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:18.445210 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kbljc_5a863693-b258-4a61-8fa6-6991f66fc566/node-exporter/0.log" Jun 09 02:24:18.644379 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:18.644361 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kbljc_5a863693-b258-4a61-8fa6-6991f66fc566/kube-rbac-proxy/0.log" Jun 09 02:24:19.698863 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:19.698829 2573 patch_prober.go:28] interesting pod/console-cdbd67b4d-684h8 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.23:8443/health\": dial tcp 10.133.0.23:8443: connect: connection refused" start-of-body= Jun 09 02:24:19.699236 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:19.698877 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-cdbd67b4d-684h8" podUID="0b59afb6-e169-4253-b26c-3ccd823d4c72" containerName="console" probeResult="failure" output="Get \"https://10.133.0.23:8443/health\": dial tcp 10.133.0.23:8443: connect: connection refused" Jun 09 02:24:21.447647 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:21.447609 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-v95hd_6ff45181-5685-4291-a424-b27f49e1e659/prometheus-operator/0.log" Jun 09 02:24:21.643937 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:21.643913 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-v95hd_6ff45181-5685-4291-a424-b27f49e1e659/kube-rbac-proxy/0.log" Jun 09 02:24:22.044447 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:22.044423 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7bb67db84c-cbxq7_774ec8f7-5fec-40ab-a338-7c799704c30e/telemeter-client/0.log" Jun 09 02:24:22.145781 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:22.145750 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6b6f4b68db-772wg" podUID="4042c7a9-0fef-4d82-8f08-11601e40928f" containerName="registry" containerID="cri-o://db986d89dbc5b215286eab96a5aa96ebcf9e20e6820b7e4771876cc6e533b620" gracePeriod=30 Jun 09 02:24:22.244798 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:22.244777 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7bb67db84c-cbxq7_774ec8f7-5fec-40ab-a338-7c799704c30e/reload/0.log" Jun 09 02:24:22.370900 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:22.370876 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-8b56b9b76-q826m_e6408c7a-c84c-4aa0-abee-ad9eb93d2ea6/console/0.log" Jun 09 02:24:22.371015 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:22.370926 2573 generic.go:356] "Generic (PLEG): container finished" podID="e6408c7a-c84c-4aa0-abee-ad9eb93d2ea6" containerID="e718e6097dc0fd0c4db989c90084eba56a73f9c42199f110cae3bba6b0d9f63e" exitCode=137 Jun 09 02:24:22.371127 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:22.371026 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8b56b9b76-q826m" event={"ID":"e6408c7a-c84c-4aa0-abee-ad9eb93d2ea6","Type":"ContainerDied","Data":"e718e6097dc0fd0c4db989c90084eba56a73f9c42199f110cae3bba6b0d9f63e"} Jun 09 02:24:22.423805 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:22.423784 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-8b56b9b76-q826m_e6408c7a-c84c-4aa0-abee-ad9eb93d2ea6/console/0.log" Jun 09 02:24:22.442408 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:22.442384 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8b56b9b76-q826m" Jun 09 02:24:22.447434 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:22.447391 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7bb67db84c-cbxq7_774ec8f7-5fec-40ab-a338-7c799704c30e/kube-rbac-proxy/0.log" Jun 09 02:24:22.487262 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:22.487243 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e6408c7a-c84c-4aa0-abee-ad9eb93d2ea6-service-ca\") pod \"e6408c7a-c84c-4aa0-abee-ad9eb93d2ea6\" (UID: \"e6408c7a-c84c-4aa0-abee-ad9eb93d2ea6\") " Jun 09 02:24:22.487602 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:22.487288 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e6408c7a-c84c-4aa0-abee-ad9eb93d2ea6-console-config\") pod \"e6408c7a-c84c-4aa0-abee-ad9eb93d2ea6\" (UID: \"e6408c7a-c84c-4aa0-abee-ad9eb93d2ea6\") " Jun 09 02:24:22.487602 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:22.487308 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e6408c7a-c84c-4aa0-abee-ad9eb93d2ea6-console-serving-cert\") pod \"e6408c7a-c84c-4aa0-abee-ad9eb93d2ea6\" (UID: \"e6408c7a-c84c-4aa0-abee-ad9eb93d2ea6\") " Jun 09 02:24:22.487602 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:22.487342 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l4jvs\" (UniqueName: \"kubernetes.io/projected/e6408c7a-c84c-4aa0-abee-ad9eb93d2ea6-kube-api-access-l4jvs\") pod \"e6408c7a-c84c-4aa0-abee-ad9eb93d2ea6\" (UID: \"e6408c7a-c84c-4aa0-abee-ad9eb93d2ea6\") " Jun 09 02:24:22.487602 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:22.487369 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e6408c7a-c84c-4aa0-abee-ad9eb93d2ea6-console-oauth-config\") pod \"e6408c7a-c84c-4aa0-abee-ad9eb93d2ea6\" (UID: \"e6408c7a-c84c-4aa0-abee-ad9eb93d2ea6\") " Jun 09 02:24:22.487602 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:22.487395 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e6408c7a-c84c-4aa0-abee-ad9eb93d2ea6-oauth-serving-cert\") pod \"e6408c7a-c84c-4aa0-abee-ad9eb93d2ea6\" (UID: \"e6408c7a-c84c-4aa0-abee-ad9eb93d2ea6\") " Jun 09 02:24:22.487820 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:22.487625 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e6408c7a-c84c-4aa0-abee-ad9eb93d2ea6-service-ca" (OuterVolumeSpecName: "service-ca") pod "e6408c7a-c84c-4aa0-abee-ad9eb93d2ea6" (UID: "e6408c7a-c84c-4aa0-abee-ad9eb93d2ea6"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 02:24:22.487820 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:22.487634 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e6408c7a-c84c-4aa0-abee-ad9eb93d2ea6-console-config" (OuterVolumeSpecName: "console-config") pod "e6408c7a-c84c-4aa0-abee-ad9eb93d2ea6" (UID: "e6408c7a-c84c-4aa0-abee-ad9eb93d2ea6"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 02:24:22.487919 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:22.487812 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e6408c7a-c84c-4aa0-abee-ad9eb93d2ea6-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e6408c7a-c84c-4aa0-abee-ad9eb93d2ea6" (UID: "e6408c7a-c84c-4aa0-abee-ad9eb93d2ea6"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 02:24:22.489474 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:22.489442 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6408c7a-c84c-4aa0-abee-ad9eb93d2ea6-kube-api-access-l4jvs" (OuterVolumeSpecName: "kube-api-access-l4jvs") pod "e6408c7a-c84c-4aa0-abee-ad9eb93d2ea6" (UID: "e6408c7a-c84c-4aa0-abee-ad9eb93d2ea6"). InnerVolumeSpecName "kube-api-access-l4jvs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 02:24:22.489787 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:22.489757 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e6408c7a-c84c-4aa0-abee-ad9eb93d2ea6-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e6408c7a-c84c-4aa0-abee-ad9eb93d2ea6" (UID: "e6408c7a-c84c-4aa0-abee-ad9eb93d2ea6"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 02:24:22.489787 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:22.489772 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e6408c7a-c84c-4aa0-abee-ad9eb93d2ea6-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e6408c7a-c84c-4aa0-abee-ad9eb93d2ea6" (UID: "e6408c7a-c84c-4aa0-abee-ad9eb93d2ea6"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 02:24:22.588619 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:22.588568 2573 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e6408c7a-c84c-4aa0-abee-ad9eb93d2ea6-console-config\") on node \"ip-10-0-143-102.ec2.internal\" DevicePath \"\"" Jun 09 02:24:22.588619 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:22.588594 2573 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e6408c7a-c84c-4aa0-abee-ad9eb93d2ea6-console-serving-cert\") on node \"ip-10-0-143-102.ec2.internal\" DevicePath \"\"" Jun 09 02:24:22.588619 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:22.588605 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l4jvs\" (UniqueName: \"kubernetes.io/projected/e6408c7a-c84c-4aa0-abee-ad9eb93d2ea6-kube-api-access-l4jvs\") on node \"ip-10-0-143-102.ec2.internal\" DevicePath \"\"" Jun 09 02:24:22.588619 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:22.588614 2573 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e6408c7a-c84c-4aa0-abee-ad9eb93d2ea6-console-oauth-config\") on node \"ip-10-0-143-102.ec2.internal\" DevicePath \"\"" Jun 09 02:24:22.588619 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:22.588621 2573 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e6408c7a-c84c-4aa0-abee-ad9eb93d2ea6-oauth-serving-cert\") on node \"ip-10-0-143-102.ec2.internal\" DevicePath \"\"" Jun 09 02:24:22.588806 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:22.588629 2573 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e6408c7a-c84c-4aa0-abee-ad9eb93d2ea6-service-ca\") on node \"ip-10-0-143-102.ec2.internal\" DevicePath \"\"" Jun 09 02:24:22.644556 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:22.644532 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8947bf746-nddpw_e8420c3f-7b6f-4934-9f14-d3a454dacc8c/thanos-query/0.log" Jun 09 02:24:22.844324 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:22.844261 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8947bf746-nddpw_e8420c3f-7b6f-4934-9f14-d3a454dacc8c/kube-rbac-proxy-web/0.log" Jun 09 02:24:23.043683 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:23.043655 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8947bf746-nddpw_e8420c3f-7b6f-4934-9f14-d3a454dacc8c/kube-rbac-proxy/0.log" Jun 09 02:24:23.244742 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:23.244716 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8947bf746-nddpw_e8420c3f-7b6f-4934-9f14-d3a454dacc8c/prom-label-proxy/0.log" Jun 09 02:24:23.375375 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:23.375354 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-8b56b9b76-q826m_e6408c7a-c84c-4aa0-abee-ad9eb93d2ea6/console/0.log" Jun 09 02:24:23.375459 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:23.375439 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8b56b9b76-q826m" Jun 09 02:24:23.375498 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:23.375481 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8b56b9b76-q826m" event={"ID":"e6408c7a-c84c-4aa0-abee-ad9eb93d2ea6","Type":"ContainerDied","Data":"75f191b2d790333543b5c8c69ed844876fb140629ae076c0aebcd7c61b804a04"} Jun 09 02:24:23.375544 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:23.375531 2573 scope.go:117] "RemoveContainer" containerID="e718e6097dc0fd0c4db989c90084eba56a73f9c42199f110cae3bba6b0d9f63e" Jun 09 02:24:23.377094 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:23.377054 2573 generic.go:356] "Generic (PLEG): container finished" podID="4042c7a9-0fef-4d82-8f08-11601e40928f" containerID="db986d89dbc5b215286eab96a5aa96ebcf9e20e6820b7e4771876cc6e533b620" exitCode=0 Jun 09 02:24:23.377197 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:23.377113 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6b6f4b68db-772wg" event={"ID":"4042c7a9-0fef-4d82-8f08-11601e40928f","Type":"ContainerDied","Data":"db986d89dbc5b215286eab96a5aa96ebcf9e20e6820b7e4771876cc6e533b620"} Jun 09 02:24:23.394566 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:23.394545 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8b56b9b76-q826m"] Jun 09 02:24:23.400429 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:23.400408 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8b56b9b76-q826m"] Jun 09 02:24:23.444817 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:23.444787 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8947bf746-nddpw_e8420c3f-7b6f-4934-9f14-d3a454dacc8c/kube-rbac-proxy-rules/0.log" Jun 09 02:24:23.644197 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:23.644171 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8947bf746-nddpw_e8420c3f-7b6f-4934-9f14-d3a454dacc8c/kube-rbac-proxy-metrics/0.log" Jun 09 02:24:23.844409 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:23.844376 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d5d5bb78b-sbmsx_6678acb6-6bca-47c4-be4f-acb6f2c1c530/networking-console-plugin/0.log" Jun 09 02:24:24.046583 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:24.046558 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-9hfq7_41d0740b-ac9d-47bd-92c3-8c89c459ae7c/console-operator/1.log" Jun 09 02:24:24.248406 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:24.248380 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-9hfq7_41d0740b-ac9d-47bd-92c3-8c89c459ae7c/console-operator/2.log" Jun 09 02:24:24.383780 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:24.383714 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6b6f4b68db-772wg" event={"ID":"4042c7a9-0fef-4d82-8f08-11601e40928f","Type":"ContainerStarted","Data":"f17fe0484542b4935fff7444618eb91d8c40e54757a43ac2491f3ade8e8a3456"} Jun 09 02:24:24.383896 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:24.383818 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6b6f4b68db-772wg" Jun 09 02:24:24.465955 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:24.465931 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e6408c7a-c84c-4aa0-abee-ad9eb93d2ea6" path="/var/lib/kubelet/pods/e6408c7a-c84c-4aa0-abee-ad9eb93d2ea6/volumes" Jun 09 02:24:25.045206 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:25.045178 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-cdbd67b4d-684h8_0b59afb6-e169-4253-b26c-3ccd823d4c72/console/0.log" Jun 09 02:24:25.247451 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:25.247423 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-q5gzn_6c83b986-fb5e-4664-85aa-e78a5c0e9de1/download-server/0.log" Jun 09 02:24:25.782322 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:25.782293 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:24:25.831394 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:25.831366 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:24:25.879159 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:24:25.879130 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-r5vqq" podUID="9c20a1c4-e1eb-4851-8379-b0138b0a1389" Jun 09 02:24:26.393025 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:26.392999 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-r5vqq" Jun 09 02:24:26.844596 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:26.844574 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-btr7x_37660632-e407-412f-aa36-3e764febd673/dns-node-resolver/0.log" Jun 09 02:24:27.246000 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:27.245925 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6b6f4b68db-772wg_4042c7a9-0fef-4d82-8f08-11601e40928f/registry/1.log" Jun 09 02:24:27.844421 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:27.844399 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-fgmlx_6627f9b3-28ae-40b2-9ba9-fe6614fe60dc/node-ca/0.log" Jun 09 02:24:28.845230 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:28.845206 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hzfpk_7d40cc8c-039c-4f1a-9460-f601e7d4b00d/serve-healthcheck-canary/0.log" Jun 09 02:24:29.548154 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:29.548123 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9c20a1c4-e1eb-4851-8379-b0138b0a1389-metrics-tls\") pod \"dns-default-r5vqq\" (UID: \"9c20a1c4-e1eb-4851-8379-b0138b0a1389\") " pod="openshift-dns/dns-default-r5vqq" Jun 09 02:24:29.550373 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:29.550351 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9c20a1c4-e1eb-4851-8379-b0138b0a1389-metrics-tls\") pod \"dns-default-r5vqq\" (UID: \"9c20a1c4-e1eb-4851-8379-b0138b0a1389\") " pod="openshift-dns/dns-default-r5vqq" Jun 09 02:24:29.696420 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:29.696392 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5xqfr\"" Jun 09 02:24:29.698481 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:29.698458 2573 patch_prober.go:28] interesting pod/console-cdbd67b4d-684h8 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.23:8443/health\": dial tcp 10.133.0.23:8443: connect: connection refused" start-of-body= Jun 09 02:24:29.698614 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:29.698503 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-cdbd67b4d-684h8" podUID="0b59afb6-e169-4253-b26c-3ccd823d4c72" containerName="console" probeResult="failure" output="Get \"https://10.133.0.23:8443/health\": dial tcp 10.133.0.23:8443: connect: connection refused" Jun 09 02:24:29.703915 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:29.703896 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-r5vqq" Jun 09 02:24:29.834468 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:29.834332 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-r5vqq"] Jun 09 02:24:29.836625 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:24:29.836597 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c20a1c4_e1eb_4851_8379_b0138b0a1389.slice/crio-efe78388d8e5524478f332c7487c0e736a2b7a6026a9f65467f575573f2baabe WatchSource:0}: Error finding container efe78388d8e5524478f332c7487c0e736a2b7a6026a9f65467f575573f2baabe: Status 404 returned error can't find the container with id efe78388d8e5524478f332c7487c0e736a2b7a6026a9f65467f575573f2baabe Jun 09 02:24:30.411436 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:30.411393 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-r5vqq" event={"ID":"9c20a1c4-e1eb-4851-8379-b0138b0a1389","Type":"ContainerStarted","Data":"efe78388d8e5524478f332c7487c0e736a2b7a6026a9f65467f575573f2baabe"} Jun 09 02:24:32.425355 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:32.425314 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-r5vqq" event={"ID":"9c20a1c4-e1eb-4851-8379-b0138b0a1389","Type":"ContainerStarted","Data":"6c6989c4d694b313826eae14898eab56ca48a0392e992140fdb2f5c11d7e055b"} Jun 09 02:24:32.425773 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:32.425384 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-r5vqq" event={"ID":"9c20a1c4-e1eb-4851-8379-b0138b0a1389","Type":"ContainerStarted","Data":"2493d3a8574ac79e0074cd2a77ddec311471ef55954a3070633c052b8043acdf"} Jun 09 02:24:32.426266 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:32.426241 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-r5vqq" Jun 09 02:24:32.442390 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:32.442337 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-r5vqq" podStartSLOduration=251.736605891 podStartE2EDuration="4m13.442309996s" totalImagesPullingTime="1.705704105s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:20:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:24:32.440679475 +0000 UTC m=+288.387796817" watchObservedRunningTime="2026-06-09 02:24:32.442309996 +0000 UTC m=+288.389427341" Jun 09 02:24:35.522234 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:35.522194 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:24:36.567808 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:36.567773 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:24:39.702450 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:39.702414 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-cdbd67b4d-684h8" Jun 09 02:24:39.706251 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:39.706225 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-cdbd67b4d-684h8" Jun 09 02:24:39.854406 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:39.854372 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:24:39.954964 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:39.954904 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:24:40.002920 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:40.002893 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:24:40.727665 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:40.727635 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:24:40.776029 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:40.776000 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:24:40.909678 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:40.909639 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:24:41.010399 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:41.010343 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:24:41.110063 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:41.110040 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:24:43.436414 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:43.436382 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-r5vqq" Jun 09 02:24:44.407514 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:44.407437 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-9hfq7_41d0740b-ac9d-47bd-92c3-8c89c459ae7c/console-operator/1.log" Jun 09 02:24:44.410822 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:44.410800 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-9hfq7_41d0740b-ac9d-47bd-92c3-8c89c459ae7c/console-operator/1.log" Jun 09 02:24:44.416640 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:44.416622 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jz2q7_37e9e0fa-4abd-4eeb-8671-934808ecdf78/ovn-acl-logging/0.log" Jun 09 02:24:44.419667 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:44.419649 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jz2q7_37e9e0fa-4abd-4eeb-8671-934808ecdf78/ovn-acl-logging/0.log" Jun 09 02:24:44.421057 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:44.421036 2573 kubelet.go:1648] "Image garbage collection succeeded" Jun 09 02:24:45.393404 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:45.393380 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6b6f4b68db-772wg" Jun 09 02:24:45.498392 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:45.498356 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:24:45.599384 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:45.599355 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:24:45.653323 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:45.653268 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:24:47.952208 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:47.952153 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:24:48.053314 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:48.053284 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:24:48.153374 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:48.153339 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:24:49.517106 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:49.517060 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:24:49.564607 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:49.564576 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:24:52.577950 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:52.577915 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:24:52.677932 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:52.677898 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:24:53.472656 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:53.472622 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:24:53.573777 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:53.573750 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:24:58.596484 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:58.596435 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:24:58.645334 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:24:58.645300 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:25:01.733445 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:01.733406 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:25:01.785283 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:01.785207 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:25:09.090095 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:09.090029 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:25:09.140613 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:09.140575 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:25:09.404350 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:09.404273 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:25:09.453298 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:09.453268 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:25:09.910229 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:09.910197 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-855596df4f-plgmb"] Jun 09 02:25:09.910673 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:09.910649 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6408c7a-c84c-4aa0-abee-ad9eb93d2ea6" containerName="console" Jun 09 02:25:09.910673 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:09.910674 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6408c7a-c84c-4aa0-abee-ad9eb93d2ea6" containerName="console" Jun 09 02:25:09.910830 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:09.910778 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6408c7a-c84c-4aa0-abee-ad9eb93d2ea6" containerName="console" Jun 09 02:25:09.915380 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:09.915363 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-855596df4f-plgmb" Jun 09 02:25:09.924039 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:09.924021 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-855596df4f-plgmb"] Jun 09 02:25:09.959996 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:09.959975 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b09e2f0c-4574-42b4-ad9a-c392ce7c054d-oauth-serving-cert\") pod \"console-855596df4f-plgmb\" (UID: \"b09e2f0c-4574-42b4-ad9a-c392ce7c054d\") " pod="openshift-console/console-855596df4f-plgmb" Jun 09 02:25:09.960109 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:09.960009 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b09e2f0c-4574-42b4-ad9a-c392ce7c054d-console-oauth-config\") pod \"console-855596df4f-plgmb\" (UID: \"b09e2f0c-4574-42b4-ad9a-c392ce7c054d\") " pod="openshift-console/console-855596df4f-plgmb" Jun 09 02:25:09.960109 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:09.960030 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b09e2f0c-4574-42b4-ad9a-c392ce7c054d-service-ca\") pod \"console-855596df4f-plgmb\" (UID: \"b09e2f0c-4574-42b4-ad9a-c392ce7c054d\") " pod="openshift-console/console-855596df4f-plgmb" Jun 09 02:25:09.960109 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:09.960052 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b09e2f0c-4574-42b4-ad9a-c392ce7c054d-trusted-ca-bundle\") pod \"console-855596df4f-plgmb\" (UID: \"b09e2f0c-4574-42b4-ad9a-c392ce7c054d\") " pod="openshift-console/console-855596df4f-plgmb" Jun 09 02:25:09.960268 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:09.960113 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b09e2f0c-4574-42b4-ad9a-c392ce7c054d-console-config\") pod \"console-855596df4f-plgmb\" (UID: \"b09e2f0c-4574-42b4-ad9a-c392ce7c054d\") " pod="openshift-console/console-855596df4f-plgmb" Jun 09 02:25:09.960268 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:09.960159 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b09e2f0c-4574-42b4-ad9a-c392ce7c054d-console-serving-cert\") pod \"console-855596df4f-plgmb\" (UID: \"b09e2f0c-4574-42b4-ad9a-c392ce7c054d\") " pod="openshift-console/console-855596df4f-plgmb" Jun 09 02:25:09.960268 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:09.960188 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdrgx\" (UniqueName: \"kubernetes.io/projected/b09e2f0c-4574-42b4-ad9a-c392ce7c054d-kube-api-access-pdrgx\") pod \"console-855596df4f-plgmb\" (UID: \"b09e2f0c-4574-42b4-ad9a-c392ce7c054d\") " pod="openshift-console/console-855596df4f-plgmb" Jun 09 02:25:09.969841 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:09.969810 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:25:10.060508 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:10.060484 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b09e2f0c-4574-42b4-ad9a-c392ce7c054d-oauth-serving-cert\") pod \"console-855596df4f-plgmb\" (UID: \"b09e2f0c-4574-42b4-ad9a-c392ce7c054d\") " pod="openshift-console/console-855596df4f-plgmb" Jun 09 02:25:10.060610 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:10.060526 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b09e2f0c-4574-42b4-ad9a-c392ce7c054d-console-oauth-config\") pod \"console-855596df4f-plgmb\" (UID: \"b09e2f0c-4574-42b4-ad9a-c392ce7c054d\") " pod="openshift-console/console-855596df4f-plgmb" Jun 09 02:25:10.060610 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:10.060557 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b09e2f0c-4574-42b4-ad9a-c392ce7c054d-service-ca\") pod \"console-855596df4f-plgmb\" (UID: \"b09e2f0c-4574-42b4-ad9a-c392ce7c054d\") " pod="openshift-console/console-855596df4f-plgmb" Jun 09 02:25:10.060610 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:10.060600 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b09e2f0c-4574-42b4-ad9a-c392ce7c054d-trusted-ca-bundle\") pod \"console-855596df4f-plgmb\" (UID: \"b09e2f0c-4574-42b4-ad9a-c392ce7c054d\") " pod="openshift-console/console-855596df4f-plgmb" Jun 09 02:25:10.060765 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:10.060631 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b09e2f0c-4574-42b4-ad9a-c392ce7c054d-console-config\") pod \"console-855596df4f-plgmb\" (UID: \"b09e2f0c-4574-42b4-ad9a-c392ce7c054d\") " pod="openshift-console/console-855596df4f-plgmb" Jun 09 02:25:10.060765 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:10.060662 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b09e2f0c-4574-42b4-ad9a-c392ce7c054d-console-serving-cert\") pod \"console-855596df4f-plgmb\" (UID: \"b09e2f0c-4574-42b4-ad9a-c392ce7c054d\") " pod="openshift-console/console-855596df4f-plgmb" Jun 09 02:25:10.060765 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:10.060689 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdrgx\" (UniqueName: \"kubernetes.io/projected/b09e2f0c-4574-42b4-ad9a-c392ce7c054d-kube-api-access-pdrgx\") pod \"console-855596df4f-plgmb\" (UID: \"b09e2f0c-4574-42b4-ad9a-c392ce7c054d\") " pod="openshift-console/console-855596df4f-plgmb" Jun 09 02:25:10.061341 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:10.061318 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b09e2f0c-4574-42b4-ad9a-c392ce7c054d-oauth-serving-cert\") pod \"console-855596df4f-plgmb\" (UID: \"b09e2f0c-4574-42b4-ad9a-c392ce7c054d\") " pod="openshift-console/console-855596df4f-plgmb" Jun 09 02:25:10.061462 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:10.061318 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b09e2f0c-4574-42b4-ad9a-c392ce7c054d-service-ca\") pod \"console-855596df4f-plgmb\" (UID: \"b09e2f0c-4574-42b4-ad9a-c392ce7c054d\") " pod="openshift-console/console-855596df4f-plgmb" Jun 09 02:25:10.061557 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:10.061536 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b09e2f0c-4574-42b4-ad9a-c392ce7c054d-trusted-ca-bundle\") pod \"console-855596df4f-plgmb\" (UID: \"b09e2f0c-4574-42b4-ad9a-c392ce7c054d\") " pod="openshift-console/console-855596df4f-plgmb" Jun 09 02:25:10.061641 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:10.061619 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b09e2f0c-4574-42b4-ad9a-c392ce7c054d-console-config\") pod \"console-855596df4f-plgmb\" (UID: \"b09e2f0c-4574-42b4-ad9a-c392ce7c054d\") " pod="openshift-console/console-855596df4f-plgmb" Jun 09 02:25:10.063066 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:10.063036 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b09e2f0c-4574-42b4-ad9a-c392ce7c054d-console-oauth-config\") pod \"console-855596df4f-plgmb\" (UID: \"b09e2f0c-4574-42b4-ad9a-c392ce7c054d\") " pod="openshift-console/console-855596df4f-plgmb" Jun 09 02:25:10.063164 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:10.063097 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b09e2f0c-4574-42b4-ad9a-c392ce7c054d-console-serving-cert\") pod \"console-855596df4f-plgmb\" (UID: \"b09e2f0c-4574-42b4-ad9a-c392ce7c054d\") " pod="openshift-console/console-855596df4f-plgmb" Jun 09 02:25:10.068318 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:10.068298 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdrgx\" (UniqueName: \"kubernetes.io/projected/b09e2f0c-4574-42b4-ad9a-c392ce7c054d-kube-api-access-pdrgx\") pod \"console-855596df4f-plgmb\" (UID: \"b09e2f0c-4574-42b4-ad9a-c392ce7c054d\") " pod="openshift-console/console-855596df4f-plgmb" Jun 09 02:25:10.074162 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:10.074133 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:25:10.170441 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:10.170384 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:25:10.226409 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:10.226384 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-855596df4f-plgmb" Jun 09 02:25:10.358429 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:10.358403 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-855596df4f-plgmb"] Jun 09 02:25:10.360405 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:25:10.360378 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb09e2f0c_4574_42b4_ad9a_c392ce7c054d.slice/crio-925437199b34c3bed10030cec38fd590418f678c5ddf065caea53d9210398475 WatchSource:0}: Error finding container 925437199b34c3bed10030cec38fd590418f678c5ddf065caea53d9210398475: Status 404 returned error can't find the container with id 925437199b34c3bed10030cec38fd590418f678c5ddf065caea53d9210398475 Jun 09 02:25:10.581265 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:10.581235 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-855596df4f-plgmb" event={"ID":"b09e2f0c-4574-42b4-ad9a-c392ce7c054d","Type":"ContainerStarted","Data":"81a5abb8b38d6500b27ad73fa129dbc5c334842396e6990c2957c88796069e38"} Jun 09 02:25:10.581415 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:10.581292 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-855596df4f-plgmb" event={"ID":"b09e2f0c-4574-42b4-ad9a-c392ce7c054d","Type":"ContainerStarted","Data":"925437199b34c3bed10030cec38fd590418f678c5ddf065caea53d9210398475"} Jun 09 02:25:10.600574 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:10.600530 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-855596df4f-plgmb" podStartSLOduration=1.600514423 podStartE2EDuration="1.600514423s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:25:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:25:10.598390681 +0000 UTC m=+326.545508024" watchObservedRunningTime="2026-06-09 02:25:10.600514423 +0000 UTC m=+326.547631833" Jun 09 02:25:10.697120 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:10.697068 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:25:10.800972 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:10.800945 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:25:16.747925 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:16.747886 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:25:16.848504 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:16.848472 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:25:20.227326 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:20.227296 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-855596df4f-plgmb" Jun 09 02:25:20.227785 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:20.227392 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-855596df4f-plgmb" Jun 09 02:25:20.232523 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:20.232500 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-855596df4f-plgmb" Jun 09 02:25:20.627432 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:20.627404 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-855596df4f-plgmb" Jun 09 02:25:20.671053 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:20.671017 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-cdbd67b4d-684h8"] Jun 09 02:25:20.769826 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:20.769785 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:25:20.879979 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:20.879908 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:25:20.925695 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:20.925664 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:25:42.993023 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:42.992913 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:25:43.042870 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:43.042823 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:25:45.690068 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:45.690004 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-cdbd67b4d-684h8" podUID="0b59afb6-e169-4253-b26c-3ccd823d4c72" containerName="console" containerID="cri-o://7ef41b3230b408c872a36958389a104cc4b5ae86b4c02cfa7227194b214e2a17" gracePeriod=15 Jun 09 02:25:45.937736 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:45.937715 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cdbd67b4d-684h8" Jun 09 02:25:46.017556 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:46.017495 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0b59afb6-e169-4253-b26c-3ccd823d4c72-oauth-serving-cert\") pod \"0b59afb6-e169-4253-b26c-3ccd823d4c72\" (UID: \"0b59afb6-e169-4253-b26c-3ccd823d4c72\") " Jun 09 02:25:46.017556 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:46.017536 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0b59afb6-e169-4253-b26c-3ccd823d4c72-service-ca\") pod \"0b59afb6-e169-4253-b26c-3ccd823d4c72\" (UID: \"0b59afb6-e169-4253-b26c-3ccd823d4c72\") " Jun 09 02:25:46.017704 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:46.017563 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b59afb6-e169-4253-b26c-3ccd823d4c72-trusted-ca-bundle\") pod \"0b59afb6-e169-4253-b26c-3ccd823d4c72\" (UID: \"0b59afb6-e169-4253-b26c-3ccd823d4c72\") " Jun 09 02:25:46.017704 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:46.017585 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mpmcp\" (UniqueName: \"kubernetes.io/projected/0b59afb6-e169-4253-b26c-3ccd823d4c72-kube-api-access-mpmcp\") pod \"0b59afb6-e169-4253-b26c-3ccd823d4c72\" (UID: \"0b59afb6-e169-4253-b26c-3ccd823d4c72\") " Jun 09 02:25:46.017704 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:46.017630 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0b59afb6-e169-4253-b26c-3ccd823d4c72-console-config\") pod \"0b59afb6-e169-4253-b26c-3ccd823d4c72\" (UID: \"0b59afb6-e169-4253-b26c-3ccd823d4c72\") " Jun 09 02:25:46.017704 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:46.017659 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0b59afb6-e169-4253-b26c-3ccd823d4c72-console-oauth-config\") pod \"0b59afb6-e169-4253-b26c-3ccd823d4c72\" (UID: \"0b59afb6-e169-4253-b26c-3ccd823d4c72\") " Jun 09 02:25:46.017896 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:46.017730 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0b59afb6-e169-4253-b26c-3ccd823d4c72-console-serving-cert\") pod \"0b59afb6-e169-4253-b26c-3ccd823d4c72\" (UID: \"0b59afb6-e169-4253-b26c-3ccd823d4c72\") " Jun 09 02:25:46.017945 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:46.017901 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b59afb6-e169-4253-b26c-3ccd823d4c72-service-ca" (OuterVolumeSpecName: "service-ca") pod "0b59afb6-e169-4253-b26c-3ccd823d4c72" (UID: "0b59afb6-e169-4253-b26c-3ccd823d4c72"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 02:25:46.018092 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:46.018050 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b59afb6-e169-4253-b26c-3ccd823d4c72-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "0b59afb6-e169-4253-b26c-3ccd823d4c72" (UID: "0b59afb6-e169-4253-b26c-3ccd823d4c72"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 02:25:46.018205 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:46.018180 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b59afb6-e169-4253-b26c-3ccd823d4c72-console-config" (OuterVolumeSpecName: "console-config") pod "0b59afb6-e169-4253-b26c-3ccd823d4c72" (UID: "0b59afb6-e169-4253-b26c-3ccd823d4c72"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 02:25:46.018205 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:46.018187 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b59afb6-e169-4253-b26c-3ccd823d4c72-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0b59afb6-e169-4253-b26c-3ccd823d4c72" (UID: "0b59afb6-e169-4253-b26c-3ccd823d4c72"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 02:25:46.019900 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:46.019872 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b59afb6-e169-4253-b26c-3ccd823d4c72-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0b59afb6-e169-4253-b26c-3ccd823d4c72" (UID: "0b59afb6-e169-4253-b26c-3ccd823d4c72"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 02:25:46.020139 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:46.020122 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b59afb6-e169-4253-b26c-3ccd823d4c72-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0b59afb6-e169-4253-b26c-3ccd823d4c72" (UID: "0b59afb6-e169-4253-b26c-3ccd823d4c72"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 02:25:46.020139 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:46.020127 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b59afb6-e169-4253-b26c-3ccd823d4c72-kube-api-access-mpmcp" (OuterVolumeSpecName: "kube-api-access-mpmcp") pod "0b59afb6-e169-4253-b26c-3ccd823d4c72" (UID: "0b59afb6-e169-4253-b26c-3ccd823d4c72"). InnerVolumeSpecName "kube-api-access-mpmcp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 02:25:46.119208 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:46.119187 2573 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0b59afb6-e169-4253-b26c-3ccd823d4c72-oauth-serving-cert\") on node \"ip-10-0-143-102.ec2.internal\" DevicePath \"\"" Jun 09 02:25:46.119208 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:46.119204 2573 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0b59afb6-e169-4253-b26c-3ccd823d4c72-service-ca\") on node \"ip-10-0-143-102.ec2.internal\" DevicePath \"\"" Jun 09 02:25:46.119321 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:46.119213 2573 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b59afb6-e169-4253-b26c-3ccd823d4c72-trusted-ca-bundle\") on node \"ip-10-0-143-102.ec2.internal\" DevicePath \"\"" Jun 09 02:25:46.119321 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:46.119221 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mpmcp\" (UniqueName: \"kubernetes.io/projected/0b59afb6-e169-4253-b26c-3ccd823d4c72-kube-api-access-mpmcp\") on node \"ip-10-0-143-102.ec2.internal\" DevicePath \"\"" Jun 09 02:25:46.119321 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:46.119229 2573 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0b59afb6-e169-4253-b26c-3ccd823d4c72-console-config\") on node \"ip-10-0-143-102.ec2.internal\" DevicePath \"\"" Jun 09 02:25:46.119321 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:46.119237 2573 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0b59afb6-e169-4253-b26c-3ccd823d4c72-console-oauth-config\") on node \"ip-10-0-143-102.ec2.internal\" DevicePath \"\"" Jun 09 02:25:46.119321 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:46.119244 2573 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0b59afb6-e169-4253-b26c-3ccd823d4c72-console-serving-cert\") on node \"ip-10-0-143-102.ec2.internal\" DevicePath \"\"" Jun 09 02:25:46.727712 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:46.727652 2573 generic.go:356] "Generic (PLEG): container finished" podID="0b59afb6-e169-4253-b26c-3ccd823d4c72" containerID="7ef41b3230b408c872a36958389a104cc4b5ae86b4c02cfa7227194b214e2a17" exitCode=0 Jun 09 02:25:46.727712 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:46.727700 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cdbd67b4d-684h8" Jun 09 02:25:46.728036 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:46.727724 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cdbd67b4d-684h8" event={"ID":"0b59afb6-e169-4253-b26c-3ccd823d4c72","Type":"ContainerDied","Data":"7ef41b3230b408c872a36958389a104cc4b5ae86b4c02cfa7227194b214e2a17"} Jun 09 02:25:46.728036 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:46.727768 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cdbd67b4d-684h8" event={"ID":"0b59afb6-e169-4253-b26c-3ccd823d4c72","Type":"ContainerDied","Data":"e1324b7b0f46ca9a756c0cfd3a83aa9ae75139f5873593003e629585fc3bad66"} Jun 09 02:25:46.728036 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:46.727791 2573 scope.go:117] "RemoveContainer" containerID="7ef41b3230b408c872a36958389a104cc4b5ae86b4c02cfa7227194b214e2a17" Jun 09 02:25:46.736344 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:46.736325 2573 scope.go:117] "RemoveContainer" containerID="7ef41b3230b408c872a36958389a104cc4b5ae86b4c02cfa7227194b214e2a17" Jun 09 02:25:46.736639 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:25:46.736617 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ef41b3230b408c872a36958389a104cc4b5ae86b4c02cfa7227194b214e2a17\": container with ID starting with 7ef41b3230b408c872a36958389a104cc4b5ae86b4c02cfa7227194b214e2a17 not found: ID does not exist" containerID="7ef41b3230b408c872a36958389a104cc4b5ae86b4c02cfa7227194b214e2a17" Jun 09 02:25:46.736683 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:46.736649 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ef41b3230b408c872a36958389a104cc4b5ae86b4c02cfa7227194b214e2a17"} err="failed to get container status \"7ef41b3230b408c872a36958389a104cc4b5ae86b4c02cfa7227194b214e2a17\": rpc error: code = NotFound desc = could not find container \"7ef41b3230b408c872a36958389a104cc4b5ae86b4c02cfa7227194b214e2a17\": container with ID starting with 7ef41b3230b408c872a36958389a104cc4b5ae86b4c02cfa7227194b214e2a17 not found: ID does not exist" Jun 09 02:25:46.742468 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:46.742444 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-cdbd67b4d-684h8"] Jun 09 02:25:46.747505 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:46.747481 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-cdbd67b4d-684h8"] Jun 09 02:25:47.814681 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:47.814649 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:25:47.908652 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:47.908625 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:25:48.340626 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:48.340596 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dfs7jh"] Jun 09 02:25:48.340979 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:48.340963 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b59afb6-e169-4253-b26c-3ccd823d4c72" containerName="console" Jun 09 02:25:48.341026 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:48.340980 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b59afb6-e169-4253-b26c-3ccd823d4c72" containerName="console" Jun 09 02:25:48.341062 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:48.341041 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b59afb6-e169-4253-b26c-3ccd823d4c72" containerName="console" Jun 09 02:25:48.345720 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:48.345702 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dfs7jh" Jun 09 02:25:48.348060 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:48.348035 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 09 02:25:48.348195 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:48.348061 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-x8s7r\"" Jun 09 02:25:48.348195 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:48.348061 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 09 02:25:48.351647 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:48.351620 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dfs7jh"] Jun 09 02:25:48.434851 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:48.434823 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9f3a767f-e457-4ed2-bee2-7e04c9ecfe46-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dfs7jh\" (UID: \"9f3a767f-e457-4ed2-bee2-7e04c9ecfe46\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dfs7jh" Jun 09 02:25:48.434945 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:48.434854 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6thcr\" (UniqueName: \"kubernetes.io/projected/9f3a767f-e457-4ed2-bee2-7e04c9ecfe46-kube-api-access-6thcr\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dfs7jh\" (UID: \"9f3a767f-e457-4ed2-bee2-7e04c9ecfe46\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dfs7jh" Jun 09 02:25:48.434945 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:48.434884 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9f3a767f-e457-4ed2-bee2-7e04c9ecfe46-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dfs7jh\" (UID: \"9f3a767f-e457-4ed2-bee2-7e04c9ecfe46\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dfs7jh" Jun 09 02:25:48.466204 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:48.466177 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b59afb6-e169-4253-b26c-3ccd823d4c72" path="/var/lib/kubelet/pods/0b59afb6-e169-4253-b26c-3ccd823d4c72/volumes" Jun 09 02:25:48.535844 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:48.535818 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9f3a767f-e457-4ed2-bee2-7e04c9ecfe46-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dfs7jh\" (UID: \"9f3a767f-e457-4ed2-bee2-7e04c9ecfe46\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dfs7jh" Jun 09 02:25:48.535932 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:48.535848 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6thcr\" (UniqueName: \"kubernetes.io/projected/9f3a767f-e457-4ed2-bee2-7e04c9ecfe46-kube-api-access-6thcr\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dfs7jh\" (UID: \"9f3a767f-e457-4ed2-bee2-7e04c9ecfe46\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dfs7jh" Jun 09 02:25:48.535932 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:48.535878 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9f3a767f-e457-4ed2-bee2-7e04c9ecfe46-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dfs7jh\" (UID: \"9f3a767f-e457-4ed2-bee2-7e04c9ecfe46\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dfs7jh" Jun 09 02:25:48.536225 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:48.536202 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9f3a767f-e457-4ed2-bee2-7e04c9ecfe46-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dfs7jh\" (UID: \"9f3a767f-e457-4ed2-bee2-7e04c9ecfe46\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dfs7jh" Jun 09 02:25:48.536269 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:48.536259 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9f3a767f-e457-4ed2-bee2-7e04c9ecfe46-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dfs7jh\" (UID: \"9f3a767f-e457-4ed2-bee2-7e04c9ecfe46\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dfs7jh" Jun 09 02:25:48.543616 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:48.543585 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6thcr\" (UniqueName: \"kubernetes.io/projected/9f3a767f-e457-4ed2-bee2-7e04c9ecfe46-kube-api-access-6thcr\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dfs7jh\" (UID: \"9f3a767f-e457-4ed2-bee2-7e04c9ecfe46\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dfs7jh" Jun 09 02:25:48.656200 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:48.656142 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dfs7jh" Jun 09 02:25:48.803154 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:48.803131 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dfs7jh"] Jun 09 02:25:48.805227 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:25:48.805202 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f3a767f_e457_4ed2_bee2_7e04c9ecfe46.slice/crio-a0f3d164ec88182cd1c95dba1188256140b9250dec36ed9e74503f0e2943c6db WatchSource:0}: Error finding container a0f3d164ec88182cd1c95dba1188256140b9250dec36ed9e74503f0e2943c6db: Status 404 returned error can't find the container with id a0f3d164ec88182cd1c95dba1188256140b9250dec36ed9e74503f0e2943c6db Jun 09 02:25:48.807239 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:48.807221 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 02:25:49.749720 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:49.749691 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dfs7jh" event={"ID":"9f3a767f-e457-4ed2-bee2-7e04c9ecfe46","Type":"ContainerStarted","Data":"a0f3d164ec88182cd1c95dba1188256140b9250dec36ed9e74503f0e2943c6db"} Jun 09 02:25:56.781503 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:56.781468 2573 generic.go:356] "Generic (PLEG): container finished" podID="9f3a767f-e457-4ed2-bee2-7e04c9ecfe46" containerID="a07a643d61fc8d2ce764857f0c25254a170406369db513cbb20b84a7efc97f7f" exitCode=0 Jun 09 02:25:56.781868 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:56.781561 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dfs7jh" event={"ID":"9f3a767f-e457-4ed2-bee2-7e04c9ecfe46","Type":"ContainerDied","Data":"a07a643d61fc8d2ce764857f0c25254a170406369db513cbb20b84a7efc97f7f"} Jun 09 02:25:59.796944 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:59.796907 2573 generic.go:356] "Generic (PLEG): container finished" podID="9f3a767f-e457-4ed2-bee2-7e04c9ecfe46" containerID="bceaf01c37582a2318f40eae6a356e12de846bb34dc2c82e4b81024ca5b2f4d0" exitCode=0 Jun 09 02:25:59.797341 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:25:59.796994 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dfs7jh" event={"ID":"9f3a767f-e457-4ed2-bee2-7e04c9ecfe46","Type":"ContainerDied","Data":"bceaf01c37582a2318f40eae6a356e12de846bb34dc2c82e4b81024ca5b2f4d0"} Jun 09 02:26:06.832366 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:06.832339 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dfs7jh" event={"ID":"9f3a767f-e457-4ed2-bee2-7e04c9ecfe46","Type":"ContainerStarted","Data":"8c129655a4eff9e482a87857f54afbcb4cf52cc431660cafa48623dc9510ef7c"} Jun 09 02:26:06.850378 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:06.850328 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dfs7jh" podStartSLOduration=2.881169083 podStartE2EDuration="18.850314488s" totalImagesPullingTime="15.969145405s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:25:48 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:26:06.848682214 +0000 UTC m=+382.795799555" watchObservedRunningTime="2026-06-09 02:26:06.850314488 +0000 UTC m=+382.797431830" Jun 09 02:26:07.839510 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:07.839479 2573 generic.go:356] "Generic (PLEG): container finished" podID="9f3a767f-e457-4ed2-bee2-7e04c9ecfe46" containerID="8c129655a4eff9e482a87857f54afbcb4cf52cc431660cafa48623dc9510ef7c" exitCode=0 Jun 09 02:26:07.839841 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:07.839577 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dfs7jh" event={"ID":"9f3a767f-e457-4ed2-bee2-7e04c9ecfe46","Type":"ContainerDied","Data":"8c129655a4eff9e482a87857f54afbcb4cf52cc431660cafa48623dc9510ef7c"} Jun 09 02:26:08.767808 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:08.767771 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:26:08.972522 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:08.972503 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dfs7jh" Jun 09 02:26:09.093265 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:09.093242 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9f3a767f-e457-4ed2-bee2-7e04c9ecfe46-util\") pod \"9f3a767f-e457-4ed2-bee2-7e04c9ecfe46\" (UID: \"9f3a767f-e457-4ed2-bee2-7e04c9ecfe46\") " Jun 09 02:26:09.093382 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:09.093349 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6thcr\" (UniqueName: \"kubernetes.io/projected/9f3a767f-e457-4ed2-bee2-7e04c9ecfe46-kube-api-access-6thcr\") pod \"9f3a767f-e457-4ed2-bee2-7e04c9ecfe46\" (UID: \"9f3a767f-e457-4ed2-bee2-7e04c9ecfe46\") " Jun 09 02:26:09.093450 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:09.093419 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9f3a767f-e457-4ed2-bee2-7e04c9ecfe46-bundle\") pod \"9f3a767f-e457-4ed2-bee2-7e04c9ecfe46\" (UID: \"9f3a767f-e457-4ed2-bee2-7e04c9ecfe46\") " Jun 09 02:26:09.094008 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:09.093985 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f3a767f-e457-4ed2-bee2-7e04c9ecfe46-bundle" (OuterVolumeSpecName: "bundle") pod "9f3a767f-e457-4ed2-bee2-7e04c9ecfe46" (UID: "9f3a767f-e457-4ed2-bee2-7e04c9ecfe46"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 02:26:09.095448 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:09.095419 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f3a767f-e457-4ed2-bee2-7e04c9ecfe46-kube-api-access-6thcr" (OuterVolumeSpecName: "kube-api-access-6thcr") pod "9f3a767f-e457-4ed2-bee2-7e04c9ecfe46" (UID: "9f3a767f-e457-4ed2-bee2-7e04c9ecfe46"). InnerVolumeSpecName "kube-api-access-6thcr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 02:26:09.097495 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:09.097478 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f3a767f-e457-4ed2-bee2-7e04c9ecfe46-util" (OuterVolumeSpecName: "util") pod "9f3a767f-e457-4ed2-bee2-7e04c9ecfe46" (UID: "9f3a767f-e457-4ed2-bee2-7e04c9ecfe46"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 02:26:09.194324 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:09.194300 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9f3a767f-e457-4ed2-bee2-7e04c9ecfe46-util\") on node \"ip-10-0-143-102.ec2.internal\" DevicePath \"\"" Jun 09 02:26:09.194324 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:09.194319 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6thcr\" (UniqueName: \"kubernetes.io/projected/9f3a767f-e457-4ed2-bee2-7e04c9ecfe46-kube-api-access-6thcr\") on node \"ip-10-0-143-102.ec2.internal\" DevicePath \"\"" Jun 09 02:26:09.194430 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:09.194330 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9f3a767f-e457-4ed2-bee2-7e04c9ecfe46-bundle\") on node \"ip-10-0-143-102.ec2.internal\" DevicePath \"\"" Jun 09 02:26:09.850761 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:09.850733 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dfs7jh" Jun 09 02:26:09.850856 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:09.850760 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dfs7jh" event={"ID":"9f3a767f-e457-4ed2-bee2-7e04c9ecfe46","Type":"ContainerDied","Data":"a0f3d164ec88182cd1c95dba1188256140b9250dec36ed9e74503f0e2943c6db"} Jun 09 02:26:09.850856 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:09.850808 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a0f3d164ec88182cd1c95dba1188256140b9250dec36ed9e74503f0e2943c6db" Jun 09 02:26:14.097306 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:14.097271 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:26:15.494633 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:15.494601 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:26:16.046287 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:16.046250 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-l4572"] Jun 09 02:26:16.046640 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:16.046615 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f3a767f-e457-4ed2-bee2-7e04c9ecfe46" containerName="extract" Jun 09 02:26:16.046640 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:16.046638 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f3a767f-e457-4ed2-bee2-7e04c9ecfe46" containerName="extract" Jun 09 02:26:16.046640 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:16.046656 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f3a767f-e457-4ed2-bee2-7e04c9ecfe46" containerName="util" Jun 09 02:26:16.046836 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:16.046662 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f3a767f-e457-4ed2-bee2-7e04c9ecfe46" containerName="util" Jun 09 02:26:16.046836 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:16.046670 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f3a767f-e457-4ed2-bee2-7e04c9ecfe46" containerName="pull" Jun 09 02:26:16.046836 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:16.046676 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f3a767f-e457-4ed2-bee2-7e04c9ecfe46" containerName="pull" Jun 09 02:26:16.046836 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:16.046735 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f3a767f-e457-4ed2-bee2-7e04c9ecfe46" containerName="extract" Jun 09 02:26:16.098489 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:16.098469 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-l4572"] Jun 09 02:26:16.098595 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:16.098545 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-l4572" Jun 09 02:26:16.116355 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:16.116339 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-cnvtd\"" Jun 09 02:26:16.116524 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:16.116511 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 09 02:26:16.116647 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:16.116631 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 09 02:26:16.142377 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:16.142354 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8clcg\" (UniqueName: \"kubernetes.io/projected/7f19d4d3-4ab3-42e2-9f43-2f2906d8855a-kube-api-access-8clcg\") pod \"cert-manager-operator-controller-manager-57757f7cfc-l4572\" (UID: \"7f19d4d3-4ab3-42e2-9f43-2f2906d8855a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-l4572" Jun 09 02:26:16.142452 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:16.142398 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7f19d4d3-4ab3-42e2-9f43-2f2906d8855a-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-l4572\" (UID: \"7f19d4d3-4ab3-42e2-9f43-2f2906d8855a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-l4572" Jun 09 02:26:16.242656 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:16.242633 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8clcg\" (UniqueName: \"kubernetes.io/projected/7f19d4d3-4ab3-42e2-9f43-2f2906d8855a-kube-api-access-8clcg\") pod \"cert-manager-operator-controller-manager-57757f7cfc-l4572\" (UID: \"7f19d4d3-4ab3-42e2-9f43-2f2906d8855a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-l4572" Jun 09 02:26:16.242741 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:16.242674 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7f19d4d3-4ab3-42e2-9f43-2f2906d8855a-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-l4572\" (UID: \"7f19d4d3-4ab3-42e2-9f43-2f2906d8855a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-l4572" Jun 09 02:26:16.248096 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:16.243339 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7f19d4d3-4ab3-42e2-9f43-2f2906d8855a-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-l4572\" (UID: \"7f19d4d3-4ab3-42e2-9f43-2f2906d8855a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-l4572" Jun 09 02:26:16.251819 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:16.251797 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8clcg\" (UniqueName: \"kubernetes.io/projected/7f19d4d3-4ab3-42e2-9f43-2f2906d8855a-kube-api-access-8clcg\") pod \"cert-manager-operator-controller-manager-57757f7cfc-l4572\" (UID: \"7f19d4d3-4ab3-42e2-9f43-2f2906d8855a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-l4572" Jun 09 02:26:16.406794 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:16.406739 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-l4572" Jun 09 02:26:16.555024 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:16.555000 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-l4572"] Jun 09 02:26:16.557856 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:26:16.557830 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f19d4d3_4ab3_42e2_9f43_2f2906d8855a.slice/crio-30218570f92e5b4b473ff9a915e8bb64cba6e70d6188e3b88894d4661152b2bb WatchSource:0}: Error finding container 30218570f92e5b4b473ff9a915e8bb64cba6e70d6188e3b88894d4661152b2bb: Status 404 returned error can't find the container with id 30218570f92e5b4b473ff9a915e8bb64cba6e70d6188e3b88894d4661152b2bb Jun 09 02:26:16.881788 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:16.881759 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-l4572" event={"ID":"7f19d4d3-4ab3-42e2-9f43-2f2906d8855a","Type":"ContainerStarted","Data":"30218570f92e5b4b473ff9a915e8bb64cba6e70d6188e3b88894d4661152b2bb"} Jun 09 02:26:17.722442 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:17.722385 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:26:17.822470 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:17.822434 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:26:18.893419 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:18.893388 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-l4572" event={"ID":"7f19d4d3-4ab3-42e2-9f43-2f2906d8855a","Type":"ContainerStarted","Data":"9e6acc57632c79606b12051364aea8451a115244c0235035813e6044544022b1"} Jun 09 02:26:18.914186 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:18.914138 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-l4572" podStartSLOduration=0.79014711 podStartE2EDuration="2.914125139s" totalImagesPullingTime="2.123978029s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:26:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:26:18.913675518 +0000 UTC m=+394.860792861" watchObservedRunningTime="2026-06-09 02:26:18.914125139 +0000 UTC m=+394.861242481" Jun 09 02:26:19.299271 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:19.299233 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:26:19.414367 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:19.414323 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:26:19.529278 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:19.529244 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:26:20.135568 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:20.135539 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk8bm4"] Jun 09 02:26:20.138020 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:20.137993 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk8bm4" Jun 09 02:26:20.140310 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:20.140289 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 09 02:26:20.141271 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:20.141244 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-x8s7r\"" Jun 09 02:26:20.141381 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:20.141295 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 09 02:26:20.147384 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:20.147361 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk8bm4"] Jun 09 02:26:20.168815 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:20.168793 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zqdh\" (UniqueName: \"kubernetes.io/projected/ed57df2c-0291-4c1f-8c0a-96f7b1574319-kube-api-access-8zqdh\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk8bm4\" (UID: \"ed57df2c-0291-4c1f-8c0a-96f7b1574319\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk8bm4" Jun 09 02:26:20.168948 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:20.168877 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ed57df2c-0291-4c1f-8c0a-96f7b1574319-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk8bm4\" (UID: \"ed57df2c-0291-4c1f-8c0a-96f7b1574319\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk8bm4" Jun 09 02:26:20.168948 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:20.168933 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ed57df2c-0291-4c1f-8c0a-96f7b1574319-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk8bm4\" (UID: \"ed57df2c-0291-4c1f-8c0a-96f7b1574319\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk8bm4" Jun 09 02:26:20.269515 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:20.269488 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zqdh\" (UniqueName: \"kubernetes.io/projected/ed57df2c-0291-4c1f-8c0a-96f7b1574319-kube-api-access-8zqdh\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk8bm4\" (UID: \"ed57df2c-0291-4c1f-8c0a-96f7b1574319\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk8bm4" Jun 09 02:26:20.269645 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:20.269527 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ed57df2c-0291-4c1f-8c0a-96f7b1574319-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk8bm4\" (UID: \"ed57df2c-0291-4c1f-8c0a-96f7b1574319\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk8bm4" Jun 09 02:26:20.269645 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:20.269549 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ed57df2c-0291-4c1f-8c0a-96f7b1574319-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk8bm4\" (UID: \"ed57df2c-0291-4c1f-8c0a-96f7b1574319\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk8bm4" Jun 09 02:26:20.269854 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:20.269837 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ed57df2c-0291-4c1f-8c0a-96f7b1574319-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk8bm4\" (UID: \"ed57df2c-0291-4c1f-8c0a-96f7b1574319\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk8bm4" Jun 09 02:26:20.269889 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:20.269868 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ed57df2c-0291-4c1f-8c0a-96f7b1574319-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk8bm4\" (UID: \"ed57df2c-0291-4c1f-8c0a-96f7b1574319\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk8bm4" Jun 09 02:26:20.276767 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:20.276745 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zqdh\" (UniqueName: \"kubernetes.io/projected/ed57df2c-0291-4c1f-8c0a-96f7b1574319-kube-api-access-8zqdh\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk8bm4\" (UID: \"ed57df2c-0291-4c1f-8c0a-96f7b1574319\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk8bm4" Jun 09 02:26:20.448118 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:20.448051 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk8bm4" Jun 09 02:26:20.575456 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:20.575410 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk8bm4"] Jun 09 02:26:20.577778 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:26:20.577753 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded57df2c_0291_4c1f_8c0a_96f7b1574319.slice/crio-5041ffa5a42cbb620be5a419a52bbd534ee9135f9e7c47022f48d552b4990a84 WatchSource:0}: Error finding container 5041ffa5a42cbb620be5a419a52bbd534ee9135f9e7c47022f48d552b4990a84: Status 404 returned error can't find the container with id 5041ffa5a42cbb620be5a419a52bbd534ee9135f9e7c47022f48d552b4990a84 Jun 09 02:26:20.905315 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:20.905286 2573 generic.go:356] "Generic (PLEG): container finished" podID="ed57df2c-0291-4c1f-8c0a-96f7b1574319" containerID="752319dce2ac858520cd68742f46a36369fc4e0c73828beb0d32c90b38717b5c" exitCode=0 Jun 09 02:26:20.905428 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:20.905373 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk8bm4" event={"ID":"ed57df2c-0291-4c1f-8c0a-96f7b1574319","Type":"ContainerDied","Data":"752319dce2ac858520cd68742f46a36369fc4e0c73828beb0d32c90b38717b5c"} Jun 09 02:26:20.905477 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:20.905427 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk8bm4" event={"ID":"ed57df2c-0291-4c1f-8c0a-96f7b1574319","Type":"ContainerStarted","Data":"5041ffa5a42cbb620be5a419a52bbd534ee9135f9e7c47022f48d552b4990a84"} Jun 09 02:26:22.884542 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:22.884505 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:26:23.164107 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:23.164023 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-v9px8"] Jun 09 02:26:23.166454 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:23.166440 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-v9px8" Jun 09 02:26:23.168690 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:23.168670 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 09 02:26:23.168807 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:23.168788 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-wmrbf\"" Jun 09 02:26:23.168935 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:23.168909 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 09 02:26:23.175804 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:23.175784 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-v9px8"] Jun 09 02:26:23.186122 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:23.186097 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9958b89f-8588-4f5f-bb35-051dc94b160d-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-v9px8\" (UID: \"9958b89f-8588-4f5f-bb35-051dc94b160d\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-v9px8" Jun 09 02:26:23.186229 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:23.186183 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtmnp\" (UniqueName: \"kubernetes.io/projected/9958b89f-8588-4f5f-bb35-051dc94b160d-kube-api-access-qtmnp\") pod \"cert-manager-cainjector-5d99449ffd-v9px8\" (UID: \"9958b89f-8588-4f5f-bb35-051dc94b160d\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-v9px8" Jun 09 02:26:23.270436 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:23.270406 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:26:23.287459 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:23.287435 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtmnp\" (UniqueName: \"kubernetes.io/projected/9958b89f-8588-4f5f-bb35-051dc94b160d-kube-api-access-qtmnp\") pod \"cert-manager-cainjector-5d99449ffd-v9px8\" (UID: \"9958b89f-8588-4f5f-bb35-051dc94b160d\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-v9px8" Jun 09 02:26:23.287573 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:23.287558 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9958b89f-8588-4f5f-bb35-051dc94b160d-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-v9px8\" (UID: \"9958b89f-8588-4f5f-bb35-051dc94b160d\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-v9px8" Jun 09 02:26:23.295060 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:23.295037 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9958b89f-8588-4f5f-bb35-051dc94b160d-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-v9px8\" (UID: \"9958b89f-8588-4f5f-bb35-051dc94b160d\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-v9px8" Jun 09 02:26:23.295156 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:23.295131 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtmnp\" (UniqueName: \"kubernetes.io/projected/9958b89f-8588-4f5f-bb35-051dc94b160d-kube-api-access-qtmnp\") pod \"cert-manager-cainjector-5d99449ffd-v9px8\" (UID: \"9958b89f-8588-4f5f-bb35-051dc94b160d\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-v9px8" Jun 09 02:26:23.483585 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:23.483535 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-v9px8" Jun 09 02:26:23.605566 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:23.605542 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-v9px8"] Jun 09 02:26:23.607569 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:26:23.607544 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9958b89f_8588_4f5f_bb35_051dc94b160d.slice/crio-f6e1322f040d859eaa8d031695d485af3baae36d0e36c053dea890163134d850 WatchSource:0}: Error finding container f6e1322f040d859eaa8d031695d485af3baae36d0e36c053dea890163134d850: Status 404 returned error can't find the container with id f6e1322f040d859eaa8d031695d485af3baae36d0e36c053dea890163134d850 Jun 09 02:26:23.926260 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:23.926234 2573 generic.go:356] "Generic (PLEG): container finished" podID="ed57df2c-0291-4c1f-8c0a-96f7b1574319" containerID="db525155f125068745b52cf59ecbbe3209762cc4aebe53e43f69bb3b785b032c" exitCode=0 Jun 09 02:26:23.926573 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:23.926284 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk8bm4" event={"ID":"ed57df2c-0291-4c1f-8c0a-96f7b1574319","Type":"ContainerDied","Data":"db525155f125068745b52cf59ecbbe3209762cc4aebe53e43f69bb3b785b032c"} Jun 09 02:26:23.927618 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:23.927588 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-v9px8" event={"ID":"9958b89f-8588-4f5f-bb35-051dc94b160d","Type":"ContainerStarted","Data":"f6e1322f040d859eaa8d031695d485af3baae36d0e36c053dea890163134d850"} Jun 09 02:26:24.502041 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:24.502015 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:26:24.551046 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:24.551023 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:26:24.935565 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:24.935541 2573 generic.go:356] "Generic (PLEG): container finished" podID="ed57df2c-0291-4c1f-8c0a-96f7b1574319" containerID="109abd91f780d3d557dd6999d87238907b81de2c753325f63d12e66ebe8337da" exitCode=0 Jun 09 02:26:24.935945 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:24.935572 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk8bm4" event={"ID":"ed57df2c-0291-4c1f-8c0a-96f7b1574319","Type":"ContainerDied","Data":"109abd91f780d3d557dd6999d87238907b81de2c753325f63d12e66ebe8337da"} Jun 09 02:26:26.090842 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:26.090820 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk8bm4" Jun 09 02:26:26.112920 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:26.112312 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ed57df2c-0291-4c1f-8c0a-96f7b1574319-util\") pod \"ed57df2c-0291-4c1f-8c0a-96f7b1574319\" (UID: \"ed57df2c-0291-4c1f-8c0a-96f7b1574319\") " Jun 09 02:26:26.112920 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:26.112378 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8zqdh\" (UniqueName: \"kubernetes.io/projected/ed57df2c-0291-4c1f-8c0a-96f7b1574319-kube-api-access-8zqdh\") pod \"ed57df2c-0291-4c1f-8c0a-96f7b1574319\" (UID: \"ed57df2c-0291-4c1f-8c0a-96f7b1574319\") " Jun 09 02:26:26.112920 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:26.112424 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ed57df2c-0291-4c1f-8c0a-96f7b1574319-bundle\") pod \"ed57df2c-0291-4c1f-8c0a-96f7b1574319\" (UID: \"ed57df2c-0291-4c1f-8c0a-96f7b1574319\") " Jun 09 02:26:26.113560 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:26.113347 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed57df2c-0291-4c1f-8c0a-96f7b1574319-bundle" (OuterVolumeSpecName: "bundle") pod "ed57df2c-0291-4c1f-8c0a-96f7b1574319" (UID: "ed57df2c-0291-4c1f-8c0a-96f7b1574319"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 02:26:26.117067 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:26.116128 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed57df2c-0291-4c1f-8c0a-96f7b1574319-kube-api-access-8zqdh" (OuterVolumeSpecName: "kube-api-access-8zqdh") pod "ed57df2c-0291-4c1f-8c0a-96f7b1574319" (UID: "ed57df2c-0291-4c1f-8c0a-96f7b1574319"). InnerVolumeSpecName "kube-api-access-8zqdh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 02:26:26.123685 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:26.123658 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed57df2c-0291-4c1f-8c0a-96f7b1574319-util" (OuterVolumeSpecName: "util") pod "ed57df2c-0291-4c1f-8c0a-96f7b1574319" (UID: "ed57df2c-0291-4c1f-8c0a-96f7b1574319"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 02:26:26.213913 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:26.213856 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ed57df2c-0291-4c1f-8c0a-96f7b1574319-util\") on node \"ip-10-0-143-102.ec2.internal\" DevicePath \"\"" Jun 09 02:26:26.213913 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:26.213879 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8zqdh\" (UniqueName: \"kubernetes.io/projected/ed57df2c-0291-4c1f-8c0a-96f7b1574319-kube-api-access-8zqdh\") on node \"ip-10-0-143-102.ec2.internal\" DevicePath \"\"" Jun 09 02:26:26.213913 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:26.213889 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ed57df2c-0291-4c1f-8c0a-96f7b1574319-bundle\") on node \"ip-10-0-143-102.ec2.internal\" DevicePath \"\"" Jun 09 02:26:26.947577 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:26.947549 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk8bm4" event={"ID":"ed57df2c-0291-4c1f-8c0a-96f7b1574319","Type":"ContainerDied","Data":"5041ffa5a42cbb620be5a419a52bbd534ee9135f9e7c47022f48d552b4990a84"} Jun 09 02:26:26.947681 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:26.947600 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5041ffa5a42cbb620be5a419a52bbd534ee9135f9e7c47022f48d552b4990a84" Jun 09 02:26:26.947681 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:26.947566 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk8bm4" Jun 09 02:26:27.954305 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:27.954249 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-v9px8" event={"ID":"9958b89f-8588-4f5f-bb35-051dc94b160d","Type":"ContainerStarted","Data":"fda6f6921bc921d1b871e003949c53107ec4ba53c2509e4f7fcf2577ef100898"} Jun 09 02:26:27.969249 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:27.969200 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-v9px8" podStartSLOduration=1.651137464 podStartE2EDuration="4.969183381s" totalImagesPullingTime="3.318045917s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:26:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:26:27.967891094 +0000 UTC m=+403.915008435" watchObservedRunningTime="2026-06-09 02:26:27.969183381 +0000 UTC m=+403.916300723" Jun 09 02:26:30.408931 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:30.408889 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:26:30.509675 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:30.509638 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:26:30.559973 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:30.559948 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:26:30.912518 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:30.912489 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:26:31.011912 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:31.011883 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:26:37.035168 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:37.035124 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:26:37.135730 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:37.135699 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:26:39.164624 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:39.164581 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:26:40.029420 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:40.029388 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-42r9f"] Jun 09 02:26:40.029727 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:40.029713 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed57df2c-0291-4c1f-8c0a-96f7b1574319" containerName="extract" Jun 09 02:26:40.029788 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:40.029728 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed57df2c-0291-4c1f-8c0a-96f7b1574319" containerName="extract" Jun 09 02:26:40.029788 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:40.029737 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed57df2c-0291-4c1f-8c0a-96f7b1574319" containerName="pull" Jun 09 02:26:40.029788 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:40.029743 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed57df2c-0291-4c1f-8c0a-96f7b1574319" containerName="pull" Jun 09 02:26:40.029788 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:40.029754 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed57df2c-0291-4c1f-8c0a-96f7b1574319" containerName="util" Jun 09 02:26:40.029788 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:40.029760 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed57df2c-0291-4c1f-8c0a-96f7b1574319" containerName="util" Jun 09 02:26:40.029959 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:40.029828 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed57df2c-0291-4c1f-8c0a-96f7b1574319" containerName="extract" Jun 09 02:26:40.032874 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:40.032854 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-42r9f" Jun 09 02:26:40.034960 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:40.034935 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-dvscj\"" Jun 09 02:26:40.038564 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:40.038538 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-42r9f"] Jun 09 02:26:40.116248 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:40.116221 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2b94d0f3-9168-4b5a-81a3-4f8aae2ce604-bound-sa-token\") pod \"cert-manager-59c77684cc-42r9f\" (UID: \"2b94d0f3-9168-4b5a-81a3-4f8aae2ce604\") " pod="cert-manager/cert-manager-59c77684cc-42r9f" Jun 09 02:26:40.116359 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:40.116278 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrx2n\" (UniqueName: \"kubernetes.io/projected/2b94d0f3-9168-4b5a-81a3-4f8aae2ce604-kube-api-access-jrx2n\") pod \"cert-manager-59c77684cc-42r9f\" (UID: \"2b94d0f3-9168-4b5a-81a3-4f8aae2ce604\") " pod="cert-manager/cert-manager-59c77684cc-42r9f" Jun 09 02:26:40.216961 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:40.216936 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2b94d0f3-9168-4b5a-81a3-4f8aae2ce604-bound-sa-token\") pod \"cert-manager-59c77684cc-42r9f\" (UID: \"2b94d0f3-9168-4b5a-81a3-4f8aae2ce604\") " pod="cert-manager/cert-manager-59c77684cc-42r9f" Jun 09 02:26:40.217408 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:40.216979 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrx2n\" (UniqueName: \"kubernetes.io/projected/2b94d0f3-9168-4b5a-81a3-4f8aae2ce604-kube-api-access-jrx2n\") pod \"cert-manager-59c77684cc-42r9f\" (UID: \"2b94d0f3-9168-4b5a-81a3-4f8aae2ce604\") " pod="cert-manager/cert-manager-59c77684cc-42r9f" Jun 09 02:26:40.224636 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:40.224609 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2b94d0f3-9168-4b5a-81a3-4f8aae2ce604-bound-sa-token\") pod \"cert-manager-59c77684cc-42r9f\" (UID: \"2b94d0f3-9168-4b5a-81a3-4f8aae2ce604\") " pod="cert-manager/cert-manager-59c77684cc-42r9f" Jun 09 02:26:40.224727 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:40.224713 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrx2n\" (UniqueName: \"kubernetes.io/projected/2b94d0f3-9168-4b5a-81a3-4f8aae2ce604-kube-api-access-jrx2n\") pod \"cert-manager-59c77684cc-42r9f\" (UID: \"2b94d0f3-9168-4b5a-81a3-4f8aae2ce604\") " pod="cert-manager/cert-manager-59c77684cc-42r9f" Jun 09 02:26:40.343773 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:40.343750 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-42r9f" Jun 09 02:26:40.472479 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:40.472442 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-42r9f"] Jun 09 02:26:40.473987 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:26:40.473962 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2b94d0f3_9168_4b5a_81a3_4f8aae2ce604.slice/crio-a643716199dd7f5fbc9347ee9f0e6c02ea72757a68e5bb47077131a86c7ac2ed WatchSource:0}: Error finding container a643716199dd7f5fbc9347ee9f0e6c02ea72757a68e5bb47077131a86c7ac2ed: Status 404 returned error can't find the container with id a643716199dd7f5fbc9347ee9f0e6c02ea72757a68e5bb47077131a86c7ac2ed Jun 09 02:26:40.770174 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:40.770108 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6fcjh"] Jun 09 02:26:40.773497 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:40.773481 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6fcjh" Jun 09 02:26:40.775985 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:40.775967 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 09 02:26:40.776102 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:40.776014 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 09 02:26:40.776841 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:40.776819 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-x8s7r\"" Jun 09 02:26:40.781627 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:40.781605 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6fcjh"] Jun 09 02:26:40.820629 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:40.820604 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d047084c-3d09-4cc1-979d-62249e0a688d-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6fcjh\" (UID: \"d047084c-3d09-4cc1-979d-62249e0a688d\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6fcjh" Jun 09 02:26:40.820702 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:40.820631 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d047084c-3d09-4cc1-979d-62249e0a688d-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6fcjh\" (UID: \"d047084c-3d09-4cc1-979d-62249e0a688d\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6fcjh" Jun 09 02:26:40.820750 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:40.820707 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gn5d8\" (UniqueName: \"kubernetes.io/projected/d047084c-3d09-4cc1-979d-62249e0a688d-kube-api-access-gn5d8\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6fcjh\" (UID: \"d047084c-3d09-4cc1-979d-62249e0a688d\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6fcjh" Jun 09 02:26:40.921835 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:40.921809 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gn5d8\" (UniqueName: \"kubernetes.io/projected/d047084c-3d09-4cc1-979d-62249e0a688d-kube-api-access-gn5d8\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6fcjh\" (UID: \"d047084c-3d09-4cc1-979d-62249e0a688d\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6fcjh" Jun 09 02:26:40.921910 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:40.921856 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d047084c-3d09-4cc1-979d-62249e0a688d-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6fcjh\" (UID: \"d047084c-3d09-4cc1-979d-62249e0a688d\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6fcjh" Jun 09 02:26:40.921910 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:40.921879 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d047084c-3d09-4cc1-979d-62249e0a688d-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6fcjh\" (UID: \"d047084c-3d09-4cc1-979d-62249e0a688d\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6fcjh" Jun 09 02:26:40.922239 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:40.922220 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d047084c-3d09-4cc1-979d-62249e0a688d-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6fcjh\" (UID: \"d047084c-3d09-4cc1-979d-62249e0a688d\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6fcjh" Jun 09 02:26:40.922282 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:40.922254 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d047084c-3d09-4cc1-979d-62249e0a688d-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6fcjh\" (UID: \"d047084c-3d09-4cc1-979d-62249e0a688d\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6fcjh" Jun 09 02:26:40.928998 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:40.928976 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gn5d8\" (UniqueName: \"kubernetes.io/projected/d047084c-3d09-4cc1-979d-62249e0a688d-kube-api-access-gn5d8\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6fcjh\" (UID: \"d047084c-3d09-4cc1-979d-62249e0a688d\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6fcjh" Jun 09 02:26:41.018814 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:41.018789 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-42r9f" event={"ID":"2b94d0f3-9168-4b5a-81a3-4f8aae2ce604","Type":"ContainerStarted","Data":"bb83757ee539748a5366e3e7754eb81b5c1c759e9018773ad98d66bbf90f63a0"} Jun 09 02:26:41.018891 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:41.018818 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-42r9f" event={"ID":"2b94d0f3-9168-4b5a-81a3-4f8aae2ce604","Type":"ContainerStarted","Data":"a643716199dd7f5fbc9347ee9f0e6c02ea72757a68e5bb47077131a86c7ac2ed"} Jun 09 02:26:41.033596 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:41.033522 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-42r9f" podStartSLOduration=1.033509807 podStartE2EDuration="1.033509807s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:26:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:26:41.03225609 +0000 UTC m=+416.979373431" watchObservedRunningTime="2026-06-09 02:26:41.033509807 +0000 UTC m=+416.980627150" Jun 09 02:26:41.083746 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:41.083725 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6fcjh" Jun 09 02:26:41.202897 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:41.202874 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6fcjh"] Jun 09 02:26:41.204603 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:26:41.204577 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd047084c_3d09_4cc1_979d_62249e0a688d.slice/crio-98c88b0a0d76f29a2af69d6748286a40e8d5526a86b847f31f30de01ca72ed61 WatchSource:0}: Error finding container 98c88b0a0d76f29a2af69d6748286a40e8d5526a86b847f31f30de01ca72ed61: Status 404 returned error can't find the container with id 98c88b0a0d76f29a2af69d6748286a40e8d5526a86b847f31f30de01ca72ed61 Jun 09 02:26:42.025225 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:42.025190 2573 generic.go:356] "Generic (PLEG): container finished" podID="d047084c-3d09-4cc1-979d-62249e0a688d" containerID="65ef8be36aea3d7ba4643ce546dfe1bf13cb7acb79b12b30e245c0cf2aa9cc23" exitCode=0 Jun 09 02:26:42.025850 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:42.025284 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6fcjh" event={"ID":"d047084c-3d09-4cc1-979d-62249e0a688d","Type":"ContainerDied","Data":"65ef8be36aea3d7ba4643ce546dfe1bf13cb7acb79b12b30e245c0cf2aa9cc23"} Jun 09 02:26:42.025850 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:42.025361 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6fcjh" event={"ID":"d047084c-3d09-4cc1-979d-62249e0a688d","Type":"ContainerStarted","Data":"98c88b0a0d76f29a2af69d6748286a40e8d5526a86b847f31f30de01ca72ed61"} Jun 09 02:26:43.032603 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:43.032539 2573 generic.go:356] "Generic (PLEG): container finished" podID="d047084c-3d09-4cc1-979d-62249e0a688d" containerID="01a22e4a2bcfd07d8e758f8e8f6a81b11303742f9b6635b022cfeb3962efdaa1" exitCode=0 Jun 09 02:26:43.032603 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:43.032599 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6fcjh" event={"ID":"d047084c-3d09-4cc1-979d-62249e0a688d","Type":"ContainerDied","Data":"01a22e4a2bcfd07d8e758f8e8f6a81b11303742f9b6635b022cfeb3962efdaa1"} Jun 09 02:26:44.041332 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:44.041298 2573 generic.go:356] "Generic (PLEG): container finished" podID="d047084c-3d09-4cc1-979d-62249e0a688d" containerID="0588e8a81dac1990419cd0bdc54d1cec963418cd9ae536d8357ccaa2e8b63b79" exitCode=0 Jun 09 02:26:44.041645 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:44.041387 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6fcjh" event={"ID":"d047084c-3d09-4cc1-979d-62249e0a688d","Type":"ContainerDied","Data":"0588e8a81dac1990419cd0bdc54d1cec963418cd9ae536d8357ccaa2e8b63b79"} Jun 09 02:26:45.175113 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:45.175090 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6fcjh" Jun 09 02:26:45.257976 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:45.257951 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d047084c-3d09-4cc1-979d-62249e0a688d-bundle\") pod \"d047084c-3d09-4cc1-979d-62249e0a688d\" (UID: \"d047084c-3d09-4cc1-979d-62249e0a688d\") " Jun 09 02:26:45.258062 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:45.257984 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gn5d8\" (UniqueName: \"kubernetes.io/projected/d047084c-3d09-4cc1-979d-62249e0a688d-kube-api-access-gn5d8\") pod \"d047084c-3d09-4cc1-979d-62249e0a688d\" (UID: \"d047084c-3d09-4cc1-979d-62249e0a688d\") " Jun 09 02:26:45.258062 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:45.258013 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d047084c-3d09-4cc1-979d-62249e0a688d-util\") pod \"d047084c-3d09-4cc1-979d-62249e0a688d\" (UID: \"d047084c-3d09-4cc1-979d-62249e0a688d\") " Jun 09 02:26:45.258613 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:45.258587 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d047084c-3d09-4cc1-979d-62249e0a688d-bundle" (OuterVolumeSpecName: "bundle") pod "d047084c-3d09-4cc1-979d-62249e0a688d" (UID: "d047084c-3d09-4cc1-979d-62249e0a688d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 02:26:45.259828 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:45.259799 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d047084c-3d09-4cc1-979d-62249e0a688d-kube-api-access-gn5d8" (OuterVolumeSpecName: "kube-api-access-gn5d8") pod "d047084c-3d09-4cc1-979d-62249e0a688d" (UID: "d047084c-3d09-4cc1-979d-62249e0a688d"). InnerVolumeSpecName "kube-api-access-gn5d8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 02:26:45.265799 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:45.265775 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d047084c-3d09-4cc1-979d-62249e0a688d-util" (OuterVolumeSpecName: "util") pod "d047084c-3d09-4cc1-979d-62249e0a688d" (UID: "d047084c-3d09-4cc1-979d-62249e0a688d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 02:26:45.358897 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:45.358845 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d047084c-3d09-4cc1-979d-62249e0a688d-bundle\") on node \"ip-10-0-143-102.ec2.internal\" DevicePath \"\"" Jun 09 02:26:45.358897 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:45.358867 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gn5d8\" (UniqueName: \"kubernetes.io/projected/d047084c-3d09-4cc1-979d-62249e0a688d-kube-api-access-gn5d8\") on node \"ip-10-0-143-102.ec2.internal\" DevicePath \"\"" Jun 09 02:26:45.358897 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:45.358877 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d047084c-3d09-4cc1-979d-62249e0a688d-util\") on node \"ip-10-0-143-102.ec2.internal\" DevicePath \"\"" Jun 09 02:26:46.053647 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:46.053618 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6fcjh" event={"ID":"d047084c-3d09-4cc1-979d-62249e0a688d","Type":"ContainerDied","Data":"98c88b0a0d76f29a2af69d6748286a40e8d5526a86b847f31f30de01ca72ed61"} Jun 09 02:26:46.053793 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:46.053667 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="98c88b0a0d76f29a2af69d6748286a40e8d5526a86b847f31f30de01ca72ed61" Jun 09 02:26:46.053793 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:46.053667 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6fcjh" Jun 09 02:26:54.326093 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:54.322469 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:26:54.433315 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:54.433284 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:26:54.920936 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:54.920893 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:26:55.120734 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:55.120696 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:26:55.231224 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:55.231154 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:26:55.302261 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:55.302235 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-777db45658-jkhgh"] Jun 09 02:26:55.302700 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:55.302675 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d047084c-3d09-4cc1-979d-62249e0a688d" containerName="util" Jun 09 02:26:55.302700 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:55.302698 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="d047084c-3d09-4cc1-979d-62249e0a688d" containerName="util" Jun 09 02:26:55.302884 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:55.302717 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d047084c-3d09-4cc1-979d-62249e0a688d" containerName="pull" Jun 09 02:26:55.302884 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:55.302726 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="d047084c-3d09-4cc1-979d-62249e0a688d" containerName="pull" Jun 09 02:26:55.302884 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:55.302741 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d047084c-3d09-4cc1-979d-62249e0a688d" containerName="extract" Jun 09 02:26:55.302884 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:55.302749 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="d047084c-3d09-4cc1-979d-62249e0a688d" containerName="extract" Jun 09 02:26:55.302884 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:55.302862 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="d047084c-3d09-4cc1-979d-62249e0a688d" containerName="extract" Jun 09 02:26:55.308188 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:55.308167 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-777db45658-jkhgh" Jun 09 02:26:55.310802 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:55.310783 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 09 02:26:55.310925 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:55.310882 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-xzlcg\"" Jun 09 02:26:55.310988 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:55.310955 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 09 02:26:55.311152 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:55.311137 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 09 02:26:55.311210 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:55.311164 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 09 02:26:55.326726 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:55.326701 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-777db45658-jkhgh"] Jun 09 02:26:55.391929 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:55.391904 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:26:55.437083 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:55.437059 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e64a8c1e-4087-4bf4-9e87-b838dd252ccf-webhook-cert\") pod \"opendatahub-operator-controller-manager-777db45658-jkhgh\" (UID: \"e64a8c1e-4087-4bf4-9e87-b838dd252ccf\") " pod="opendatahub/opendatahub-operator-controller-manager-777db45658-jkhgh" Jun 09 02:26:55.437195 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:55.437125 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e64a8c1e-4087-4bf4-9e87-b838dd252ccf-apiservice-cert\") pod \"opendatahub-operator-controller-manager-777db45658-jkhgh\" (UID: \"e64a8c1e-4087-4bf4-9e87-b838dd252ccf\") " pod="opendatahub/opendatahub-operator-controller-manager-777db45658-jkhgh" Jun 09 02:26:55.437195 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:55.437178 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlvhf\" (UniqueName: \"kubernetes.io/projected/e64a8c1e-4087-4bf4-9e87-b838dd252ccf-kube-api-access-zlvhf\") pod \"opendatahub-operator-controller-manager-777db45658-jkhgh\" (UID: \"e64a8c1e-4087-4bf4-9e87-b838dd252ccf\") " pod="opendatahub/opendatahub-operator-controller-manager-777db45658-jkhgh" Jun 09 02:26:55.437275 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:55.437198 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e64a8c1e-4087-4bf4-9e87-b838dd252ccf-tmp\") pod \"opendatahub-operator-controller-manager-777db45658-jkhgh\" (UID: \"e64a8c1e-4087-4bf4-9e87-b838dd252ccf\") " pod="opendatahub/opendatahub-operator-controller-manager-777db45658-jkhgh" Jun 09 02:26:55.437275 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:55.437216 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e64a8c1e-4087-4bf4-9e87-b838dd252ccf-manifests\") pod \"opendatahub-operator-controller-manager-777db45658-jkhgh\" (UID: \"e64a8c1e-4087-4bf4-9e87-b838dd252ccf\") " pod="opendatahub/opendatahub-operator-controller-manager-777db45658-jkhgh" Jun 09 02:26:55.498028 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:55.497971 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:26:55.537436 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:55.537412 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e64a8c1e-4087-4bf4-9e87-b838dd252ccf-apiservice-cert\") pod \"opendatahub-operator-controller-manager-777db45658-jkhgh\" (UID: \"e64a8c1e-4087-4bf4-9e87-b838dd252ccf\") " pod="opendatahub/opendatahub-operator-controller-manager-777db45658-jkhgh" Jun 09 02:26:55.537537 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:55.537444 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zlvhf\" (UniqueName: \"kubernetes.io/projected/e64a8c1e-4087-4bf4-9e87-b838dd252ccf-kube-api-access-zlvhf\") pod \"opendatahub-operator-controller-manager-777db45658-jkhgh\" (UID: \"e64a8c1e-4087-4bf4-9e87-b838dd252ccf\") " pod="opendatahub/opendatahub-operator-controller-manager-777db45658-jkhgh" Jun 09 02:26:55.537537 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:55.537466 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e64a8c1e-4087-4bf4-9e87-b838dd252ccf-tmp\") pod \"opendatahub-operator-controller-manager-777db45658-jkhgh\" (UID: \"e64a8c1e-4087-4bf4-9e87-b838dd252ccf\") " pod="opendatahub/opendatahub-operator-controller-manager-777db45658-jkhgh" Jun 09 02:26:55.537638 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:55.537554 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e64a8c1e-4087-4bf4-9e87-b838dd252ccf-manifests\") pod \"opendatahub-operator-controller-manager-777db45658-jkhgh\" (UID: \"e64a8c1e-4087-4bf4-9e87-b838dd252ccf\") " pod="opendatahub/opendatahub-operator-controller-manager-777db45658-jkhgh" Jun 09 02:26:55.537638 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:55.537610 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e64a8c1e-4087-4bf4-9e87-b838dd252ccf-webhook-cert\") pod \"opendatahub-operator-controller-manager-777db45658-jkhgh\" (UID: \"e64a8c1e-4087-4bf4-9e87-b838dd252ccf\") " pod="opendatahub/opendatahub-operator-controller-manager-777db45658-jkhgh" Jun 09 02:26:55.537949 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:55.537922 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e64a8c1e-4087-4bf4-9e87-b838dd252ccf-manifests\") pod \"opendatahub-operator-controller-manager-777db45658-jkhgh\" (UID: \"e64a8c1e-4087-4bf4-9e87-b838dd252ccf\") " pod="opendatahub/opendatahub-operator-controller-manager-777db45658-jkhgh" Jun 09 02:26:55.539709 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:55.539684 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e64a8c1e-4087-4bf4-9e87-b838dd252ccf-tmp\") pod \"opendatahub-operator-controller-manager-777db45658-jkhgh\" (UID: \"e64a8c1e-4087-4bf4-9e87-b838dd252ccf\") " pod="opendatahub/opendatahub-operator-controller-manager-777db45658-jkhgh" Jun 09 02:26:55.539812 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:55.539789 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e64a8c1e-4087-4bf4-9e87-b838dd252ccf-webhook-cert\") pod \"opendatahub-operator-controller-manager-777db45658-jkhgh\" (UID: \"e64a8c1e-4087-4bf4-9e87-b838dd252ccf\") " pod="opendatahub/opendatahub-operator-controller-manager-777db45658-jkhgh" Jun 09 02:26:55.539863 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:55.539810 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e64a8c1e-4087-4bf4-9e87-b838dd252ccf-apiservice-cert\") pod \"opendatahub-operator-controller-manager-777db45658-jkhgh\" (UID: \"e64a8c1e-4087-4bf4-9e87-b838dd252ccf\") " pod="opendatahub/opendatahub-operator-controller-manager-777db45658-jkhgh" Jun 09 02:26:55.545153 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:55.545127 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlvhf\" (UniqueName: \"kubernetes.io/projected/e64a8c1e-4087-4bf4-9e87-b838dd252ccf-kube-api-access-zlvhf\") pod \"opendatahub-operator-controller-manager-777db45658-jkhgh\" (UID: \"e64a8c1e-4087-4bf4-9e87-b838dd252ccf\") " pod="opendatahub/opendatahub-operator-controller-manager-777db45658-jkhgh" Jun 09 02:26:55.592390 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:55.592364 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:26:55.619445 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:55.619422 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-777db45658-jkhgh" Jun 09 02:26:55.695702 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:55.695668 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:26:55.749967 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:55.749943 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-777db45658-jkhgh"] Jun 09 02:26:55.752273 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:26:55.752245 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode64a8c1e_4087_4bf4_9e87_b838dd252ccf.slice/crio-f742386fb5690d0fd08a7dc83ba5f0618e04fd8c959cb8de40763185f58b7109 WatchSource:0}: Error finding container f742386fb5690d0fd08a7dc83ba5f0618e04fd8c959cb8de40763185f58b7109: Status 404 returned error can't find the container with id f742386fb5690d0fd08a7dc83ba5f0618e04fd8c959cb8de40763185f58b7109 Jun 09 02:26:55.758883 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:55.758858 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:26:55.817362 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:55.817342 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:26:55.911585 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:55.911566 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:26:56.038131 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:56.038103 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:26:56.101311 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:56.101286 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-777db45658-jkhgh" event={"ID":"e64a8c1e-4087-4bf4-9e87-b838dd252ccf","Type":"ContainerStarted","Data":"f742386fb5690d0fd08a7dc83ba5f0618e04fd8c959cb8de40763185f58b7109"} Jun 09 02:26:59.118992 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:59.118956 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-777db45658-jkhgh" event={"ID":"e64a8c1e-4087-4bf4-9e87-b838dd252ccf","Type":"ContainerStarted","Data":"40d3d363976ad3aceed7e22778d88a10ecbb6bef8c8ac298f603f0e8e1e11fc7"} Jun 09 02:26:59.424487 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:59.424397 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:26:59.524065 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:26:59.524028 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:27:00.124746 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:00.124716 2573 generic.go:356] "Generic (PLEG): container finished" podID="e64a8c1e-4087-4bf4-9e87-b838dd252ccf" containerID="40d3d363976ad3aceed7e22778d88a10ecbb6bef8c8ac298f603f0e8e1e11fc7" exitCode=0 Jun 09 02:27:00.125119 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:00.124784 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-777db45658-jkhgh" event={"ID":"e64a8c1e-4087-4bf4-9e87-b838dd252ccf","Type":"ContainerDied","Data":"40d3d363976ad3aceed7e22778d88a10ecbb6bef8c8ac298f603f0e8e1e11fc7"} Jun 09 02:27:01.132343 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:01.132302 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-777db45658-jkhgh" event={"ID":"e64a8c1e-4087-4bf4-9e87-b838dd252ccf","Type":"ContainerStarted","Data":"f63ae6b8b588bee1b17af4bf2ce8e7ff3a01db5112cf59f4c73173151ae0c5c8"} Jun 09 02:27:01.132832 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:01.132400 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-777db45658-jkhgh" Jun 09 02:27:01.153578 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:01.153527 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-777db45658-jkhgh" podStartSLOduration=2.196785226 podStartE2EDuration="6.153511304s" totalImagesPullingTime="3.035098246s" totalInitContainerRuntime="921.627832ms" isStatefulPod=false podCreationTimestamp="2026-06-09 02:26:55 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:27:01.15217926 +0000 UTC m=+437.099296603" watchObservedRunningTime="2026-06-09 02:27:01.153511304 +0000 UTC m=+437.100628646" Jun 09 02:27:11.811874 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:11.811835 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-67785bd58c-cvj87"] Jun 09 02:27:11.821852 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:11.820352 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-67785bd58c-cvj87" Jun 09 02:27:11.823608 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:11.823581 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 09 02:27:11.823766 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:11.823748 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 09 02:27:11.824034 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:11.824018 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-7b7vh\"" Jun 09 02:27:11.824207 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:11.824188 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 09 02:27:11.824734 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:11.824717 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 09 02:27:11.824824 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:11.824806 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 09 02:27:11.828871 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:11.828845 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-67785bd58c-cvj87"] Jun 09 02:27:11.967264 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:11.967235 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cb57a46b-75d4-4ce5-a109-f45a72a003a0-cert\") pod \"lws-controller-manager-67785bd58c-cvj87\" (UID: \"cb57a46b-75d4-4ce5-a109-f45a72a003a0\") " pod="openshift-lws-operator/lws-controller-manager-67785bd58c-cvj87" Jun 09 02:27:11.967385 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:11.967322 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/cb57a46b-75d4-4ce5-a109-f45a72a003a0-manager-config\") pod \"lws-controller-manager-67785bd58c-cvj87\" (UID: \"cb57a46b-75d4-4ce5-a109-f45a72a003a0\") " pod="openshift-lws-operator/lws-controller-manager-67785bd58c-cvj87" Jun 09 02:27:11.967385 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:11.967351 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bbfkx\" (UniqueName: \"kubernetes.io/projected/cb57a46b-75d4-4ce5-a109-f45a72a003a0-kube-api-access-bbfkx\") pod \"lws-controller-manager-67785bd58c-cvj87\" (UID: \"cb57a46b-75d4-4ce5-a109-f45a72a003a0\") " pod="openshift-lws-operator/lws-controller-manager-67785bd58c-cvj87" Jun 09 02:27:11.967385 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:11.967375 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/cb57a46b-75d4-4ce5-a109-f45a72a003a0-metrics-cert\") pod \"lws-controller-manager-67785bd58c-cvj87\" (UID: \"cb57a46b-75d4-4ce5-a109-f45a72a003a0\") " pod="openshift-lws-operator/lws-controller-manager-67785bd58c-cvj87" Jun 09 02:27:12.067812 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:12.067761 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cb57a46b-75d4-4ce5-a109-f45a72a003a0-cert\") pod \"lws-controller-manager-67785bd58c-cvj87\" (UID: \"cb57a46b-75d4-4ce5-a109-f45a72a003a0\") " pod="openshift-lws-operator/lws-controller-manager-67785bd58c-cvj87" Jun 09 02:27:12.067910 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:12.067818 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/cb57a46b-75d4-4ce5-a109-f45a72a003a0-manager-config\") pod \"lws-controller-manager-67785bd58c-cvj87\" (UID: \"cb57a46b-75d4-4ce5-a109-f45a72a003a0\") " pod="openshift-lws-operator/lws-controller-manager-67785bd58c-cvj87" Jun 09 02:27:12.067967 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:12.067937 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bbfkx\" (UniqueName: \"kubernetes.io/projected/cb57a46b-75d4-4ce5-a109-f45a72a003a0-kube-api-access-bbfkx\") pod \"lws-controller-manager-67785bd58c-cvj87\" (UID: \"cb57a46b-75d4-4ce5-a109-f45a72a003a0\") " pod="openshift-lws-operator/lws-controller-manager-67785bd58c-cvj87" Jun 09 02:27:12.068018 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:12.067976 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/cb57a46b-75d4-4ce5-a109-f45a72a003a0-metrics-cert\") pod \"lws-controller-manager-67785bd58c-cvj87\" (UID: \"cb57a46b-75d4-4ce5-a109-f45a72a003a0\") " pod="openshift-lws-operator/lws-controller-manager-67785bd58c-cvj87" Jun 09 02:27:12.068357 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:12.068336 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/cb57a46b-75d4-4ce5-a109-f45a72a003a0-manager-config\") pod \"lws-controller-manager-67785bd58c-cvj87\" (UID: \"cb57a46b-75d4-4ce5-a109-f45a72a003a0\") " pod="openshift-lws-operator/lws-controller-manager-67785bd58c-cvj87" Jun 09 02:27:12.070041 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:12.070022 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cb57a46b-75d4-4ce5-a109-f45a72a003a0-cert\") pod \"lws-controller-manager-67785bd58c-cvj87\" (UID: \"cb57a46b-75d4-4ce5-a109-f45a72a003a0\") " pod="openshift-lws-operator/lws-controller-manager-67785bd58c-cvj87" Jun 09 02:27:12.070155 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:12.070138 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/cb57a46b-75d4-4ce5-a109-f45a72a003a0-metrics-cert\") pod \"lws-controller-manager-67785bd58c-cvj87\" (UID: \"cb57a46b-75d4-4ce5-a109-f45a72a003a0\") " pod="openshift-lws-operator/lws-controller-manager-67785bd58c-cvj87" Jun 09 02:27:12.075034 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:12.075011 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbfkx\" (UniqueName: \"kubernetes.io/projected/cb57a46b-75d4-4ce5-a109-f45a72a003a0-kube-api-access-bbfkx\") pod \"lws-controller-manager-67785bd58c-cvj87\" (UID: \"cb57a46b-75d4-4ce5-a109-f45a72a003a0\") " pod="openshift-lws-operator/lws-controller-manager-67785bd58c-cvj87" Jun 09 02:27:12.132608 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:12.132584 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-67785bd58c-cvj87" Jun 09 02:27:12.140067 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:12.140050 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-777db45658-jkhgh" Jun 09 02:27:12.262395 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:12.262368 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-67785bd58c-cvj87"] Jun 09 02:27:12.264334 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:27:12.264306 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb57a46b_75d4_4ce5_a109_f45a72a003a0.slice/crio-33f033c6f34ede56475270a04f9bb2338bbf728bbf36c434fa313367a3cf89db WatchSource:0}: Error finding container 33f033c6f34ede56475270a04f9bb2338bbf728bbf36c434fa313367a3cf89db: Status 404 returned error can't find the container with id 33f033c6f34ede56475270a04f9bb2338bbf728bbf36c434fa313367a3cf89db Jun 09 02:27:13.197587 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:13.197548 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-67785bd58c-cvj87" event={"ID":"cb57a46b-75d4-4ce5-a109-f45a72a003a0","Type":"ContainerStarted","Data":"33f033c6f34ede56475270a04f9bb2338bbf728bbf36c434fa313367a3cf89db"} Jun 09 02:27:13.799168 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:13.799129 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:27:13.947405 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:13.947330 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:27:14.039705 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:14.039670 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:27:14.111102 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:14.111057 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:27:14.204112 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:14.204022 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-67785bd58c-cvj87" event={"ID":"cb57a46b-75d4-4ce5-a109-f45a72a003a0","Type":"ContainerStarted","Data":"ede955582e670499c72d3d5ce861f50648a4aa98d85a9fa35faf19f303dea80d"} Jun 09 02:27:14.204112 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:14.204098 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-67785bd58c-cvj87" Jun 09 02:27:14.221858 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:14.221809 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-67785bd58c-cvj87" podStartSLOduration=1.801868871 podStartE2EDuration="3.22179519s" totalImagesPullingTime="1.419926319s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:27:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:27:14.219953658 +0000 UTC m=+450.167071001" watchObservedRunningTime="2026-06-09 02:27:14.22179519 +0000 UTC m=+450.168912533" Jun 09 02:27:14.392247 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:14.392220 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:27:14.492401 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:14.492321 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:27:14.592036 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:14.592000 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:27:14.728397 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:14.728353 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:27:14.898770 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:14.898743 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:27:16.121186 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:16.121136 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066gn7x"] Jun 09 02:27:16.124664 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:16.124647 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066gn7x" Jun 09 02:27:16.126838 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:16.126818 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 09 02:27:16.126966 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:16.126823 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 09 02:27:16.127704 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:16.127683 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-x8s7r\"" Jun 09 02:27:16.131363 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:16.131342 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066gn7x"] Jun 09 02:27:16.198368 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:16.198336 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kn92m\" (UniqueName: \"kubernetes.io/projected/09e92649-21dd-43dc-b542-537f7aa12a35-kube-api-access-kn92m\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066gn7x\" (UID: \"09e92649-21dd-43dc-b542-537f7aa12a35\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066gn7x" Jun 09 02:27:16.198484 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:16.198385 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/09e92649-21dd-43dc-b542-537f7aa12a35-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066gn7x\" (UID: \"09e92649-21dd-43dc-b542-537f7aa12a35\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066gn7x" Jun 09 02:27:16.198484 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:16.198462 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/09e92649-21dd-43dc-b542-537f7aa12a35-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066gn7x\" (UID: \"09e92649-21dd-43dc-b542-537f7aa12a35\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066gn7x" Jun 09 02:27:16.299850 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:16.299806 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kn92m\" (UniqueName: \"kubernetes.io/projected/09e92649-21dd-43dc-b542-537f7aa12a35-kube-api-access-kn92m\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066gn7x\" (UID: \"09e92649-21dd-43dc-b542-537f7aa12a35\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066gn7x" Jun 09 02:27:16.299961 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:16.299870 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/09e92649-21dd-43dc-b542-537f7aa12a35-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066gn7x\" (UID: \"09e92649-21dd-43dc-b542-537f7aa12a35\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066gn7x" Jun 09 02:27:16.299961 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:16.299907 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/09e92649-21dd-43dc-b542-537f7aa12a35-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066gn7x\" (UID: \"09e92649-21dd-43dc-b542-537f7aa12a35\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066gn7x" Jun 09 02:27:16.300266 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:16.300248 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/09e92649-21dd-43dc-b542-537f7aa12a35-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066gn7x\" (UID: \"09e92649-21dd-43dc-b542-537f7aa12a35\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066gn7x" Jun 09 02:27:16.300307 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:16.300281 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/09e92649-21dd-43dc-b542-537f7aa12a35-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066gn7x\" (UID: \"09e92649-21dd-43dc-b542-537f7aa12a35\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066gn7x" Jun 09 02:27:16.307388 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:16.307364 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kn92m\" (UniqueName: \"kubernetes.io/projected/09e92649-21dd-43dc-b542-537f7aa12a35-kube-api-access-kn92m\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066gn7x\" (UID: \"09e92649-21dd-43dc-b542-537f7aa12a35\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066gn7x" Jun 09 02:27:16.435469 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:16.435409 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066gn7x" Jun 09 02:27:16.565629 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:16.565608 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066gn7x"] Jun 09 02:27:16.567648 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:27:16.567625 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09e92649_21dd_43dc_b542_537f7aa12a35.slice/crio-703fad9180b0dc2f53924589bf0098671fc7625888a946bf852678e6bef171ba WatchSource:0}: Error finding container 703fad9180b0dc2f53924589bf0098671fc7625888a946bf852678e6bef171ba: Status 404 returned error can't find the container with id 703fad9180b0dc2f53924589bf0098671fc7625888a946bf852678e6bef171ba Jun 09 02:27:17.219951 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:17.219917 2573 generic.go:356] "Generic (PLEG): container finished" podID="09e92649-21dd-43dc-b542-537f7aa12a35" containerID="3f990f14f8e63ffc520a4fe54fa88b5106e09a578adb90688cf0d5b8e3a288ce" exitCode=0 Jun 09 02:27:17.220328 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:17.220006 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066gn7x" event={"ID":"09e92649-21dd-43dc-b542-537f7aa12a35","Type":"ContainerDied","Data":"3f990f14f8e63ffc520a4fe54fa88b5106e09a578adb90688cf0d5b8e3a288ce"} Jun 09 02:27:17.220328 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:17.220059 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066gn7x" event={"ID":"09e92649-21dd-43dc-b542-537f7aa12a35","Type":"ContainerStarted","Data":"703fad9180b0dc2f53924589bf0098671fc7625888a946bf852678e6bef171ba"} Jun 09 02:27:18.227286 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:18.227256 2573 generic.go:356] "Generic (PLEG): container finished" podID="09e92649-21dd-43dc-b542-537f7aa12a35" containerID="07ad345ef9bce195b0daa0c6a38a076bb0d6e6fb94acf1c93da222024dd6ac49" exitCode=0 Jun 09 02:27:18.227612 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:18.227348 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066gn7x" event={"ID":"09e92649-21dd-43dc-b542-537f7aa12a35","Type":"ContainerDied","Data":"07ad345ef9bce195b0daa0c6a38a076bb0d6e6fb94acf1c93da222024dd6ac49"} Jun 09 02:27:19.235223 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:19.235190 2573 generic.go:356] "Generic (PLEG): container finished" podID="09e92649-21dd-43dc-b542-537f7aa12a35" containerID="6923d7f5001a6eab30af9093afe043ae1190d7dc1f201d55cd956781a188fbd6" exitCode=0 Jun 09 02:27:19.235666 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:19.235274 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066gn7x" event={"ID":"09e92649-21dd-43dc-b542-537f7aa12a35","Type":"ContainerDied","Data":"6923d7f5001a6eab30af9093afe043ae1190d7dc1f201d55cd956781a188fbd6"} Jun 09 02:27:20.370280 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:20.370252 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066gn7x" Jun 09 02:27:20.532867 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:20.532808 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kn92m\" (UniqueName: \"kubernetes.io/projected/09e92649-21dd-43dc-b542-537f7aa12a35-kube-api-access-kn92m\") pod \"09e92649-21dd-43dc-b542-537f7aa12a35\" (UID: \"09e92649-21dd-43dc-b542-537f7aa12a35\") " Jun 09 02:27:20.532867 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:20.532852 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/09e92649-21dd-43dc-b542-537f7aa12a35-util\") pod \"09e92649-21dd-43dc-b542-537f7aa12a35\" (UID: \"09e92649-21dd-43dc-b542-537f7aa12a35\") " Jun 09 02:27:20.533047 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:20.532899 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/09e92649-21dd-43dc-b542-537f7aa12a35-bundle\") pod \"09e92649-21dd-43dc-b542-537f7aa12a35\" (UID: \"09e92649-21dd-43dc-b542-537f7aa12a35\") " Jun 09 02:27:20.533760 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:20.533725 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09e92649-21dd-43dc-b542-537f7aa12a35-bundle" (OuterVolumeSpecName: "bundle") pod "09e92649-21dd-43dc-b542-537f7aa12a35" (UID: "09e92649-21dd-43dc-b542-537f7aa12a35"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 02:27:20.534814 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:20.534792 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09e92649-21dd-43dc-b542-537f7aa12a35-kube-api-access-kn92m" (OuterVolumeSpecName: "kube-api-access-kn92m") pod "09e92649-21dd-43dc-b542-537f7aa12a35" (UID: "09e92649-21dd-43dc-b542-537f7aa12a35"). InnerVolumeSpecName "kube-api-access-kn92m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 02:27:20.540687 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:20.540664 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09e92649-21dd-43dc-b542-537f7aa12a35-util" (OuterVolumeSpecName: "util") pod "09e92649-21dd-43dc-b542-537f7aa12a35" (UID: "09e92649-21dd-43dc-b542-537f7aa12a35"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 02:27:20.634015 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:20.633991 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kn92m\" (UniqueName: \"kubernetes.io/projected/09e92649-21dd-43dc-b542-537f7aa12a35-kube-api-access-kn92m\") on node \"ip-10-0-143-102.ec2.internal\" DevicePath \"\"" Jun 09 02:27:20.634015 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:20.634014 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/09e92649-21dd-43dc-b542-537f7aa12a35-util\") on node \"ip-10-0-143-102.ec2.internal\" DevicePath \"\"" Jun 09 02:27:20.634156 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:20.634023 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/09e92649-21dd-43dc-b542-537f7aa12a35-bundle\") on node \"ip-10-0-143-102.ec2.internal\" DevicePath \"\"" Jun 09 02:27:21.251610 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:21.251586 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066gn7x" event={"ID":"09e92649-21dd-43dc-b542-537f7aa12a35","Type":"ContainerDied","Data":"703fad9180b0dc2f53924589bf0098671fc7625888a946bf852678e6bef171ba"} Jun 09 02:27:21.251734 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:21.251630 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="703fad9180b0dc2f53924589bf0098671fc7625888a946bf852678e6bef171ba" Jun 09 02:27:21.251734 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:21.251595 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066gn7x" Jun 09 02:27:24.499148 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:24.499112 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:27:24.597175 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:24.597093 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:27:24.738465 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:24.738431 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:27:24.856896 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:24.856865 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:27:25.211518 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:25.211454 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-67785bd58c-cvj87" Jun 09 02:27:25.761992 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:25.761959 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:27:25.862226 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:25.862196 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:27:25.973195 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:25.973148 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:27:27.984435 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:27.984403 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:27:28.104975 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:28.104935 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:27:29.148540 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:29.148508 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:27:29.307437 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:29.307408 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9477n"] Jun 09 02:27:29.307767 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:29.307755 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09e92649-21dd-43dc-b542-537f7aa12a35" containerName="pull" Jun 09 02:27:29.307813 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:29.307769 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="09e92649-21dd-43dc-b542-537f7aa12a35" containerName="pull" Jun 09 02:27:29.307813 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:29.307792 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09e92649-21dd-43dc-b542-537f7aa12a35" containerName="extract" Jun 09 02:27:29.307813 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:29.307797 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="09e92649-21dd-43dc-b542-537f7aa12a35" containerName="extract" Jun 09 02:27:29.307813 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:29.307805 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09e92649-21dd-43dc-b542-537f7aa12a35" containerName="util" Jun 09 02:27:29.307813 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:29.307810 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="09e92649-21dd-43dc-b542-537f7aa12a35" containerName="util" Jun 09 02:27:29.307948 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:29.307857 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="09e92649-21dd-43dc-b542-537f7aa12a35" containerName="extract" Jun 09 02:27:29.362940 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:29.362907 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9477n"] Jun 09 02:27:29.363110 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:29.363013 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9477n" Jun 09 02:27:29.365558 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:29.365537 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 09 02:27:29.365686 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:29.365595 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-x8s7r\"" Jun 09 02:27:29.366436 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:29.366421 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 09 02:27:29.506380 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:29.506314 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/96e73da8-08e2-4728-a6cc-114bf0d4ee29-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9477n\" (UID: \"96e73da8-08e2-4728-a6cc-114bf0d4ee29\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9477n" Jun 09 02:27:29.506380 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:29.506376 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/96e73da8-08e2-4728-a6cc-114bf0d4ee29-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9477n\" (UID: \"96e73da8-08e2-4728-a6cc-114bf0d4ee29\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9477n" Jun 09 02:27:29.506517 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:29.506424 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktc4j\" (UniqueName: \"kubernetes.io/projected/96e73da8-08e2-4728-a6cc-114bf0d4ee29-kube-api-access-ktc4j\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9477n\" (UID: \"96e73da8-08e2-4728-a6cc-114bf0d4ee29\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9477n" Jun 09 02:27:29.606964 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:29.606935 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/96e73da8-08e2-4728-a6cc-114bf0d4ee29-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9477n\" (UID: \"96e73da8-08e2-4728-a6cc-114bf0d4ee29\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9477n" Jun 09 02:27:29.607134 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:29.607120 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/96e73da8-08e2-4728-a6cc-114bf0d4ee29-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9477n\" (UID: \"96e73da8-08e2-4728-a6cc-114bf0d4ee29\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9477n" Jun 09 02:27:29.607214 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:29.607193 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktc4j\" (UniqueName: \"kubernetes.io/projected/96e73da8-08e2-4728-a6cc-114bf0d4ee29-kube-api-access-ktc4j\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9477n\" (UID: \"96e73da8-08e2-4728-a6cc-114bf0d4ee29\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9477n" Jun 09 02:27:29.607389 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:29.607364 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/96e73da8-08e2-4728-a6cc-114bf0d4ee29-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9477n\" (UID: \"96e73da8-08e2-4728-a6cc-114bf0d4ee29\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9477n" Jun 09 02:27:29.607554 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:29.607480 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/96e73da8-08e2-4728-a6cc-114bf0d4ee29-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9477n\" (UID: \"96e73da8-08e2-4728-a6cc-114bf0d4ee29\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9477n" Jun 09 02:27:29.620242 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:29.620206 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktc4j\" (UniqueName: \"kubernetes.io/projected/96e73da8-08e2-4728-a6cc-114bf0d4ee29-kube-api-access-ktc4j\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9477n\" (UID: \"96e73da8-08e2-4728-a6cc-114bf0d4ee29\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9477n" Jun 09 02:27:29.672029 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:29.672008 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9477n" Jun 09 02:27:29.822763 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:29.822735 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9477n"] Jun 09 02:27:29.825833 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:27:29.825803 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96e73da8_08e2_4728_a6cc_114bf0d4ee29.slice/crio-e68f94b7e657df9426a70468dd87421cc9d05e14705292231eedbb6d9a742e52 WatchSource:0}: Error finding container e68f94b7e657df9426a70468dd87421cc9d05e14705292231eedbb6d9a742e52: Status 404 returned error can't find the container with id e68f94b7e657df9426a70468dd87421cc9d05e14705292231eedbb6d9a742e52 Jun 09 02:27:29.922987 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:29.922958 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:27:30.044602 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:30.044576 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:27:30.300486 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:30.300426 2573 generic.go:356] "Generic (PLEG): container finished" podID="96e73da8-08e2-4728-a6cc-114bf0d4ee29" containerID="02d622e82d6a96064c327ad1af5d956d6ed144e238f96099e3557922226b26eb" exitCode=0 Jun 09 02:27:30.300486 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:30.300462 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9477n" event={"ID":"96e73da8-08e2-4728-a6cc-114bf0d4ee29","Type":"ContainerDied","Data":"02d622e82d6a96064c327ad1af5d956d6ed144e238f96099e3557922226b26eb"} Jun 09 02:27:30.300814 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:30.300525 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9477n" event={"ID":"96e73da8-08e2-4728-a6cc-114bf0d4ee29","Type":"ContainerStarted","Data":"e68f94b7e657df9426a70468dd87421cc9d05e14705292231eedbb6d9a742e52"} Jun 09 02:27:30.541934 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:30.541905 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:27:30.607270 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:30.607208 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-865f6f7c76-jvssm"] Jun 09 02:27:30.609562 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:30.609543 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-865f6f7c76-jvssm" Jun 09 02:27:30.611934 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:30.611915 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 09 02:27:30.612027 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:30.611957 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-rrnb5\"" Jun 09 02:27:30.620297 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:30.620279 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-865f6f7c76-jvssm"] Jun 09 02:27:30.640137 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:30.640101 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:27:30.719164 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:30.719138 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7plx2\" (UniqueName: \"kubernetes.io/projected/0f5d8000-acae-4ed6-baa2-da6f891a7993-kube-api-access-7plx2\") pod \"dashboard-redirect-865f6f7c76-jvssm\" (UID: \"0f5d8000-acae-4ed6-baa2-da6f891a7993\") " pod="opendatahub/dashboard-redirect-865f6f7c76-jvssm" Jun 09 02:27:30.719261 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:30.719198 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/0f5d8000-acae-4ed6-baa2-da6f891a7993-redirect-config\") pod \"dashboard-redirect-865f6f7c76-jvssm\" (UID: \"0f5d8000-acae-4ed6-baa2-da6f891a7993\") " pod="opendatahub/dashboard-redirect-865f6f7c76-jvssm" Jun 09 02:27:30.819898 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:30.819874 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/0f5d8000-acae-4ed6-baa2-da6f891a7993-redirect-config\") pod \"dashboard-redirect-865f6f7c76-jvssm\" (UID: \"0f5d8000-acae-4ed6-baa2-da6f891a7993\") " pod="opendatahub/dashboard-redirect-865f6f7c76-jvssm" Jun 09 02:27:30.819995 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:30.819928 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7plx2\" (UniqueName: \"kubernetes.io/projected/0f5d8000-acae-4ed6-baa2-da6f891a7993-kube-api-access-7plx2\") pod \"dashboard-redirect-865f6f7c76-jvssm\" (UID: \"0f5d8000-acae-4ed6-baa2-da6f891a7993\") " pod="opendatahub/dashboard-redirect-865f6f7c76-jvssm" Jun 09 02:27:30.820628 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:30.820605 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/0f5d8000-acae-4ed6-baa2-da6f891a7993-redirect-config\") pod \"dashboard-redirect-865f6f7c76-jvssm\" (UID: \"0f5d8000-acae-4ed6-baa2-da6f891a7993\") " pod="opendatahub/dashboard-redirect-865f6f7c76-jvssm" Jun 09 02:27:30.834300 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:30.834280 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7plx2\" (UniqueName: \"kubernetes.io/projected/0f5d8000-acae-4ed6-baa2-da6f891a7993-kube-api-access-7plx2\") pod \"dashboard-redirect-865f6f7c76-jvssm\" (UID: \"0f5d8000-acae-4ed6-baa2-da6f891a7993\") " pod="opendatahub/dashboard-redirect-865f6f7c76-jvssm" Jun 09 02:27:30.918962 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:30.918917 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-865f6f7c76-jvssm" Jun 09 02:27:31.056795 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:31.056766 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-865f6f7c76-jvssm"] Jun 09 02:27:31.072170 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:27:31.072140 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f5d8000_acae_4ed6_baa2_da6f891a7993.slice/crio-0121a7e713414c4e1832bee6600fe64560e8145e8803c21eac2b09f261ea2fca WatchSource:0}: Error finding container 0121a7e713414c4e1832bee6600fe64560e8145e8803c21eac2b09f261ea2fca: Status 404 returned error can't find the container with id 0121a7e713414c4e1832bee6600fe64560e8145e8803c21eac2b09f261ea2fca Jun 09 02:27:31.310312 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:31.310283 2573 generic.go:356] "Generic (PLEG): container finished" podID="96e73da8-08e2-4728-a6cc-114bf0d4ee29" containerID="379c833ed317dbd2417929fc0ef2c322d04034cde32e5e218193df16752a5d94" exitCode=0 Jun 09 02:27:31.310632 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:31.310374 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9477n" event={"ID":"96e73da8-08e2-4728-a6cc-114bf0d4ee29","Type":"ContainerDied","Data":"379c833ed317dbd2417929fc0ef2c322d04034cde32e5e218193df16752a5d94"} Jun 09 02:27:31.311608 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:31.311584 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-865f6f7c76-jvssm" event={"ID":"0f5d8000-acae-4ed6-baa2-da6f891a7993","Type":"ContainerStarted","Data":"0121a7e713414c4e1832bee6600fe64560e8145e8803c21eac2b09f261ea2fca"} Jun 09 02:27:32.319393 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:32.319360 2573 generic.go:356] "Generic (PLEG): container finished" podID="96e73da8-08e2-4728-a6cc-114bf0d4ee29" containerID="14ee6fa60fabcc7ba8390998d58f1aba06abfaa3a070cb808696efcf5d20130c" exitCode=0 Jun 09 02:27:32.319804 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:32.319450 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9477n" event={"ID":"96e73da8-08e2-4728-a6cc-114bf0d4ee29","Type":"ContainerDied","Data":"14ee6fa60fabcc7ba8390998d58f1aba06abfaa3a070cb808696efcf5d20130c"} Jun 09 02:27:33.458295 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:33.458274 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9477n" Jun 09 02:27:33.545306 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:33.545282 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/96e73da8-08e2-4728-a6cc-114bf0d4ee29-util\") pod \"96e73da8-08e2-4728-a6cc-114bf0d4ee29\" (UID: \"96e73da8-08e2-4728-a6cc-114bf0d4ee29\") " Jun 09 02:27:33.545407 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:33.545349 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/96e73da8-08e2-4728-a6cc-114bf0d4ee29-bundle\") pod \"96e73da8-08e2-4728-a6cc-114bf0d4ee29\" (UID: \"96e73da8-08e2-4728-a6cc-114bf0d4ee29\") " Jun 09 02:27:33.545407 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:33.545399 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ktc4j\" (UniqueName: \"kubernetes.io/projected/96e73da8-08e2-4728-a6cc-114bf0d4ee29-kube-api-access-ktc4j\") pod \"96e73da8-08e2-4728-a6cc-114bf0d4ee29\" (UID: \"96e73da8-08e2-4728-a6cc-114bf0d4ee29\") " Jun 09 02:27:33.546439 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:33.546403 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96e73da8-08e2-4728-a6cc-114bf0d4ee29-bundle" (OuterVolumeSpecName: "bundle") pod "96e73da8-08e2-4728-a6cc-114bf0d4ee29" (UID: "96e73da8-08e2-4728-a6cc-114bf0d4ee29"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 02:27:33.547176 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:33.547154 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96e73da8-08e2-4728-a6cc-114bf0d4ee29-kube-api-access-ktc4j" (OuterVolumeSpecName: "kube-api-access-ktc4j") pod "96e73da8-08e2-4728-a6cc-114bf0d4ee29" (UID: "96e73da8-08e2-4728-a6cc-114bf0d4ee29"). InnerVolumeSpecName "kube-api-access-ktc4j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 02:27:33.550622 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:33.550592 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96e73da8-08e2-4728-a6cc-114bf0d4ee29-util" (OuterVolumeSpecName: "util") pod "96e73da8-08e2-4728-a6cc-114bf0d4ee29" (UID: "96e73da8-08e2-4728-a6cc-114bf0d4ee29"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 02:27:33.646724 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:33.646680 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ktc4j\" (UniqueName: \"kubernetes.io/projected/96e73da8-08e2-4728-a6cc-114bf0d4ee29-kube-api-access-ktc4j\") on node \"ip-10-0-143-102.ec2.internal\" DevicePath \"\"" Jun 09 02:27:33.646724 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:33.646699 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/96e73da8-08e2-4728-a6cc-114bf0d4ee29-util\") on node \"ip-10-0-143-102.ec2.internal\" DevicePath \"\"" Jun 09 02:27:33.646724 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:33.646707 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/96e73da8-08e2-4728-a6cc-114bf0d4ee29-bundle\") on node \"ip-10-0-143-102.ec2.internal\" DevicePath \"\"" Jun 09 02:27:34.009431 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:34.009357 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:27:34.111908 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:34.111881 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:27:34.333138 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:34.333109 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9477n" Jun 09 02:27:34.333300 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:34.333109 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9477n" event={"ID":"96e73da8-08e2-4728-a6cc-114bf0d4ee29","Type":"ContainerDied","Data":"e68f94b7e657df9426a70468dd87421cc9d05e14705292231eedbb6d9a742e52"} Jun 09 02:27:34.333357 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:34.333300 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e68f94b7e657df9426a70468dd87421cc9d05e14705292231eedbb6d9a742e52" Jun 09 02:27:34.335136 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:34.335108 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-865f6f7c76-jvssm" event={"ID":"0f5d8000-acae-4ed6-baa2-da6f891a7993","Type":"ContainerStarted","Data":"c6eabe387d8d4d5e78902df5e7fd9f77981bfd2a85ed1792f785dd3bf23dd42e"} Jun 09 02:27:34.353572 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:34.353524 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-865f6f7c76-jvssm" podStartSLOduration=2.047029935 podStartE2EDuration="4.353507853s" totalImagesPullingTime="2.306477918s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:27:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:27:34.351545955 +0000 UTC m=+470.298663298" watchObservedRunningTime="2026-06-09 02:27:34.353507853 +0000 UTC m=+470.300625234" Jun 09 02:27:40.851886 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:40.851848 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:27:40.955715 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:40.955663 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:27:41.082277 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:41.082247 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:27:41.168799 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:41.168745 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:27:41.517930 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:41.517851 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:27:44.306538 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:44.306501 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:27:44.406782 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:44.406754 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:27:44.558272 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:44.558201 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mgxvw"] Jun 09 02:27:44.558698 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:44.558680 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96e73da8-08e2-4728-a6cc-114bf0d4ee29" containerName="pull" Jun 09 02:27:44.558698 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:44.558697 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="96e73da8-08e2-4728-a6cc-114bf0d4ee29" containerName="pull" Jun 09 02:27:44.558876 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:44.558709 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96e73da8-08e2-4728-a6cc-114bf0d4ee29" containerName="util" Jun 09 02:27:44.558876 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:44.558717 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="96e73da8-08e2-4728-a6cc-114bf0d4ee29" containerName="util" Jun 09 02:27:44.558876 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:44.558730 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96e73da8-08e2-4728-a6cc-114bf0d4ee29" containerName="extract" Jun 09 02:27:44.558876 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:44.558739 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="96e73da8-08e2-4728-a6cc-114bf0d4ee29" containerName="extract" Jun 09 02:27:44.558876 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:44.558833 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="96e73da8-08e2-4728-a6cc-114bf0d4ee29" containerName="extract" Jun 09 02:27:44.562206 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:44.562184 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mgxvw" Jun 09 02:27:44.564602 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:44.564581 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 09 02:27:44.564802 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:44.564781 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-pfzp7\"" Jun 09 02:27:44.564985 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:44.564640 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 09 02:27:44.564985 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:44.564635 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 09 02:27:44.571440 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:44.571420 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mgxvw"] Jun 09 02:27:44.584156 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:44.584129 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:27:44.730364 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:44.730330 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bb6068da-b2de-4c0d-817b-367d9985c647-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mgxvw\" (UID: \"bb6068da-b2de-4c0d-817b-367d9985c647\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mgxvw" Jun 09 02:27:44.730577 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:44.730370 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzbl7\" (UniqueName: \"kubernetes.io/projected/bb6068da-b2de-4c0d-817b-367d9985c647-kube-api-access-mzbl7\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mgxvw\" (UID: \"bb6068da-b2de-4c0d-817b-367d9985c647\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mgxvw" Jun 09 02:27:44.730577 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:44.730387 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bb6068da-b2de-4c0d-817b-367d9985c647-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mgxvw\" (UID: \"bb6068da-b2de-4c0d-817b-367d9985c647\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mgxvw" Jun 09 02:27:44.730577 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:44.730408 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bb6068da-b2de-4c0d-817b-367d9985c647-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mgxvw\" (UID: \"bb6068da-b2de-4c0d-817b-367d9985c647\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mgxvw" Jun 09 02:27:44.730577 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:44.730451 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb6068da-b2de-4c0d-817b-367d9985c647-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mgxvw\" (UID: \"bb6068da-b2de-4c0d-817b-367d9985c647\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mgxvw" Jun 09 02:27:44.730577 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:44.730492 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bb6068da-b2de-4c0d-817b-367d9985c647-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mgxvw\" (UID: \"bb6068da-b2de-4c0d-817b-367d9985c647\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mgxvw" Jun 09 02:27:44.730577 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:44.730506 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bb6068da-b2de-4c0d-817b-367d9985c647-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mgxvw\" (UID: \"bb6068da-b2de-4c0d-817b-367d9985c647\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mgxvw" Jun 09 02:27:44.730577 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:44.730528 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb6068da-b2de-4c0d-817b-367d9985c647-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mgxvw\" (UID: \"bb6068da-b2de-4c0d-817b-367d9985c647\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mgxvw" Jun 09 02:27:44.730577 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:44.730547 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bb6068da-b2de-4c0d-817b-367d9985c647-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mgxvw\" (UID: \"bb6068da-b2de-4c0d-817b-367d9985c647\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mgxvw" Jun 09 02:27:44.782469 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:44.782444 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:27:44.830939 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:44.830888 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bb6068da-b2de-4c0d-817b-367d9985c647-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mgxvw\" (UID: \"bb6068da-b2de-4c0d-817b-367d9985c647\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mgxvw" Jun 09 02:27:44.830939 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:44.830922 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bb6068da-b2de-4c0d-817b-367d9985c647-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mgxvw\" (UID: \"bb6068da-b2de-4c0d-817b-367d9985c647\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mgxvw" Jun 09 02:27:44.831062 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:44.830949 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzbl7\" (UniqueName: \"kubernetes.io/projected/bb6068da-b2de-4c0d-817b-367d9985c647-kube-api-access-mzbl7\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mgxvw\" (UID: \"bb6068da-b2de-4c0d-817b-367d9985c647\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mgxvw" Jun 09 02:27:44.831062 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:44.830990 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bb6068da-b2de-4c0d-817b-367d9985c647-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mgxvw\" (UID: \"bb6068da-b2de-4c0d-817b-367d9985c647\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mgxvw" Jun 09 02:27:44.831062 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:44.831030 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bb6068da-b2de-4c0d-817b-367d9985c647-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mgxvw\" (UID: \"bb6068da-b2de-4c0d-817b-367d9985c647\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mgxvw" Jun 09 02:27:44.831210 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:44.831067 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb6068da-b2de-4c0d-817b-367d9985c647-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mgxvw\" (UID: \"bb6068da-b2de-4c0d-817b-367d9985c647\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mgxvw" Jun 09 02:27:44.831379 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:44.831359 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bb6068da-b2de-4c0d-817b-367d9985c647-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mgxvw\" (UID: \"bb6068da-b2de-4c0d-817b-367d9985c647\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mgxvw" Jun 09 02:27:44.831465 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:44.831432 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bb6068da-b2de-4c0d-817b-367d9985c647-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mgxvw\" (UID: \"bb6068da-b2de-4c0d-817b-367d9985c647\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mgxvw" Jun 09 02:27:44.831534 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:44.831513 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb6068da-b2de-4c0d-817b-367d9985c647-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mgxvw\" (UID: \"bb6068da-b2de-4c0d-817b-367d9985c647\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mgxvw" Jun 09 02:27:44.831583 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:44.831565 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bb6068da-b2de-4c0d-817b-367d9985c647-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mgxvw\" (UID: \"bb6068da-b2de-4c0d-817b-367d9985c647\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mgxvw" Jun 09 02:27:44.831678 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:44.831597 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bb6068da-b2de-4c0d-817b-367d9985c647-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mgxvw\" (UID: \"bb6068da-b2de-4c0d-817b-367d9985c647\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mgxvw" Jun 09 02:27:44.831678 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:44.831637 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb6068da-b2de-4c0d-817b-367d9985c647-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mgxvw\" (UID: \"bb6068da-b2de-4c0d-817b-367d9985c647\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mgxvw" Jun 09 02:27:44.831975 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:44.831951 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb6068da-b2de-4c0d-817b-367d9985c647-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mgxvw\" (UID: \"bb6068da-b2de-4c0d-817b-367d9985c647\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mgxvw" Jun 09 02:27:44.832185 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:44.832166 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bb6068da-b2de-4c0d-817b-367d9985c647-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mgxvw\" (UID: \"bb6068da-b2de-4c0d-817b-367d9985c647\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mgxvw" Jun 09 02:27:44.833212 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:44.833194 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bb6068da-b2de-4c0d-817b-367d9985c647-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mgxvw\" (UID: \"bb6068da-b2de-4c0d-817b-367d9985c647\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mgxvw" Jun 09 02:27:44.833353 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:44.833335 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bb6068da-b2de-4c0d-817b-367d9985c647-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mgxvw\" (UID: \"bb6068da-b2de-4c0d-817b-367d9985c647\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mgxvw" Jun 09 02:27:44.841016 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:44.840990 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzbl7\" (UniqueName: \"kubernetes.io/projected/bb6068da-b2de-4c0d-817b-367d9985c647-kube-api-access-mzbl7\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mgxvw\" (UID: \"bb6068da-b2de-4c0d-817b-367d9985c647\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mgxvw" Jun 09 02:27:44.841107 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:44.841043 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bb6068da-b2de-4c0d-817b-367d9985c647-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mgxvw\" (UID: \"bb6068da-b2de-4c0d-817b-367d9985c647\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mgxvw" Jun 09 02:27:44.875294 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:44.875273 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mgxvw" Jun 09 02:27:44.881169 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:44.881129 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:27:44.982815 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:44.982782 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:27:45.000793 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:45.000774 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mgxvw"] Jun 09 02:27:45.002591 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:27:45.002565 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb6068da_b2de_4c0d_817b_367d9985c647.slice/crio-43449984fc2ad921e9e49af7a1b08f9a443bcf2ac355313767ff9a4b44e9c0cd WatchSource:0}: Error finding container 43449984fc2ad921e9e49af7a1b08f9a443bcf2ac355313767ff9a4b44e9c0cd: Status 404 returned error can't find the container with id 43449984fc2ad921e9e49af7a1b08f9a443bcf2ac355313767ff9a4b44e9c0cd Jun 09 02:27:45.390061 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:45.390033 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mgxvw" event={"ID":"bb6068da-b2de-4c0d-817b-367d9985c647","Type":"ContainerStarted","Data":"43449984fc2ad921e9e49af7a1b08f9a443bcf2ac355313767ff9a4b44e9c0cd"} Jun 09 02:27:48.518839 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:48.518801 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 09 02:27:48.519157 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:48.518876 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 09 02:27:48.519157 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:48.518904 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 09 02:27:49.413307 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:49.413269 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mgxvw" event={"ID":"bb6068da-b2de-4c0d-817b-367d9985c647","Type":"ContainerStarted","Data":"a081e0eb67473de0fab414a43bead562030aa519e08a32562ae8b4834f9f058d"} Jun 09 02:27:49.432686 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:49.432633 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mgxvw" podStartSLOduration=1.918711696 podStartE2EDuration="5.432616706s" totalImagesPullingTime="3.51390501s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:27:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:27:49.431125977 +0000 UTC m=+485.378243318" watchObservedRunningTime="2026-06-09 02:27:49.432616706 +0000 UTC m=+485.379734047" Jun 09 02:27:49.876004 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:49.875973 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mgxvw" Jun 09 02:27:49.881817 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:49.881791 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mgxvw" Jun 09 02:27:50.418918 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:50.418896 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mgxvw" Jun 09 02:27:50.419756 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:27:50.419738 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mgxvw" Jun 09 02:28:15.458176 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:15.458132 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:28:15.561233 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:15.561188 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:28:15.597329 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:15.597302 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7n75s"] Jun 09 02:28:15.607933 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:15.607911 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-7n75s" Jun 09 02:28:15.608755 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:15.608731 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7n75s"] Jun 09 02:28:15.610600 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:15.610579 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 09 02:28:15.611482 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:15.611461 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 09 02:28:15.611575 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:15.611461 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-zv9fc\"" Jun 09 02:28:15.641751 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:15.641724 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:28:15.675836 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:15.675814 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zhdf\" (UniqueName: \"kubernetes.io/projected/d9e99d92-e691-493f-a217-cd868b826d9a-kube-api-access-7zhdf\") pod \"kuadrant-operator-catalog-7n75s\" (UID: \"d9e99d92-e691-493f-a217-cd868b826d9a\") " pod="kuadrant-system/kuadrant-operator-catalog-7n75s" Jun 09 02:28:15.776903 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:15.776853 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7zhdf\" (UniqueName: \"kubernetes.io/projected/d9e99d92-e691-493f-a217-cd868b826d9a-kube-api-access-7zhdf\") pod \"kuadrant-operator-catalog-7n75s\" (UID: \"d9e99d92-e691-493f-a217-cd868b826d9a\") " pod="kuadrant-system/kuadrant-operator-catalog-7n75s" Jun 09 02:28:15.784450 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:15.784420 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zhdf\" (UniqueName: \"kubernetes.io/projected/d9e99d92-e691-493f-a217-cd868b826d9a-kube-api-access-7zhdf\") pod \"kuadrant-operator-catalog-7n75s\" (UID: \"d9e99d92-e691-493f-a217-cd868b826d9a\") " pod="kuadrant-system/kuadrant-operator-catalog-7n75s" Jun 09 02:28:15.917689 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:15.917662 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-7n75s" Jun 09 02:28:15.972733 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:15.972691 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7n75s"] Jun 09 02:28:16.046286 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:16.046257 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7n75s"] Jun 09 02:28:16.048195 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:28:16.048165 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9e99d92_e691_493f_a217_cd868b826d9a.slice/crio-5c01daad707c3fbd1925710360a038e7090e73924dc99a5df6a550d8ab3ca1cb WatchSource:0}: Error finding container 5c01daad707c3fbd1925710360a038e7090e73924dc99a5df6a550d8ab3ca1cb: Status 404 returned error can't find the container with id 5c01daad707c3fbd1925710360a038e7090e73924dc99a5df6a550d8ab3ca1cb Jun 09 02:28:16.178165 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:16.178139 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rj28v"] Jun 09 02:28:16.182618 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:16.182602 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-rj28v" Jun 09 02:28:16.187873 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:16.187851 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rj28v"] Jun 09 02:28:16.282171 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:16.282147 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8rfm\" (UniqueName: \"kubernetes.io/projected/2f1e3584-fe38-4463-b169-d6ba2b47bcd0-kube-api-access-v8rfm\") pod \"kuadrant-operator-catalog-rj28v\" (UID: \"2f1e3584-fe38-4463-b169-d6ba2b47bcd0\") " pod="kuadrant-system/kuadrant-operator-catalog-rj28v" Jun 09 02:28:16.382705 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:16.382651 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8rfm\" (UniqueName: \"kubernetes.io/projected/2f1e3584-fe38-4463-b169-d6ba2b47bcd0-kube-api-access-v8rfm\") pod \"kuadrant-operator-catalog-rj28v\" (UID: \"2f1e3584-fe38-4463-b169-d6ba2b47bcd0\") " pod="kuadrant-system/kuadrant-operator-catalog-rj28v" Jun 09 02:28:16.392026 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:16.392004 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8rfm\" (UniqueName: \"kubernetes.io/projected/2f1e3584-fe38-4463-b169-d6ba2b47bcd0-kube-api-access-v8rfm\") pod \"kuadrant-operator-catalog-rj28v\" (UID: \"2f1e3584-fe38-4463-b169-d6ba2b47bcd0\") " pod="kuadrant-system/kuadrant-operator-catalog-rj28v" Jun 09 02:28:16.492148 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:16.492123 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-rj28v" Jun 09 02:28:16.554868 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:16.554841 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-7n75s" event={"ID":"d9e99d92-e691-493f-a217-cd868b826d9a","Type":"ContainerStarted","Data":"5c01daad707c3fbd1925710360a038e7090e73924dc99a5df6a550d8ab3ca1cb"} Jun 09 02:28:16.623444 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:16.623308 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rj28v"] Jun 09 02:28:16.651110 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:28:16.651028 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f1e3584_fe38_4463_b169_d6ba2b47bcd0.slice/crio-c825382d1cdd57fc225273a1b18e54ad27026af06c1200707b841498c87b23e1 WatchSource:0}: Error finding container c825382d1cdd57fc225273a1b18e54ad27026af06c1200707b841498c87b23e1: Status 404 returned error can't find the container with id c825382d1cdd57fc225273a1b18e54ad27026af06c1200707b841498c87b23e1 Jun 09 02:28:17.562897 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:17.562859 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-rj28v" event={"ID":"2f1e3584-fe38-4463-b169-d6ba2b47bcd0","Type":"ContainerStarted","Data":"c825382d1cdd57fc225273a1b18e54ad27026af06c1200707b841498c87b23e1"} Jun 09 02:28:18.569311 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:18.569277 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-7n75s" event={"ID":"d9e99d92-e691-493f-a217-cd868b826d9a","Type":"ContainerStarted","Data":"a4ba317d8a31b015d74fc74f28608cbe617cea3687799da6aab6b117a442cc66"} Jun 09 02:28:18.569748 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:18.569341 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-7n75s" podUID="d9e99d92-e691-493f-a217-cd868b826d9a" containerName="registry-server" containerID="cri-o://a4ba317d8a31b015d74fc74f28608cbe617cea3687799da6aab6b117a442cc66" gracePeriod=2 Jun 09 02:28:18.570987 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:18.570965 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-rj28v" event={"ID":"2f1e3584-fe38-4463-b169-d6ba2b47bcd0","Type":"ContainerStarted","Data":"d5e6cc2d9046145e9a440ce8872987cec45e0222be0fe2cb305b51b60f47795c"} Jun 09 02:28:18.585585 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:18.585547 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-7n75s" podStartSLOduration=1.529530705 podStartE2EDuration="3.58553404s" totalImagesPullingTime="2.056003335s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:28:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:28:18.58460058 +0000 UTC m=+514.531717922" watchObservedRunningTime="2026-06-09 02:28:18.58553404 +0000 UTC m=+514.532651382" Jun 09 02:28:18.599793 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:18.599755 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-rj28v" podStartSLOduration=1.144016517 podStartE2EDuration="2.599742495s" totalImagesPullingTime="1.455725978s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:28:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:28:18.597530277 +0000 UTC m=+514.544647620" watchObservedRunningTime="2026-06-09 02:28:18.599742495 +0000 UTC m=+514.546860046" Jun 09 02:28:18.813221 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:18.813200 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-7n75s" Jun 09 02:28:18.904310 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:18.904254 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7zhdf\" (UniqueName: \"kubernetes.io/projected/d9e99d92-e691-493f-a217-cd868b826d9a-kube-api-access-7zhdf\") pod \"d9e99d92-e691-493f-a217-cd868b826d9a\" (UID: \"d9e99d92-e691-493f-a217-cd868b826d9a\") " Jun 09 02:28:18.906312 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:18.906292 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9e99d92-e691-493f-a217-cd868b826d9a-kube-api-access-7zhdf" (OuterVolumeSpecName: "kube-api-access-7zhdf") pod "d9e99d92-e691-493f-a217-cd868b826d9a" (UID: "d9e99d92-e691-493f-a217-cd868b826d9a"). InnerVolumeSpecName "kube-api-access-7zhdf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 02:28:19.005291 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:19.005256 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7zhdf\" (UniqueName: \"kubernetes.io/projected/d9e99d92-e691-493f-a217-cd868b826d9a-kube-api-access-7zhdf\") on node \"ip-10-0-143-102.ec2.internal\" DevicePath \"\"" Jun 09 02:28:19.578357 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:19.578314 2573 generic.go:356] "Generic (PLEG): container finished" podID="d9e99d92-e691-493f-a217-cd868b826d9a" containerID="a4ba317d8a31b015d74fc74f28608cbe617cea3687799da6aab6b117a442cc66" exitCode=0 Jun 09 02:28:19.578705 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:19.578378 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-7n75s" Jun 09 02:28:19.578705 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:19.578406 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-7n75s" event={"ID":"d9e99d92-e691-493f-a217-cd868b826d9a","Type":"ContainerDied","Data":"a4ba317d8a31b015d74fc74f28608cbe617cea3687799da6aab6b117a442cc66"} Jun 09 02:28:19.578705 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:19.578452 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-7n75s" event={"ID":"d9e99d92-e691-493f-a217-cd868b826d9a","Type":"ContainerDied","Data":"5c01daad707c3fbd1925710360a038e7090e73924dc99a5df6a550d8ab3ca1cb"} Jun 09 02:28:19.578705 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:19.578473 2573 scope.go:117] "RemoveContainer" containerID="a4ba317d8a31b015d74fc74f28608cbe617cea3687799da6aab6b117a442cc66" Jun 09 02:28:19.589115 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:19.589064 2573 scope.go:117] "RemoveContainer" containerID="a4ba317d8a31b015d74fc74f28608cbe617cea3687799da6aab6b117a442cc66" Jun 09 02:28:19.589430 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:28:19.589410 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a4ba317d8a31b015d74fc74f28608cbe617cea3687799da6aab6b117a442cc66\": container with ID starting with a4ba317d8a31b015d74fc74f28608cbe617cea3687799da6aab6b117a442cc66 not found: ID does not exist" containerID="a4ba317d8a31b015d74fc74f28608cbe617cea3687799da6aab6b117a442cc66" Jun 09 02:28:19.589480 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:19.589441 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4ba317d8a31b015d74fc74f28608cbe617cea3687799da6aab6b117a442cc66"} err="failed to get container status \"a4ba317d8a31b015d74fc74f28608cbe617cea3687799da6aab6b117a442cc66\": rpc error: code = NotFound desc = could not find container \"a4ba317d8a31b015d74fc74f28608cbe617cea3687799da6aab6b117a442cc66\": container with ID starting with a4ba317d8a31b015d74fc74f28608cbe617cea3687799da6aab6b117a442cc66 not found: ID does not exist" Jun 09 02:28:19.599474 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:19.599447 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7n75s"] Jun 09 02:28:19.602730 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:19.602706 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7n75s"] Jun 09 02:28:20.466968 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:20.466937 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d9e99d92-e691-493f-a217-cd868b826d9a" path="/var/lib/kubelet/pods/d9e99d92-e691-493f-a217-cd868b826d9a/volumes" Jun 09 02:28:26.492628 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:26.492597 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-rj28v" Jun 09 02:28:26.493148 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:26.492676 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-rj28v" Jun 09 02:28:26.515532 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:26.515510 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-rj28v" Jun 09 02:28:26.635854 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:26.635832 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-rj28v" Jun 09 02:28:31.386581 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:31.386492 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tzmpq"] Jun 09 02:28:31.386963 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:31.386889 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9e99d92-e691-493f-a217-cd868b826d9a" containerName="registry-server" Jun 09 02:28:31.386963 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:31.386903 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9e99d92-e691-493f-a217-cd868b826d9a" containerName="registry-server" Jun 09 02:28:31.387039 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:31.386983 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="d9e99d92-e691-493f-a217-cd868b826d9a" containerName="registry-server" Jun 09 02:28:31.390441 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:31.390421 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tzmpq" Jun 09 02:28:31.392741 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:31.392714 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-nq6h5\"" Jun 09 02:28:31.397311 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:31.397285 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tzmpq"] Jun 09 02:28:31.504358 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:31.504339 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/57cb1808-abed-4e68-a7b1-3b0274f0cafd-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tzmpq\" (UID: \"57cb1808-abed-4e68-a7b1-3b0274f0cafd\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tzmpq" Jun 09 02:28:31.504465 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:31.504374 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/57cb1808-abed-4e68-a7b1-3b0274f0cafd-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tzmpq\" (UID: \"57cb1808-abed-4e68-a7b1-3b0274f0cafd\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tzmpq" Jun 09 02:28:31.504465 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:31.504454 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjcv4\" (UniqueName: \"kubernetes.io/projected/57cb1808-abed-4e68-a7b1-3b0274f0cafd-kube-api-access-xjcv4\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tzmpq\" (UID: \"57cb1808-abed-4e68-a7b1-3b0274f0cafd\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tzmpq" Jun 09 02:28:31.605796 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:31.605774 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjcv4\" (UniqueName: \"kubernetes.io/projected/57cb1808-abed-4e68-a7b1-3b0274f0cafd-kube-api-access-xjcv4\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tzmpq\" (UID: \"57cb1808-abed-4e68-a7b1-3b0274f0cafd\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tzmpq" Jun 09 02:28:31.605900 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:31.605821 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/57cb1808-abed-4e68-a7b1-3b0274f0cafd-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tzmpq\" (UID: \"57cb1808-abed-4e68-a7b1-3b0274f0cafd\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tzmpq" Jun 09 02:28:31.605991 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:31.605968 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/57cb1808-abed-4e68-a7b1-3b0274f0cafd-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tzmpq\" (UID: \"57cb1808-abed-4e68-a7b1-3b0274f0cafd\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tzmpq" Jun 09 02:28:31.606143 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:31.606127 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/57cb1808-abed-4e68-a7b1-3b0274f0cafd-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tzmpq\" (UID: \"57cb1808-abed-4e68-a7b1-3b0274f0cafd\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tzmpq" Jun 09 02:28:31.606267 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:31.606250 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/57cb1808-abed-4e68-a7b1-3b0274f0cafd-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tzmpq\" (UID: \"57cb1808-abed-4e68-a7b1-3b0274f0cafd\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tzmpq" Jun 09 02:28:31.613691 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:31.613662 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjcv4\" (UniqueName: \"kubernetes.io/projected/57cb1808-abed-4e68-a7b1-3b0274f0cafd-kube-api-access-xjcv4\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tzmpq\" (UID: \"57cb1808-abed-4e68-a7b1-3b0274f0cafd\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tzmpq" Jun 09 02:28:31.700847 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:31.700800 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tzmpq" Jun 09 02:28:31.850411 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:31.850384 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tzmpq"] Jun 09 02:28:31.851745 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:28:31.851719 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57cb1808_abed_4e68_a7b1_3b0274f0cafd.slice/crio-7b5e5a9f4b80c8ce9240180ad611b405a89a71e406a9d5a2f1cea1c90602f137 WatchSource:0}: Error finding container 7b5e5a9f4b80c8ce9240180ad611b405a89a71e406a9d5a2f1cea1c90602f137: Status 404 returned error can't find the container with id 7b5e5a9f4b80c8ce9240180ad611b405a89a71e406a9d5a2f1cea1c90602f137 Jun 09 02:28:32.190268 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:32.190240 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7355l45"] Jun 09 02:28:32.194059 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:32.194043 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7355l45" Jun 09 02:28:32.201724 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:32.201703 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7355l45"] Jun 09 02:28:32.312247 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:32.312224 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/40031394-4711-444f-af69-5d243f817666-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7355l45\" (UID: \"40031394-4711-444f-af69-5d243f817666\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7355l45" Jun 09 02:28:32.312359 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:32.312261 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/40031394-4711-444f-af69-5d243f817666-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7355l45\" (UID: \"40031394-4711-444f-af69-5d243f817666\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7355l45" Jun 09 02:28:32.312403 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:32.312366 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dww92\" (UniqueName: \"kubernetes.io/projected/40031394-4711-444f-af69-5d243f817666-kube-api-access-dww92\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7355l45\" (UID: \"40031394-4711-444f-af69-5d243f817666\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7355l45" Jun 09 02:28:32.413374 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:32.413349 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dww92\" (UniqueName: \"kubernetes.io/projected/40031394-4711-444f-af69-5d243f817666-kube-api-access-dww92\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7355l45\" (UID: \"40031394-4711-444f-af69-5d243f817666\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7355l45" Jun 09 02:28:32.413654 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:32.413389 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/40031394-4711-444f-af69-5d243f817666-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7355l45\" (UID: \"40031394-4711-444f-af69-5d243f817666\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7355l45" Jun 09 02:28:32.413654 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:32.413420 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/40031394-4711-444f-af69-5d243f817666-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7355l45\" (UID: \"40031394-4711-444f-af69-5d243f817666\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7355l45" Jun 09 02:28:32.413798 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:32.413777 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/40031394-4711-444f-af69-5d243f817666-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7355l45\" (UID: \"40031394-4711-444f-af69-5d243f817666\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7355l45" Jun 09 02:28:32.413854 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:32.413839 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/40031394-4711-444f-af69-5d243f817666-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7355l45\" (UID: \"40031394-4711-444f-af69-5d243f817666\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7355l45" Jun 09 02:28:32.421022 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:32.420997 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dww92\" (UniqueName: \"kubernetes.io/projected/40031394-4711-444f-af69-5d243f817666-kube-api-access-dww92\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7355l45\" (UID: \"40031394-4711-444f-af69-5d243f817666\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7355l45" Jun 09 02:28:32.504664 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:32.504612 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7355l45" Jun 09 02:28:32.635628 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:32.635606 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7355l45"] Jun 09 02:28:32.637988 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:28:32.637962 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40031394_4711_444f_af69_5d243f817666.slice/crio-f10104073d4834bdd8761bb1f8ee5749f6ae87f3520643afa8c1c35dbd489eac WatchSource:0}: Error finding container f10104073d4834bdd8761bb1f8ee5749f6ae87f3520643afa8c1c35dbd489eac: Status 404 returned error can't find the container with id f10104073d4834bdd8761bb1f8ee5749f6ae87f3520643afa8c1c35dbd489eac Jun 09 02:28:32.648982 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:32.648952 2573 generic.go:356] "Generic (PLEG): container finished" podID="57cb1808-abed-4e68-a7b1-3b0274f0cafd" containerID="e5f1105a5fcab265d4936dab3717c7fc1274f54c103b0942f6af528bb7585453" exitCode=0 Jun 09 02:28:32.649066 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:32.649029 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tzmpq" event={"ID":"57cb1808-abed-4e68-a7b1-3b0274f0cafd","Type":"ContainerDied","Data":"e5f1105a5fcab265d4936dab3717c7fc1274f54c103b0942f6af528bb7585453"} Jun 09 02:28:32.649163 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:32.649082 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tzmpq" event={"ID":"57cb1808-abed-4e68-a7b1-3b0274f0cafd","Type":"ContainerStarted","Data":"7b5e5a9f4b80c8ce9240180ad611b405a89a71e406a9d5a2f1cea1c90602f137"} Jun 09 02:28:32.650417 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:32.650398 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7355l45" event={"ID":"40031394-4711-444f-af69-5d243f817666","Type":"ContainerStarted","Data":"f10104073d4834bdd8761bb1f8ee5749f6ae87f3520643afa8c1c35dbd489eac"} Jun 09 02:28:32.787045 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:32.787020 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tw9nz"] Jun 09 02:28:32.790786 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:32.790769 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tw9nz" Jun 09 02:28:32.797528 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:32.797506 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tw9nz"] Jun 09 02:28:32.917471 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:32.917443 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/df35e67a-39f6-4e96-ab0d-0739cf7a331c-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tw9nz\" (UID: \"df35e67a-39f6-4e96-ab0d-0739cf7a331c\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tw9nz" Jun 09 02:28:32.917585 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:32.917519 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpc5q\" (UniqueName: \"kubernetes.io/projected/df35e67a-39f6-4e96-ab0d-0739cf7a331c-kube-api-access-bpc5q\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tw9nz\" (UID: \"df35e67a-39f6-4e96-ab0d-0739cf7a331c\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tw9nz" Jun 09 02:28:32.917655 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:32.917581 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/df35e67a-39f6-4e96-ab0d-0739cf7a331c-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tw9nz\" (UID: \"df35e67a-39f6-4e96-ab0d-0739cf7a331c\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tw9nz" Jun 09 02:28:33.017974 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:33.017950 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bpc5q\" (UniqueName: \"kubernetes.io/projected/df35e67a-39f6-4e96-ab0d-0739cf7a331c-kube-api-access-bpc5q\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tw9nz\" (UID: \"df35e67a-39f6-4e96-ab0d-0739cf7a331c\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tw9nz" Jun 09 02:28:33.018154 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:33.018002 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/df35e67a-39f6-4e96-ab0d-0739cf7a331c-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tw9nz\" (UID: \"df35e67a-39f6-4e96-ab0d-0739cf7a331c\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tw9nz" Jun 09 02:28:33.018154 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:33.018045 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/df35e67a-39f6-4e96-ab0d-0739cf7a331c-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tw9nz\" (UID: \"df35e67a-39f6-4e96-ab0d-0739cf7a331c\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tw9nz" Jun 09 02:28:33.018383 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:33.018366 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/df35e67a-39f6-4e96-ab0d-0739cf7a331c-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tw9nz\" (UID: \"df35e67a-39f6-4e96-ab0d-0739cf7a331c\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tw9nz" Jun 09 02:28:33.018417 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:33.018398 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/df35e67a-39f6-4e96-ab0d-0739cf7a331c-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tw9nz\" (UID: \"df35e67a-39f6-4e96-ab0d-0739cf7a331c\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tw9nz" Jun 09 02:28:33.026214 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:33.026193 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpc5q\" (UniqueName: \"kubernetes.io/projected/df35e67a-39f6-4e96-ab0d-0739cf7a331c-kube-api-access-bpc5q\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tw9nz\" (UID: \"df35e67a-39f6-4e96-ab0d-0739cf7a331c\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tw9nz" Jun 09 02:28:33.100212 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:33.100159 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tw9nz" Jun 09 02:28:33.192044 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:33.192017 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15jhr2"] Jun 09 02:28:33.195522 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:33.195503 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15jhr2" Jun 09 02:28:33.203203 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:33.203023 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15jhr2"] Jun 09 02:28:33.230723 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:33.230706 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tw9nz"] Jun 09 02:28:33.232319 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:28:33.232302 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf35e67a_39f6_4e96_ab0d_0739cf7a331c.slice/crio-991ba651b923ceb02183225eb5372241e7fc7faf4cfef1691fb548a4a8d631a3 WatchSource:0}: Error finding container 991ba651b923ceb02183225eb5372241e7fc7faf4cfef1691fb548a4a8d631a3: Status 404 returned error can't find the container with id 991ba651b923ceb02183225eb5372241e7fc7faf4cfef1691fb548a4a8d631a3 Jun 09 02:28:33.324127 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:33.324066 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/257a476e-eb09-41ce-91d9-95757c054af4-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15jhr2\" (UID: \"257a476e-eb09-41ce-91d9-95757c054af4\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15jhr2" Jun 09 02:28:33.324318 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:33.324284 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/257a476e-eb09-41ce-91d9-95757c054af4-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15jhr2\" (UID: \"257a476e-eb09-41ce-91d9-95757c054af4\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15jhr2" Jun 09 02:28:33.324421 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:33.324326 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5pcz\" (UniqueName: \"kubernetes.io/projected/257a476e-eb09-41ce-91d9-95757c054af4-kube-api-access-g5pcz\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15jhr2\" (UID: \"257a476e-eb09-41ce-91d9-95757c054af4\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15jhr2" Jun 09 02:28:33.425515 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:33.425454 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/257a476e-eb09-41ce-91d9-95757c054af4-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15jhr2\" (UID: \"257a476e-eb09-41ce-91d9-95757c054af4\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15jhr2" Jun 09 02:28:33.425515 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:33.425487 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5pcz\" (UniqueName: \"kubernetes.io/projected/257a476e-eb09-41ce-91d9-95757c054af4-kube-api-access-g5pcz\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15jhr2\" (UID: \"257a476e-eb09-41ce-91d9-95757c054af4\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15jhr2" Jun 09 02:28:33.425515 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:33.425515 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/257a476e-eb09-41ce-91d9-95757c054af4-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15jhr2\" (UID: \"257a476e-eb09-41ce-91d9-95757c054af4\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15jhr2" Jun 09 02:28:33.426032 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:33.425913 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/257a476e-eb09-41ce-91d9-95757c054af4-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15jhr2\" (UID: \"257a476e-eb09-41ce-91d9-95757c054af4\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15jhr2" Jun 09 02:28:33.426032 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:33.425932 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/257a476e-eb09-41ce-91d9-95757c054af4-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15jhr2\" (UID: \"257a476e-eb09-41ce-91d9-95757c054af4\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15jhr2" Jun 09 02:28:33.433793 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:33.433780 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5pcz\" (UniqueName: \"kubernetes.io/projected/257a476e-eb09-41ce-91d9-95757c054af4-kube-api-access-g5pcz\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15jhr2\" (UID: \"257a476e-eb09-41ce-91d9-95757c054af4\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15jhr2" Jun 09 02:28:33.507533 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:33.507513 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15jhr2" Jun 09 02:28:33.630761 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:33.630733 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15jhr2"] Jun 09 02:28:33.633276 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:28:33.633237 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod257a476e_eb09_41ce_91d9_95757c054af4.slice/crio-1914f23d653ea9b58d0a35e2ee84dd966794feed6e0c51d0e517cbe2677ac146 WatchSource:0}: Error finding container 1914f23d653ea9b58d0a35e2ee84dd966794feed6e0c51d0e517cbe2677ac146: Status 404 returned error can't find the container with id 1914f23d653ea9b58d0a35e2ee84dd966794feed6e0c51d0e517cbe2677ac146 Jun 09 02:28:33.658302 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:33.658279 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15jhr2" event={"ID":"257a476e-eb09-41ce-91d9-95757c054af4","Type":"ContainerStarted","Data":"1914f23d653ea9b58d0a35e2ee84dd966794feed6e0c51d0e517cbe2677ac146"} Jun 09 02:28:33.659717 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:33.659698 2573 generic.go:356] "Generic (PLEG): container finished" podID="40031394-4711-444f-af69-5d243f817666" containerID="f14c9a623f037520ca26039947e019344c6db87291f0e801d48535db080424ba" exitCode=0 Jun 09 02:28:33.659804 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:33.659772 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7355l45" event={"ID":"40031394-4711-444f-af69-5d243f817666","Type":"ContainerDied","Data":"f14c9a623f037520ca26039947e019344c6db87291f0e801d48535db080424ba"} Jun 09 02:28:33.661372 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:33.661344 2573 generic.go:356] "Generic (PLEG): container finished" podID="df35e67a-39f6-4e96-ab0d-0739cf7a331c" containerID="d5808495b4670a89d958ae703e734dd057c00726512c05421c086d9cb8c012f5" exitCode=0 Jun 09 02:28:33.661463 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:33.661426 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tw9nz" event={"ID":"df35e67a-39f6-4e96-ab0d-0739cf7a331c","Type":"ContainerDied","Data":"d5808495b4670a89d958ae703e734dd057c00726512c05421c086d9cb8c012f5"} Jun 09 02:28:33.661514 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:33.661461 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tw9nz" event={"ID":"df35e67a-39f6-4e96-ab0d-0739cf7a331c","Type":"ContainerStarted","Data":"991ba651b923ceb02183225eb5372241e7fc7faf4cfef1691fb548a4a8d631a3"} Jun 09 02:28:33.663383 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:33.663348 2573 generic.go:356] "Generic (PLEG): container finished" podID="57cb1808-abed-4e68-a7b1-3b0274f0cafd" containerID="4f88d68569d6f107fb6f896808e6764199cba2b9289a3389ff3a0901211550fc" exitCode=0 Jun 09 02:28:33.663450 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:33.663377 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tzmpq" event={"ID":"57cb1808-abed-4e68-a7b1-3b0274f0cafd","Type":"ContainerDied","Data":"4f88d68569d6f107fb6f896808e6764199cba2b9289a3389ff3a0901211550fc"} Jun 09 02:28:34.670469 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:34.670414 2573 generic.go:356] "Generic (PLEG): container finished" podID="57cb1808-abed-4e68-a7b1-3b0274f0cafd" containerID="3e105bb9fec5bde22647ed0f4f5781f93f1ff73843cba26f19eb680065afd999" exitCode=0 Jun 09 02:28:34.670788 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:34.670481 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tzmpq" event={"ID":"57cb1808-abed-4e68-a7b1-3b0274f0cafd","Type":"ContainerDied","Data":"3e105bb9fec5bde22647ed0f4f5781f93f1ff73843cba26f19eb680065afd999"} Jun 09 02:28:34.671786 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:34.671766 2573 generic.go:356] "Generic (PLEG): container finished" podID="257a476e-eb09-41ce-91d9-95757c054af4" containerID="814aabcbb32397d10d3bca79bf3d819fea4ca1540bd6318c2cfccef955e5b664" exitCode=0 Jun 09 02:28:34.671893 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:34.671838 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15jhr2" event={"ID":"257a476e-eb09-41ce-91d9-95757c054af4","Type":"ContainerDied","Data":"814aabcbb32397d10d3bca79bf3d819fea4ca1540bd6318c2cfccef955e5b664"} Jun 09 02:28:34.673704 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:34.673683 2573 generic.go:356] "Generic (PLEG): container finished" podID="40031394-4711-444f-af69-5d243f817666" containerID="863813fe16dfd28f5924657145c53faf444cea39a10d08356975307fe36c4835" exitCode=0 Jun 09 02:28:34.673788 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:34.673708 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7355l45" event={"ID":"40031394-4711-444f-af69-5d243f817666","Type":"ContainerDied","Data":"863813fe16dfd28f5924657145c53faf444cea39a10d08356975307fe36c4835"} Jun 09 02:28:34.675629 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:34.675612 2573 generic.go:356] "Generic (PLEG): container finished" podID="df35e67a-39f6-4e96-ab0d-0739cf7a331c" containerID="d41f44cb137f7a778a39def8649719fea22c73b0ca0daf57d0f0252aa4da3fb1" exitCode=0 Jun 09 02:28:34.675712 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:34.675655 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tw9nz" event={"ID":"df35e67a-39f6-4e96-ab0d-0739cf7a331c","Type":"ContainerDied","Data":"d41f44cb137f7a778a39def8649719fea22c73b0ca0daf57d0f0252aa4da3fb1"} Jun 09 02:28:35.682785 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:35.682760 2573 generic.go:356] "Generic (PLEG): container finished" podID="40031394-4711-444f-af69-5d243f817666" containerID="08aa154d5696813f3f0d0c7b8339c12d7783298a8616667d74a4fe41bf55b277" exitCode=0 Jun 09 02:28:35.683119 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:35.682838 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7355l45" event={"ID":"40031394-4711-444f-af69-5d243f817666","Type":"ContainerDied","Data":"08aa154d5696813f3f0d0c7b8339c12d7783298a8616667d74a4fe41bf55b277"} Jun 09 02:28:35.684777 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:35.684755 2573 generic.go:356] "Generic (PLEG): container finished" podID="df35e67a-39f6-4e96-ab0d-0739cf7a331c" containerID="1573b9c3d3b10f159bc42cae86ca8d14d337da009afa63ec369147e0920850d2" exitCode=0 Jun 09 02:28:35.684874 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:35.684837 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tw9nz" event={"ID":"df35e67a-39f6-4e96-ab0d-0739cf7a331c","Type":"ContainerDied","Data":"1573b9c3d3b10f159bc42cae86ca8d14d337da009afa63ec369147e0920850d2"} Jun 09 02:28:35.686635 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:35.686610 2573 generic.go:356] "Generic (PLEG): container finished" podID="257a476e-eb09-41ce-91d9-95757c054af4" containerID="6cb37a6778d7489579d71824944163bed8f67847b0f22c7e75abea8e68030d43" exitCode=0 Jun 09 02:28:35.686700 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:35.686646 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15jhr2" event={"ID":"257a476e-eb09-41ce-91d9-95757c054af4","Type":"ContainerDied","Data":"6cb37a6778d7489579d71824944163bed8f67847b0f22c7e75abea8e68030d43"} Jun 09 02:28:35.903112 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:35.903092 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tzmpq" Jun 09 02:28:36.047833 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:36.047813 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/57cb1808-abed-4e68-a7b1-3b0274f0cafd-bundle\") pod \"57cb1808-abed-4e68-a7b1-3b0274f0cafd\" (UID: \"57cb1808-abed-4e68-a7b1-3b0274f0cafd\") " Jun 09 02:28:36.047937 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:36.047860 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/57cb1808-abed-4e68-a7b1-3b0274f0cafd-util\") pod \"57cb1808-abed-4e68-a7b1-3b0274f0cafd\" (UID: \"57cb1808-abed-4e68-a7b1-3b0274f0cafd\") " Jun 09 02:28:36.047937 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:36.047890 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xjcv4\" (UniqueName: \"kubernetes.io/projected/57cb1808-abed-4e68-a7b1-3b0274f0cafd-kube-api-access-xjcv4\") pod \"57cb1808-abed-4e68-a7b1-3b0274f0cafd\" (UID: \"57cb1808-abed-4e68-a7b1-3b0274f0cafd\") " Jun 09 02:28:36.048271 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:36.048238 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57cb1808-abed-4e68-a7b1-3b0274f0cafd-bundle" (OuterVolumeSpecName: "bundle") pod "57cb1808-abed-4e68-a7b1-3b0274f0cafd" (UID: "57cb1808-abed-4e68-a7b1-3b0274f0cafd"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 02:28:36.049937 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:36.049907 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57cb1808-abed-4e68-a7b1-3b0274f0cafd-kube-api-access-xjcv4" (OuterVolumeSpecName: "kube-api-access-xjcv4") pod "57cb1808-abed-4e68-a7b1-3b0274f0cafd" (UID: "57cb1808-abed-4e68-a7b1-3b0274f0cafd"). InnerVolumeSpecName "kube-api-access-xjcv4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 02:28:36.053273 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:36.053251 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57cb1808-abed-4e68-a7b1-3b0274f0cafd-util" (OuterVolumeSpecName: "util") pod "57cb1808-abed-4e68-a7b1-3b0274f0cafd" (UID: "57cb1808-abed-4e68-a7b1-3b0274f0cafd"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 02:28:36.149195 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:36.149174 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/57cb1808-abed-4e68-a7b1-3b0274f0cafd-bundle\") on node \"ip-10-0-143-102.ec2.internal\" DevicePath \"\"" Jun 09 02:28:36.149195 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:36.149194 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/57cb1808-abed-4e68-a7b1-3b0274f0cafd-util\") on node \"ip-10-0-143-102.ec2.internal\" DevicePath \"\"" Jun 09 02:28:36.149316 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:36.149203 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xjcv4\" (UniqueName: \"kubernetes.io/projected/57cb1808-abed-4e68-a7b1-3b0274f0cafd-kube-api-access-xjcv4\") on node \"ip-10-0-143-102.ec2.internal\" DevicePath \"\"" Jun 09 02:28:36.693993 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:36.693967 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tzmpq" Jun 09 02:28:36.694333 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:36.693994 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tzmpq" event={"ID":"57cb1808-abed-4e68-a7b1-3b0274f0cafd","Type":"ContainerDied","Data":"7b5e5a9f4b80c8ce9240180ad611b405a89a71e406a9d5a2f1cea1c90602f137"} Jun 09 02:28:36.694333 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:36.694047 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7b5e5a9f4b80c8ce9240180ad611b405a89a71e406a9d5a2f1cea1c90602f137" Jun 09 02:28:36.696429 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:36.696406 2573 generic.go:356] "Generic (PLEG): container finished" podID="257a476e-eb09-41ce-91d9-95757c054af4" containerID="f35fbb9c448740d148d46fb4952250658c028d5af0f045468ea2beeb443f7f7b" exitCode=0 Jun 09 02:28:36.696520 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:36.696460 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15jhr2" event={"ID":"257a476e-eb09-41ce-91d9-95757c054af4","Type":"ContainerDied","Data":"f35fbb9c448740d148d46fb4952250658c028d5af0f045468ea2beeb443f7f7b"} Jun 09 02:28:36.851515 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:36.851494 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tw9nz" Jun 09 02:28:36.854206 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:36.854187 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7355l45" Jun 09 02:28:36.854488 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:36.854471 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/40031394-4711-444f-af69-5d243f817666-util\") pod \"40031394-4711-444f-af69-5d243f817666\" (UID: \"40031394-4711-444f-af69-5d243f817666\") " Jun 09 02:28:36.854526 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:36.854506 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dww92\" (UniqueName: \"kubernetes.io/projected/40031394-4711-444f-af69-5d243f817666-kube-api-access-dww92\") pod \"40031394-4711-444f-af69-5d243f817666\" (UID: \"40031394-4711-444f-af69-5d243f817666\") " Jun 09 02:28:36.854557 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:36.854529 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bpc5q\" (UniqueName: \"kubernetes.io/projected/df35e67a-39f6-4e96-ab0d-0739cf7a331c-kube-api-access-bpc5q\") pod \"df35e67a-39f6-4e96-ab0d-0739cf7a331c\" (UID: \"df35e67a-39f6-4e96-ab0d-0739cf7a331c\") " Jun 09 02:28:36.854596 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:36.854590 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/df35e67a-39f6-4e96-ab0d-0739cf7a331c-util\") pod \"df35e67a-39f6-4e96-ab0d-0739cf7a331c\" (UID: \"df35e67a-39f6-4e96-ab0d-0739cf7a331c\") " Jun 09 02:28:36.854638 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:36.854613 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/df35e67a-39f6-4e96-ab0d-0739cf7a331c-bundle\") pod \"df35e67a-39f6-4e96-ab0d-0739cf7a331c\" (UID: \"df35e67a-39f6-4e96-ab0d-0739cf7a331c\") " Jun 09 02:28:36.854691 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:36.854645 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/40031394-4711-444f-af69-5d243f817666-bundle\") pod \"40031394-4711-444f-af69-5d243f817666\" (UID: \"40031394-4711-444f-af69-5d243f817666\") " Jun 09 02:28:36.855500 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:36.855459 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40031394-4711-444f-af69-5d243f817666-bundle" (OuterVolumeSpecName: "bundle") pod "40031394-4711-444f-af69-5d243f817666" (UID: "40031394-4711-444f-af69-5d243f817666"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 02:28:36.855500 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:36.855476 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df35e67a-39f6-4e96-ab0d-0739cf7a331c-bundle" (OuterVolumeSpecName: "bundle") pod "df35e67a-39f6-4e96-ab0d-0739cf7a331c" (UID: "df35e67a-39f6-4e96-ab0d-0739cf7a331c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 02:28:36.856599 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:36.856576 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df35e67a-39f6-4e96-ab0d-0739cf7a331c-kube-api-access-bpc5q" (OuterVolumeSpecName: "kube-api-access-bpc5q") pod "df35e67a-39f6-4e96-ab0d-0739cf7a331c" (UID: "df35e67a-39f6-4e96-ab0d-0739cf7a331c"). InnerVolumeSpecName "kube-api-access-bpc5q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 02:28:36.856678 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:36.856646 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40031394-4711-444f-af69-5d243f817666-kube-api-access-dww92" (OuterVolumeSpecName: "kube-api-access-dww92") pod "40031394-4711-444f-af69-5d243f817666" (UID: "40031394-4711-444f-af69-5d243f817666"). InnerVolumeSpecName "kube-api-access-dww92". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 02:28:36.860089 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:36.860057 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df35e67a-39f6-4e96-ab0d-0739cf7a331c-util" (OuterVolumeSpecName: "util") pod "df35e67a-39f6-4e96-ab0d-0739cf7a331c" (UID: "df35e67a-39f6-4e96-ab0d-0739cf7a331c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 02:28:36.862434 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:36.862399 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40031394-4711-444f-af69-5d243f817666-util" (OuterVolumeSpecName: "util") pod "40031394-4711-444f-af69-5d243f817666" (UID: "40031394-4711-444f-af69-5d243f817666"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 02:28:36.955705 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:36.955686 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/df35e67a-39f6-4e96-ab0d-0739cf7a331c-util\") on node \"ip-10-0-143-102.ec2.internal\" DevicePath \"\"" Jun 09 02:28:36.955705 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:36.955704 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/df35e67a-39f6-4e96-ab0d-0739cf7a331c-bundle\") on node \"ip-10-0-143-102.ec2.internal\" DevicePath \"\"" Jun 09 02:28:36.955837 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:36.955713 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/40031394-4711-444f-af69-5d243f817666-bundle\") on node \"ip-10-0-143-102.ec2.internal\" DevicePath \"\"" Jun 09 02:28:36.955837 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:36.955720 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/40031394-4711-444f-af69-5d243f817666-util\") on node \"ip-10-0-143-102.ec2.internal\" DevicePath \"\"" Jun 09 02:28:36.955837 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:36.955728 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dww92\" (UniqueName: \"kubernetes.io/projected/40031394-4711-444f-af69-5d243f817666-kube-api-access-dww92\") on node \"ip-10-0-143-102.ec2.internal\" DevicePath \"\"" Jun 09 02:28:36.955837 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:36.955736 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bpc5q\" (UniqueName: \"kubernetes.io/projected/df35e67a-39f6-4e96-ab0d-0739cf7a331c-kube-api-access-bpc5q\") on node \"ip-10-0-143-102.ec2.internal\" DevicePath \"\"" Jun 09 02:28:37.703899 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:37.703870 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tw9nz" Jun 09 02:28:37.703899 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:37.703891 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tw9nz" event={"ID":"df35e67a-39f6-4e96-ab0d-0739cf7a331c","Type":"ContainerDied","Data":"991ba651b923ceb02183225eb5372241e7fc7faf4cfef1691fb548a4a8d631a3"} Jun 09 02:28:37.704367 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:37.703935 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="991ba651b923ceb02183225eb5372241e7fc7faf4cfef1691fb548a4a8d631a3" Jun 09 02:28:37.706551 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:37.706520 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7355l45" event={"ID":"40031394-4711-444f-af69-5d243f817666","Type":"ContainerDied","Data":"f10104073d4834bdd8761bb1f8ee5749f6ae87f3520643afa8c1c35dbd489eac"} Jun 09 02:28:37.706551 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:37.706539 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7355l45" Jun 09 02:28:37.706738 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:37.706568 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f10104073d4834bdd8761bb1f8ee5749f6ae87f3520643afa8c1c35dbd489eac" Jun 09 02:28:37.840576 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:37.840549 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15jhr2" Jun 09 02:28:37.861922 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:37.861899 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/257a476e-eb09-41ce-91d9-95757c054af4-bundle\") pod \"257a476e-eb09-41ce-91d9-95757c054af4\" (UID: \"257a476e-eb09-41ce-91d9-95757c054af4\") " Jun 09 02:28:37.862010 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:37.861951 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g5pcz\" (UniqueName: \"kubernetes.io/projected/257a476e-eb09-41ce-91d9-95757c054af4-kube-api-access-g5pcz\") pod \"257a476e-eb09-41ce-91d9-95757c054af4\" (UID: \"257a476e-eb09-41ce-91d9-95757c054af4\") " Jun 09 02:28:37.862010 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:37.861988 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/257a476e-eb09-41ce-91d9-95757c054af4-util\") pod \"257a476e-eb09-41ce-91d9-95757c054af4\" (UID: \"257a476e-eb09-41ce-91d9-95757c054af4\") " Jun 09 02:28:37.862448 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:37.862425 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/257a476e-eb09-41ce-91d9-95757c054af4-bundle" (OuterVolumeSpecName: "bundle") pod "257a476e-eb09-41ce-91d9-95757c054af4" (UID: "257a476e-eb09-41ce-91d9-95757c054af4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 02:28:37.863913 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:37.863884 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/257a476e-eb09-41ce-91d9-95757c054af4-kube-api-access-g5pcz" (OuterVolumeSpecName: "kube-api-access-g5pcz") pod "257a476e-eb09-41ce-91d9-95757c054af4" (UID: "257a476e-eb09-41ce-91d9-95757c054af4"). InnerVolumeSpecName "kube-api-access-g5pcz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 02:28:37.870691 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:37.870667 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/257a476e-eb09-41ce-91d9-95757c054af4-util" (OuterVolumeSpecName: "util") pod "257a476e-eb09-41ce-91d9-95757c054af4" (UID: "257a476e-eb09-41ce-91d9-95757c054af4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 02:28:37.962813 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:37.962758 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/257a476e-eb09-41ce-91d9-95757c054af4-bundle\") on node \"ip-10-0-143-102.ec2.internal\" DevicePath \"\"" Jun 09 02:28:37.962813 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:37.962780 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g5pcz\" (UniqueName: \"kubernetes.io/projected/257a476e-eb09-41ce-91d9-95757c054af4-kube-api-access-g5pcz\") on node \"ip-10-0-143-102.ec2.internal\" DevicePath \"\"" Jun 09 02:28:37.962813 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:37.962790 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/257a476e-eb09-41ce-91d9-95757c054af4-util\") on node \"ip-10-0-143-102.ec2.internal\" DevicePath \"\"" Jun 09 02:28:38.714324 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:38.714294 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15jhr2" event={"ID":"257a476e-eb09-41ce-91d9-95757c054af4","Type":"ContainerDied","Data":"1914f23d653ea9b58d0a35e2ee84dd966794feed6e0c51d0e517cbe2677ac146"} Jun 09 02:28:38.714634 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:38.714341 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1914f23d653ea9b58d0a35e2ee84dd966794feed6e0c51d0e517cbe2677ac146" Jun 09 02:28:38.714634 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:38.714346 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15jhr2" Jun 09 02:28:45.134483 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:45.134447 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:28:47.781291 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:47.781258 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m89nq"] Jun 09 02:28:47.781645 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:47.781595 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df35e67a-39f6-4e96-ab0d-0739cf7a331c" containerName="extract" Jun 09 02:28:47.781645 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:47.781605 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="df35e67a-39f6-4e96-ab0d-0739cf7a331c" containerName="extract" Jun 09 02:28:47.781645 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:47.781616 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40031394-4711-444f-af69-5d243f817666" containerName="util" Jun 09 02:28:47.781645 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:47.781622 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="40031394-4711-444f-af69-5d243f817666" containerName="util" Jun 09 02:28:47.781645 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:47.781633 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df35e67a-39f6-4e96-ab0d-0739cf7a331c" containerName="util" Jun 09 02:28:47.781645 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:47.781638 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="df35e67a-39f6-4e96-ab0d-0739cf7a331c" containerName="util" Jun 09 02:28:47.781645 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:47.781644 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df35e67a-39f6-4e96-ab0d-0739cf7a331c" containerName="pull" Jun 09 02:28:47.781645 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:47.781649 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="df35e67a-39f6-4e96-ab0d-0739cf7a331c" containerName="pull" Jun 09 02:28:47.781986 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:47.781655 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40031394-4711-444f-af69-5d243f817666" containerName="extract" Jun 09 02:28:47.781986 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:47.781661 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="40031394-4711-444f-af69-5d243f817666" containerName="extract" Jun 09 02:28:47.781986 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:47.781675 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="257a476e-eb09-41ce-91d9-95757c054af4" containerName="util" Jun 09 02:28:47.781986 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:47.781679 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="257a476e-eb09-41ce-91d9-95757c054af4" containerName="util" Jun 09 02:28:47.781986 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:47.781685 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57cb1808-abed-4e68-a7b1-3b0274f0cafd" containerName="extract" Jun 09 02:28:47.781986 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:47.781690 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="57cb1808-abed-4e68-a7b1-3b0274f0cafd" containerName="extract" Jun 09 02:28:47.781986 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:47.781699 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57cb1808-abed-4e68-a7b1-3b0274f0cafd" containerName="util" Jun 09 02:28:47.781986 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:47.781704 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="57cb1808-abed-4e68-a7b1-3b0274f0cafd" containerName="util" Jun 09 02:28:47.781986 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:47.781709 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="257a476e-eb09-41ce-91d9-95757c054af4" containerName="extract" Jun 09 02:28:47.781986 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:47.781713 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="257a476e-eb09-41ce-91d9-95757c054af4" containerName="extract" Jun 09 02:28:47.781986 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:47.781720 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40031394-4711-444f-af69-5d243f817666" containerName="pull" Jun 09 02:28:47.781986 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:47.781725 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="40031394-4711-444f-af69-5d243f817666" containerName="pull" Jun 09 02:28:47.781986 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:47.781731 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="257a476e-eb09-41ce-91d9-95757c054af4" containerName="pull" Jun 09 02:28:47.781986 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:47.781735 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="257a476e-eb09-41ce-91d9-95757c054af4" containerName="pull" Jun 09 02:28:47.781986 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:47.781744 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57cb1808-abed-4e68-a7b1-3b0274f0cafd" containerName="pull" Jun 09 02:28:47.781986 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:47.781749 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="57cb1808-abed-4e68-a7b1-3b0274f0cafd" containerName="pull" Jun 09 02:28:47.781986 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:47.781802 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="57cb1808-abed-4e68-a7b1-3b0274f0cafd" containerName="extract" Jun 09 02:28:47.781986 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:47.781812 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="df35e67a-39f6-4e96-ab0d-0739cf7a331c" containerName="extract" Jun 09 02:28:47.781986 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:47.781825 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="40031394-4711-444f-af69-5d243f817666" containerName="extract" Jun 09 02:28:47.781986 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:47.781834 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="257a476e-eb09-41ce-91d9-95757c054af4" containerName="extract" Jun 09 02:28:47.786233 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:47.786218 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m89nq" Jun 09 02:28:47.788751 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:47.788730 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-9mkmf\"" Jun 09 02:28:47.797699 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:47.797678 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m89nq"] Jun 09 02:28:47.838672 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:47.838653 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpx7w\" (UniqueName: \"kubernetes.io/projected/ebe48450-2c4e-4d68-89d6-b649337d3f0d-kube-api-access-bpx7w\") pod \"limitador-operator-controller-manager-859d7b78bd-m89nq\" (UID: \"ebe48450-2c4e-4d68-89d6-b649337d3f0d\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m89nq" Jun 09 02:28:47.939377 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:47.939351 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bpx7w\" (UniqueName: \"kubernetes.io/projected/ebe48450-2c4e-4d68-89d6-b649337d3f0d-kube-api-access-bpx7w\") pod \"limitador-operator-controller-manager-859d7b78bd-m89nq\" (UID: \"ebe48450-2c4e-4d68-89d6-b649337d3f0d\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m89nq" Jun 09 02:28:47.950593 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:47.950573 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpx7w\" (UniqueName: \"kubernetes.io/projected/ebe48450-2c4e-4d68-89d6-b649337d3f0d-kube-api-access-bpx7w\") pod \"limitador-operator-controller-manager-859d7b78bd-m89nq\" (UID: \"ebe48450-2c4e-4d68-89d6-b649337d3f0d\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m89nq" Jun 09 02:28:48.096025 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:48.095994 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m89nq" Jun 09 02:28:48.227279 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:48.227250 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m89nq"] Jun 09 02:28:48.227581 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:28:48.227548 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebe48450_2c4e_4d68_89d6_b649337d3f0d.slice/crio-c9a55ad87d273d3552e3266e6fbac175a01749ea45ac47bd1c88c502e7c97538 WatchSource:0}: Error finding container c9a55ad87d273d3552e3266e6fbac175a01749ea45ac47bd1c88c502e7c97538: Status 404 returned error can't find the container with id c9a55ad87d273d3552e3266e6fbac175a01749ea45ac47bd1c88c502e7c97538 Jun 09 02:28:48.537607 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:48.537578 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:28:48.769599 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:48.769570 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m89nq" event={"ID":"ebe48450-2c4e-4d68-89d6-b649337d3f0d","Type":"ContainerStarted","Data":"c9a55ad87d273d3552e3266e6fbac175a01749ea45ac47bd1c88c502e7c97538"} Jun 09 02:28:49.326367 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:49.326321 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:28:50.781224 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:50.781190 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m89nq" event={"ID":"ebe48450-2c4e-4d68-89d6-b649337d3f0d","Type":"ContainerStarted","Data":"eaac4949fa2d0203b2a8ab451e51c24e800e7b275707d40889fbbcd1dcebff53"} Jun 09 02:28:50.781618 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:50.781339 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m89nq" Jun 09 02:28:50.796420 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:50.796378 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m89nq" podStartSLOduration=1.799434668 podStartE2EDuration="3.796366087s" totalImagesPullingTime="1.996931419s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:28:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:28:50.795891168 +0000 UTC m=+546.743008510" watchObservedRunningTime="2026-06-09 02:28:50.796366087 +0000 UTC m=+546.743483428" Jun 09 02:28:52.653493 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:52.653452 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:28:52.959730 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:52.959656 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:28:54.565305 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:54.565260 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:28:55.074224 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:55.074194 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7445b668d-c765x"] Jun 09 02:28:55.078249 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:55.078224 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7445b668d-c765x" Jun 09 02:28:55.099460 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:55.099430 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7445b668d-c765x"] Jun 09 02:28:55.110842 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:55.110817 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-jnprm"] Jun 09 02:28:55.121238 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:55.121214 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jnprm" Jun 09 02:28:55.123385 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:55.123366 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 09 02:28:55.123385 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:55.123379 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-k9q5r\"" Jun 09 02:28:55.128386 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:55.128365 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-jnprm"] Jun 09 02:28:55.176709 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:55.176659 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:28:55.197663 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:55.197637 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/99798d7a-f474-4213-b4f9-90576b0dee53-oauth-serving-cert\") pod \"console-7445b668d-c765x\" (UID: \"99798d7a-f474-4213-b4f9-90576b0dee53\") " pod="openshift-console/console-7445b668d-c765x" Jun 09 02:28:55.197761 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:55.197693 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/99798d7a-f474-4213-b4f9-90576b0dee53-service-ca\") pod \"console-7445b668d-c765x\" (UID: \"99798d7a-f474-4213-b4f9-90576b0dee53\") " pod="openshift-console/console-7445b668d-c765x" Jun 09 02:28:55.197761 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:55.197711 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4nfft\" (UniqueName: \"kubernetes.io/projected/99798d7a-f474-4213-b4f9-90576b0dee53-kube-api-access-4nfft\") pod \"console-7445b668d-c765x\" (UID: \"99798d7a-f474-4213-b4f9-90576b0dee53\") " pod="openshift-console/console-7445b668d-c765x" Jun 09 02:28:55.197836 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:55.197773 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/99798d7a-f474-4213-b4f9-90576b0dee53-console-oauth-config\") pod \"console-7445b668d-c765x\" (UID: \"99798d7a-f474-4213-b4f9-90576b0dee53\") " pod="openshift-console/console-7445b668d-c765x" Jun 09 02:28:55.197836 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:55.197802 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/99798d7a-f474-4213-b4f9-90576b0dee53-trusted-ca-bundle\") pod \"console-7445b668d-c765x\" (UID: \"99798d7a-f474-4213-b4f9-90576b0dee53\") " pod="openshift-console/console-7445b668d-c765x" Jun 09 02:28:55.197899 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:55.197860 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/99798d7a-f474-4213-b4f9-90576b0dee53-console-serving-cert\") pod \"console-7445b668d-c765x\" (UID: \"99798d7a-f474-4213-b4f9-90576b0dee53\") " pod="openshift-console/console-7445b668d-c765x" Jun 09 02:28:55.197899 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:55.197874 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/99798d7a-f474-4213-b4f9-90576b0dee53-console-config\") pod \"console-7445b668d-c765x\" (UID: \"99798d7a-f474-4213-b4f9-90576b0dee53\") " pod="openshift-console/console-7445b668d-c765x" Jun 09 02:28:55.197958 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:55.197933 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bcrxj\" (UniqueName: \"kubernetes.io/projected/354ab5d7-f1f2-41a4-9198-9afcef3cc2c7-kube-api-access-bcrxj\") pod \"dns-operator-controller-manager-864dd78c4c-jnprm\" (UID: \"354ab5d7-f1f2-41a4-9198-9afcef3cc2c7\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jnprm" Jun 09 02:28:55.298853 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:55.298828 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/99798d7a-f474-4213-b4f9-90576b0dee53-service-ca\") pod \"console-7445b668d-c765x\" (UID: \"99798d7a-f474-4213-b4f9-90576b0dee53\") " pod="openshift-console/console-7445b668d-c765x" Jun 09 02:28:55.298853 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:55.298855 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4nfft\" (UniqueName: \"kubernetes.io/projected/99798d7a-f474-4213-b4f9-90576b0dee53-kube-api-access-4nfft\") pod \"console-7445b668d-c765x\" (UID: \"99798d7a-f474-4213-b4f9-90576b0dee53\") " pod="openshift-console/console-7445b668d-c765x" Jun 09 02:28:55.299024 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:55.298872 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/99798d7a-f474-4213-b4f9-90576b0dee53-console-oauth-config\") pod \"console-7445b668d-c765x\" (UID: \"99798d7a-f474-4213-b4f9-90576b0dee53\") " pod="openshift-console/console-7445b668d-c765x" Jun 09 02:28:55.299024 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:55.298894 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/99798d7a-f474-4213-b4f9-90576b0dee53-trusted-ca-bundle\") pod \"console-7445b668d-c765x\" (UID: \"99798d7a-f474-4213-b4f9-90576b0dee53\") " pod="openshift-console/console-7445b668d-c765x" Jun 09 02:28:55.299024 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:55.298941 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/99798d7a-f474-4213-b4f9-90576b0dee53-console-serving-cert\") pod \"console-7445b668d-c765x\" (UID: \"99798d7a-f474-4213-b4f9-90576b0dee53\") " pod="openshift-console/console-7445b668d-c765x" Jun 09 02:28:55.299024 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:55.298961 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/99798d7a-f474-4213-b4f9-90576b0dee53-console-config\") pod \"console-7445b668d-c765x\" (UID: \"99798d7a-f474-4213-b4f9-90576b0dee53\") " pod="openshift-console/console-7445b668d-c765x" Jun 09 02:28:55.299252 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:55.299117 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bcrxj\" (UniqueName: \"kubernetes.io/projected/354ab5d7-f1f2-41a4-9198-9afcef3cc2c7-kube-api-access-bcrxj\") pod \"dns-operator-controller-manager-864dd78c4c-jnprm\" (UID: \"354ab5d7-f1f2-41a4-9198-9afcef3cc2c7\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jnprm" Jun 09 02:28:55.299252 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:55.299157 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/99798d7a-f474-4213-b4f9-90576b0dee53-oauth-serving-cert\") pod \"console-7445b668d-c765x\" (UID: \"99798d7a-f474-4213-b4f9-90576b0dee53\") " pod="openshift-console/console-7445b668d-c765x" Jun 09 02:28:55.299712 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:55.299691 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/99798d7a-f474-4213-b4f9-90576b0dee53-console-config\") pod \"console-7445b668d-c765x\" (UID: \"99798d7a-f474-4213-b4f9-90576b0dee53\") " pod="openshift-console/console-7445b668d-c765x" Jun 09 02:28:55.299783 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:55.299741 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/99798d7a-f474-4213-b4f9-90576b0dee53-service-ca\") pod \"console-7445b668d-c765x\" (UID: \"99798d7a-f474-4213-b4f9-90576b0dee53\") " pod="openshift-console/console-7445b668d-c765x" Jun 09 02:28:55.299863 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:55.299843 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/99798d7a-f474-4213-b4f9-90576b0dee53-oauth-serving-cert\") pod \"console-7445b668d-c765x\" (UID: \"99798d7a-f474-4213-b4f9-90576b0dee53\") " pod="openshift-console/console-7445b668d-c765x" Jun 09 02:28:55.299950 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:55.299929 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/99798d7a-f474-4213-b4f9-90576b0dee53-trusted-ca-bundle\") pod \"console-7445b668d-c765x\" (UID: \"99798d7a-f474-4213-b4f9-90576b0dee53\") " pod="openshift-console/console-7445b668d-c765x" Jun 09 02:28:55.301450 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:55.301429 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/99798d7a-f474-4213-b4f9-90576b0dee53-console-oauth-config\") pod \"console-7445b668d-c765x\" (UID: \"99798d7a-f474-4213-b4f9-90576b0dee53\") " pod="openshift-console/console-7445b668d-c765x" Jun 09 02:28:55.301518 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:55.301483 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/99798d7a-f474-4213-b4f9-90576b0dee53-console-serving-cert\") pod \"console-7445b668d-c765x\" (UID: \"99798d7a-f474-4213-b4f9-90576b0dee53\") " pod="openshift-console/console-7445b668d-c765x" Jun 09 02:28:55.306813 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:55.306792 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4nfft\" (UniqueName: \"kubernetes.io/projected/99798d7a-f474-4213-b4f9-90576b0dee53-kube-api-access-4nfft\") pod \"console-7445b668d-c765x\" (UID: \"99798d7a-f474-4213-b4f9-90576b0dee53\") " pod="openshift-console/console-7445b668d-c765x" Jun 09 02:28:55.307097 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:55.307060 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bcrxj\" (UniqueName: \"kubernetes.io/projected/354ab5d7-f1f2-41a4-9198-9afcef3cc2c7-kube-api-access-bcrxj\") pod \"dns-operator-controller-manager-864dd78c4c-jnprm\" (UID: \"354ab5d7-f1f2-41a4-9198-9afcef3cc2c7\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jnprm" Jun 09 02:28:55.339508 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:55.339441 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:28:55.389591 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:55.389568 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7445b668d-c765x" Jun 09 02:28:55.434103 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:55.433983 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jnprm" Jun 09 02:28:55.441885 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:55.441853 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:28:55.538962 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:55.538891 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7445b668d-c765x"] Jun 09 02:28:55.544241 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:28:55.544202 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99798d7a_f474_4213_b4f9_90576b0dee53.slice/crio-d44cf86f484493cf2dab3d673252b8bf99d47b4ec8dda2d0f3ec8dd271c52caa WatchSource:0}: Error finding container d44cf86f484493cf2dab3d673252b8bf99d47b4ec8dda2d0f3ec8dd271c52caa: Status 404 returned error can't find the container with id d44cf86f484493cf2dab3d673252b8bf99d47b4ec8dda2d0f3ec8dd271c52caa Jun 09 02:28:55.583514 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:55.583448 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-jnprm"] Jun 09 02:28:55.585908 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:28:55.585885 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod354ab5d7_f1f2_41a4_9198_9afcef3cc2c7.slice/crio-b589bb23ba95c02211ed46e58a6f0b5b34a4dc8de92a8e42a31681992c0e4652 WatchSource:0}: Error finding container b589bb23ba95c02211ed46e58a6f0b5b34a4dc8de92a8e42a31681992c0e4652: Status 404 returned error can't find the container with id b589bb23ba95c02211ed46e58a6f0b5b34a4dc8de92a8e42a31681992c0e4652 Jun 09 02:28:55.746381 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:55.746348 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:28:55.813713 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:55.813683 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7445b668d-c765x" event={"ID":"99798d7a-f474-4213-b4f9-90576b0dee53","Type":"ContainerStarted","Data":"35b91cb65b56332bceed2365fcd59ed4cfcdaa7e91979783d0b8bd81599b25b5"} Jun 09 02:28:55.813897 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:55.813738 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7445b668d-c765x" event={"ID":"99798d7a-f474-4213-b4f9-90576b0dee53","Type":"ContainerStarted","Data":"d44cf86f484493cf2dab3d673252b8bf99d47b4ec8dda2d0f3ec8dd271c52caa"} Jun 09 02:28:55.815358 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:55.815337 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jnprm" event={"ID":"354ab5d7-f1f2-41a4-9198-9afcef3cc2c7","Type":"ContainerStarted","Data":"b589bb23ba95c02211ed46e58a6f0b5b34a4dc8de92a8e42a31681992c0e4652"} Jun 09 02:28:55.853204 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:55.853139 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:28:55.861782 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:55.861743 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7445b668d-c765x" podStartSLOduration=0.861730846 podStartE2EDuration="861.730846ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:28:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:28:55.859465506 +0000 UTC m=+551.806582859" watchObservedRunningTime="2026-06-09 02:28:55.861730846 +0000 UTC m=+551.808848189" Jun 09 02:28:55.981996 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:55.981947 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:28:57.583580 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:57.583541 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:28:57.831176 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:57.831146 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jnprm" event={"ID":"354ab5d7-f1f2-41a4-9198-9afcef3cc2c7","Type":"ContainerStarted","Data":"a50982ef36162560c88ce549eea112818a002b2b1b65e200da32a504a832352c"} Jun 09 02:28:57.831304 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:57.831226 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jnprm" Jun 09 02:28:57.850659 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:28:57.850586 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jnprm" podStartSLOduration=0.809102581 podStartE2EDuration="2.850569345s" totalImagesPullingTime="2.041466764s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:28:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:28:57.848719567 +0000 UTC m=+553.795836911" watchObservedRunningTime="2026-06-09 02:28:57.850569345 +0000 UTC m=+553.797686686" Jun 09 02:29:00.747323 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:00.747287 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:29:00.847848 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:00.847809 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:29:01.055186 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:01.055155 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:29:01.790162 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:01.790132 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m89nq" Jun 09 02:29:05.389685 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:05.389644 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7445b668d-c765x" Jun 09 02:29:05.390153 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:05.389712 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7445b668d-c765x" Jun 09 02:29:05.394452 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:05.394418 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7445b668d-c765x" Jun 09 02:29:05.880819 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:05.880792 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7445b668d-c765x" Jun 09 02:29:05.928095 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:05.927585 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-855596df4f-plgmb"] Jun 09 02:29:06.025780 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:06.025721 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:29:06.083839 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:06.083781 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:29:06.138474 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:06.138409 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:29:06.237307 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:06.237275 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:29:06.551648 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:06.551618 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:29:06.665921 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:06.665885 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:29:08.839450 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:08.839417 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jnprm" Jun 09 02:29:09.546650 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:09.546611 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:29:09.645606 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:09.645564 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:29:09.766950 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:09.766923 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-7mj98"] Jun 09 02:29:09.771905 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:09.771875 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-7mj98" Jun 09 02:29:09.772853 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:09.772826 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:29:09.774375 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:09.774320 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jun 09 02:29:09.774486 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:09.774458 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jun 09 02:29:09.775346 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:09.775326 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-nq6h5\"" Jun 09 02:29:09.777642 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:09.777615 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-7mj98"] Jun 09 02:29:09.926455 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:09.926390 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3065ce1e-53d8-40e0-a9e7-2d7314d6aef3-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-7mj98\" (UID: \"3065ce1e-53d8-40e0-a9e7-2d7314d6aef3\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-7mj98" Jun 09 02:29:09.926455 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:09.926427 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/3065ce1e-53d8-40e0-a9e7-2d7314d6aef3-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-7mj98\" (UID: \"3065ce1e-53d8-40e0-a9e7-2d7314d6aef3\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-7mj98" Jun 09 02:29:09.926785 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:09.926517 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdq4h\" (UniqueName: \"kubernetes.io/projected/3065ce1e-53d8-40e0-a9e7-2d7314d6aef3-kube-api-access-jdq4h\") pod \"kuadrant-console-plugin-66b5774985-7mj98\" (UID: \"3065ce1e-53d8-40e0-a9e7-2d7314d6aef3\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-7mj98" Jun 09 02:29:09.936611 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:09.936585 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:29:10.027203 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:10.027184 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3065ce1e-53d8-40e0-a9e7-2d7314d6aef3-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-7mj98\" (UID: \"3065ce1e-53d8-40e0-a9e7-2d7314d6aef3\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-7mj98" Jun 09 02:29:10.027310 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:10.027222 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/3065ce1e-53d8-40e0-a9e7-2d7314d6aef3-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-7mj98\" (UID: \"3065ce1e-53d8-40e0-a9e7-2d7314d6aef3\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-7mj98" Jun 09 02:29:10.027310 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:10.027278 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdq4h\" (UniqueName: \"kubernetes.io/projected/3065ce1e-53d8-40e0-a9e7-2d7314d6aef3-kube-api-access-jdq4h\") pod \"kuadrant-console-plugin-66b5774985-7mj98\" (UID: \"3065ce1e-53d8-40e0-a9e7-2d7314d6aef3\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-7mj98" Jun 09 02:29:10.027798 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:10.027777 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3065ce1e-53d8-40e0-a9e7-2d7314d6aef3-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-7mj98\" (UID: \"3065ce1e-53d8-40e0-a9e7-2d7314d6aef3\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-7mj98" Jun 09 02:29:10.029676 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:10.029653 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/3065ce1e-53d8-40e0-a9e7-2d7314d6aef3-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-7mj98\" (UID: \"3065ce1e-53d8-40e0-a9e7-2d7314d6aef3\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-7mj98" Jun 09 02:29:10.035041 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:10.035019 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdq4h\" (UniqueName: \"kubernetes.io/projected/3065ce1e-53d8-40e0-a9e7-2d7314d6aef3-kube-api-access-jdq4h\") pod \"kuadrant-console-plugin-66b5774985-7mj98\" (UID: \"3065ce1e-53d8-40e0-a9e7-2d7314d6aef3\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-7mj98" Jun 09 02:29:10.083452 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:10.083430 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-7mj98" Jun 09 02:29:10.219220 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:10.219199 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-7mj98"] Jun 09 02:29:10.220915 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:29:10.220883 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3065ce1e_53d8_40e0_a9e7_2d7314d6aef3.slice/crio-985f0c4ea5614afcea0b33b13528dec2daeeebbf812c0d84ad41ced2ebd92bc1 WatchSource:0}: Error finding container 985f0c4ea5614afcea0b33b13528dec2daeeebbf812c0d84ad41ced2ebd92bc1: Status 404 returned error can't find the container with id 985f0c4ea5614afcea0b33b13528dec2daeeebbf812c0d84ad41ced2ebd92bc1 Jun 09 02:29:10.339467 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:10.339442 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:29:10.440532 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:10.440502 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:29:10.909623 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:10.909585 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-7mj98" event={"ID":"3065ce1e-53d8-40e0-a9e7-2d7314d6aef3","Type":"ContainerStarted","Data":"985f0c4ea5614afcea0b33b13528dec2daeeebbf812c0d84ad41ced2ebd92bc1"} Jun 09 02:29:13.666466 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:13.666427 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:29:13.766291 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:13.766249 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:29:17.135792 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:17.135754 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:29:17.236507 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:17.236468 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:29:19.053607 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:19.053573 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8wqg4"] Jun 09 02:29:19.062445 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:19.062421 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8wqg4" Jun 09 02:29:19.065240 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:19.065222 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-nn6hf\"" Jun 09 02:29:19.071736 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:19.071709 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8wqg4"] Jun 09 02:29:19.209558 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:19.209524 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/edd7848a-e948-4293-8f70-0fb8189db8cd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-8wqg4\" (UID: \"edd7848a-e948-4293-8f70-0fb8189db8cd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8wqg4" Jun 09 02:29:19.209732 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:19.209630 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9kfpx\" (UniqueName: \"kubernetes.io/projected/edd7848a-e948-4293-8f70-0fb8189db8cd-kube-api-access-9kfpx\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-8wqg4\" (UID: \"edd7848a-e948-4293-8f70-0fb8189db8cd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8wqg4" Jun 09 02:29:19.310697 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:19.310618 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9kfpx\" (UniqueName: \"kubernetes.io/projected/edd7848a-e948-4293-8f70-0fb8189db8cd-kube-api-access-9kfpx\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-8wqg4\" (UID: \"edd7848a-e948-4293-8f70-0fb8189db8cd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8wqg4" Jun 09 02:29:19.310845 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:19.310707 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/edd7848a-e948-4293-8f70-0fb8189db8cd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-8wqg4\" (UID: \"edd7848a-e948-4293-8f70-0fb8189db8cd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8wqg4" Jun 09 02:29:19.311110 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:19.311087 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/edd7848a-e948-4293-8f70-0fb8189db8cd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-8wqg4\" (UID: \"edd7848a-e948-4293-8f70-0fb8189db8cd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8wqg4" Jun 09 02:29:19.319756 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:19.319734 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9kfpx\" (UniqueName: \"kubernetes.io/projected/edd7848a-e948-4293-8f70-0fb8189db8cd-kube-api-access-9kfpx\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-8wqg4\" (UID: \"edd7848a-e948-4293-8f70-0fb8189db8cd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8wqg4" Jun 09 02:29:19.376791 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:19.376754 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8wqg4" Jun 09 02:29:19.808322 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:19.808241 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8wqg4"] Jun 09 02:29:19.811155 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:19.811124 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8wqg4"] Jun 09 02:29:19.826648 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:19.826619 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zl9s7"] Jun 09 02:29:19.842713 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:19.842644 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zl9s7" Jun 09 02:29:19.846598 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:19.845157 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zl9s7"] Jun 09 02:29:19.847914 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:19.847889 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m89nq"] Jun 09 02:29:19.848199 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:19.848169 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m89nq" podUID="ebe48450-2c4e-4d68-89d6-b649337d3f0d" containerName="manager" containerID="cri-o://eaac4949fa2d0203b2a8ab451e51c24e800e7b275707d40889fbbcd1dcebff53" gracePeriod=2 Jun 09 02:29:19.865408 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:19.865376 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m89nq"] Jun 09 02:29:19.874500 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:29:19.874467 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-m89nq\" is forbidden: User \"system:node:ip-10-0-143-102.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-102.ec2.internal' and this object" podUID="ebe48450-2c4e-4d68-89d6-b649337d3f0d" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m89nq" Jun 09 02:29:19.877869 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:19.877843 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tr8cg"] Jun 09 02:29:19.878383 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:19.878362 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ebe48450-2c4e-4d68-89d6-b649337d3f0d" containerName="manager" Jun 09 02:29:19.878383 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:19.878384 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebe48450-2c4e-4d68-89d6-b649337d3f0d" containerName="manager" Jun 09 02:29:19.878562 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:19.878481 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="ebe48450-2c4e-4d68-89d6-b649337d3f0d" containerName="manager" Jun 09 02:29:19.881835 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:19.881812 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tr8cg" Jun 09 02:29:19.884206 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:29:19.884170 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-m89nq\" is forbidden: User \"system:node:ip-10-0-143-102.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-102.ec2.internal' and this object" podUID="ebe48450-2c4e-4d68-89d6-b649337d3f0d" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m89nq" Jun 09 02:29:19.892163 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:19.892139 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tr8cg"] Jun 09 02:29:20.016955 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:20.016924 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbzzq\" (UniqueName: \"kubernetes.io/projected/9cb218b6-1f4a-48da-92d0-af90f2758214-kube-api-access-mbzzq\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-zl9s7\" (UID: \"9cb218b6-1f4a-48da-92d0-af90f2758214\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zl9s7" Jun 09 02:29:20.017109 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:20.016981 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnvkh\" (UniqueName: \"kubernetes.io/projected/8f2181e2-aded-4cdc-bebe-60b211f50f45-kube-api-access-hnvkh\") pod \"limitador-operator-controller-manager-859d7b78bd-tr8cg\" (UID: \"8f2181e2-aded-4cdc-bebe-60b211f50f45\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tr8cg" Jun 09 02:29:20.017197 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:20.017112 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9cb218b6-1f4a-48da-92d0-af90f2758214-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-zl9s7\" (UID: \"9cb218b6-1f4a-48da-92d0-af90f2758214\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zl9s7" Jun 09 02:29:20.118400 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:20.118339 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9cb218b6-1f4a-48da-92d0-af90f2758214-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-zl9s7\" (UID: \"9cb218b6-1f4a-48da-92d0-af90f2758214\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zl9s7" Jun 09 02:29:20.118766 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:20.118400 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbzzq\" (UniqueName: \"kubernetes.io/projected/9cb218b6-1f4a-48da-92d0-af90f2758214-kube-api-access-mbzzq\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-zl9s7\" (UID: \"9cb218b6-1f4a-48da-92d0-af90f2758214\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zl9s7" Jun 09 02:29:20.118766 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:20.118435 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hnvkh\" (UniqueName: \"kubernetes.io/projected/8f2181e2-aded-4cdc-bebe-60b211f50f45-kube-api-access-hnvkh\") pod \"limitador-operator-controller-manager-859d7b78bd-tr8cg\" (UID: \"8f2181e2-aded-4cdc-bebe-60b211f50f45\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tr8cg" Jun 09 02:29:20.118870 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:20.118842 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9cb218b6-1f4a-48da-92d0-af90f2758214-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-zl9s7\" (UID: \"9cb218b6-1f4a-48da-92d0-af90f2758214\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zl9s7" Jun 09 02:29:20.133913 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:20.133889 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbzzq\" (UniqueName: \"kubernetes.io/projected/9cb218b6-1f4a-48da-92d0-af90f2758214-kube-api-access-mbzzq\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-zl9s7\" (UID: \"9cb218b6-1f4a-48da-92d0-af90f2758214\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zl9s7" Jun 09 02:29:20.134058 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:20.134037 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnvkh\" (UniqueName: \"kubernetes.io/projected/8f2181e2-aded-4cdc-bebe-60b211f50f45-kube-api-access-hnvkh\") pod \"limitador-operator-controller-manager-859d7b78bd-tr8cg\" (UID: \"8f2181e2-aded-4cdc-bebe-60b211f50f45\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tr8cg" Jun 09 02:29:20.163800 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:20.163780 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zl9s7" Jun 09 02:29:20.236121 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:20.236093 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tr8cg" Jun 09 02:29:20.405996 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:20.405916 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:29:20.510719 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:20.510567 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:29:23.920288 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:23.920250 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:29:23.966687 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:23.966606 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:29:24.104265 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:24.104225 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:29:24.156069 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:24.156021 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:29:26.905022 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:26.904983 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:29:26.952471 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:26.952440 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:29:30.959498 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:30.959436 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-855596df4f-plgmb" podUID="b09e2f0c-4574-42b4-ad9a-c392ce7c054d" containerName="console" containerID="cri-o://81a5abb8b38d6500b27ad73fa129dbc5c334842396e6990c2957c88796069e38" gracePeriod=15 Jun 09 02:29:31.366241 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:31.345349 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:29:31.408411 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:31.408381 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-855596df4f-plgmb" Jun 09 02:29:31.418508 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:31.418481 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m89nq" Jun 09 02:29:31.419858 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:31.419807 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b09e2f0c-4574-42b4-ad9a-c392ce7c054d-console-config\") pod \"b09e2f0c-4574-42b4-ad9a-c392ce7c054d\" (UID: \"b09e2f0c-4574-42b4-ad9a-c392ce7c054d\") " Jun 09 02:29:31.420102 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:31.420043 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b09e2f0c-4574-42b4-ad9a-c392ce7c054d-console-serving-cert\") pod \"b09e2f0c-4574-42b4-ad9a-c392ce7c054d\" (UID: \"b09e2f0c-4574-42b4-ad9a-c392ce7c054d\") " Jun 09 02:29:31.420339 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:31.420268 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b09e2f0c-4574-42b4-ad9a-c392ce7c054d-console-config" (OuterVolumeSpecName: "console-config") pod "b09e2f0c-4574-42b4-ad9a-c392ce7c054d" (UID: "b09e2f0c-4574-42b4-ad9a-c392ce7c054d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 02:29:31.420339 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:31.420292 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b09e2f0c-4574-42b4-ad9a-c392ce7c054d-trusted-ca-bundle\") pod \"b09e2f0c-4574-42b4-ad9a-c392ce7c054d\" (UID: \"b09e2f0c-4574-42b4-ad9a-c392ce7c054d\") " Jun 09 02:29:31.420651 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:31.420591 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b09e2f0c-4574-42b4-ad9a-c392ce7c054d-console-oauth-config\") pod \"b09e2f0c-4574-42b4-ad9a-c392ce7c054d\" (UID: \"b09e2f0c-4574-42b4-ad9a-c392ce7c054d\") " Jun 09 02:29:31.420651 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:31.420623 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b09e2f0c-4574-42b4-ad9a-c392ce7c054d-service-ca\") pod \"b09e2f0c-4574-42b4-ad9a-c392ce7c054d\" (UID: \"b09e2f0c-4574-42b4-ad9a-c392ce7c054d\") " Jun 09 02:29:31.421147 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:31.420925 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b09e2f0c-4574-42b4-ad9a-c392ce7c054d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b09e2f0c-4574-42b4-ad9a-c392ce7c054d" (UID: "b09e2f0c-4574-42b4-ad9a-c392ce7c054d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 02:29:31.421147 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:31.420933 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b09e2f0c-4574-42b4-ad9a-c392ce7c054d-oauth-serving-cert\") pod \"b09e2f0c-4574-42b4-ad9a-c392ce7c054d\" (UID: \"b09e2f0c-4574-42b4-ad9a-c392ce7c054d\") " Jun 09 02:29:31.421147 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:31.421005 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pdrgx\" (UniqueName: \"kubernetes.io/projected/b09e2f0c-4574-42b4-ad9a-c392ce7c054d-kube-api-access-pdrgx\") pod \"b09e2f0c-4574-42b4-ad9a-c392ce7c054d\" (UID: \"b09e2f0c-4574-42b4-ad9a-c392ce7c054d\") " Jun 09 02:29:31.421371 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:31.421329 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b09e2f0c-4574-42b4-ad9a-c392ce7c054d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b09e2f0c-4574-42b4-ad9a-c392ce7c054d" (UID: "b09e2f0c-4574-42b4-ad9a-c392ce7c054d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 02:29:31.421764 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:31.421573 2573 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b09e2f0c-4574-42b4-ad9a-c392ce7c054d-oauth-serving-cert\") on node \"ip-10-0-143-102.ec2.internal\" DevicePath \"\"" Jun 09 02:29:31.421764 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:31.421706 2573 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b09e2f0c-4574-42b4-ad9a-c392ce7c054d-console-config\") on node \"ip-10-0-143-102.ec2.internal\" DevicePath \"\"" Jun 09 02:29:31.421764 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:31.421721 2573 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b09e2f0c-4574-42b4-ad9a-c392ce7c054d-trusted-ca-bundle\") on node \"ip-10-0-143-102.ec2.internal\" DevicePath \"\"" Jun 09 02:29:31.421764 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:31.421735 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b09e2f0c-4574-42b4-ad9a-c392ce7c054d-service-ca" (OuterVolumeSpecName: "service-ca") pod "b09e2f0c-4574-42b4-ad9a-c392ce7c054d" (UID: "b09e2f0c-4574-42b4-ad9a-c392ce7c054d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 02:29:31.423040 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:31.423007 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b09e2f0c-4574-42b4-ad9a-c392ce7c054d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b09e2f0c-4574-42b4-ad9a-c392ce7c054d" (UID: "b09e2f0c-4574-42b4-ad9a-c392ce7c054d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 02:29:31.426424 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:31.426368 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b09e2f0c-4574-42b4-ad9a-c392ce7c054d-kube-api-access-pdrgx" (OuterVolumeSpecName: "kube-api-access-pdrgx") pod "b09e2f0c-4574-42b4-ad9a-c392ce7c054d" (UID: "b09e2f0c-4574-42b4-ad9a-c392ce7c054d"). InnerVolumeSpecName "kube-api-access-pdrgx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 02:29:31.426727 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:29:31.426691 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-m89nq\" is forbidden: User \"system:node:ip-10-0-143-102.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-102.ec2.internal' and this object" podUID="ebe48450-2c4e-4d68-89d6-b649337d3f0d" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m89nq" Jun 09 02:29:31.427468 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:31.427422 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b09e2f0c-4574-42b4-ad9a-c392ce7c054d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b09e2f0c-4574-42b4-ad9a-c392ce7c054d" (UID: "b09e2f0c-4574-42b4-ad9a-c392ce7c054d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 02:29:31.442853 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:31.442831 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zl9s7"] Jun 09 02:29:31.444999 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:29:31.444978 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cb218b6_1f4a_48da_92d0_af90f2758214.slice/crio-b44c145282452c37820b892611887f5a8e0640691c7bf9b4f1e12c7ec2263902 WatchSource:0}: Error finding container b44c145282452c37820b892611887f5a8e0640691c7bf9b4f1e12c7ec2263902: Status 404 returned error can't find the container with id b44c145282452c37820b892611887f5a8e0640691c7bf9b4f1e12c7ec2263902 Jun 09 02:29:31.465046 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:31.465027 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tr8cg"] Jun 09 02:29:31.465649 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:29:31.465625 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f2181e2_aded_4cdc_bebe_60b211f50f45.slice/crio-87b3551862500cd046e23c00985e1571f2e1237a96a55b30d0115878a3509ac4 WatchSource:0}: Error finding container 87b3551862500cd046e23c00985e1571f2e1237a96a55b30d0115878a3509ac4: Status 404 returned error can't find the container with id 87b3551862500cd046e23c00985e1571f2e1237a96a55b30d0115878a3509ac4 Jun 09 02:29:31.522623 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:31.522606 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bpx7w\" (UniqueName: \"kubernetes.io/projected/ebe48450-2c4e-4d68-89d6-b649337d3f0d-kube-api-access-bpx7w\") pod \"ebe48450-2c4e-4d68-89d6-b649337d3f0d\" (UID: \"ebe48450-2c4e-4d68-89d6-b649337d3f0d\") " Jun 09 02:29:31.522885 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:31.522868 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pdrgx\" (UniqueName: \"kubernetes.io/projected/b09e2f0c-4574-42b4-ad9a-c392ce7c054d-kube-api-access-pdrgx\") on node \"ip-10-0-143-102.ec2.internal\" DevicePath \"\"" Jun 09 02:29:31.522926 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:31.522892 2573 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b09e2f0c-4574-42b4-ad9a-c392ce7c054d-console-serving-cert\") on node \"ip-10-0-143-102.ec2.internal\" DevicePath \"\"" Jun 09 02:29:31.522926 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:31.522907 2573 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b09e2f0c-4574-42b4-ad9a-c392ce7c054d-console-oauth-config\") on node \"ip-10-0-143-102.ec2.internal\" DevicePath \"\"" Jun 09 02:29:31.522926 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:31.522918 2573 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b09e2f0c-4574-42b4-ad9a-c392ce7c054d-service-ca\") on node \"ip-10-0-143-102.ec2.internal\" DevicePath \"\"" Jun 09 02:29:31.524278 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:31.524261 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ebe48450-2c4e-4d68-89d6-b649337d3f0d-kube-api-access-bpx7w" (OuterVolumeSpecName: "kube-api-access-bpx7w") pod "ebe48450-2c4e-4d68-89d6-b649337d3f0d" (UID: "ebe48450-2c4e-4d68-89d6-b649337d3f0d"). InnerVolumeSpecName "kube-api-access-bpx7w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 02:29:31.623547 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:31.623523 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bpx7w\" (UniqueName: \"kubernetes.io/projected/ebe48450-2c4e-4d68-89d6-b649337d3f0d-kube-api-access-bpx7w\") on node \"ip-10-0-143-102.ec2.internal\" DevicePath \"\"" Jun 09 02:29:32.050863 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:32.050813 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:29:32.055471 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:32.055438 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tr8cg" event={"ID":"8f2181e2-aded-4cdc-bebe-60b211f50f45","Type":"ContainerStarted","Data":"2427175331eea4766970b81cd369dd74ad1b5c8c1ea609d2269f819f29e4b4c7"} Jun 09 02:29:32.055624 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:32.055503 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tr8cg" Jun 09 02:29:32.055624 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:32.055528 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tr8cg" event={"ID":"8f2181e2-aded-4cdc-bebe-60b211f50f45","Type":"ContainerStarted","Data":"87b3551862500cd046e23c00985e1571f2e1237a96a55b30d0115878a3509ac4"} Jun 09 02:29:32.056997 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:32.056972 2573 generic.go:356] "Generic (PLEG): container finished" podID="b09e2f0c-4574-42b4-ad9a-c392ce7c054d" containerID="81a5abb8b38d6500b27ad73fa129dbc5c334842396e6990c2957c88796069e38" exitCode=0 Jun 09 02:29:32.057157 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:32.057020 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-855596df4f-plgmb" Jun 09 02:29:32.057157 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:32.057113 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-855596df4f-plgmb" event={"ID":"b09e2f0c-4574-42b4-ad9a-c392ce7c054d","Type":"ContainerDied","Data":"81a5abb8b38d6500b27ad73fa129dbc5c334842396e6990c2957c88796069e38"} Jun 09 02:29:32.057292 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:32.057207 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-855596df4f-plgmb" event={"ID":"b09e2f0c-4574-42b4-ad9a-c392ce7c054d","Type":"ContainerDied","Data":"925437199b34c3bed10030cec38fd590418f678c5ddf065caea53d9210398475"} Jun 09 02:29:32.057292 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:32.057241 2573 scope.go:117] "RemoveContainer" containerID="81a5abb8b38d6500b27ad73fa129dbc5c334842396e6990c2957c88796069e38" Jun 09 02:29:32.057662 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:29:32.057630 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-m89nq\" is forbidden: User \"system:node:ip-10-0-143-102.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-102.ec2.internal' and this object" podUID="ebe48450-2c4e-4d68-89d6-b649337d3f0d" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m89nq" Jun 09 02:29:32.058785 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:32.058734 2573 generic.go:356] "Generic (PLEG): container finished" podID="ebe48450-2c4e-4d68-89d6-b649337d3f0d" containerID="eaac4949fa2d0203b2a8ab451e51c24e800e7b275707d40889fbbcd1dcebff53" exitCode=0 Jun 09 02:29:32.058865 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:32.058849 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m89nq" Jun 09 02:29:32.061150 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:32.061109 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zl9s7" event={"ID":"9cb218b6-1f4a-48da-92d0-af90f2758214","Type":"ContainerStarted","Data":"b44c145282452c37820b892611887f5a8e0640691c7bf9b4f1e12c7ec2263902"} Jun 09 02:29:32.063643 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:32.063619 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-7mj98" event={"ID":"3065ce1e-53d8-40e0-a9e7-2d7314d6aef3","Type":"ContainerStarted","Data":"d73d113731805eb53baf5d4e6461eebdd53ec6da4e0ff91303220bcd11722600"} Jun 09 02:29:32.068892 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:32.068871 2573 scope.go:117] "RemoveContainer" containerID="81a5abb8b38d6500b27ad73fa129dbc5c334842396e6990c2957c88796069e38" Jun 09 02:29:32.069251 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:29:32.069223 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"81a5abb8b38d6500b27ad73fa129dbc5c334842396e6990c2957c88796069e38\": container with ID starting with 81a5abb8b38d6500b27ad73fa129dbc5c334842396e6990c2957c88796069e38 not found: ID does not exist" containerID="81a5abb8b38d6500b27ad73fa129dbc5c334842396e6990c2957c88796069e38" Jun 09 02:29:32.069386 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:32.069260 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81a5abb8b38d6500b27ad73fa129dbc5c334842396e6990c2957c88796069e38"} err="failed to get container status \"81a5abb8b38d6500b27ad73fa129dbc5c334842396e6990c2957c88796069e38\": rpc error: code = NotFound desc = could not find container \"81a5abb8b38d6500b27ad73fa129dbc5c334842396e6990c2957c88796069e38\": container with ID starting with 81a5abb8b38d6500b27ad73fa129dbc5c334842396e6990c2957c88796069e38 not found: ID does not exist" Jun 09 02:29:32.069386 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:32.069280 2573 scope.go:117] "RemoveContainer" containerID="eaac4949fa2d0203b2a8ab451e51c24e800e7b275707d40889fbbcd1dcebff53" Jun 09 02:29:32.078331 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:32.078283 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tr8cg" podStartSLOduration=13.078270948 podStartE2EDuration="13.078270948s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:29:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:29:32.076915683 +0000 UTC m=+588.024033019" watchObservedRunningTime="2026-06-09 02:29:32.078270948 +0000 UTC m=+588.025388288" Jun 09 02:29:32.079231 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:32.079210 2573 scope.go:117] "RemoveContainer" containerID="eaac4949fa2d0203b2a8ab451e51c24e800e7b275707d40889fbbcd1dcebff53" Jun 09 02:29:32.079571 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:29:32.079547 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eaac4949fa2d0203b2a8ab451e51c24e800e7b275707d40889fbbcd1dcebff53\": container with ID starting with eaac4949fa2d0203b2a8ab451e51c24e800e7b275707d40889fbbcd1dcebff53 not found: ID does not exist" containerID="eaac4949fa2d0203b2a8ab451e51c24e800e7b275707d40889fbbcd1dcebff53" Jun 09 02:29:32.079732 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:32.079698 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eaac4949fa2d0203b2a8ab451e51c24e800e7b275707d40889fbbcd1dcebff53"} err="failed to get container status \"eaac4949fa2d0203b2a8ab451e51c24e800e7b275707d40889fbbcd1dcebff53\": rpc error: code = NotFound desc = could not find container \"eaac4949fa2d0203b2a8ab451e51c24e800e7b275707d40889fbbcd1dcebff53\": container with ID starting with eaac4949fa2d0203b2a8ab451e51c24e800e7b275707d40889fbbcd1dcebff53 not found: ID does not exist" Jun 09 02:29:32.094141 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:32.094099 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-7mj98" podStartSLOduration=2.01087091 podStartE2EDuration="23.09406865s" totalImagesPullingTime="21.08319774s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:29:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:29:32.092237792 +0000 UTC m=+588.039355133" watchObservedRunningTime="2026-06-09 02:29:32.09406865 +0000 UTC m=+588.041185990" Jun 09 02:29:32.094253 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:29:32.094213 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-m89nq\" is forbidden: User \"system:node:ip-10-0-143-102.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-102.ec2.internal' and this object" podUID="ebe48450-2c4e-4d68-89d6-b649337d3f0d" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m89nq" Jun 09 02:29:32.115276 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:32.115234 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-855596df4f-plgmb"] Jun 09 02:29:32.116125 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:32.116099 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:29:32.118461 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:32.118440 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-855596df4f-plgmb"] Jun 09 02:29:32.468143 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:32.468001 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b09e2f0c-4574-42b4-ad9a-c392ce7c054d" path="/var/lib/kubelet/pods/b09e2f0c-4574-42b4-ad9a-c392ce7c054d/volumes" Jun 09 02:29:32.470366 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:32.468750 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ebe48450-2c4e-4d68-89d6-b649337d3f0d" path="/var/lib/kubelet/pods/ebe48450-2c4e-4d68-89d6-b649337d3f0d/volumes" Jun 09 02:29:33.803104 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:29:33.803035 2573 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-6fb7879bc9-8wqg4_kuadrant-system_edd7848a-e948-4293-8f70-0fb8189db8cd_0(ab6be57f4f59f3ec71ef01a15662604231d460a929b36cdeda04da333b77ee42): error adding pod kuadrant-system_kuadrant-operator-controller-manager-6fb7879bc9-8wqg4 to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}" Jun 09 02:29:33.803435 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:29:33.803132 2573 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-6fb7879bc9-8wqg4_kuadrant-system_edd7848a-e948-4293-8f70-0fb8189db8cd_0(ab6be57f4f59f3ec71ef01a15662604231d460a929b36cdeda04da333b77ee42): error adding pod kuadrant-system_kuadrant-operator-controller-manager-6fb7879bc9-8wqg4 to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8wqg4" Jun 09 02:29:34.078092 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:34.077999 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8wqg4" Jun 09 02:29:34.080220 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:29:34.080183 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-8wqg4\" is forbidden: User \"system:node:ip-10-0-143-102.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-102.ec2.internal' and this object" podUID="edd7848a-e948-4293-8f70-0fb8189db8cd" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8wqg4" Jun 09 02:29:34.086392 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:34.086370 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8wqg4" Jun 09 02:29:34.088915 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:29:34.088881 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-8wqg4\" is forbidden: User \"system:node:ip-10-0-143-102.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-102.ec2.internal' and this object" podUID="edd7848a-e948-4293-8f70-0fb8189db8cd" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8wqg4" Jun 09 02:29:34.149324 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:34.149301 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9kfpx\" (UniqueName: \"kubernetes.io/projected/edd7848a-e948-4293-8f70-0fb8189db8cd-kube-api-access-9kfpx\") pod \"edd7848a-e948-4293-8f70-0fb8189db8cd\" (UID: \"edd7848a-e948-4293-8f70-0fb8189db8cd\") " Jun 09 02:29:34.149462 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:34.149447 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/edd7848a-e948-4293-8f70-0fb8189db8cd-extensions-socket-volume\") pod \"edd7848a-e948-4293-8f70-0fb8189db8cd\" (UID: \"edd7848a-e948-4293-8f70-0fb8189db8cd\") " Jun 09 02:29:34.149722 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:34.149692 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/edd7848a-e948-4293-8f70-0fb8189db8cd-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "edd7848a-e948-4293-8f70-0fb8189db8cd" (UID: "edd7848a-e948-4293-8f70-0fb8189db8cd"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 02:29:34.151717 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:34.151693 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/edd7848a-e948-4293-8f70-0fb8189db8cd-kube-api-access-9kfpx" (OuterVolumeSpecName: "kube-api-access-9kfpx") pod "edd7848a-e948-4293-8f70-0fb8189db8cd" (UID: "edd7848a-e948-4293-8f70-0fb8189db8cd"). InnerVolumeSpecName "kube-api-access-9kfpx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 02:29:34.250893 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:34.250872 2573 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/edd7848a-e948-4293-8f70-0fb8189db8cd-extensions-socket-volume\") on node \"ip-10-0-143-102.ec2.internal\" DevicePath \"\"" Jun 09 02:29:34.250893 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:34.250891 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9kfpx\" (UniqueName: \"kubernetes.io/projected/edd7848a-e948-4293-8f70-0fb8189db8cd-kube-api-access-9kfpx\") on node \"ip-10-0-143-102.ec2.internal\" DevicePath \"\"" Jun 09 02:29:34.467703 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:29:34.467614 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-8wqg4\" is forbidden: User \"system:node:ip-10-0-143-102.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-102.ec2.internal' and this object" podUID="edd7848a-e948-4293-8f70-0fb8189db8cd" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8wqg4" Jun 09 02:29:34.469639 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:34.469611 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="edd7848a-e948-4293-8f70-0fb8189db8cd" path="/var/lib/kubelet/pods/edd7848a-e948-4293-8f70-0fb8189db8cd/volumes" Jun 09 02:29:35.084758 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:35.084727 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8wqg4" Jun 09 02:29:35.086948 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:29:35.086752 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-8wqg4\" is forbidden: User \"system:node:ip-10-0-143-102.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-102.ec2.internal' and this object" podUID="edd7848a-e948-4293-8f70-0fb8189db8cd" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8wqg4" Jun 09 02:29:35.089210 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:29:35.089162 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-8wqg4\" is forbidden: User \"system:node:ip-10-0-143-102.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-102.ec2.internal' and this object" podUID="edd7848a-e948-4293-8f70-0fb8189db8cd" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8wqg4" Jun 09 02:29:36.091491 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:36.091459 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zl9s7" event={"ID":"9cb218b6-1f4a-48da-92d0-af90f2758214","Type":"ContainerStarted","Data":"20b4b094337a41b39136827cf105b63711e2450475f5328a8f70f7b9626ee676"} Jun 09 02:29:36.091888 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:36.091535 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zl9s7" Jun 09 02:29:36.111374 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:29:36.111336 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-8wqg4\" is forbidden: User \"system:node:ip-10-0-143-102.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-102.ec2.internal' and this object" podUID="edd7848a-e948-4293-8f70-0fb8189db8cd" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8wqg4" Jun 09 02:29:36.112417 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:36.112380 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zl9s7" podStartSLOduration=13.069260364 podStartE2EDuration="17.112365448s" totalImagesPullingTime="4.043105084s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:29:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:29:36.109593522 +0000 UTC m=+592.056710866" watchObservedRunningTime="2026-06-09 02:29:36.112365448 +0000 UTC m=+592.059482789" Jun 09 02:29:43.073270 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:43.073237 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tr8cg" Jun 09 02:29:44.460574 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:44.460544 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-9hfq7_41d0740b-ac9d-47bd-92c3-8c89c459ae7c/console-operator/1.log" Jun 09 02:29:44.461022 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:44.460703 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-9hfq7_41d0740b-ac9d-47bd-92c3-8c89c459ae7c/console-operator/1.log" Jun 09 02:29:44.469696 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:44.469675 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jz2q7_37e9e0fa-4abd-4eeb-8671-934808ecdf78/ovn-acl-logging/0.log" Jun 09 02:29:44.469836 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:44.469760 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jz2q7_37e9e0fa-4abd-4eeb-8671-934808ecdf78/ovn-acl-logging/0.log" Jun 09 02:29:47.098938 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:47.098910 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zl9s7" Jun 09 02:29:47.331443 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:47.331410 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6s79g"] Jun 09 02:29:47.331847 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:47.331831 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b09e2f0c-4574-42b4-ad9a-c392ce7c054d" containerName="console" Jun 09 02:29:47.331847 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:47.331849 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="b09e2f0c-4574-42b4-ad9a-c392ce7c054d" containerName="console" Jun 09 02:29:47.331948 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:47.331914 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="b09e2f0c-4574-42b4-ad9a-c392ce7c054d" containerName="console" Jun 09 02:29:47.335008 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:47.334992 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6s79g" Jun 09 02:29:47.347202 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:47.347178 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6s79g"] Jun 09 02:29:47.451602 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:47.451578 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/675c4fd8-7483-41f2-8496-998bb595b3b6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-6s79g\" (UID: \"675c4fd8-7483-41f2-8496-998bb595b3b6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6s79g" Jun 09 02:29:47.451709 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:47.451610 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kz6xd\" (UniqueName: \"kubernetes.io/projected/675c4fd8-7483-41f2-8496-998bb595b3b6-kube-api-access-kz6xd\") pod \"kuadrant-operator-controller-manager-86878c769f-6s79g\" (UID: \"675c4fd8-7483-41f2-8496-998bb595b3b6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6s79g" Jun 09 02:29:47.553002 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:47.552977 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/675c4fd8-7483-41f2-8496-998bb595b3b6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-6s79g\" (UID: \"675c4fd8-7483-41f2-8496-998bb595b3b6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6s79g" Jun 09 02:29:47.553242 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:47.553007 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kz6xd\" (UniqueName: \"kubernetes.io/projected/675c4fd8-7483-41f2-8496-998bb595b3b6-kube-api-access-kz6xd\") pod \"kuadrant-operator-controller-manager-86878c769f-6s79g\" (UID: \"675c4fd8-7483-41f2-8496-998bb595b3b6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6s79g" Jun 09 02:29:47.553480 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:47.553457 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/675c4fd8-7483-41f2-8496-998bb595b3b6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-6s79g\" (UID: \"675c4fd8-7483-41f2-8496-998bb595b3b6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6s79g" Jun 09 02:29:47.561087 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:47.561058 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kz6xd\" (UniqueName: \"kubernetes.io/projected/675c4fd8-7483-41f2-8496-998bb595b3b6-kube-api-access-kz6xd\") pod \"kuadrant-operator-controller-manager-86878c769f-6s79g\" (UID: \"675c4fd8-7483-41f2-8496-998bb595b3b6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6s79g" Jun 09 02:29:47.645646 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:47.645600 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6s79g" Jun 09 02:29:47.772527 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:47.772499 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6s79g"] Jun 09 02:29:47.773707 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:29:47.773681 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod675c4fd8_7483_41f2_8496_998bb595b3b6.slice/crio-95a5744b6edbbb1959c1a7931c926df53c39db54d8a51e70c5acce8ecad0489e WatchSource:0}: Error finding container 95a5744b6edbbb1959c1a7931c926df53c39db54d8a51e70c5acce8ecad0489e: Status 404 returned error can't find the container with id 95a5744b6edbbb1959c1a7931c926df53c39db54d8a51e70c5acce8ecad0489e Jun 09 02:29:48.164633 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:48.164606 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6s79g" event={"ID":"675c4fd8-7483-41f2-8496-998bb595b3b6","Type":"ContainerStarted","Data":"0bf3aa6a2d9a892ecb0432043f0317171ab6a60dcbcb31ff20aa68b0c8322b2d"} Jun 09 02:29:48.165044 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:48.164658 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6s79g" event={"ID":"675c4fd8-7483-41f2-8496-998bb595b3b6","Type":"ContainerStarted","Data":"95a5744b6edbbb1959c1a7931c926df53c39db54d8a51e70c5acce8ecad0489e"} Jun 09 02:29:48.165044 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:48.164681 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6s79g" Jun 09 02:29:48.182701 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:48.182443 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6s79g" podStartSLOduration=1.182425663 podStartE2EDuration="1.182425663s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:29:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:29:48.180372435 +0000 UTC m=+604.127489776" watchObservedRunningTime="2026-06-09 02:29:48.182425663 +0000 UTC m=+604.129543005" Jun 09 02:29:51.323891 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:51.323845 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:29:54.030028 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:54.029990 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:29:54.087639 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:54.087597 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:29:59.173294 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:59.173210 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6s79g" Jun 09 02:29:59.218658 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:59.218627 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zl9s7"] Jun 09 02:29:59.218880 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:59.218857 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zl9s7" podUID="9cb218b6-1f4a-48da-92d0-af90f2758214" containerName="manager" containerID="cri-o://20b4b094337a41b39136827cf105b63711e2450475f5328a8f70f7b9626ee676" gracePeriod=10 Jun 09 02:29:59.496457 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:59.496436 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zl9s7" Jun 09 02:29:59.657124 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:59.657094 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mbzzq\" (UniqueName: \"kubernetes.io/projected/9cb218b6-1f4a-48da-92d0-af90f2758214-kube-api-access-mbzzq\") pod \"9cb218b6-1f4a-48da-92d0-af90f2758214\" (UID: \"9cb218b6-1f4a-48da-92d0-af90f2758214\") " Jun 09 02:29:59.657287 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:59.657146 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9cb218b6-1f4a-48da-92d0-af90f2758214-extensions-socket-volume\") pod \"9cb218b6-1f4a-48da-92d0-af90f2758214\" (UID: \"9cb218b6-1f4a-48da-92d0-af90f2758214\") " Jun 09 02:29:59.657526 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:59.657503 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cb218b6-1f4a-48da-92d0-af90f2758214-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "9cb218b6-1f4a-48da-92d0-af90f2758214" (UID: "9cb218b6-1f4a-48da-92d0-af90f2758214"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 02:29:59.659194 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:59.659175 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9cb218b6-1f4a-48da-92d0-af90f2758214-kube-api-access-mbzzq" (OuterVolumeSpecName: "kube-api-access-mbzzq") pod "9cb218b6-1f4a-48da-92d0-af90f2758214" (UID: "9cb218b6-1f4a-48da-92d0-af90f2758214"). InnerVolumeSpecName "kube-api-access-mbzzq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 02:29:59.758036 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:59.757981 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mbzzq\" (UniqueName: \"kubernetes.io/projected/9cb218b6-1f4a-48da-92d0-af90f2758214-kube-api-access-mbzzq\") on node \"ip-10-0-143-102.ec2.internal\" DevicePath \"\"" Jun 09 02:29:59.758036 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:29:59.758002 2573 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9cb218b6-1f4a-48da-92d0-af90f2758214-extensions-socket-volume\") on node \"ip-10-0-143-102.ec2.internal\" DevicePath \"\"" Jun 09 02:30:00.237261 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:30:00.237228 2573 generic.go:356] "Generic (PLEG): container finished" podID="9cb218b6-1f4a-48da-92d0-af90f2758214" containerID="20b4b094337a41b39136827cf105b63711e2450475f5328a8f70f7b9626ee676" exitCode=0 Jun 09 02:30:00.237626 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:30:00.237263 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zl9s7" Jun 09 02:30:00.237626 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:30:00.237305 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zl9s7" event={"ID":"9cb218b6-1f4a-48da-92d0-af90f2758214","Type":"ContainerDied","Data":"20b4b094337a41b39136827cf105b63711e2450475f5328a8f70f7b9626ee676"} Jun 09 02:30:00.237626 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:30:00.237352 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zl9s7" event={"ID":"9cb218b6-1f4a-48da-92d0-af90f2758214","Type":"ContainerDied","Data":"b44c145282452c37820b892611887f5a8e0640691c7bf9b4f1e12c7ec2263902"} Jun 09 02:30:00.237626 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:30:00.237373 2573 scope.go:117] "RemoveContainer" containerID="20b4b094337a41b39136827cf105b63711e2450475f5328a8f70f7b9626ee676" Jun 09 02:30:00.246442 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:30:00.246424 2573 scope.go:117] "RemoveContainer" containerID="20b4b094337a41b39136827cf105b63711e2450475f5328a8f70f7b9626ee676" Jun 09 02:30:00.246658 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:30:00.246641 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"20b4b094337a41b39136827cf105b63711e2450475f5328a8f70f7b9626ee676\": container with ID starting with 20b4b094337a41b39136827cf105b63711e2450475f5328a8f70f7b9626ee676 not found: ID does not exist" containerID="20b4b094337a41b39136827cf105b63711e2450475f5328a8f70f7b9626ee676" Jun 09 02:30:00.246709 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:30:00.246667 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20b4b094337a41b39136827cf105b63711e2450475f5328a8f70f7b9626ee676"} err="failed to get container status \"20b4b094337a41b39136827cf105b63711e2450475f5328a8f70f7b9626ee676\": rpc error: code = NotFound desc = could not find container \"20b4b094337a41b39136827cf105b63711e2450475f5328a8f70f7b9626ee676\": container with ID starting with 20b4b094337a41b39136827cf105b63711e2450475f5328a8f70f7b9626ee676 not found: ID does not exist" Jun 09 02:30:00.258897 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:30:00.258870 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zl9s7"] Jun 09 02:30:00.262555 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:30:00.262535 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zl9s7"] Jun 09 02:30:00.467141 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:30:00.467117 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9cb218b6-1f4a-48da-92d0-af90f2758214" path="/var/lib/kubelet/pods/9cb218b6-1f4a-48da-92d0-af90f2758214/volumes" Jun 09 02:30:03.437008 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:30:03.436973 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:30:03.536483 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:30:03.536451 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:30:06.926535 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:30:06.926506 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:30:08.955236 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:30:08.955201 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:30:09.061551 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:30:09.061515 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:30:09.163802 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:30:09.163756 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:30:09.778182 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:30:09.778151 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:30:09.839800 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:30:09.839774 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:30:13.914771 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:30:13.914721 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:30:13.962691 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:30:13.962652 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:30:30.149902 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:30:30.149842 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:30:30.248696 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:30:30.248662 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:30:30.615154 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:30:30.615111 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:30:41.030700 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:30:41.030655 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:30:41.125963 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:30:41.125930 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:30:41.312182 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:30:41.312154 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:30:42.059530 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:30:42.059495 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748g4vg6"] Jun 09 02:30:42.059948 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:30:42.059932 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9cb218b6-1f4a-48da-92d0-af90f2758214" containerName="manager" Jun 09 02:30:42.059948 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:30:42.059948 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="9cb218b6-1f4a-48da-92d0-af90f2758214" containerName="manager" Jun 09 02:30:42.060030 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:30:42.060020 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="9cb218b6-1f4a-48da-92d0-af90f2758214" containerName="manager" Jun 09 02:30:42.063743 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:30:42.063711 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748g4vg6" Jun 09 02:30:42.066481 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:30:42.066458 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 09 02:30:42.066600 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:30:42.066516 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 09 02:30:42.067737 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:30:42.067710 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-x8s7r\"" Jun 09 02:30:42.071225 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:30:42.071202 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748g4vg6"] Jun 09 02:30:42.092622 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:30:42.092593 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgc2b\" (UniqueName: \"kubernetes.io/projected/8a608f1f-bb74-472f-b99c-674068419db2-kube-api-access-wgc2b\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748g4vg6\" (UID: \"8a608f1f-bb74-472f-b99c-674068419db2\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748g4vg6" Jun 09 02:30:42.092737 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:30:42.092713 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a608f1f-bb74-472f-b99c-674068419db2-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748g4vg6\" (UID: \"8a608f1f-bb74-472f-b99c-674068419db2\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748g4vg6" Jun 09 02:30:42.092807 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:30:42.092752 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8a608f1f-bb74-472f-b99c-674068419db2-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748g4vg6\" (UID: \"8a608f1f-bb74-472f-b99c-674068419db2\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748g4vg6" Jun 09 02:30:42.193331 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:30:42.193298 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a608f1f-bb74-472f-b99c-674068419db2-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748g4vg6\" (UID: \"8a608f1f-bb74-472f-b99c-674068419db2\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748g4vg6" Jun 09 02:30:42.193446 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:30:42.193336 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8a608f1f-bb74-472f-b99c-674068419db2-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748g4vg6\" (UID: \"8a608f1f-bb74-472f-b99c-674068419db2\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748g4vg6" Jun 09 02:30:42.193446 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:30:42.193370 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgc2b\" (UniqueName: \"kubernetes.io/projected/8a608f1f-bb74-472f-b99c-674068419db2-kube-api-access-wgc2b\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748g4vg6\" (UID: \"8a608f1f-bb74-472f-b99c-674068419db2\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748g4vg6" Jun 09 02:30:42.193773 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:30:42.193751 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a608f1f-bb74-472f-b99c-674068419db2-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748g4vg6\" (UID: \"8a608f1f-bb74-472f-b99c-674068419db2\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748g4vg6" Jun 09 02:30:42.193815 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:30:42.193774 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8a608f1f-bb74-472f-b99c-674068419db2-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748g4vg6\" (UID: \"8a608f1f-bb74-472f-b99c-674068419db2\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748g4vg6" Jun 09 02:30:42.204501 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:30:42.204475 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgc2b\" (UniqueName: \"kubernetes.io/projected/8a608f1f-bb74-472f-b99c-674068419db2-kube-api-access-wgc2b\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748g4vg6\" (UID: \"8a608f1f-bb74-472f-b99c-674068419db2\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748g4vg6" Jun 09 02:30:42.376064 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:30:42.376008 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748g4vg6" Jun 09 02:30:42.506955 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:30:42.506927 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748g4vg6"] Jun 09 02:30:42.507102 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:30:42.507066 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a608f1f_bb74_472f_b99c_674068419db2.slice/crio-bf72b5d07bc347f649450087243fa2c6e8fae3786febf66970b3cc1da3abdc43 WatchSource:0}: Error finding container bf72b5d07bc347f649450087243fa2c6e8fae3786febf66970b3cc1da3abdc43: Status 404 returned error can't find the container with id bf72b5d07bc347f649450087243fa2c6e8fae3786febf66970b3cc1da3abdc43 Jun 09 02:30:43.508167 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:30:43.508090 2573 generic.go:356] "Generic (PLEG): container finished" podID="8a608f1f-bb74-472f-b99c-674068419db2" containerID="2ddfb752470fe11ec89f539daf93621bdc799217b0e0062ae38e6c2a76e38b58" exitCode=0 Jun 09 02:30:43.508511 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:30:43.508167 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748g4vg6" event={"ID":"8a608f1f-bb74-472f-b99c-674068419db2","Type":"ContainerDied","Data":"2ddfb752470fe11ec89f539daf93621bdc799217b0e0062ae38e6c2a76e38b58"} Jun 09 02:30:43.508511 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:30:43.508223 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748g4vg6" event={"ID":"8a608f1f-bb74-472f-b99c-674068419db2","Type":"ContainerStarted","Data":"bf72b5d07bc347f649450087243fa2c6e8fae3786febf66970b3cc1da3abdc43"} Jun 09 02:30:44.514832 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:30:44.514807 2573 generic.go:356] "Generic (PLEG): container finished" podID="8a608f1f-bb74-472f-b99c-674068419db2" containerID="69fb1875e37d5dd98b8babe0d11f7369ca9b480fb72d56e3c56e7ad1e1d5fddf" exitCode=0 Jun 09 02:30:44.515143 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:30:44.514893 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748g4vg6" event={"ID":"8a608f1f-bb74-472f-b99c-674068419db2","Type":"ContainerDied","Data":"69fb1875e37d5dd98b8babe0d11f7369ca9b480fb72d56e3c56e7ad1e1d5fddf"} Jun 09 02:30:45.527194 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:30:45.527162 2573 generic.go:356] "Generic (PLEG): container finished" podID="8a608f1f-bb74-472f-b99c-674068419db2" containerID="1b84f7bce91e7c0dfd8b0ea6bdeb440366bb76f313c41397d02ad26b65469801" exitCode=0 Jun 09 02:30:45.527557 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:30:45.527249 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748g4vg6" event={"ID":"8a608f1f-bb74-472f-b99c-674068419db2","Type":"ContainerDied","Data":"1b84f7bce91e7c0dfd8b0ea6bdeb440366bb76f313c41397d02ad26b65469801"} Jun 09 02:30:46.661992 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:30:46.661970 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748g4vg6" Jun 09 02:30:46.729608 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:30:46.729581 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8a608f1f-bb74-472f-b99c-674068419db2-util\") pod \"8a608f1f-bb74-472f-b99c-674068419db2\" (UID: \"8a608f1f-bb74-472f-b99c-674068419db2\") " Jun 09 02:30:46.729736 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:30:46.729624 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a608f1f-bb74-472f-b99c-674068419db2-bundle\") pod \"8a608f1f-bb74-472f-b99c-674068419db2\" (UID: \"8a608f1f-bb74-472f-b99c-674068419db2\") " Jun 09 02:30:46.729736 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:30:46.729712 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wgc2b\" (UniqueName: \"kubernetes.io/projected/8a608f1f-bb74-472f-b99c-674068419db2-kube-api-access-wgc2b\") pod \"8a608f1f-bb74-472f-b99c-674068419db2\" (UID: \"8a608f1f-bb74-472f-b99c-674068419db2\") " Jun 09 02:30:46.730117 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:30:46.730068 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a608f1f-bb74-472f-b99c-674068419db2-bundle" (OuterVolumeSpecName: "bundle") pod "8a608f1f-bb74-472f-b99c-674068419db2" (UID: "8a608f1f-bb74-472f-b99c-674068419db2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 02:30:46.731582 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:30:46.731557 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a608f1f-bb74-472f-b99c-674068419db2-kube-api-access-wgc2b" (OuterVolumeSpecName: "kube-api-access-wgc2b") pod "8a608f1f-bb74-472f-b99c-674068419db2" (UID: "8a608f1f-bb74-472f-b99c-674068419db2"). InnerVolumeSpecName "kube-api-access-wgc2b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 02:30:46.735022 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:30:46.734980 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a608f1f-bb74-472f-b99c-674068419db2-util" (OuterVolumeSpecName: "util") pod "8a608f1f-bb74-472f-b99c-674068419db2" (UID: "8a608f1f-bb74-472f-b99c-674068419db2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 02:30:46.830971 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:30:46.830945 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8a608f1f-bb74-472f-b99c-674068419db2-util\") on node \"ip-10-0-143-102.ec2.internal\" DevicePath \"\"" Jun 09 02:30:46.830971 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:30:46.830968 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a608f1f-bb74-472f-b99c-674068419db2-bundle\") on node \"ip-10-0-143-102.ec2.internal\" DevicePath \"\"" Jun 09 02:30:46.831132 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:30:46.830981 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wgc2b\" (UniqueName: \"kubernetes.io/projected/8a608f1f-bb74-472f-b99c-674068419db2-kube-api-access-wgc2b\") on node \"ip-10-0-143-102.ec2.internal\" DevicePath \"\"" Jun 09 02:30:47.540905 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:30:47.540873 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748g4vg6" Jun 09 02:30:47.540905 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:30:47.540891 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748g4vg6" event={"ID":"8a608f1f-bb74-472f-b99c-674068419db2","Type":"ContainerDied","Data":"bf72b5d07bc347f649450087243fa2c6e8fae3786febf66970b3cc1da3abdc43"} Jun 09 02:30:47.541198 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:30:47.540937 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bf72b5d07bc347f649450087243fa2c6e8fae3786febf66970b3cc1da3abdc43" Jun 09 02:30:54.905735 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:30:54.905694 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-tlb4x"] Jun 09 02:30:54.906184 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:30:54.906132 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a608f1f-bb74-472f-b99c-674068419db2" containerName="extract" Jun 09 02:30:54.906184 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:30:54.906146 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a608f1f-bb74-472f-b99c-674068419db2" containerName="extract" Jun 09 02:30:54.906184 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:30:54.906164 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a608f1f-bb74-472f-b99c-674068419db2" containerName="util" Jun 09 02:30:54.906184 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:30:54.906171 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a608f1f-bb74-472f-b99c-674068419db2" containerName="util" Jun 09 02:30:54.906331 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:30:54.906188 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a608f1f-bb74-472f-b99c-674068419db2" containerName="pull" Jun 09 02:30:54.906331 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:30:54.906194 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a608f1f-bb74-472f-b99c-674068419db2" containerName="pull" Jun 09 02:30:54.906331 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:30:54.906258 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a608f1f-bb74-472f-b99c-674068419db2" containerName="extract" Jun 09 02:30:54.909757 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:30:54.909732 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-tlb4x" Jun 09 02:30:54.913435 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:30:54.913401 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 09 02:30:54.913574 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:30:54.913401 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 09 02:30:54.913574 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:30:54.913562 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-4pbgh\"" Jun 09 02:30:54.916671 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:30:54.916645 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-tlb4x"] Jun 09 02:30:54.999385 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:30:54.999358 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mb8sj\" (UniqueName: \"kubernetes.io/projected/999d64d0-7cc3-4914-9b45-93f900ce8346-kube-api-access-mb8sj\") pod \"keycloak-operator-d67dbbb48-tlb4x\" (UID: \"999d64d0-7cc3-4914-9b45-93f900ce8346\") " pod="keycloak-system/keycloak-operator-d67dbbb48-tlb4x" Jun 09 02:30:55.100145 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:30:55.100114 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mb8sj\" (UniqueName: \"kubernetes.io/projected/999d64d0-7cc3-4914-9b45-93f900ce8346-kube-api-access-mb8sj\") pod \"keycloak-operator-d67dbbb48-tlb4x\" (UID: \"999d64d0-7cc3-4914-9b45-93f900ce8346\") " pod="keycloak-system/keycloak-operator-d67dbbb48-tlb4x" Jun 09 02:30:55.109143 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:30:55.109066 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mb8sj\" (UniqueName: \"kubernetes.io/projected/999d64d0-7cc3-4914-9b45-93f900ce8346-kube-api-access-mb8sj\") pod \"keycloak-operator-d67dbbb48-tlb4x\" (UID: \"999d64d0-7cc3-4914-9b45-93f900ce8346\") " pod="keycloak-system/keycloak-operator-d67dbbb48-tlb4x" Jun 09 02:30:55.221648 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:30:55.221587 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-tlb4x" Jun 09 02:30:55.360171 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:30:55.360142 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-tlb4x"] Jun 09 02:30:55.362139 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:30:55.362115 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod999d64d0_7cc3_4914_9b45_93f900ce8346.slice/crio-7cdc319d88498dc76e46b8a6a4b2127704d3aac005f16b60188bcedefe92f6bd WatchSource:0}: Error finding container 7cdc319d88498dc76e46b8a6a4b2127704d3aac005f16b60188bcedefe92f6bd: Status 404 returned error can't find the container with id 7cdc319d88498dc76e46b8a6a4b2127704d3aac005f16b60188bcedefe92f6bd Jun 09 02:30:55.363622 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:30:55.363603 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 02:30:55.587923 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:30:55.587894 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-tlb4x" event={"ID":"999d64d0-7cc3-4914-9b45-93f900ce8346","Type":"ContainerStarted","Data":"7cdc319d88498dc76e46b8a6a4b2127704d3aac005f16b60188bcedefe92f6bd"} Jun 09 02:31:01.636316 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:31:01.636244 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-tlb4x" event={"ID":"999d64d0-7cc3-4914-9b45-93f900ce8346","Type":"ContainerStarted","Data":"449499c9b41592fcce43452a86c8c83a39751ff2a7444a7fa0a88000f64e8045"} Jun 09 02:31:01.663187 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:31:01.656060 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-d67dbbb48-tlb4x" podStartSLOduration=1.6885225190000002 podStartE2EDuration="7.65602847s" totalImagesPullingTime="5.967505951s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:30:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:31:01.652761005 +0000 UTC m=+677.599878347" watchObservedRunningTime="2026-06-09 02:31:01.65602847 +0000 UTC m=+677.603145813" Jun 09 02:31:09.277788 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:31:09.277729 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:31:09.378436 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:31:09.378404 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:31:31.449602 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:31:31.449504 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:31:31.550576 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:31:31.550545 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:31:37.734013 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:31:37.733974 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:31:38.021444 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:31:38.021366 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:31:43.722791 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:31:43.722751 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:31:43.822029 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:31:43.821980 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:31:43.914050 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:31:43.914013 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:31:44.013730 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:31:44.013652 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:31:45.184021 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:31:45.183983 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:31:45.233565 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:31:45.233535 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:31:47.407319 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:31:47.407285 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:31:47.507689 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:31:47.507647 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:32:16.329295 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:32:16.329257 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:32:16.463499 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:32:16.463463 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:33:04.940822 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:33:04.940749 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:33:05.039188 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:33:05.039157 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:33:16.672635 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:33:16.672600 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:33:33.314493 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:33:33.314444 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:33:36.910394 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:33:36.910364 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:33:44.077488 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:33:44.077449 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:33:54.517401 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:33:54.517369 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:34:04.989434 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:34:04.989401 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:34:44.507912 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:34:44.507885 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-9hfq7_41d0740b-ac9d-47bd-92c3-8c89c459ae7c/console-operator/1.log" Jun 09 02:34:44.508550 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:34:44.508530 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-9hfq7_41d0740b-ac9d-47bd-92c3-8c89c459ae7c/console-operator/1.log" Jun 09 02:34:44.514694 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:34:44.514671 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jz2q7_37e9e0fa-4abd-4eeb-8671-934808ecdf78/ovn-acl-logging/0.log" Jun 09 02:34:44.515685 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:34:44.515665 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jz2q7_37e9e0fa-4abd-4eeb-8671-934808ecdf78/ovn-acl-logging/0.log" Jun 09 02:34:46.544839 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:34:46.544796 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:34:46.643692 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:34:46.643657 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:34:47.618344 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:34:47.618314 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:34:47.713772 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:34:47.713742 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:36:13.507710 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:36:13.507625 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:36:15.084444 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:36:15.084393 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:36:15.204377 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:36:15.204345 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-85c84bb9b5-n5tgx"] Jun 09 02:36:15.207910 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:36:15.207889 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-85c84bb9b5-n5tgx" Jun 09 02:36:15.210510 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:36:15.210485 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-mrlr7\"" Jun 09 02:36:15.210618 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:36:15.210485 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 09 02:36:15.211476 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:36:15.211455 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 09 02:36:15.218507 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:36:15.218483 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-85c84bb9b5-n5tgx"] Jun 09 02:36:15.255768 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:36:15.255745 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a8fb4cc0-0c67-4e29-a972-f1c01b912ce3-webhook-cert\") pod \"maas-controller-85c84bb9b5-n5tgx\" (UID: \"a8fb4cc0-0c67-4e29-a972-f1c01b912ce3\") " pod="opendatahub/maas-controller-85c84bb9b5-n5tgx" Jun 09 02:36:15.255864 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:36:15.255791 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmqsr\" (UniqueName: \"kubernetes.io/projected/a8fb4cc0-0c67-4e29-a972-f1c01b912ce3-kube-api-access-kmqsr\") pod \"maas-controller-85c84bb9b5-n5tgx\" (UID: \"a8fb4cc0-0c67-4e29-a972-f1c01b912ce3\") " pod="opendatahub/maas-controller-85c84bb9b5-n5tgx" Jun 09 02:36:15.356712 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:36:15.356656 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a8fb4cc0-0c67-4e29-a972-f1c01b912ce3-webhook-cert\") pod \"maas-controller-85c84bb9b5-n5tgx\" (UID: \"a8fb4cc0-0c67-4e29-a972-f1c01b912ce3\") " pod="opendatahub/maas-controller-85c84bb9b5-n5tgx" Jun 09 02:36:15.356712 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:36:15.356701 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmqsr\" (UniqueName: \"kubernetes.io/projected/a8fb4cc0-0c67-4e29-a972-f1c01b912ce3-kube-api-access-kmqsr\") pod \"maas-controller-85c84bb9b5-n5tgx\" (UID: \"a8fb4cc0-0c67-4e29-a972-f1c01b912ce3\") " pod="opendatahub/maas-controller-85c84bb9b5-n5tgx" Jun 09 02:36:15.359010 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:36:15.358993 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a8fb4cc0-0c67-4e29-a972-f1c01b912ce3-webhook-cert\") pod \"maas-controller-85c84bb9b5-n5tgx\" (UID: \"a8fb4cc0-0c67-4e29-a972-f1c01b912ce3\") " pod="opendatahub/maas-controller-85c84bb9b5-n5tgx" Jun 09 02:36:15.363758 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:36:15.363736 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmqsr\" (UniqueName: \"kubernetes.io/projected/a8fb4cc0-0c67-4e29-a972-f1c01b912ce3-kube-api-access-kmqsr\") pod \"maas-controller-85c84bb9b5-n5tgx\" (UID: \"a8fb4cc0-0c67-4e29-a972-f1c01b912ce3\") " pod="opendatahub/maas-controller-85c84bb9b5-n5tgx" Jun 09 02:36:15.528004 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:36:15.527984 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-85c84bb9b5-n5tgx" Jun 09 02:36:15.651265 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:36:15.651236 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-85c84bb9b5-n5tgx"] Jun 09 02:36:15.653546 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:36:15.653520 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8fb4cc0_0c67_4e29_a972_f1c01b912ce3.slice/crio-a7817d6de22e3b12010623422d2b90503402da58bc03cc6d1ae93e74b4e2e195 WatchSource:0}: Error finding container a7817d6de22e3b12010623422d2b90503402da58bc03cc6d1ae93e74b4e2e195: Status 404 returned error can't find the container with id a7817d6de22e3b12010623422d2b90503402da58bc03cc6d1ae93e74b4e2e195 Jun 09 02:36:15.655214 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:36:15.655198 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 02:36:16.470579 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:36:16.470545 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-85c84bb9b5-n5tgx" event={"ID":"a8fb4cc0-0c67-4e29-a972-f1c01b912ce3","Type":"ContainerStarted","Data":"a7817d6de22e3b12010623422d2b90503402da58bc03cc6d1ae93e74b4e2e195"} Jun 09 02:36:18.481353 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:36:18.481316 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-85c84bb9b5-n5tgx" event={"ID":"a8fb4cc0-0c67-4e29-a972-f1c01b912ce3","Type":"ContainerStarted","Data":"3bbdd7917b7ed111d2d0371635156f81b51fee9719082bb8781d4e1684cad41f"} Jun 09 02:36:18.481830 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:36:18.481450 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-85c84bb9b5-n5tgx" Jun 09 02:36:18.496861 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:36:18.496803 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-85c84bb9b5-n5tgx" podStartSLOduration=1.162517424 podStartE2EDuration="3.496786031s" totalImagesPullingTime="2.334268607s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:36:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:36:18.496550623 +0000 UTC m=+994.443667966" watchObservedRunningTime="2026-06-09 02:36:18.496786031 +0000 UTC m=+994.443903374" Jun 09 02:36:29.493346 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:36:29.493311 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-85c84bb9b5-n5tgx" Jun 09 02:36:49.393135 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:36:49.393101 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:36:49.440457 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:36:49.440411 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:36:56.902014 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:36:56.901968 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:36:57.000617 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:36:57.000584 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:36:57.100939 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:36:57.100910 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:37:05.390711 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:37:05.390666 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:37:11.024324 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:37:11.024286 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:37:11.152699 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:37:11.152669 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:37:43.163487 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:37:43.163395 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:37:43.261238 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:37:43.261207 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:37:43.360858 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:37:43.360831 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:38:07.103911 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:38:07.103879 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:38:12.751927 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:38:12.751889 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:38:12.802495 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:38:12.802460 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:38:12.876945 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:38:12.876921 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:38:12.975394 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:38:12.975368 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:38:13.112142 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:38:13.112119 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:38:13.207275 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:38:13.207251 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:38:29.579909 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:38:29.579871 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:38:29.698322 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:38:29.698286 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:38:29.798915 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:38:29.798889 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:38:35.385773 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:38:35.385734 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:38:35.437966 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:38:35.437934 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:38:43.534463 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:38:43.534419 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:38:43.624599 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:38:43.624562 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:38:43.724292 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:38:43.724266 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:38:43.829119 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:38:43.829040 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:38:52.383907 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:38:52.383871 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:39:00.245239 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:39:00.245125 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:39:00.357596 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:39:00.357561 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:39:00.462572 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:39:00.462539 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:39:05.980001 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:39:05.979956 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:39:06.033504 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:39:06.033476 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:39:26.281802 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:39:26.281769 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:39:26.379763 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:39:26.379734 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:39:26.479544 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:39:26.479514 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:39:32.058278 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:39:32.058239 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:39:32.109447 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:39:32.109416 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:39:32.180755 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:39:32.180719 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:39:32.280332 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:39:32.280309 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:39:32.383377 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:39:32.383292 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:39:37.945573 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:39:37.945529 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:39:38.003906 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:39:38.003872 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:39:44.547795 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:39:44.547772 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-9hfq7_41d0740b-ac9d-47bd-92c3-8c89c459ae7c/console-operator/1.log" Jun 09 02:39:44.550887 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:39:44.550865 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-9hfq7_41d0740b-ac9d-47bd-92c3-8c89c459ae7c/console-operator/1.log" Jun 09 02:39:44.554132 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:39:44.554111 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jz2q7_37e9e0fa-4abd-4eeb-8671-934808ecdf78/ovn-acl-logging/0.log" Jun 09 02:39:44.557553 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:39:44.557532 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jz2q7_37e9e0fa-4abd-4eeb-8671-934808ecdf78/ovn-acl-logging/0.log" Jun 09 02:41:37.329472 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:41:37.329443 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:41:55.905624 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:41:55.905579 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:41:55.952587 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:41:55.952551 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:42:57.674681 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:42:57.674653 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:44:44.592307 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:44:44.592274 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-9hfq7_41d0740b-ac9d-47bd-92c3-8c89c459ae7c/console-operator/1.log" Jun 09 02:44:44.598629 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:44:44.598604 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-9hfq7_41d0740b-ac9d-47bd-92c3-8c89c459ae7c/console-operator/1.log" Jun 09 02:44:44.601291 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:44:44.601267 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jz2q7_37e9e0fa-4abd-4eeb-8671-934808ecdf78/ovn-acl-logging/0.log" Jun 09 02:44:44.607022 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:44:44.607007 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jz2q7_37e9e0fa-4abd-4eeb-8671-934808ecdf78/ovn-acl-logging/0.log" Jun 09 02:45:00.140923 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:45:00.140840 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["redhat-ai-gateway-infra/maas-api-key-cleanup-29682885-xbstz"] Jun 09 02:45:00.144667 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:45:00.144649 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29682885-xbstz" Jun 09 02:45:00.146903 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:45:00.146881 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ai-gateway-infra\"/\"maas-api-dockercfg-xd8sj\"" Jun 09 02:45:00.147003 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:45:00.146885 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jun 09 02:45:00.147719 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:45:00.147701 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jun 09 02:45:00.158632 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:45:00.158611 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/maas-api-key-cleanup-29682885-xbstz"] Jun 09 02:45:00.202737 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:45:00.202713 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tg6lg\" (UniqueName: \"kubernetes.io/projected/333c2d13-be04-4d90-928a-362707d9f062-kube-api-access-tg6lg\") pod \"maas-api-key-cleanup-29682885-xbstz\" (UID: \"333c2d13-be04-4d90-928a-362707d9f062\") " pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29682885-xbstz" Jun 09 02:45:00.303602 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:45:00.303578 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tg6lg\" (UniqueName: \"kubernetes.io/projected/333c2d13-be04-4d90-928a-362707d9f062-kube-api-access-tg6lg\") pod \"maas-api-key-cleanup-29682885-xbstz\" (UID: \"333c2d13-be04-4d90-928a-362707d9f062\") " pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29682885-xbstz" Jun 09 02:45:00.310682 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:45:00.310659 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tg6lg\" (UniqueName: \"kubernetes.io/projected/333c2d13-be04-4d90-928a-362707d9f062-kube-api-access-tg6lg\") pod \"maas-api-key-cleanup-29682885-xbstz\" (UID: \"333c2d13-be04-4d90-928a-362707d9f062\") " pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29682885-xbstz" Jun 09 02:45:00.455402 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:45:00.455344 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29682885-xbstz" Jun 09 02:45:00.583386 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:45:00.583359 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/maas-api-key-cleanup-29682885-xbstz"] Jun 09 02:45:00.584718 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:45:00.584693 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod333c2d13_be04_4d90_928a_362707d9f062.slice/crio-70470e810d5f4b6e1b18bfb5c2dbcf06dec80291a3cad8309ff9b52480292de1 WatchSource:0}: Error finding container 70470e810d5f4b6e1b18bfb5c2dbcf06dec80291a3cad8309ff9b52480292de1: Status 404 returned error can't find the container with id 70470e810d5f4b6e1b18bfb5c2dbcf06dec80291a3cad8309ff9b52480292de1 Jun 09 02:45:00.586543 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:45:00.586526 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 02:45:01.593494 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:45:01.593460 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29682885-xbstz" event={"ID":"333c2d13-be04-4d90-928a-362707d9f062","Type":"ContainerStarted","Data":"70470e810d5f4b6e1b18bfb5c2dbcf06dec80291a3cad8309ff9b52480292de1"} Jun 09 02:45:03.607032 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:45:03.607000 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29682885-xbstz" event={"ID":"333c2d13-be04-4d90-928a-362707d9f062","Type":"ContainerStarted","Data":"ad0626dde3fb10c131b24b10e92b9dffe45dfcf914e5bdac5fb180e154bd8fd2"} Jun 09 02:45:03.623030 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:45:03.622982 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29682885-xbstz" podStartSLOduration=1.555740209 podStartE2EDuration="3.622969601s" totalImagesPullingTime="2.067229392s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:45:03.620776902 +0000 UTC m=+1519.567894245" watchObservedRunningTime="2026-06-09 02:45:03.622969601 +0000 UTC m=+1519.570086985" Jun 09 02:45:44.723890 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:45:44.723857 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:45:44.776273 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:45:44.776246 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:46:00.011531 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:46:00.011483 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["redhat-ai-gateway-infra/maas-api-key-cleanup-29682885-xbstz"] Jun 09 02:46:00.012063 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:46:00.011726 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29682885-xbstz" podUID="333c2d13-be04-4d90-928a-362707d9f062" containerName="cleanup" containerID="cri-o://ad0626dde3fb10c131b24b10e92b9dffe45dfcf914e5bdac5fb180e154bd8fd2" gracePeriod=30 Jun 09 02:46:30.117311 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:46:30.117272 2573 generic.go:356] "Generic (PLEG): container finished" podID="333c2d13-be04-4d90-928a-362707d9f062" containerID="ad0626dde3fb10c131b24b10e92b9dffe45dfcf914e5bdac5fb180e154bd8fd2" exitCode=137 Jun 09 02:46:30.117678 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:46:30.117346 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29682885-xbstz" event={"ID":"333c2d13-be04-4d90-928a-362707d9f062","Type":"ContainerDied","Data":"ad0626dde3fb10c131b24b10e92b9dffe45dfcf914e5bdac5fb180e154bd8fd2"} Jun 09 02:46:30.203046 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:46:30.203027 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29682885-xbstz" Jun 09 02:46:30.305255 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:46:30.305229 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tg6lg\" (UniqueName: \"kubernetes.io/projected/333c2d13-be04-4d90-928a-362707d9f062-kube-api-access-tg6lg\") pod \"333c2d13-be04-4d90-928a-362707d9f062\" (UID: \"333c2d13-be04-4d90-928a-362707d9f062\") " Jun 09 02:46:30.307243 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:46:30.307220 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/333c2d13-be04-4d90-928a-362707d9f062-kube-api-access-tg6lg" (OuterVolumeSpecName: "kube-api-access-tg6lg") pod "333c2d13-be04-4d90-928a-362707d9f062" (UID: "333c2d13-be04-4d90-928a-362707d9f062"). InnerVolumeSpecName "kube-api-access-tg6lg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 02:46:30.406845 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:46:30.406811 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tg6lg\" (UniqueName: \"kubernetes.io/projected/333c2d13-be04-4d90-928a-362707d9f062-kube-api-access-tg6lg\") on node \"ip-10-0-143-102.ec2.internal\" DevicePath \"\"" Jun 09 02:46:31.125287 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:46:31.125262 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29682885-xbstz" Jun 09 02:46:31.125696 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:46:31.125299 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29682885-xbstz" event={"ID":"333c2d13-be04-4d90-928a-362707d9f062","Type":"ContainerDied","Data":"70470e810d5f4b6e1b18bfb5c2dbcf06dec80291a3cad8309ff9b52480292de1"} Jun 09 02:46:31.125696 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:46:31.125356 2573 scope.go:117] "RemoveContainer" containerID="ad0626dde3fb10c131b24b10e92b9dffe45dfcf914e5bdac5fb180e154bd8fd2" Jun 09 02:46:31.141497 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:46:31.141477 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["redhat-ai-gateway-infra/maas-api-key-cleanup-29682885-xbstz"] Jun 09 02:46:31.143920 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:46:31.143901 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["redhat-ai-gateway-infra/maas-api-key-cleanup-29682885-xbstz"] Jun 09 02:46:32.467150 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:46:32.467123 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="333c2d13-be04-4d90-928a-362707d9f062" path="/var/lib/kubelet/pods/333c2d13-be04-4d90-928a-362707d9f062/volumes" Jun 09 02:46:39.623392 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:46:39.623353 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6s79g"] Jun 09 02:46:39.623977 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:46:39.623563 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6s79g" podUID="675c4fd8-7483-41f2-8496-998bb595b3b6" containerName="manager" containerID="cri-o://0bf3aa6a2d9a892ecb0432043f0317171ab6a60dcbcb31ff20aa68b0c8322b2d" gracePeriod=10 Jun 09 02:46:39.876458 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:46:39.876408 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6s79g" Jun 09 02:46:39.984333 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:46:39.984306 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/675c4fd8-7483-41f2-8496-998bb595b3b6-extensions-socket-volume\") pod \"675c4fd8-7483-41f2-8496-998bb595b3b6\" (UID: \"675c4fd8-7483-41f2-8496-998bb595b3b6\") " Jun 09 02:46:39.984459 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:46:39.984337 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kz6xd\" (UniqueName: \"kubernetes.io/projected/675c4fd8-7483-41f2-8496-998bb595b3b6-kube-api-access-kz6xd\") pod \"675c4fd8-7483-41f2-8496-998bb595b3b6\" (UID: \"675c4fd8-7483-41f2-8496-998bb595b3b6\") " Jun 09 02:46:39.984705 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:46:39.984679 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/675c4fd8-7483-41f2-8496-998bb595b3b6-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "675c4fd8-7483-41f2-8496-998bb595b3b6" (UID: "675c4fd8-7483-41f2-8496-998bb595b3b6"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 02:46:39.986308 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:46:39.986285 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/675c4fd8-7483-41f2-8496-998bb595b3b6-kube-api-access-kz6xd" (OuterVolumeSpecName: "kube-api-access-kz6xd") pod "675c4fd8-7483-41f2-8496-998bb595b3b6" (UID: "675c4fd8-7483-41f2-8496-998bb595b3b6"). InnerVolumeSpecName "kube-api-access-kz6xd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 02:46:40.085438 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:46:40.085413 2573 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/675c4fd8-7483-41f2-8496-998bb595b3b6-extensions-socket-volume\") on node \"ip-10-0-143-102.ec2.internal\" DevicePath \"\"" Jun 09 02:46:40.085438 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:46:40.085436 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kz6xd\" (UniqueName: \"kubernetes.io/projected/675c4fd8-7483-41f2-8496-998bb595b3b6-kube-api-access-kz6xd\") on node \"ip-10-0-143-102.ec2.internal\" DevicePath \"\"" Jun 09 02:46:40.182030 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:46:40.181971 2573 generic.go:356] "Generic (PLEG): container finished" podID="675c4fd8-7483-41f2-8496-998bb595b3b6" containerID="0bf3aa6a2d9a892ecb0432043f0317171ab6a60dcbcb31ff20aa68b0c8322b2d" exitCode=0 Jun 09 02:46:40.182148 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:46:40.182026 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6s79g" Jun 09 02:46:40.182148 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:46:40.182057 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6s79g" event={"ID":"675c4fd8-7483-41f2-8496-998bb595b3b6","Type":"ContainerDied","Data":"0bf3aa6a2d9a892ecb0432043f0317171ab6a60dcbcb31ff20aa68b0c8322b2d"} Jun 09 02:46:40.182271 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:46:40.182149 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6s79g" event={"ID":"675c4fd8-7483-41f2-8496-998bb595b3b6","Type":"ContainerDied","Data":"95a5744b6edbbb1959c1a7931c926df53c39db54d8a51e70c5acce8ecad0489e"} Jun 09 02:46:40.182271 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:46:40.182187 2573 scope.go:117] "RemoveContainer" containerID="0bf3aa6a2d9a892ecb0432043f0317171ab6a60dcbcb31ff20aa68b0c8322b2d" Jun 09 02:46:40.195174 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:46:40.195152 2573 scope.go:117] "RemoveContainer" containerID="0bf3aa6a2d9a892ecb0432043f0317171ab6a60dcbcb31ff20aa68b0c8322b2d" Jun 09 02:46:40.195427 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:46:40.195411 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0bf3aa6a2d9a892ecb0432043f0317171ab6a60dcbcb31ff20aa68b0c8322b2d\": container with ID starting with 0bf3aa6a2d9a892ecb0432043f0317171ab6a60dcbcb31ff20aa68b0c8322b2d not found: ID does not exist" containerID="0bf3aa6a2d9a892ecb0432043f0317171ab6a60dcbcb31ff20aa68b0c8322b2d" Jun 09 02:46:40.195476 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:46:40.195433 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0bf3aa6a2d9a892ecb0432043f0317171ab6a60dcbcb31ff20aa68b0c8322b2d"} err="failed to get container status \"0bf3aa6a2d9a892ecb0432043f0317171ab6a60dcbcb31ff20aa68b0c8322b2d\": rpc error: code = NotFound desc = could not find container \"0bf3aa6a2d9a892ecb0432043f0317171ab6a60dcbcb31ff20aa68b0c8322b2d\": container with ID starting with 0bf3aa6a2d9a892ecb0432043f0317171ab6a60dcbcb31ff20aa68b0c8322b2d not found: ID does not exist" Jun 09 02:46:40.204421 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:46:40.204397 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6s79g"] Jun 09 02:46:40.209357 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:46:40.209337 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6s79g"] Jun 09 02:46:40.473314 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:46:40.470589 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="675c4fd8-7483-41f2-8496-998bb595b3b6" path="/var/lib/kubelet/pods/675c4fd8-7483-41f2-8496-998bb595b3b6/volumes" Jun 09 02:47:45.705558 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:47:45.705519 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rxw9j"] Jun 09 02:47:45.706011 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:47:45.705937 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="675c4fd8-7483-41f2-8496-998bb595b3b6" containerName="manager" Jun 09 02:47:45.706011 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:47:45.705950 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="675c4fd8-7483-41f2-8496-998bb595b3b6" containerName="manager" Jun 09 02:47:45.706011 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:47:45.705961 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="333c2d13-be04-4d90-928a-362707d9f062" containerName="cleanup" Jun 09 02:47:45.706011 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:47:45.705967 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="333c2d13-be04-4d90-928a-362707d9f062" containerName="cleanup" Jun 09 02:47:45.706239 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:47:45.706050 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="675c4fd8-7483-41f2-8496-998bb595b3b6" containerName="manager" Jun 09 02:47:45.706239 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:47:45.706060 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="333c2d13-be04-4d90-928a-362707d9f062" containerName="cleanup" Jun 09 02:47:45.709325 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:47:45.709305 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rxw9j" Jun 09 02:47:45.712500 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:47:45.712474 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-nn6hf\"" Jun 09 02:47:45.722291 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:47:45.722263 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rxw9j"] Jun 09 02:47:45.794929 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:47:45.794900 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wplmn\" (UniqueName: \"kubernetes.io/projected/85982e92-a688-44d7-aa35-8549f92033c9-kube-api-access-wplmn\") pod \"kuadrant-operator-controller-manager-86878c769f-rxw9j\" (UID: \"85982e92-a688-44d7-aa35-8549f92033c9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rxw9j" Jun 09 02:47:45.795042 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:47:45.794938 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/85982e92-a688-44d7-aa35-8549f92033c9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-rxw9j\" (UID: \"85982e92-a688-44d7-aa35-8549f92033c9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rxw9j" Jun 09 02:47:45.895638 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:47:45.895600 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wplmn\" (UniqueName: \"kubernetes.io/projected/85982e92-a688-44d7-aa35-8549f92033c9-kube-api-access-wplmn\") pod \"kuadrant-operator-controller-manager-86878c769f-rxw9j\" (UID: \"85982e92-a688-44d7-aa35-8549f92033c9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rxw9j" Jun 09 02:47:45.895764 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:47:45.895649 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/85982e92-a688-44d7-aa35-8549f92033c9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-rxw9j\" (UID: \"85982e92-a688-44d7-aa35-8549f92033c9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rxw9j" Jun 09 02:47:45.896159 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:47:45.896138 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/85982e92-a688-44d7-aa35-8549f92033c9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-rxw9j\" (UID: \"85982e92-a688-44d7-aa35-8549f92033c9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rxw9j" Jun 09 02:47:45.908316 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:47:45.908289 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wplmn\" (UniqueName: \"kubernetes.io/projected/85982e92-a688-44d7-aa35-8549f92033c9-kube-api-access-wplmn\") pod \"kuadrant-operator-controller-manager-86878c769f-rxw9j\" (UID: \"85982e92-a688-44d7-aa35-8549f92033c9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rxw9j" Jun 09 02:47:46.021122 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:47:46.021054 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rxw9j" Jun 09 02:47:46.171411 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:47:46.171380 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rxw9j"] Jun 09 02:47:46.172424 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:47:46.172397 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85982e92_a688_44d7_aa35_8549f92033c9.slice/crio-b65e365dfc3470d2777b69aa43ce4ff9042f8165a2bf6d5c84c74961573544f7 WatchSource:0}: Error finding container b65e365dfc3470d2777b69aa43ce4ff9042f8165a2bf6d5c84c74961573544f7: Status 404 returned error can't find the container with id b65e365dfc3470d2777b69aa43ce4ff9042f8165a2bf6d5c84c74961573544f7 Jun 09 02:47:46.585045 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:47:46.585016 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rxw9j" event={"ID":"85982e92-a688-44d7-aa35-8549f92033c9","Type":"ContainerStarted","Data":"6d4e1de8ea489a32de13f14e10bc52cbea7a02522f63fc664124c6e2e23fa4e1"} Jun 09 02:47:46.585229 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:47:46.585065 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rxw9j" event={"ID":"85982e92-a688-44d7-aa35-8549f92033c9","Type":"ContainerStarted","Data":"b65e365dfc3470d2777b69aa43ce4ff9042f8165a2bf6d5c84c74961573544f7"} Jun 09 02:47:46.585229 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:47:46.585109 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rxw9j" Jun 09 02:47:46.605575 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:47:46.605537 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rxw9j" podStartSLOduration=1.60552357 podStartE2EDuration="1.60552357s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:47:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:47:46.602483782 +0000 UTC m=+1682.549601123" watchObservedRunningTime="2026-06-09 02:47:46.60552357 +0000 UTC m=+1682.552640913" Jun 09 02:47:57.594663 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:47:57.594627 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rxw9j" Jun 09 02:49:44.632739 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:49:44.632714 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-9hfq7_41d0740b-ac9d-47bd-92c3-8c89c459ae7c/console-operator/1.log" Jun 09 02:49:44.639343 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:49:44.639321 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jz2q7_37e9e0fa-4abd-4eeb-8671-934808ecdf78/ovn-acl-logging/0.log" Jun 09 02:49:44.639514 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:49:44.639498 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-9hfq7_41d0740b-ac9d-47bd-92c3-8c89c459ae7c/console-operator/1.log" Jun 09 02:49:44.645697 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:49:44.645679 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jz2q7_37e9e0fa-4abd-4eeb-8671-934808ecdf78/ovn-acl-logging/0.log" Jun 09 02:50:48.334380 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:50:48.334331 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:50:49.399128 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:50:49.399061 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:52:34.524545 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:52:34.524464 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:52:36.879321 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:52:36.879289 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:54:44.672173 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:54:44.672142 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-9hfq7_41d0740b-ac9d-47bd-92c3-8c89c459ae7c/console-operator/1.log" Jun 09 02:54:44.679232 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:54:44.679212 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jz2q7_37e9e0fa-4abd-4eeb-8671-934808ecdf78/ovn-acl-logging/0.log" Jun 09 02:54:44.680668 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:54:44.680652 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-9hfq7_41d0740b-ac9d-47bd-92c3-8c89c459ae7c/console-operator/1.log" Jun 09 02:54:44.687090 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:54:44.687061 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jz2q7_37e9e0fa-4abd-4eeb-8671-934808ecdf78/ovn-acl-logging/0.log" Jun 09 02:55:17.589434 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:55:17.589380 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:56:23.543787 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:56:23.543747 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:56:29.011175 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:56:29.011142 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:56:53.280128 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:56:53.280064 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:57:06.307330 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:06.307240 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:57:07.889589 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:07.889557 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-a6a08889-openshift-default-566666b5b4-vnf2h"] Jun 09 02:57:07.893625 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:07.893607 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a6a08889-openshift-default-566666b5b4-vnf2h" Jun 09 02:57:07.896355 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:07.896336 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-a6a08889-openshift-default-dockercfg-jfxwj\"" Jun 09 02:57:07.904560 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:07.904540 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-a6a08889-openshift-default-566666b5b4-vnf2h"] Jun 09 02:57:07.916441 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:07.916417 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/056c320e-f1f1-4a75-adea-51569eedd3ee-istio-podinfo\") pod \"e2e-ait-a6a08889-openshift-default-566666b5b4-vnf2h\" (UID: \"056c320e-f1f1-4a75-adea-51569eedd3ee\") " pod="openshift-ingress/e2e-ait-a6a08889-openshift-default-566666b5b4-vnf2h" Jun 09 02:57:07.916532 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:07.916455 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/056c320e-f1f1-4a75-adea-51569eedd3ee-istio-data\") pod \"e2e-ait-a6a08889-openshift-default-566666b5b4-vnf2h\" (UID: \"056c320e-f1f1-4a75-adea-51569eedd3ee\") " pod="openshift-ingress/e2e-ait-a6a08889-openshift-default-566666b5b4-vnf2h" Jun 09 02:57:07.916532 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:07.916472 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/056c320e-f1f1-4a75-adea-51569eedd3ee-workload-socket\") pod \"e2e-ait-a6a08889-openshift-default-566666b5b4-vnf2h\" (UID: \"056c320e-f1f1-4a75-adea-51569eedd3ee\") " pod="openshift-ingress/e2e-ait-a6a08889-openshift-default-566666b5b4-vnf2h" Jun 09 02:57:07.916532 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:07.916512 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/056c320e-f1f1-4a75-adea-51569eedd3ee-credential-socket\") pod \"e2e-ait-a6a08889-openshift-default-566666b5b4-vnf2h\" (UID: \"056c320e-f1f1-4a75-adea-51569eedd3ee\") " pod="openshift-ingress/e2e-ait-a6a08889-openshift-default-566666b5b4-vnf2h" Jun 09 02:57:07.916689 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:07.916548 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pzl9\" (UniqueName: \"kubernetes.io/projected/056c320e-f1f1-4a75-adea-51569eedd3ee-kube-api-access-5pzl9\") pod \"e2e-ait-a6a08889-openshift-default-566666b5b4-vnf2h\" (UID: \"056c320e-f1f1-4a75-adea-51569eedd3ee\") " pod="openshift-ingress/e2e-ait-a6a08889-openshift-default-566666b5b4-vnf2h" Jun 09 02:57:07.916689 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:07.916614 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/056c320e-f1f1-4a75-adea-51569eedd3ee-workload-certs\") pod \"e2e-ait-a6a08889-openshift-default-566666b5b4-vnf2h\" (UID: \"056c320e-f1f1-4a75-adea-51569eedd3ee\") " pod="openshift-ingress/e2e-ait-a6a08889-openshift-default-566666b5b4-vnf2h" Jun 09 02:57:07.916689 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:07.916654 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/056c320e-f1f1-4a75-adea-51569eedd3ee-istio-token\") pod \"e2e-ait-a6a08889-openshift-default-566666b5b4-vnf2h\" (UID: \"056c320e-f1f1-4a75-adea-51569eedd3ee\") " pod="openshift-ingress/e2e-ait-a6a08889-openshift-default-566666b5b4-vnf2h" Jun 09 02:57:07.916820 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:07.916693 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/056c320e-f1f1-4a75-adea-51569eedd3ee-istio-envoy\") pod \"e2e-ait-a6a08889-openshift-default-566666b5b4-vnf2h\" (UID: \"056c320e-f1f1-4a75-adea-51569eedd3ee\") " pod="openshift-ingress/e2e-ait-a6a08889-openshift-default-566666b5b4-vnf2h" Jun 09 02:57:07.916820 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:07.916758 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/056c320e-f1f1-4a75-adea-51569eedd3ee-istiod-ca-cert\") pod \"e2e-ait-a6a08889-openshift-default-566666b5b4-vnf2h\" (UID: \"056c320e-f1f1-4a75-adea-51569eedd3ee\") " pod="openshift-ingress/e2e-ait-a6a08889-openshift-default-566666b5b4-vnf2h" Jun 09 02:57:07.923278 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:07.923258 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:57:08.017837 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:08.017806 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/056c320e-f1f1-4a75-adea-51569eedd3ee-istio-data\") pod \"e2e-ait-a6a08889-openshift-default-566666b5b4-vnf2h\" (UID: \"056c320e-f1f1-4a75-adea-51569eedd3ee\") " pod="openshift-ingress/e2e-ait-a6a08889-openshift-default-566666b5b4-vnf2h" Jun 09 02:57:08.017949 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:08.017842 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/056c320e-f1f1-4a75-adea-51569eedd3ee-workload-socket\") pod \"e2e-ait-a6a08889-openshift-default-566666b5b4-vnf2h\" (UID: \"056c320e-f1f1-4a75-adea-51569eedd3ee\") " pod="openshift-ingress/e2e-ait-a6a08889-openshift-default-566666b5b4-vnf2h" Jun 09 02:57:08.017949 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:08.017869 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/056c320e-f1f1-4a75-adea-51569eedd3ee-credential-socket\") pod \"e2e-ait-a6a08889-openshift-default-566666b5b4-vnf2h\" (UID: \"056c320e-f1f1-4a75-adea-51569eedd3ee\") " pod="openshift-ingress/e2e-ait-a6a08889-openshift-default-566666b5b4-vnf2h" Jun 09 02:57:08.017949 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:08.017906 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pzl9\" (UniqueName: \"kubernetes.io/projected/056c320e-f1f1-4a75-adea-51569eedd3ee-kube-api-access-5pzl9\") pod \"e2e-ait-a6a08889-openshift-default-566666b5b4-vnf2h\" (UID: \"056c320e-f1f1-4a75-adea-51569eedd3ee\") " pod="openshift-ingress/e2e-ait-a6a08889-openshift-default-566666b5b4-vnf2h" Jun 09 02:57:08.017949 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:08.017938 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/056c320e-f1f1-4a75-adea-51569eedd3ee-workload-certs\") pod \"e2e-ait-a6a08889-openshift-default-566666b5b4-vnf2h\" (UID: \"056c320e-f1f1-4a75-adea-51569eedd3ee\") " pod="openshift-ingress/e2e-ait-a6a08889-openshift-default-566666b5b4-vnf2h" Jun 09 02:57:08.018205 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:08.017958 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/056c320e-f1f1-4a75-adea-51569eedd3ee-istio-token\") pod \"e2e-ait-a6a08889-openshift-default-566666b5b4-vnf2h\" (UID: \"056c320e-f1f1-4a75-adea-51569eedd3ee\") " pod="openshift-ingress/e2e-ait-a6a08889-openshift-default-566666b5b4-vnf2h" Jun 09 02:57:08.018205 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:08.017984 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/056c320e-f1f1-4a75-adea-51569eedd3ee-istio-envoy\") pod \"e2e-ait-a6a08889-openshift-default-566666b5b4-vnf2h\" (UID: \"056c320e-f1f1-4a75-adea-51569eedd3ee\") " pod="openshift-ingress/e2e-ait-a6a08889-openshift-default-566666b5b4-vnf2h" Jun 09 02:57:08.018205 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:08.018040 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/056c320e-f1f1-4a75-adea-51569eedd3ee-istiod-ca-cert\") pod \"e2e-ait-a6a08889-openshift-default-566666b5b4-vnf2h\" (UID: \"056c320e-f1f1-4a75-adea-51569eedd3ee\") " pod="openshift-ingress/e2e-ait-a6a08889-openshift-default-566666b5b4-vnf2h" Jun 09 02:57:08.018205 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:08.018146 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/056c320e-f1f1-4a75-adea-51569eedd3ee-istio-podinfo\") pod \"e2e-ait-a6a08889-openshift-default-566666b5b4-vnf2h\" (UID: \"056c320e-f1f1-4a75-adea-51569eedd3ee\") " pod="openshift-ingress/e2e-ait-a6a08889-openshift-default-566666b5b4-vnf2h" Jun 09 02:57:08.018403 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:08.018262 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/056c320e-f1f1-4a75-adea-51569eedd3ee-workload-socket\") pod \"e2e-ait-a6a08889-openshift-default-566666b5b4-vnf2h\" (UID: \"056c320e-f1f1-4a75-adea-51569eedd3ee\") " pod="openshift-ingress/e2e-ait-a6a08889-openshift-default-566666b5b4-vnf2h" Jun 09 02:57:08.018403 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:08.018376 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/056c320e-f1f1-4a75-adea-51569eedd3ee-workload-certs\") pod \"e2e-ait-a6a08889-openshift-default-566666b5b4-vnf2h\" (UID: \"056c320e-f1f1-4a75-adea-51569eedd3ee\") " pod="openshift-ingress/e2e-ait-a6a08889-openshift-default-566666b5b4-vnf2h" Jun 09 02:57:08.018505 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:08.018482 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/056c320e-f1f1-4a75-adea-51569eedd3ee-credential-socket\") pod \"e2e-ait-a6a08889-openshift-default-566666b5b4-vnf2h\" (UID: \"056c320e-f1f1-4a75-adea-51569eedd3ee\") " pod="openshift-ingress/e2e-ait-a6a08889-openshift-default-566666b5b4-vnf2h" Jun 09 02:57:08.018587 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:08.018568 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/056c320e-f1f1-4a75-adea-51569eedd3ee-istio-data\") pod \"e2e-ait-a6a08889-openshift-default-566666b5b4-vnf2h\" (UID: \"056c320e-f1f1-4a75-adea-51569eedd3ee\") " pod="openshift-ingress/e2e-ait-a6a08889-openshift-default-566666b5b4-vnf2h" Jun 09 02:57:08.018801 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:08.018784 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/056c320e-f1f1-4a75-adea-51569eedd3ee-istiod-ca-cert\") pod \"e2e-ait-a6a08889-openshift-default-566666b5b4-vnf2h\" (UID: \"056c320e-f1f1-4a75-adea-51569eedd3ee\") " pod="openshift-ingress/e2e-ait-a6a08889-openshift-default-566666b5b4-vnf2h" Jun 09 02:57:08.020485 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:08.020456 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/056c320e-f1f1-4a75-adea-51569eedd3ee-istio-envoy\") pod \"e2e-ait-a6a08889-openshift-default-566666b5b4-vnf2h\" (UID: \"056c320e-f1f1-4a75-adea-51569eedd3ee\") " pod="openshift-ingress/e2e-ait-a6a08889-openshift-default-566666b5b4-vnf2h" Jun 09 02:57:08.020581 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:08.020529 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/056c320e-f1f1-4a75-adea-51569eedd3ee-istio-podinfo\") pod \"e2e-ait-a6a08889-openshift-default-566666b5b4-vnf2h\" (UID: \"056c320e-f1f1-4a75-adea-51569eedd3ee\") " pod="openshift-ingress/e2e-ait-a6a08889-openshift-default-566666b5b4-vnf2h" Jun 09 02:57:08.026963 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:08.026941 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pzl9\" (UniqueName: \"kubernetes.io/projected/056c320e-f1f1-4a75-adea-51569eedd3ee-kube-api-access-5pzl9\") pod \"e2e-ait-a6a08889-openshift-default-566666b5b4-vnf2h\" (UID: \"056c320e-f1f1-4a75-adea-51569eedd3ee\") " pod="openshift-ingress/e2e-ait-a6a08889-openshift-default-566666b5b4-vnf2h" Jun 09 02:57:08.028045 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:08.028021 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:57:08.038884 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:08.038866 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/056c320e-f1f1-4a75-adea-51569eedd3ee-istio-token\") pod \"e2e-ait-a6a08889-openshift-default-566666b5b4-vnf2h\" (UID: \"056c320e-f1f1-4a75-adea-51569eedd3ee\") " pod="openshift-ingress/e2e-ait-a6a08889-openshift-default-566666b5b4-vnf2h" Jun 09 02:57:08.118649 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:08.118617 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:57:08.201901 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:08.201832 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:57:08.205824 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:08.205806 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a6a08889-openshift-default-566666b5b4-vnf2h" Jun 09 02:57:08.263422 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:08.262416 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:57:08.358513 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:08.358482 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-a6a08889-openshift-default-566666b5b4-vnf2h"] Jun 09 02:57:08.359474 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:57:08.359443 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod056c320e_f1f1_4a75_adea_51569eedd3ee.slice/crio-d8d038577013a22b22705d9246f56783b7bcea066f4ab2184ac7db2a14679ea4 WatchSource:0}: Error finding container d8d038577013a22b22705d9246f56783b7bcea066f4ab2184ac7db2a14679ea4: Status 404 returned error can't find the container with id d8d038577013a22b22705d9246f56783b7bcea066f4ab2184ac7db2a14679ea4 Jun 09 02:57:08.361962 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:08.361918 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 09 02:57:08.362061 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:08.361996 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 09 02:57:08.362061 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:08.362025 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 09 02:57:08.791706 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:08.791671 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:57:08.929770 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:08.929731 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a6a08889-openshift-default-566666b5b4-vnf2h" event={"ID":"056c320e-f1f1-4a75-adea-51569eedd3ee","Type":"ContainerStarted","Data":"a45e8188a625ed2c2a79d246ccbc6c6123163c8076b8bf9b4337d3be8aa210f6"} Jun 09 02:57:08.930169 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:08.929784 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a6a08889-openshift-default-566666b5b4-vnf2h" event={"ID":"056c320e-f1f1-4a75-adea-51569eedd3ee","Type":"ContainerStarted","Data":"d8d038577013a22b22705d9246f56783b7bcea066f4ab2184ac7db2a14679ea4"} Jun 09 02:57:08.951317 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:08.951262 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-a6a08889-openshift-default-566666b5b4-vnf2h" podStartSLOduration=1.95124252 podStartE2EDuration="1.95124252s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:57:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:57:08.950294051 +0000 UTC m=+2244.897411398" watchObservedRunningTime="2026-06-09 02:57:08.95124252 +0000 UTC m=+2244.898359862" Jun 09 02:57:09.090447 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:09.090336 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:57:09.206215 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:09.206191 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-a6a08889-openshift-default-566666b5b4-vnf2h" Jun 09 02:57:09.210785 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:09.210757 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-a6a08889-openshift-default-566666b5b4-vnf2h" Jun 09 02:57:09.486245 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:09.486179 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:57:09.705853 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:09.705826 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:57:09.936727 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:09.936699 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-a6a08889-openshift-default-566666b5b4-vnf2h" Jun 09 02:57:09.937598 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:09.937580 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-a6a08889-openshift-default-566666b5b4-vnf2h" Jun 09 02:57:10.017767 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:10.017741 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:57:10.378787 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:10.378757 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:57:10.978527 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:10.978493 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:57:11.488248 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:11.488218 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:57:11.590196 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:11.590169 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:57:12.178190 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:12.178157 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:57:12.783663 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:12.783626 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:57:14.167351 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:14.167320 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:57:14.328350 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:14.328321 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-a6a08889-openshift-default-566666b5b4-vnf2h"] Jun 09 02:57:14.328573 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:14.328546 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-a6a08889-openshift-default-566666b5b4-vnf2h" podUID="056c320e-f1f1-4a75-adea-51569eedd3ee" containerName="istio-proxy" containerID="cri-o://a45e8188a625ed2c2a79d246ccbc6c6123163c8076b8bf9b4337d3be8aa210f6" gracePeriod=30 Jun 09 02:57:14.352917 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:14.352888 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:57:14.450512 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:14.450428 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:57:15.811651 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:15.811623 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:57:19.280216 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:19.280194 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a6a08889-openshift-default-566666b5b4-vnf2h" Jun 09 02:57:19.423572 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:19.423519 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/056c320e-f1f1-4a75-adea-51569eedd3ee-istio-podinfo\") pod \"056c320e-f1f1-4a75-adea-51569eedd3ee\" (UID: \"056c320e-f1f1-4a75-adea-51569eedd3ee\") " Jun 09 02:57:19.423572 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:19.423555 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/056c320e-f1f1-4a75-adea-51569eedd3ee-istiod-ca-cert\") pod \"056c320e-f1f1-4a75-adea-51569eedd3ee\" (UID: \"056c320e-f1f1-4a75-adea-51569eedd3ee\") " Jun 09 02:57:19.423719 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:19.423580 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/056c320e-f1f1-4a75-adea-51569eedd3ee-credential-socket\") pod \"056c320e-f1f1-4a75-adea-51569eedd3ee\" (UID: \"056c320e-f1f1-4a75-adea-51569eedd3ee\") " Jun 09 02:57:19.423719 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:19.423595 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5pzl9\" (UniqueName: \"kubernetes.io/projected/056c320e-f1f1-4a75-adea-51569eedd3ee-kube-api-access-5pzl9\") pod \"056c320e-f1f1-4a75-adea-51569eedd3ee\" (UID: \"056c320e-f1f1-4a75-adea-51569eedd3ee\") " Jun 09 02:57:19.423719 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:19.423624 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/056c320e-f1f1-4a75-adea-51569eedd3ee-workload-socket\") pod \"056c320e-f1f1-4a75-adea-51569eedd3ee\" (UID: \"056c320e-f1f1-4a75-adea-51569eedd3ee\") " Jun 09 02:57:19.423719 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:19.423647 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/056c320e-f1f1-4a75-adea-51569eedd3ee-istio-envoy\") pod \"056c320e-f1f1-4a75-adea-51569eedd3ee\" (UID: \"056c320e-f1f1-4a75-adea-51569eedd3ee\") " Jun 09 02:57:19.423719 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:19.423666 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/056c320e-f1f1-4a75-adea-51569eedd3ee-istio-token\") pod \"056c320e-f1f1-4a75-adea-51569eedd3ee\" (UID: \"056c320e-f1f1-4a75-adea-51569eedd3ee\") " Jun 09 02:57:19.423719 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:19.423702 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/056c320e-f1f1-4a75-adea-51569eedd3ee-workload-certs\") pod \"056c320e-f1f1-4a75-adea-51569eedd3ee\" (UID: \"056c320e-f1f1-4a75-adea-51569eedd3ee\") " Jun 09 02:57:19.424056 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:19.423727 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/056c320e-f1f1-4a75-adea-51569eedd3ee-istio-data\") pod \"056c320e-f1f1-4a75-adea-51569eedd3ee\" (UID: \"056c320e-f1f1-4a75-adea-51569eedd3ee\") " Jun 09 02:57:19.424056 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:19.423840 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/056c320e-f1f1-4a75-adea-51569eedd3ee-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "056c320e-f1f1-4a75-adea-51569eedd3ee" (UID: "056c320e-f1f1-4a75-adea-51569eedd3ee"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 02:57:19.424056 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:19.423962 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/056c320e-f1f1-4a75-adea-51569eedd3ee-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "056c320e-f1f1-4a75-adea-51569eedd3ee" (UID: "056c320e-f1f1-4a75-adea-51569eedd3ee"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 02:57:19.424056 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:19.424027 2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/056c320e-f1f1-4a75-adea-51569eedd3ee-credential-socket\") on node \"ip-10-0-143-102.ec2.internal\" DevicePath \"\"" Jun 09 02:57:19.424056 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:19.424041 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/056c320e-f1f1-4a75-adea-51569eedd3ee-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "056c320e-f1f1-4a75-adea-51569eedd3ee" (UID: "056c320e-f1f1-4a75-adea-51569eedd3ee"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 02:57:19.424348 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:19.424223 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/056c320e-f1f1-4a75-adea-51569eedd3ee-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "056c320e-f1f1-4a75-adea-51569eedd3ee" (UID: "056c320e-f1f1-4a75-adea-51569eedd3ee"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 02:57:19.424736 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:19.424711 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/056c320e-f1f1-4a75-adea-51569eedd3ee-istio-data" (OuterVolumeSpecName: "istio-data") pod "056c320e-f1f1-4a75-adea-51569eedd3ee" (UID: "056c320e-f1f1-4a75-adea-51569eedd3ee"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 02:57:19.425872 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:19.425842 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/056c320e-f1f1-4a75-adea-51569eedd3ee-kube-api-access-5pzl9" (OuterVolumeSpecName: "kube-api-access-5pzl9") pod "056c320e-f1f1-4a75-adea-51569eedd3ee" (UID: "056c320e-f1f1-4a75-adea-51569eedd3ee"). InnerVolumeSpecName "kube-api-access-5pzl9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 02:57:19.425872 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:19.425859 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/056c320e-f1f1-4a75-adea-51569eedd3ee-istio-token" (OuterVolumeSpecName: "istio-token") pod "056c320e-f1f1-4a75-adea-51569eedd3ee" (UID: "056c320e-f1f1-4a75-adea-51569eedd3ee"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 02:57:19.425997 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:19.425972 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/056c320e-f1f1-4a75-adea-51569eedd3ee-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "056c320e-f1f1-4a75-adea-51569eedd3ee" (UID: "056c320e-f1f1-4a75-adea-51569eedd3ee"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 09 02:57:19.425997 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:19.425976 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/056c320e-f1f1-4a75-adea-51569eedd3ee-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "056c320e-f1f1-4a75-adea-51569eedd3ee" (UID: "056c320e-f1f1-4a75-adea-51569eedd3ee"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 02:57:19.525083 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:19.525059 2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/056c320e-f1f1-4a75-adea-51569eedd3ee-istio-podinfo\") on node \"ip-10-0-143-102.ec2.internal\" DevicePath \"\"" Jun 09 02:57:19.525172 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:19.525101 2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/056c320e-f1f1-4a75-adea-51569eedd3ee-istiod-ca-cert\") on node \"ip-10-0-143-102.ec2.internal\" DevicePath \"\"" Jun 09 02:57:19.525172 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:19.525115 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5pzl9\" (UniqueName: \"kubernetes.io/projected/056c320e-f1f1-4a75-adea-51569eedd3ee-kube-api-access-5pzl9\") on node \"ip-10-0-143-102.ec2.internal\" DevicePath \"\"" Jun 09 02:57:19.525172 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:19.525126 2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/056c320e-f1f1-4a75-adea-51569eedd3ee-workload-socket\") on node \"ip-10-0-143-102.ec2.internal\" DevicePath \"\"" Jun 09 02:57:19.525172 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:19.525135 2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/056c320e-f1f1-4a75-adea-51569eedd3ee-istio-envoy\") on node \"ip-10-0-143-102.ec2.internal\" DevicePath \"\"" Jun 09 02:57:19.525172 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:19.525142 2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/056c320e-f1f1-4a75-adea-51569eedd3ee-istio-token\") on node \"ip-10-0-143-102.ec2.internal\" DevicePath \"\"" Jun 09 02:57:19.525172 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:19.525155 2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/056c320e-f1f1-4a75-adea-51569eedd3ee-workload-certs\") on node \"ip-10-0-143-102.ec2.internal\" DevicePath \"\"" Jun 09 02:57:19.525172 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:19.525162 2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/056c320e-f1f1-4a75-adea-51569eedd3ee-istio-data\") on node \"ip-10-0-143-102.ec2.internal\" DevicePath \"\"" Jun 09 02:57:20.005682 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:20.005647 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:57:20.005862 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:20.005837 2573 generic.go:356] "Generic (PLEG): container finished" podID="056c320e-f1f1-4a75-adea-51569eedd3ee" containerID="a45e8188a625ed2c2a79d246ccbc6c6123163c8076b8bf9b4337d3be8aa210f6" exitCode=0 Jun 09 02:57:20.005911 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:20.005890 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a6a08889-openshift-default-566666b5b4-vnf2h" Jun 09 02:57:20.005951 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:20.005911 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a6a08889-openshift-default-566666b5b4-vnf2h" event={"ID":"056c320e-f1f1-4a75-adea-51569eedd3ee","Type":"ContainerDied","Data":"a45e8188a625ed2c2a79d246ccbc6c6123163c8076b8bf9b4337d3be8aa210f6"} Jun 09 02:57:20.005983 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:20.005963 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a6a08889-openshift-default-566666b5b4-vnf2h" event={"ID":"056c320e-f1f1-4a75-adea-51569eedd3ee","Type":"ContainerDied","Data":"d8d038577013a22b22705d9246f56783b7bcea066f4ab2184ac7db2a14679ea4"} Jun 09 02:57:20.006016 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:20.005986 2573 scope.go:117] "RemoveContainer" containerID="a45e8188a625ed2c2a79d246ccbc6c6123163c8076b8bf9b4337d3be8aa210f6" Jun 09 02:57:20.016533 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:20.016513 2573 scope.go:117] "RemoveContainer" containerID="a45e8188a625ed2c2a79d246ccbc6c6123163c8076b8bf9b4337d3be8aa210f6" Jun 09 02:57:20.016802 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:57:20.016785 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a45e8188a625ed2c2a79d246ccbc6c6123163c8076b8bf9b4337d3be8aa210f6\": container with ID starting with a45e8188a625ed2c2a79d246ccbc6c6123163c8076b8bf9b4337d3be8aa210f6 not found: ID does not exist" containerID="a45e8188a625ed2c2a79d246ccbc6c6123163c8076b8bf9b4337d3be8aa210f6" Jun 09 02:57:20.016868 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:20.016809 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a45e8188a625ed2c2a79d246ccbc6c6123163c8076b8bf9b4337d3be8aa210f6"} err="failed to get container status \"a45e8188a625ed2c2a79d246ccbc6c6123163c8076b8bf9b4337d3be8aa210f6\": rpc error: code = NotFound desc = could not find container \"a45e8188a625ed2c2a79d246ccbc6c6123163c8076b8bf9b4337d3be8aa210f6\": container with ID starting with a45e8188a625ed2c2a79d246ccbc6c6123163c8076b8bf9b4337d3be8aa210f6 not found: ID does not exist" Jun 09 02:57:20.027947 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:20.027923 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-a6a08889-openshift-default-566666b5b4-vnf2h"] Jun 09 02:57:20.033219 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:20.033196 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-a6a08889-openshift-default-566666b5b4-vnf2h"] Jun 09 02:57:20.057856 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:20.057829 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:57:20.166952 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:20.166927 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-2fb17c08-openshift-default-54f7b6977b-2cd9c"] Jun 09 02:57:20.167354 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:20.167338 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="056c320e-f1f1-4a75-adea-51569eedd3ee" containerName="istio-proxy" Jun 09 02:57:20.167354 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:20.167353 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="056c320e-f1f1-4a75-adea-51569eedd3ee" containerName="istio-proxy" Jun 09 02:57:20.167472 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:20.167462 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="056c320e-f1f1-4a75-adea-51569eedd3ee" containerName="istio-proxy" Jun 09 02:57:20.170424 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:20.170407 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-2fb17c08-openshift-default-54f7b6977b-2cd9c" Jun 09 02:57:20.173102 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:20.173056 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-2fb17c08-openshift-default-dockercfg-pt7zd\"" Jun 09 02:57:20.183178 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:20.183155 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-2fb17c08-openshift-default-54f7b6977b-2cd9c"] Jun 09 02:57:20.208623 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:20.208602 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:57:20.231836 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:20.231816 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6688a799-c6e2-4055-baa0-18a9e4dd2a5c-istio-podinfo\") pod \"e2e-ait-2fb17c08-openshift-default-54f7b6977b-2cd9c\" (UID: \"6688a799-c6e2-4055-baa0-18a9e4dd2a5c\") " pod="openshift-ingress/e2e-ait-2fb17c08-openshift-default-54f7b6977b-2cd9c" Jun 09 02:57:20.231945 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:20.231848 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6688a799-c6e2-4055-baa0-18a9e4dd2a5c-workload-certs\") pod \"e2e-ait-2fb17c08-openshift-default-54f7b6977b-2cd9c\" (UID: \"6688a799-c6e2-4055-baa0-18a9e4dd2a5c\") " pod="openshift-ingress/e2e-ait-2fb17c08-openshift-default-54f7b6977b-2cd9c" Jun 09 02:57:20.231945 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:20.231869 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6688a799-c6e2-4055-baa0-18a9e4dd2a5c-istio-token\") pod \"e2e-ait-2fb17c08-openshift-default-54f7b6977b-2cd9c\" (UID: \"6688a799-c6e2-4055-baa0-18a9e4dd2a5c\") " pod="openshift-ingress/e2e-ait-2fb17c08-openshift-default-54f7b6977b-2cd9c" Jun 09 02:57:20.232030 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:20.231960 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6688a799-c6e2-4055-baa0-18a9e4dd2a5c-workload-socket\") pod \"e2e-ait-2fb17c08-openshift-default-54f7b6977b-2cd9c\" (UID: \"6688a799-c6e2-4055-baa0-18a9e4dd2a5c\") " pod="openshift-ingress/e2e-ait-2fb17c08-openshift-default-54f7b6977b-2cd9c" Jun 09 02:57:20.232030 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:20.231996 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6688a799-c6e2-4055-baa0-18a9e4dd2a5c-istiod-ca-cert\") pod \"e2e-ait-2fb17c08-openshift-default-54f7b6977b-2cd9c\" (UID: \"6688a799-c6e2-4055-baa0-18a9e4dd2a5c\") " pod="openshift-ingress/e2e-ait-2fb17c08-openshift-default-54f7b6977b-2cd9c" Jun 09 02:57:20.232143 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:20.232034 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rzfs\" (UniqueName: \"kubernetes.io/projected/6688a799-c6e2-4055-baa0-18a9e4dd2a5c-kube-api-access-7rzfs\") pod \"e2e-ait-2fb17c08-openshift-default-54f7b6977b-2cd9c\" (UID: \"6688a799-c6e2-4055-baa0-18a9e4dd2a5c\") " pod="openshift-ingress/e2e-ait-2fb17c08-openshift-default-54f7b6977b-2cd9c" Jun 09 02:57:20.232198 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:20.232137 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6688a799-c6e2-4055-baa0-18a9e4dd2a5c-credential-socket\") pod \"e2e-ait-2fb17c08-openshift-default-54f7b6977b-2cd9c\" (UID: \"6688a799-c6e2-4055-baa0-18a9e4dd2a5c\") " pod="openshift-ingress/e2e-ait-2fb17c08-openshift-default-54f7b6977b-2cd9c" Jun 09 02:57:20.232198 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:20.232178 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6688a799-c6e2-4055-baa0-18a9e4dd2a5c-istio-envoy\") pod \"e2e-ait-2fb17c08-openshift-default-54f7b6977b-2cd9c\" (UID: \"6688a799-c6e2-4055-baa0-18a9e4dd2a5c\") " pod="openshift-ingress/e2e-ait-2fb17c08-openshift-default-54f7b6977b-2cd9c" Jun 09 02:57:20.232311 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:20.232212 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6688a799-c6e2-4055-baa0-18a9e4dd2a5c-istio-data\") pod \"e2e-ait-2fb17c08-openshift-default-54f7b6977b-2cd9c\" (UID: \"6688a799-c6e2-4055-baa0-18a9e4dd2a5c\") " pod="openshift-ingress/e2e-ait-2fb17c08-openshift-default-54f7b6977b-2cd9c" Jun 09 02:57:20.261913 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:20.261830 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:57:20.333170 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:20.333138 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rzfs\" (UniqueName: \"kubernetes.io/projected/6688a799-c6e2-4055-baa0-18a9e4dd2a5c-kube-api-access-7rzfs\") pod \"e2e-ait-2fb17c08-openshift-default-54f7b6977b-2cd9c\" (UID: \"6688a799-c6e2-4055-baa0-18a9e4dd2a5c\") " pod="openshift-ingress/e2e-ait-2fb17c08-openshift-default-54f7b6977b-2cd9c" Jun 09 02:57:20.333597 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:20.333204 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6688a799-c6e2-4055-baa0-18a9e4dd2a5c-credential-socket\") pod \"e2e-ait-2fb17c08-openshift-default-54f7b6977b-2cd9c\" (UID: \"6688a799-c6e2-4055-baa0-18a9e4dd2a5c\") " pod="openshift-ingress/e2e-ait-2fb17c08-openshift-default-54f7b6977b-2cd9c" Jun 09 02:57:20.333597 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:20.333228 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6688a799-c6e2-4055-baa0-18a9e4dd2a5c-istio-envoy\") pod \"e2e-ait-2fb17c08-openshift-default-54f7b6977b-2cd9c\" (UID: \"6688a799-c6e2-4055-baa0-18a9e4dd2a5c\") " pod="openshift-ingress/e2e-ait-2fb17c08-openshift-default-54f7b6977b-2cd9c" Jun 09 02:57:20.333597 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:20.333261 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6688a799-c6e2-4055-baa0-18a9e4dd2a5c-istio-data\") pod \"e2e-ait-2fb17c08-openshift-default-54f7b6977b-2cd9c\" (UID: \"6688a799-c6e2-4055-baa0-18a9e4dd2a5c\") " pod="openshift-ingress/e2e-ait-2fb17c08-openshift-default-54f7b6977b-2cd9c" Jun 09 02:57:20.333597 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:20.333309 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6688a799-c6e2-4055-baa0-18a9e4dd2a5c-istio-podinfo\") pod \"e2e-ait-2fb17c08-openshift-default-54f7b6977b-2cd9c\" (UID: \"6688a799-c6e2-4055-baa0-18a9e4dd2a5c\") " pod="openshift-ingress/e2e-ait-2fb17c08-openshift-default-54f7b6977b-2cd9c" Jun 09 02:57:20.333597 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:20.333345 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6688a799-c6e2-4055-baa0-18a9e4dd2a5c-workload-certs\") pod \"e2e-ait-2fb17c08-openshift-default-54f7b6977b-2cd9c\" (UID: \"6688a799-c6e2-4055-baa0-18a9e4dd2a5c\") " pod="openshift-ingress/e2e-ait-2fb17c08-openshift-default-54f7b6977b-2cd9c" Jun 09 02:57:20.333597 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:20.333369 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6688a799-c6e2-4055-baa0-18a9e4dd2a5c-istio-token\") pod \"e2e-ait-2fb17c08-openshift-default-54f7b6977b-2cd9c\" (UID: \"6688a799-c6e2-4055-baa0-18a9e4dd2a5c\") " pod="openshift-ingress/e2e-ait-2fb17c08-openshift-default-54f7b6977b-2cd9c" Jun 09 02:57:20.333597 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:20.333427 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6688a799-c6e2-4055-baa0-18a9e4dd2a5c-workload-socket\") pod \"e2e-ait-2fb17c08-openshift-default-54f7b6977b-2cd9c\" (UID: \"6688a799-c6e2-4055-baa0-18a9e4dd2a5c\") " pod="openshift-ingress/e2e-ait-2fb17c08-openshift-default-54f7b6977b-2cd9c" Jun 09 02:57:20.333597 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:20.333455 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6688a799-c6e2-4055-baa0-18a9e4dd2a5c-istiod-ca-cert\") pod \"e2e-ait-2fb17c08-openshift-default-54f7b6977b-2cd9c\" (UID: \"6688a799-c6e2-4055-baa0-18a9e4dd2a5c\") " pod="openshift-ingress/e2e-ait-2fb17c08-openshift-default-54f7b6977b-2cd9c" Jun 09 02:57:20.334029 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:20.333634 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6688a799-c6e2-4055-baa0-18a9e4dd2a5c-credential-socket\") pod \"e2e-ait-2fb17c08-openshift-default-54f7b6977b-2cd9c\" (UID: \"6688a799-c6e2-4055-baa0-18a9e4dd2a5c\") " pod="openshift-ingress/e2e-ait-2fb17c08-openshift-default-54f7b6977b-2cd9c" Jun 09 02:57:20.334029 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:20.333938 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6688a799-c6e2-4055-baa0-18a9e4dd2a5c-workload-socket\") pod \"e2e-ait-2fb17c08-openshift-default-54f7b6977b-2cd9c\" (UID: \"6688a799-c6e2-4055-baa0-18a9e4dd2a5c\") " pod="openshift-ingress/e2e-ait-2fb17c08-openshift-default-54f7b6977b-2cd9c" Jun 09 02:57:20.334029 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:20.333983 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6688a799-c6e2-4055-baa0-18a9e4dd2a5c-workload-certs\") pod \"e2e-ait-2fb17c08-openshift-default-54f7b6977b-2cd9c\" (UID: \"6688a799-c6e2-4055-baa0-18a9e4dd2a5c\") " pod="openshift-ingress/e2e-ait-2fb17c08-openshift-default-54f7b6977b-2cd9c" Jun 09 02:57:20.334234 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:20.334216 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6688a799-c6e2-4055-baa0-18a9e4dd2a5c-istio-data\") pod \"e2e-ait-2fb17c08-openshift-default-54f7b6977b-2cd9c\" (UID: \"6688a799-c6e2-4055-baa0-18a9e4dd2a5c\") " pod="openshift-ingress/e2e-ait-2fb17c08-openshift-default-54f7b6977b-2cd9c" Jun 09 02:57:20.334282 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:20.334218 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6688a799-c6e2-4055-baa0-18a9e4dd2a5c-istiod-ca-cert\") pod \"e2e-ait-2fb17c08-openshift-default-54f7b6977b-2cd9c\" (UID: \"6688a799-c6e2-4055-baa0-18a9e4dd2a5c\") " pod="openshift-ingress/e2e-ait-2fb17c08-openshift-default-54f7b6977b-2cd9c" Jun 09 02:57:20.335923 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:20.335892 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6688a799-c6e2-4055-baa0-18a9e4dd2a5c-istio-podinfo\") pod \"e2e-ait-2fb17c08-openshift-default-54f7b6977b-2cd9c\" (UID: \"6688a799-c6e2-4055-baa0-18a9e4dd2a5c\") " pod="openshift-ingress/e2e-ait-2fb17c08-openshift-default-54f7b6977b-2cd9c" Jun 09 02:57:20.336291 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:20.336271 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6688a799-c6e2-4055-baa0-18a9e4dd2a5c-istio-envoy\") pod \"e2e-ait-2fb17c08-openshift-default-54f7b6977b-2cd9c\" (UID: \"6688a799-c6e2-4055-baa0-18a9e4dd2a5c\") " pod="openshift-ingress/e2e-ait-2fb17c08-openshift-default-54f7b6977b-2cd9c" Jun 09 02:57:20.345671 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:20.345387 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6688a799-c6e2-4055-baa0-18a9e4dd2a5c-istio-token\") pod \"e2e-ait-2fb17c08-openshift-default-54f7b6977b-2cd9c\" (UID: \"6688a799-c6e2-4055-baa0-18a9e4dd2a5c\") " pod="openshift-ingress/e2e-ait-2fb17c08-openshift-default-54f7b6977b-2cd9c" Jun 09 02:57:20.346759 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:20.346739 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rzfs\" (UniqueName: \"kubernetes.io/projected/6688a799-c6e2-4055-baa0-18a9e4dd2a5c-kube-api-access-7rzfs\") pod \"e2e-ait-2fb17c08-openshift-default-54f7b6977b-2cd9c\" (UID: \"6688a799-c6e2-4055-baa0-18a9e4dd2a5c\") " pod="openshift-ingress/e2e-ait-2fb17c08-openshift-default-54f7b6977b-2cd9c" Jun 09 02:57:20.365552 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:20.365527 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:57:20.431212 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:20.431187 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:57:20.468549 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:20.468522 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="056c320e-f1f1-4a75-adea-51569eedd3ee" path="/var/lib/kubelet/pods/056c320e-f1f1-4a75-adea-51569eedd3ee/volumes" Jun 09 02:57:20.482319 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:20.482301 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-2fb17c08-openshift-default-54f7b6977b-2cd9c" Jun 09 02:57:20.510628 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:20.510606 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:57:20.652960 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:20.652939 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-2fb17c08-openshift-default-54f7b6977b-2cd9c"] Jun 09 02:57:20.655502 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:57:20.655475 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6688a799_c6e2_4055_baa0_18a9e4dd2a5c.slice/crio-e99ae0586c712fee7485b2c7ebd1a5d140fdf6ac862f9627b53a119169dedb96 WatchSource:0}: Error finding container e99ae0586c712fee7485b2c7ebd1a5d140fdf6ac862f9627b53a119169dedb96: Status 404 returned error can't find the container with id e99ae0586c712fee7485b2c7ebd1a5d140fdf6ac862f9627b53a119169dedb96 Jun 09 02:57:20.657677 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:20.657650 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 09 02:57:20.657753 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:20.657709 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 09 02:57:20.657753 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:20.657738 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 09 02:57:20.792813 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:20.792724 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:57:20.994181 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:20.994149 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:57:21.014302 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:21.014269 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2fb17c08-openshift-default-54f7b6977b-2cd9c" event={"ID":"6688a799-c6e2-4055-baa0-18a9e4dd2a5c","Type":"ContainerStarted","Data":"07a11c6d592669566dbf255bf2a49f58b16ee8272d3201350f2446d555fe642a"} Jun 09 02:57:21.014464 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:21.014330 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2fb17c08-openshift-default-54f7b6977b-2cd9c" event={"ID":"6688a799-c6e2-4055-baa0-18a9e4dd2a5c","Type":"ContainerStarted","Data":"e99ae0586c712fee7485b2c7ebd1a5d140fdf6ac862f9627b53a119169dedb96"} Jun 09 02:57:21.037917 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:21.037875 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-2fb17c08-openshift-default-54f7b6977b-2cd9c" podStartSLOduration=1.037861121 podStartE2EDuration="1.037861121s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:57:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:57:21.036009523 +0000 UTC m=+2256.983126866" watchObservedRunningTime="2026-06-09 02:57:21.037861121 +0000 UTC m=+2256.984978464" Jun 09 02:57:21.094201 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:21.094131 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:57:21.330102 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:21.330055 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:57:21.483177 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:21.483110 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-2fb17c08-openshift-default-54f7b6977b-2cd9c" Jun 09 02:57:21.487623 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:21.487602 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-2fb17c08-openshift-default-54f7b6977b-2cd9c" Jun 09 02:57:21.764063 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:21.763986 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:57:22.021829 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:22.021744 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-2fb17c08-openshift-default-54f7b6977b-2cd9c" Jun 09 02:57:22.022537 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:22.022517 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-2fb17c08-openshift-default-54f7b6977b-2cd9c" Jun 09 02:57:22.361171 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:22.361138 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:57:22.960227 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:22.960194 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:57:23.236937 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:23.236911 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:57:23.561979 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:23.561942 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:57:24.159334 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:24.159296 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:57:24.761923 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:24.761871 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:57:25.706315 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:25.706279 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:57:26.463416 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:26.463388 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:57:27.600839 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:27.600812 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-2fb17c08-openshift-default-54f7b6977b-2cd9c"] Jun 09 02:57:27.601320 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:27.600977 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-2fb17c08-openshift-default-54f7b6977b-2cd9c" podUID="6688a799-c6e2-4055-baa0-18a9e4dd2a5c" containerName="istio-proxy" containerID="cri-o://07a11c6d592669566dbf255bf2a49f58b16ee8272d3201350f2446d555fe642a" gracePeriod=30 Jun 09 02:57:27.622328 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:27.622299 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:57:27.721382 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:27.721350 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:57:31.074014 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:31.073981 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-2fb17c08-openshift-default-54f7b6977b-2cd9c" Jun 09 02:57:31.087477 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:31.087423 2573 generic.go:356] "Generic (PLEG): container finished" podID="6688a799-c6e2-4055-baa0-18a9e4dd2a5c" containerID="07a11c6d592669566dbf255bf2a49f58b16ee8272d3201350f2446d555fe642a" exitCode=0 Jun 09 02:57:31.087477 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:31.087468 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-2fb17c08-openshift-default-54f7b6977b-2cd9c" Jun 09 02:57:31.087653 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:31.087494 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2fb17c08-openshift-default-54f7b6977b-2cd9c" event={"ID":"6688a799-c6e2-4055-baa0-18a9e4dd2a5c","Type":"ContainerDied","Data":"07a11c6d592669566dbf255bf2a49f58b16ee8272d3201350f2446d555fe642a"} Jun 09 02:57:31.087653 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:31.087548 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2fb17c08-openshift-default-54f7b6977b-2cd9c" event={"ID":"6688a799-c6e2-4055-baa0-18a9e4dd2a5c","Type":"ContainerDied","Data":"e99ae0586c712fee7485b2c7ebd1a5d140fdf6ac862f9627b53a119169dedb96"} Jun 09 02:57:31.087653 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:31.087574 2573 scope.go:117] "RemoveContainer" containerID="07a11c6d592669566dbf255bf2a49f58b16ee8272d3201350f2446d555fe642a" Jun 09 02:57:31.097535 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:31.097512 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:57:31.098877 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:31.098859 2573 scope.go:117] "RemoveContainer" containerID="07a11c6d592669566dbf255bf2a49f58b16ee8272d3201350f2446d555fe642a" Jun 09 02:57:31.099565 ip-10-0-143-102 kubenswrapper[2573]: E0609 02:57:31.099540 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"07a11c6d592669566dbf255bf2a49f58b16ee8272d3201350f2446d555fe642a\": container with ID starting with 07a11c6d592669566dbf255bf2a49f58b16ee8272d3201350f2446d555fe642a not found: ID does not exist" containerID="07a11c6d592669566dbf255bf2a49f58b16ee8272d3201350f2446d555fe642a" Jun 09 02:57:31.099678 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:31.099575 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07a11c6d592669566dbf255bf2a49f58b16ee8272d3201350f2446d555fe642a"} err="failed to get container status \"07a11c6d592669566dbf255bf2a49f58b16ee8272d3201350f2446d555fe642a\": rpc error: code = NotFound desc = could not find container \"07a11c6d592669566dbf255bf2a49f58b16ee8272d3201350f2446d555fe642a\": container with ID starting with 07a11c6d592669566dbf255bf2a49f58b16ee8272d3201350f2446d555fe642a not found: ID does not exist" Jun 09 02:57:31.251369 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:31.251302 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7rzfs\" (UniqueName: \"kubernetes.io/projected/6688a799-c6e2-4055-baa0-18a9e4dd2a5c-kube-api-access-7rzfs\") pod \"6688a799-c6e2-4055-baa0-18a9e4dd2a5c\" (UID: \"6688a799-c6e2-4055-baa0-18a9e4dd2a5c\") " Jun 09 02:57:31.251369 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:31.251340 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6688a799-c6e2-4055-baa0-18a9e4dd2a5c-workload-socket\") pod \"6688a799-c6e2-4055-baa0-18a9e4dd2a5c\" (UID: \"6688a799-c6e2-4055-baa0-18a9e4dd2a5c\") " Jun 09 02:57:31.251369 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:31.251366 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6688a799-c6e2-4055-baa0-18a9e4dd2a5c-workload-certs\") pod \"6688a799-c6e2-4055-baa0-18a9e4dd2a5c\" (UID: \"6688a799-c6e2-4055-baa0-18a9e4dd2a5c\") " Jun 09 02:57:31.251604 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:31.251407 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6688a799-c6e2-4055-baa0-18a9e4dd2a5c-istiod-ca-cert\") pod \"6688a799-c6e2-4055-baa0-18a9e4dd2a5c\" (UID: \"6688a799-c6e2-4055-baa0-18a9e4dd2a5c\") " Jun 09 02:57:31.251604 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:31.251459 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6688a799-c6e2-4055-baa0-18a9e4dd2a5c-istio-data\") pod \"6688a799-c6e2-4055-baa0-18a9e4dd2a5c\" (UID: \"6688a799-c6e2-4055-baa0-18a9e4dd2a5c\") " Jun 09 02:57:31.251604 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:31.251484 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6688a799-c6e2-4055-baa0-18a9e4dd2a5c-istio-envoy\") pod \"6688a799-c6e2-4055-baa0-18a9e4dd2a5c\" (UID: \"6688a799-c6e2-4055-baa0-18a9e4dd2a5c\") " Jun 09 02:57:31.251604 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:31.251520 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6688a799-c6e2-4055-baa0-18a9e4dd2a5c-istio-token\") pod \"6688a799-c6e2-4055-baa0-18a9e4dd2a5c\" (UID: \"6688a799-c6e2-4055-baa0-18a9e4dd2a5c\") " Jun 09 02:57:31.251604 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:31.251559 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6688a799-c6e2-4055-baa0-18a9e4dd2a5c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6688a799-c6e2-4055-baa0-18a9e4dd2a5c" (UID: "6688a799-c6e2-4055-baa0-18a9e4dd2a5c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 02:57:31.251604 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:31.251571 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6688a799-c6e2-4055-baa0-18a9e4dd2a5c-credential-socket\") pod \"6688a799-c6e2-4055-baa0-18a9e4dd2a5c\" (UID: \"6688a799-c6e2-4055-baa0-18a9e4dd2a5c\") " Jun 09 02:57:31.251896 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:31.251637 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6688a799-c6e2-4055-baa0-18a9e4dd2a5c-istio-podinfo\") pod \"6688a799-c6e2-4055-baa0-18a9e4dd2a5c\" (UID: \"6688a799-c6e2-4055-baa0-18a9e4dd2a5c\") " Jun 09 02:57:31.251896 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:31.251689 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6688a799-c6e2-4055-baa0-18a9e4dd2a5c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6688a799-c6e2-4055-baa0-18a9e4dd2a5c" (UID: "6688a799-c6e2-4055-baa0-18a9e4dd2a5c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 02:57:31.251896 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:31.251798 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6688a799-c6e2-4055-baa0-18a9e4dd2a5c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6688a799-c6e2-4055-baa0-18a9e4dd2a5c" (UID: "6688a799-c6e2-4055-baa0-18a9e4dd2a5c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 02:57:31.251896 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:31.251865 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6688a799-c6e2-4055-baa0-18a9e4dd2a5c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6688a799-c6e2-4055-baa0-18a9e4dd2a5c" (UID: "6688a799-c6e2-4055-baa0-18a9e4dd2a5c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 02:57:31.252110 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:31.252041 2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6688a799-c6e2-4055-baa0-18a9e4dd2a5c-workload-socket\") on node \"ip-10-0-143-102.ec2.internal\" DevicePath \"\"" Jun 09 02:57:31.252110 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:31.252062 2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6688a799-c6e2-4055-baa0-18a9e4dd2a5c-workload-certs\") on node \"ip-10-0-143-102.ec2.internal\" DevicePath \"\"" Jun 09 02:57:31.252110 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:31.252103 2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6688a799-c6e2-4055-baa0-18a9e4dd2a5c-istiod-ca-cert\") on node \"ip-10-0-143-102.ec2.internal\" DevicePath \"\"" Jun 09 02:57:31.252240 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:31.252116 2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6688a799-c6e2-4055-baa0-18a9e4dd2a5c-credential-socket\") on node \"ip-10-0-143-102.ec2.internal\" DevicePath \"\"" Jun 09 02:57:31.252286 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:31.252262 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6688a799-c6e2-4055-baa0-18a9e4dd2a5c-istio-data" (OuterVolumeSpecName: "istio-data") pod "6688a799-c6e2-4055-baa0-18a9e4dd2a5c" (UID: "6688a799-c6e2-4055-baa0-18a9e4dd2a5c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 02:57:31.253699 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:31.253669 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6688a799-c6e2-4055-baa0-18a9e4dd2a5c-istio-token" (OuterVolumeSpecName: "istio-token") pod "6688a799-c6e2-4055-baa0-18a9e4dd2a5c" (UID: "6688a799-c6e2-4055-baa0-18a9e4dd2a5c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 02:57:31.253831 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:31.253711 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6688a799-c6e2-4055-baa0-18a9e4dd2a5c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6688a799-c6e2-4055-baa0-18a9e4dd2a5c" (UID: "6688a799-c6e2-4055-baa0-18a9e4dd2a5c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 02:57:31.253973 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:31.253956 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6688a799-c6e2-4055-baa0-18a9e4dd2a5c-kube-api-access-7rzfs" (OuterVolumeSpecName: "kube-api-access-7rzfs") pod "6688a799-c6e2-4055-baa0-18a9e4dd2a5c" (UID: "6688a799-c6e2-4055-baa0-18a9e4dd2a5c"). InnerVolumeSpecName "kube-api-access-7rzfs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 02:57:31.254030 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:31.254010 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6688a799-c6e2-4055-baa0-18a9e4dd2a5c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6688a799-c6e2-4055-baa0-18a9e4dd2a5c" (UID: "6688a799-c6e2-4055-baa0-18a9e4dd2a5c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 09 02:57:31.352772 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:31.352750 2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6688a799-c6e2-4055-baa0-18a9e4dd2a5c-istio-token\") on node \"ip-10-0-143-102.ec2.internal\" DevicePath \"\"" Jun 09 02:57:31.352772 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:31.352772 2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6688a799-c6e2-4055-baa0-18a9e4dd2a5c-istio-podinfo\") on node \"ip-10-0-143-102.ec2.internal\" DevicePath \"\"" Jun 09 02:57:31.352901 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:31.352781 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7rzfs\" (UniqueName: \"kubernetes.io/projected/6688a799-c6e2-4055-baa0-18a9e4dd2a5c-kube-api-access-7rzfs\") on node \"ip-10-0-143-102.ec2.internal\" DevicePath \"\"" Jun 09 02:57:31.352901 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:31.352792 2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6688a799-c6e2-4055-baa0-18a9e4dd2a5c-istio-data\") on node \"ip-10-0-143-102.ec2.internal\" DevicePath \"\"" Jun 09 02:57:31.352901 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:31.352800 2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6688a799-c6e2-4055-baa0-18a9e4dd2a5c-istio-envoy\") on node \"ip-10-0-143-102.ec2.internal\" DevicePath \"\"" Jun 09 02:57:31.409554 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:31.409527 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-2fb17c08-openshift-default-54f7b6977b-2cd9c"] Jun 09 02:57:31.414608 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:31.414585 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-2fb17c08-openshift-default-54f7b6977b-2cd9c"] Jun 09 02:57:32.468137 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:32.468106 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6688a799-c6e2-4055-baa0-18a9e4dd2a5c" path="/var/lib/kubelet/pods/6688a799-c6e2-4055-baa0-18a9e4dd2a5c/volumes" Jun 09 02:57:33.340643 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:33.340609 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:57:33.395371 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:33.395342 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:57:44.036390 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:44.036356 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-865f6f7c76-jvssm_0f5d8000-acae-4ed6-baa2-da6f891a7993/nginx/0.log" Jun 09 02:57:44.378777 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:44.378659 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-85c84bb9b5-n5tgx_a8fb4cc0-0c67-4e29-a972-f1c01b912ce3/manager/0.log" Jun 09 02:57:44.965246 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:44.965217 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-777db45658-jkhgh_e64a8c1e-4087-4bf4-9e87-b838dd252ccf/copy-manifests/0.log" Jun 09 02:57:44.972184 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:44.972116 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-777db45658-jkhgh_e64a8c1e-4087-4bf4-9e87-b838dd252ccf/manager/0.log" Jun 09 02:57:45.708887 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:45.708857 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tzmpq_57cb1808-abed-4e68-a7b1-3b0274f0cafd/util/0.log" Jun 09 02:57:45.716563 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:45.716536 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tzmpq_57cb1808-abed-4e68-a7b1-3b0274f0cafd/pull/0.log" Jun 09 02:57:45.722362 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:45.722339 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tzmpq_57cb1808-abed-4e68-a7b1-3b0274f0cafd/extract/0.log" Jun 09 02:57:45.831491 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:45.831462 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tw9nz_df35e67a-39f6-4e96-ab0d-0739cf7a331c/util/0.log" Jun 09 02:57:45.838246 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:45.838220 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tw9nz_df35e67a-39f6-4e96-ab0d-0739cf7a331c/pull/0.log" Jun 09 02:57:45.844714 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:45.844690 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tw9nz_df35e67a-39f6-4e96-ab0d-0739cf7a331c/extract/0.log" Jun 09 02:57:45.954782 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:45.954759 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7355l45_40031394-4711-444f-af69-5d243f817666/pull/0.log" Jun 09 02:57:45.961358 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:45.961263 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7355l45_40031394-4711-444f-af69-5d243f817666/extract/0.log" Jun 09 02:57:45.967423 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:45.967402 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7355l45_40031394-4711-444f-af69-5d243f817666/util/0.log" Jun 09 02:57:46.078430 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:46.078406 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15jhr2_257a476e-eb09-41ce-91d9-95757c054af4/util/0.log" Jun 09 02:57:46.084599 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:46.084580 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15jhr2_257a476e-eb09-41ce-91d9-95757c054af4/pull/0.log" Jun 09 02:57:46.090935 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:46.090906 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15jhr2_257a476e-eb09-41ce-91d9-95757c054af4/extract/0.log" Jun 09 02:57:46.432223 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:46.432201 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-jnprm_354ab5d7-f1f2-41a4-9198-9afcef3cc2c7/manager/0.log" Jun 09 02:57:46.536163 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:46.536144 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-7mj98_3065ce1e-53d8-40e0-a9e7-2d7314d6aef3/kuadrant-console-plugin/0.log" Jun 09 02:57:46.649746 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:46.649727 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-rj28v_2f1e3584-fe38-4463-b169-d6ba2b47bcd0/registry-server/0.log" Jun 09 02:57:46.763889 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:46.763832 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-rxw9j_85982e92-a688-44d7-aa35-8549f92033c9/manager/0.log" Jun 09 02:57:46.992484 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:46.992463 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-tr8cg_8f2181e2-aded-4cdc-bebe-60b211f50f45/manager/0.log" Jun 09 02:57:47.323434 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:47.323410 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795mgxvw_bb6068da-b2de-4c0d-817b-367d9985c647/istio-proxy/0.log" Jun 09 02:57:52.928609 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:52.928577 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-xdkm6/must-gather-l7kpl"] Jun 09 02:57:52.928979 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:52.928966 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6688a799-c6e2-4055-baa0-18a9e4dd2a5c" containerName="istio-proxy" Jun 09 02:57:52.928979 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:52.928980 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="6688a799-c6e2-4055-baa0-18a9e4dd2a5c" containerName="istio-proxy" Jun 09 02:57:52.929065 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:52.929060 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="6688a799-c6e2-4055-baa0-18a9e4dd2a5c" containerName="istio-proxy" Jun 09 02:57:52.933915 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:52.933893 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xdkm6/must-gather-l7kpl" Jun 09 02:57:52.936626 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:52.936605 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xdkm6\"/\"openshift-service-ca.crt\"" Jun 09 02:57:52.937677 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:52.937649 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xdkm6\"/\"kube-root-ca.crt\"" Jun 09 02:57:52.937775 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:52.937745 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-xdkm6\"/\"default-dockercfg-xh6kn\"" Jun 09 02:57:52.943126 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:52.943099 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:57:52.943888 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:52.943863 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xdkm6/must-gather-l7kpl"] Jun 09 02:57:53.027114 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:53.027066 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/8e76e3b2-1c1d-4fd7-a939-28495ccd7186-must-gather-output\") pod \"must-gather-l7kpl\" (UID: \"8e76e3b2-1c1d-4fd7-a939-28495ccd7186\") " pod="openshift-must-gather-xdkm6/must-gather-l7kpl" Jun 09 02:57:53.027201 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:53.027188 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twlfk\" (UniqueName: \"kubernetes.io/projected/8e76e3b2-1c1d-4fd7-a939-28495ccd7186-kube-api-access-twlfk\") pod \"must-gather-l7kpl\" (UID: \"8e76e3b2-1c1d-4fd7-a939-28495ccd7186\") " pod="openshift-must-gather-xdkm6/must-gather-l7kpl" Jun 09 02:57:53.062945 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:53.062922 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" limit=1024 Jun 09 02:57:53.127733 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:53.127709 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twlfk\" (UniqueName: \"kubernetes.io/projected/8e76e3b2-1c1d-4fd7-a939-28495ccd7186-kube-api-access-twlfk\") pod \"must-gather-l7kpl\" (UID: \"8e76e3b2-1c1d-4fd7-a939-28495ccd7186\") " pod="openshift-must-gather-xdkm6/must-gather-l7kpl" Jun 09 02:57:53.127823 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:53.127752 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/8e76e3b2-1c1d-4fd7-a939-28495ccd7186-must-gather-output\") pod \"must-gather-l7kpl\" (UID: \"8e76e3b2-1c1d-4fd7-a939-28495ccd7186\") " pod="openshift-must-gather-xdkm6/must-gather-l7kpl" Jun 09 02:57:53.128042 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:53.128026 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/8e76e3b2-1c1d-4fd7-a939-28495ccd7186-must-gather-output\") pod \"must-gather-l7kpl\" (UID: \"8e76e3b2-1c1d-4fd7-a939-28495ccd7186\") " pod="openshift-must-gather-xdkm6/must-gather-l7kpl" Jun 09 02:57:53.136582 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:53.136556 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-twlfk\" (UniqueName: \"kubernetes.io/projected/8e76e3b2-1c1d-4fd7-a939-28495ccd7186-kube-api-access-twlfk\") pod \"must-gather-l7kpl\" (UID: \"8e76e3b2-1c1d-4fd7-a939-28495ccd7186\") " pod="openshift-must-gather-xdkm6/must-gather-l7kpl" Jun 09 02:57:53.244418 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:53.244369 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xdkm6/must-gather-l7kpl" Jun 09 02:57:53.378583 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:53.378555 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xdkm6/must-gather-l7kpl"] Jun 09 02:57:53.379597 ip-10-0-143-102 kubenswrapper[2573]: W0609 02:57:53.379574 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8e76e3b2_1c1d_4fd7_a939_28495ccd7186.slice/crio-4b95011f905adbf7484465fb84a6294cafbbcbc12152f15b9f89986809c1eec9 WatchSource:0}: Error finding container 4b95011f905adbf7484465fb84a6294cafbbcbc12152f15b9f89986809c1eec9: Status 404 returned error can't find the container with id 4b95011f905adbf7484465fb84a6294cafbbcbc12152f15b9f89986809c1eec9 Jun 09 02:57:53.381406 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:53.381389 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 02:57:54.235780 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:54.235743 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xdkm6/must-gather-l7kpl" event={"ID":"8e76e3b2-1c1d-4fd7-a939-28495ccd7186","Type":"ContainerStarted","Data":"4b95011f905adbf7484465fb84a6294cafbbcbc12152f15b9f89986809c1eec9"} Jun 09 02:57:55.245370 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:55.245334 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xdkm6/must-gather-l7kpl" event={"ID":"8e76e3b2-1c1d-4fd7-a939-28495ccd7186","Type":"ContainerStarted","Data":"bffe9b28ae7896f415c4864740ddbcdfc3e7fe85b598db917e602c146ba31bf9"} Jun 09 02:57:55.245834 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:55.245382 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xdkm6/must-gather-l7kpl" event={"ID":"8e76e3b2-1c1d-4fd7-a939-28495ccd7186","Type":"ContainerStarted","Data":"a2a3178e5b79625fb1281408304f0ca675c880fb8d93bfe1e055528c182b1456"} Jun 09 02:57:55.261792 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:55.261736 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-xdkm6/must-gather-l7kpl" podStartSLOduration=2.432718487 podStartE2EDuration="3.26172278s" totalImagesPullingTime="829.004293ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:57:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:57:55.258739299 +0000 UTC m=+2291.205856641" watchObservedRunningTime="2026-06-09 02:57:55.26172278 +0000 UTC m=+2291.208840122" Jun 09 02:57:55.889000 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:55.888972 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-8gdb7_d745eb48-8450-4c3b-8f93-c6ab1f3036a0/global-pull-secret-syncer/0.log" Jun 09 02:57:55.977513 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:55.977467 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-5hctt_b8b26c95-6b25-462e-bbca-66eefe50f0bb/konnectivity-agent/0.log" Jun 09 02:57:56.105851 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:57:56.105827 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-102.ec2.internal_34d10cebf6d68c8388770209edc1ad38/haproxy/0.log" Jun 09 02:58:00.413993 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:58:00.413940 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tzmpq_57cb1808-abed-4e68-a7b1-3b0274f0cafd/extract/0.log" Jun 09 02:58:00.446004 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:58:00.445968 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tzmpq_57cb1808-abed-4e68-a7b1-3b0274f0cafd/util/0.log" Jun 09 02:58:00.483800 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:58:00.483766 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tzmpq_57cb1808-abed-4e68-a7b1-3b0274f0cafd/pull/0.log" Jun 09 02:58:00.532342 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:58:00.532317 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tw9nz_df35e67a-39f6-4e96-ab0d-0739cf7a331c/extract/0.log" Jun 09 02:58:00.571773 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:58:00.571741 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tw9nz_df35e67a-39f6-4e96-ab0d-0739cf7a331c/util/0.log" Jun 09 02:58:00.614191 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:58:00.614160 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tw9nz_df35e67a-39f6-4e96-ab0d-0739cf7a331c/pull/0.log" Jun 09 02:58:00.667507 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:58:00.667430 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7355l45_40031394-4711-444f-af69-5d243f817666/extract/0.log" Jun 09 02:58:00.711871 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:58:00.711840 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7355l45_40031394-4711-444f-af69-5d243f817666/util/0.log" Jun 09 02:58:00.753714 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:58:00.753680 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7355l45_40031394-4711-444f-af69-5d243f817666/pull/0.log" Jun 09 02:58:00.799484 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:58:00.799394 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15jhr2_257a476e-eb09-41ce-91d9-95757c054af4/extract/0.log" Jun 09 02:58:00.838900 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:58:00.838822 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15jhr2_257a476e-eb09-41ce-91d9-95757c054af4/util/0.log" Jun 09 02:58:00.881051 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:58:00.880978 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15jhr2_257a476e-eb09-41ce-91d9-95757c054af4/pull/0.log" Jun 09 02:58:01.257692 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:58:01.257664 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-jnprm_354ab5d7-f1f2-41a4-9198-9afcef3cc2c7/manager/0.log" Jun 09 02:58:01.299517 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:58:01.299490 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-7mj98_3065ce1e-53d8-40e0-a9e7-2d7314d6aef3/kuadrant-console-plugin/0.log" Jun 09 02:58:01.356805 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:58:01.356775 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-rj28v_2f1e3584-fe38-4463-b169-d6ba2b47bcd0/registry-server/0.log" Jun 09 02:58:01.444631 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:58:01.444603 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-rxw9j_85982e92-a688-44d7-aa35-8549f92033c9/manager/0.log" Jun 09 02:58:01.548210 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:58:01.548170 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-tr8cg_8f2181e2-aded-4cdc-bebe-60b211f50f45/manager/0.log" Jun 09 02:58:03.140602 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:58:03.140563 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-rhlw9_4fedd3d3-404f-4e0a-b965-c5cc70b36896/cluster-monitoring-operator/0.log" Jun 09 02:58:03.170410 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:58:03.170376 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-97ltg_4fa30d51-ae8f-402a-9929-6e7047eb8243/kube-state-metrics/0.log" Jun 09 02:58:03.192608 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:58:03.192579 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-97ltg_4fa30d51-ae8f-402a-9929-6e7047eb8243/kube-rbac-proxy-main/0.log" Jun 09 02:58:03.213662 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:58:03.213627 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-97ltg_4fa30d51-ae8f-402a-9929-6e7047eb8243/kube-rbac-proxy-self/0.log" Jun 09 02:58:03.374388 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:58:03.374343 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kbljc_5a863693-b258-4a61-8fa6-6991f66fc566/node-exporter/0.log" Jun 09 02:58:03.399299 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:58:03.399226 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kbljc_5a863693-b258-4a61-8fa6-6991f66fc566/kube-rbac-proxy/0.log" Jun 09 02:58:03.429276 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:58:03.429249 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kbljc_5a863693-b258-4a61-8fa6-6991f66fc566/init-textfile/0.log" Jun 09 02:58:03.817908 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:58:03.817848 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-v95hd_6ff45181-5685-4291-a424-b27f49e1e659/prometheus-operator/0.log" Jun 09 02:58:03.847463 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:58:03.847438 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-v95hd_6ff45181-5685-4291-a424-b27f49e1e659/kube-rbac-proxy/0.log" Jun 09 02:58:03.901941 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:58:03.901910 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7bb67db84c-cbxq7_774ec8f7-5fec-40ab-a338-7c799704c30e/telemeter-client/0.log" Jun 09 02:58:03.922906 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:58:03.922880 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7bb67db84c-cbxq7_774ec8f7-5fec-40ab-a338-7c799704c30e/reload/0.log" Jun 09 02:58:03.949156 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:58:03.949116 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7bb67db84c-cbxq7_774ec8f7-5fec-40ab-a338-7c799704c30e/kube-rbac-proxy/0.log" Jun 09 02:58:03.983367 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:58:03.983286 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8947bf746-nddpw_e8420c3f-7b6f-4934-9f14-d3a454dacc8c/thanos-query/0.log" Jun 09 02:58:04.004336 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:58:04.004305 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8947bf746-nddpw_e8420c3f-7b6f-4934-9f14-d3a454dacc8c/kube-rbac-proxy-web/0.log" Jun 09 02:58:04.025886 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:58:04.025856 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8947bf746-nddpw_e8420c3f-7b6f-4934-9f14-d3a454dacc8c/kube-rbac-proxy/0.log" Jun 09 02:58:04.048094 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:58:04.048033 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8947bf746-nddpw_e8420c3f-7b6f-4934-9f14-d3a454dacc8c/prom-label-proxy/0.log" Jun 09 02:58:04.067792 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:58:04.067754 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8947bf746-nddpw_e8420c3f-7b6f-4934-9f14-d3a454dacc8c/kube-rbac-proxy-rules/0.log" Jun 09 02:58:04.090480 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:58:04.090444 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8947bf746-nddpw_e8420c3f-7b6f-4934-9f14-d3a454dacc8c/kube-rbac-proxy-metrics/0.log" Jun 09 02:58:05.351701 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:58:05.351673 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d5d5bb78b-sbmsx_6678acb6-6bca-47c4-be4f-acb6f2c1c530/networking-console-plugin/0.log" Jun 09 02:58:05.971409 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:58:05.971380 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-9hfq7_41d0740b-ac9d-47bd-92c3-8c89c459ae7c/console-operator/1.log" Jun 09 02:58:05.979353 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:58:05.979326 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-9hfq7_41d0740b-ac9d-47bd-92c3-8c89c459ae7c/console-operator/2.log" Jun 09 02:58:06.549138 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:58:06.549108 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7445b668d-c765x_99798d7a-f474-4213-b4f9-90576b0dee53/console/0.log" Jun 09 02:58:06.582620 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:58:06.582584 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-q5gzn_6c83b986-fb5e-4664-85aa-e78a5c0e9de1/download-server/0.log" Jun 09 02:58:07.282279 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:58:07.282241 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-xdkm6/perf-node-gather-daemonset-bwfsz"] Jun 09 02:58:07.291089 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:58:07.291040 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xdkm6/perf-node-gather-daemonset-bwfsz" Jun 09 02:58:07.294347 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:58:07.294316 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xdkm6/perf-node-gather-daemonset-bwfsz"] Jun 09 02:58:07.386836 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:58:07.386507 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a56f0aa8-6de9-4cc1-8874-830d45485875-sys\") pod \"perf-node-gather-daemonset-bwfsz\" (UID: \"a56f0aa8-6de9-4cc1-8874-830d45485875\") " pod="openshift-must-gather-xdkm6/perf-node-gather-daemonset-bwfsz" Jun 09 02:58:07.386836 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:58:07.386556 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42n4k\" (UniqueName: \"kubernetes.io/projected/a56f0aa8-6de9-4cc1-8874-830d45485875-kube-api-access-42n4k\") pod \"perf-node-gather-daemonset-bwfsz\" (UID: \"a56f0aa8-6de9-4cc1-8874-830d45485875\") " pod="openshift-must-gather-xdkm6/perf-node-gather-daemonset-bwfsz" Jun 09 02:58:07.386836 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:58:07.386587 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a56f0aa8-6de9-4cc1-8874-830d45485875-proc\") pod \"perf-node-gather-daemonset-bwfsz\" (UID: \"a56f0aa8-6de9-4cc1-8874-830d45485875\") " pod="openshift-must-gather-xdkm6/perf-node-gather-daemonset-bwfsz" Jun 09 02:58:07.386836 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:58:07.386609 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a56f0aa8-6de9-4cc1-8874-830d45485875-lib-modules\") pod \"perf-node-gather-daemonset-bwfsz\" (UID: \"a56f0aa8-6de9-4cc1-8874-830d45485875\") " pod="openshift-must-gather-xdkm6/perf-node-gather-daemonset-bwfsz" Jun 09 02:58:07.386836 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:58:07.386680 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a56f0aa8-6de9-4cc1-8874-830d45485875-podres\") pod \"perf-node-gather-daemonset-bwfsz\" (UID: \"a56f0aa8-6de9-4cc1-8874-830d45485875\") " pod="openshift-must-gather-xdkm6/perf-node-gather-daemonset-bwfsz" Jun 09 02:58:07.488267 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:58:07.488230 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a56f0aa8-6de9-4cc1-8874-830d45485875-sys\") pod \"perf-node-gather-daemonset-bwfsz\" (UID: \"a56f0aa8-6de9-4cc1-8874-830d45485875\") " pod="openshift-must-gather-xdkm6/perf-node-gather-daemonset-bwfsz" Jun 09 02:58:07.488459 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:58:07.488278 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42n4k\" (UniqueName: \"kubernetes.io/projected/a56f0aa8-6de9-4cc1-8874-830d45485875-kube-api-access-42n4k\") pod \"perf-node-gather-daemonset-bwfsz\" (UID: \"a56f0aa8-6de9-4cc1-8874-830d45485875\") " pod="openshift-must-gather-xdkm6/perf-node-gather-daemonset-bwfsz" Jun 09 02:58:07.488524 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:58:07.488393 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a56f0aa8-6de9-4cc1-8874-830d45485875-sys\") pod \"perf-node-gather-daemonset-bwfsz\" (UID: \"a56f0aa8-6de9-4cc1-8874-830d45485875\") " pod="openshift-must-gather-xdkm6/perf-node-gather-daemonset-bwfsz" Jun 09 02:58:07.488524 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:58:07.488439 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a56f0aa8-6de9-4cc1-8874-830d45485875-proc\") pod \"perf-node-gather-daemonset-bwfsz\" (UID: \"a56f0aa8-6de9-4cc1-8874-830d45485875\") " pod="openshift-must-gather-xdkm6/perf-node-gather-daemonset-bwfsz" Jun 09 02:58:07.488632 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:58:07.488537 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a56f0aa8-6de9-4cc1-8874-830d45485875-lib-modules\") pod \"perf-node-gather-daemonset-bwfsz\" (UID: \"a56f0aa8-6de9-4cc1-8874-830d45485875\") " pod="openshift-must-gather-xdkm6/perf-node-gather-daemonset-bwfsz" Jun 09 02:58:07.488632 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:58:07.488479 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a56f0aa8-6de9-4cc1-8874-830d45485875-proc\") pod \"perf-node-gather-daemonset-bwfsz\" (UID: \"a56f0aa8-6de9-4cc1-8874-830d45485875\") " pod="openshift-must-gather-xdkm6/perf-node-gather-daemonset-bwfsz" Jun 09 02:58:07.488632 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:58:07.488616 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a56f0aa8-6de9-4cc1-8874-830d45485875-podres\") pod \"perf-node-gather-daemonset-bwfsz\" (UID: \"a56f0aa8-6de9-4cc1-8874-830d45485875\") " pod="openshift-must-gather-xdkm6/perf-node-gather-daemonset-bwfsz" Jun 09 02:58:07.488786 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:58:07.488741 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a56f0aa8-6de9-4cc1-8874-830d45485875-lib-modules\") pod \"perf-node-gather-daemonset-bwfsz\" (UID: \"a56f0aa8-6de9-4cc1-8874-830d45485875\") " pod="openshift-must-gather-xdkm6/perf-node-gather-daemonset-bwfsz" Jun 09 02:58:07.488838 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:58:07.488782 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a56f0aa8-6de9-4cc1-8874-830d45485875-podres\") pod \"perf-node-gather-daemonset-bwfsz\" (UID: \"a56f0aa8-6de9-4cc1-8874-830d45485875\") " pod="openshift-must-gather-xdkm6/perf-node-gather-daemonset-bwfsz" Jun 09 02:58:07.496794 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:58:07.496763 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-42n4k\" (UniqueName: \"kubernetes.io/projected/a56f0aa8-6de9-4cc1-8874-830d45485875-kube-api-access-42n4k\") pod \"perf-node-gather-daemonset-bwfsz\" (UID: \"a56f0aa8-6de9-4cc1-8874-830d45485875\") " pod="openshift-must-gather-xdkm6/perf-node-gather-daemonset-bwfsz" Jun 09 02:58:07.605684 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:58:07.605651 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xdkm6/perf-node-gather-daemonset-bwfsz" Jun 09 02:58:07.790004 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:58:07.789293 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xdkm6/perf-node-gather-daemonset-bwfsz"] Jun 09 02:58:08.361334 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:58:08.361294 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xdkm6/perf-node-gather-daemonset-bwfsz" event={"ID":"a56f0aa8-6de9-4cc1-8874-830d45485875","Type":"ContainerStarted","Data":"ce29793481e22da46a2d95f01d893067be181890c345ef72664aa1824e96c879"} Jun 09 02:58:08.361494 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:58:08.361356 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xdkm6/perf-node-gather-daemonset-bwfsz" event={"ID":"a56f0aa8-6de9-4cc1-8874-830d45485875","Type":"ContainerStarted","Data":"cdffa876893a55fccc7865f740be26c3bacdcb1792f0f82efd1a206c1b2d2bb5"} Jun 09 02:58:08.361494 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:58:08.361481 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-xdkm6/perf-node-gather-daemonset-bwfsz" Jun 09 02:58:08.377997 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:58:08.377936 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-xdkm6/perf-node-gather-daemonset-bwfsz" podStartSLOduration=1.377916518 podStartE2EDuration="1.377916518s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 02:58:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:58:08.375141344 +0000 UTC m=+2304.322258682" watchObservedRunningTime="2026-06-09 02:58:08.377916518 +0000 UTC m=+2304.325033862" Jun 09 02:58:08.407643 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:58:08.407619 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-r5vqq_9c20a1c4-e1eb-4851-8379-b0138b0a1389/dns/0.log" Jun 09 02:58:08.427394 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:58:08.427367 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-r5vqq_9c20a1c4-e1eb-4851-8379-b0138b0a1389/kube-rbac-proxy/0.log" Jun 09 02:58:08.518358 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:58:08.518325 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-btr7x_37660632-e407-412f-aa36-3e764febd673/dns-node-resolver/0.log" Jun 09 02:58:09.003748 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:58:09.003716 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6b6f4b68db-772wg_4042c7a9-0fef-4d82-8f08-11601e40928f/registry/0.log" Jun 09 02:58:09.013816 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:58:09.013790 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6b6f4b68db-772wg_4042c7a9-0fef-4d82-8f08-11601e40928f/registry/1.log" Jun 09 02:58:09.055155 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:58:09.055130 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-fgmlx_6627f9b3-28ae-40b2-9ba9-fe6614fe60dc/node-ca/0.log" Jun 09 02:58:09.949686 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:58:09.949657 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795mgxvw_bb6068da-b2de-4c0d-817b-367d9985c647/istio-proxy/0.log" Jun 09 02:58:10.820375 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:58:10.820352 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hzfpk_7d40cc8c-039c-4f1a-9460-f601e7d4b00d/serve-healthcheck-canary/0.log" Jun 09 02:58:11.289721 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:58:11.289691 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-mqg6m_5d258435-31f4-4819-82bd-85477f02a5e5/insights-operator/0.log" Jun 09 02:58:11.292596 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:58:11.292575 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-mqg6m_5d258435-31f4-4819-82bd-85477f02a5e5/insights-operator/1.log" Jun 09 02:58:11.311186 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:58:11.311161 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jk6f4_13b89d17-5f8e-4e70-9e34-e8d4d4cd90c4/kube-rbac-proxy/0.log" Jun 09 02:58:11.330548 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:58:11.330526 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jk6f4_13b89d17-5f8e-4e70-9e34-e8d4d4cd90c4/exporter/0.log" Jun 09 02:58:11.350107 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:58:11.350068 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jk6f4_13b89d17-5f8e-4e70-9e34-e8d4d4cd90c4/extractor/0.log" Jun 09 02:58:13.602495 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:58:13.602466 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-865f6f7c76-jvssm_0f5d8000-acae-4ed6-baa2-da6f891a7993/nginx/0.log" Jun 09 02:58:13.852941 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:58:13.852857 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-85c84bb9b5-n5tgx_a8fb4cc0-0c67-4e29-a972-f1c01b912ce3/manager/0.log" Jun 09 02:58:14.193618 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:58:14.193546 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-777db45658-jkhgh_e64a8c1e-4087-4bf4-9e87-b838dd252ccf/manager/0.log" Jun 09 02:58:14.213983 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:58:14.213958 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-777db45658-jkhgh_e64a8c1e-4087-4bf4-9e87-b838dd252ccf/copy-manifests/0.log" Jun 09 02:58:14.378800 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:58:14.378772 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-xdkm6/perf-node-gather-daemonset-bwfsz" Jun 09 02:58:15.687270 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:58:15.687221 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-67785bd58c-cvj87_cb57a46b-75d4-4ce5-a109-f45a72a003a0/manager/0.log" Jun 09 02:58:19.741622 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:58:19.741590 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795mgxvw_bb6068da-b2de-4c0d-817b-367d9985c647/istio-proxy/0.log" Jun 09 02:58:21.169193 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:58:21.169143 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795mgxvw_bb6068da-b2de-4c0d-817b-367d9985c647/istio-proxy/0.log" Jun 09 02:58:22.553366 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:58:22.553338 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c4qzg_9ee7881a-36ac-45e4-80a2-d3fbdf30e2ae/kube-multus-additional-cni-plugins/0.log" Jun 09 02:58:22.574894 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:58:22.574839 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c4qzg_9ee7881a-36ac-45e4-80a2-d3fbdf30e2ae/egress-router-binary-copy/0.log" Jun 09 02:58:22.595032 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:58:22.595004 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c4qzg_9ee7881a-36ac-45e4-80a2-d3fbdf30e2ae/cni-plugins/0.log" Jun 09 02:58:22.620284 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:58:22.620262 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c4qzg_9ee7881a-36ac-45e4-80a2-d3fbdf30e2ae/bond-cni-plugin/0.log" Jun 09 02:58:22.642905 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:58:22.642874 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c4qzg_9ee7881a-36ac-45e4-80a2-d3fbdf30e2ae/routeoverride-cni/0.log" Jun 09 02:58:22.666414 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:58:22.666340 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c4qzg_9ee7881a-36ac-45e4-80a2-d3fbdf30e2ae/whereabouts-cni-bincopy/0.log" Jun 09 02:58:22.687309 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:58:22.687287 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c4qzg_9ee7881a-36ac-45e4-80a2-d3fbdf30e2ae/whereabouts-cni/0.log" Jun 09 02:58:22.862293 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:58:22.862223 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-nqmc9_21fe5491-feac-4749-adfa-a195bf173d83/kube-multus/0.log" Jun 09 02:58:22.890665 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:58:22.890639 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795mgxvw_bb6068da-b2de-4c0d-817b-367d9985c647/istio-proxy/0.log" Jun 09 02:58:23.004845 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:58:23.004821 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-xfrxz_866bea41-c522-452a-9430-a3461041d710/network-metrics-daemon/0.log" Jun 09 02:58:23.022880 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:58:23.022858 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-xfrxz_866bea41-c522-452a-9430-a3461041d710/kube-rbac-proxy/0.log" Jun 09 02:58:24.139773 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:58:24.139738 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jz2q7_37e9e0fa-4abd-4eeb-8671-934808ecdf78/ovn-controller/0.log" Jun 09 02:58:24.156883 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:58:24.156861 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jz2q7_37e9e0fa-4abd-4eeb-8671-934808ecdf78/ovn-acl-logging/0.log" Jun 09 02:58:24.157041 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:58:24.156924 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jz2q7_37e9e0fa-4abd-4eeb-8671-934808ecdf78/ovn-acl-logging/1.log" Jun 09 02:58:24.175588 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:58:24.175533 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jz2q7_37e9e0fa-4abd-4eeb-8671-934808ecdf78/kube-rbac-proxy-node/0.log" Jun 09 02:58:24.197584 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:58:24.197562 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jz2q7_37e9e0fa-4abd-4eeb-8671-934808ecdf78/kube-rbac-proxy-ovn-metrics/0.log" Jun 09 02:58:24.217519 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:58:24.217486 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jz2q7_37e9e0fa-4abd-4eeb-8671-934808ecdf78/northd/0.log" Jun 09 02:58:24.237326 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:58:24.237302 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jz2q7_37e9e0fa-4abd-4eeb-8671-934808ecdf78/nbdb/0.log" Jun 09 02:58:24.256804 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:58:24.256779 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jz2q7_37e9e0fa-4abd-4eeb-8671-934808ecdf78/sbdb/0.log" Jun 09 02:58:24.315065 ip-10-0-143-102 kubenswrapper[2573]: I0609 02:58:24.315044 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jz2q7_37e9e0fa-4abd-4eeb-8671-934808ecdf78/ovnkube-controller/0.log"