Jun 14 15:11:43.788757 ip-10-0-140-30 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 14 15:11:43.788768 ip-10-0-140-30 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 14 15:11:43.788776 ip-10-0-140-30 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 14 15:11:43.788988 ip-10-0-140-30 systemd[1]: Failed to start Kubernetes Kubelet. Jun 14 15:11:53.995662 ip-10-0-140-30 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 14 15:11:53.995682 ip-10-0-140-30 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot c868f73f04b14d06844318b0be8ef4d1 -- Jun 14 15:14:02.688371 ip-10-0-140-30 systemd[1]: Starting Kubernetes Kubelet... Jun 14 15:14:03.145689 ip-10-0-140-30 kubenswrapper[2571]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 14 15:14:03.145689 ip-10-0-140-30 kubenswrapper[2571]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 14 15:14:03.145689 ip-10-0-140-30 kubenswrapper[2571]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 14 15:14:03.145689 ip-10-0-140-30 kubenswrapper[2571]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 14 15:14:03.145689 ip-10-0-140-30 kubenswrapper[2571]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 14 15:14:03.147090 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.146989 2571 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 14 15:14:03.150969 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.150950 2571 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 15:14:03.150969 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.150968 2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 15:14:03.151035 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.150972 2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 15:14:03.151035 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.150976 2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 15:14:03.151035 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.150980 2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 15:14:03.151035 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.150983 2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 15:14:03.151035 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.150986 2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 15:14:03.151035 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.150988 2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 15:14:03.151035 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.150991 2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 15:14:03.151035 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.150994 2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 15:14:03.151035 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.150997 2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 15:14:03.151035 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.151000 2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 15:14:03.151035 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.151002 2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 15:14:03.151035 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.151010 2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 15:14:03.151035 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.151013 2571 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 15:14:03.151035 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.151016 2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 15:14:03.151035 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.151018 2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 15:14:03.151035 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.151021 2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 15:14:03.151035 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.151023 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 15:14:03.151035 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.151026 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 15:14:03.151035 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.151029 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 15:14:03.151035 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.151031 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 15:14:03.151579 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.151034 2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 15:14:03.151579 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.151036 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 15:14:03.151579 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.151040 2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 15:14:03.151579 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.151057 2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 15:14:03.151579 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.151060 2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 15:14:03.151579 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.151063 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 15:14:03.151579 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.151066 2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 15:14:03.151579 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.151068 2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 15:14:03.151579 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.151071 2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 15:14:03.151579 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.151074 2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 15:14:03.151579 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.151077 2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 15:14:03.151579 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.151079 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 15:14:03.151579 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.151082 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 15:14:03.151579 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.151086 2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 15:14:03.151579 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.151090 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 15:14:03.151579 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.151092 2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 15:14:03.151579 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.151095 2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 15:14:03.151579 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.151097 2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 15:14:03.151579 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.151100 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 15:14:03.152034 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.151102 2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 15:14:03.152034 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.151105 2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 15:14:03.152034 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.151108 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 15:14:03.152034 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.151111 2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 15:14:03.152034 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.151115 2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 15:14:03.152034 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.151119 2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 15:14:03.152034 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.151121 2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 15:14:03.152034 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.151124 2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 15:14:03.152034 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.151127 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 15:14:03.152034 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.151129 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 15:14:03.152034 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.151132 2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 15:14:03.152034 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.151134 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 15:14:03.152034 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.151137 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 15:14:03.152034 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.151140 2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 15:14:03.152034 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.151143 2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 15:14:03.152034 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.151145 2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 15:14:03.152034 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.151148 2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 15:14:03.152034 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.151151 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 15:14:03.152034 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.151153 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 15:14:03.152513 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.151157 2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 15:14:03.152513 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.151160 2571 feature_gate.go:328] unrecognized feature gate: Example Jun 14 15:14:03.152513 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.151163 2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 15:14:03.152513 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.151166 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 15:14:03.152513 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.151170 2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 15:14:03.152513 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.151173 2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 15:14:03.152513 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.151176 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 15:14:03.152513 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.151178 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 15:14:03.152513 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.151181 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 15:14:03.152513 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.151184 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 15:14:03.152513 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.151186 2571 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 15:14:03.152513 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.151189 2571 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 15:14:03.152513 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.151191 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 15:14:03.152513 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.151193 2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 15:14:03.152513 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.151196 2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 15:14:03.152513 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.151199 2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 15:14:03.152513 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.151201 2571 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 15:14:03.152513 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.151204 2571 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 15:14:03.152513 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.151206 2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 15:14:03.152513 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.151216 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 15:14:03.152994 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.151219 2571 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 15:14:03.152994 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.151222 2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 15:14:03.152994 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.151225 2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 15:14:03.152994 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.151227 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 15:14:03.152994 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.151230 2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 15:14:03.152994 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.151232 2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 15:14:03.152994 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.151236 2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 15:14:03.152994 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.151239 2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 15:14:03.152994 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.151241 2571 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 15:14:03.152994 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.151244 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 15:14:03.152994 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.151247 2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 15:14:03.152994 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.151249 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 15:14:03.152994 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.151252 2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 15:14:03.152994 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.151254 2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 15:14:03.152994 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.151257 2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 15:14:03.152994 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.151259 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 15:14:03.152994 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.151262 2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 15:14:03.152994 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.151264 2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 15:14:03.152994 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.151267 2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 15:14:03.152994 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.151976 2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 15:14:03.153490 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.151983 2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 15:14:03.153490 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.151986 2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 15:14:03.153490 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.151988 2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 15:14:03.153490 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.151991 2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 15:14:03.153490 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.151994 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 15:14:03.153490 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.151997 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 15:14:03.153490 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152000 2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 15:14:03.153490 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152005 2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 15:14:03.153490 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152009 2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 15:14:03.153490 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152012 2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 15:14:03.153490 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152015 2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 15:14:03.153490 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152018 2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 15:14:03.153490 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152022 2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 15:14:03.153490 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152024 2571 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 15:14:03.153490 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152027 2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 15:14:03.153490 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152030 2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 15:14:03.153490 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152032 2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 15:14:03.153490 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152035 2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 15:14:03.153490 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152038 2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 15:14:03.153999 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152041 2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 15:14:03.153999 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152062 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 15:14:03.153999 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152065 2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 15:14:03.153999 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152068 2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 15:14:03.153999 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152071 2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 15:14:03.153999 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152074 2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 15:14:03.153999 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152077 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 15:14:03.153999 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152079 2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 15:14:03.153999 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152082 2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 15:14:03.153999 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152085 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 15:14:03.153999 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152088 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 15:14:03.153999 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152090 2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 15:14:03.153999 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152093 2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 15:14:03.153999 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152096 2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 15:14:03.153999 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152099 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 15:14:03.153999 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152101 2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 15:14:03.153999 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152110 2571 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 15:14:03.153999 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152113 2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 15:14:03.153999 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152116 2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 15:14:03.153999 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152118 2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 15:14:03.154518 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152121 2571 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 15:14:03.154518 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152123 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 15:14:03.154518 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152126 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 15:14:03.154518 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152129 2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 15:14:03.154518 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152131 2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 15:14:03.154518 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152134 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 15:14:03.154518 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152137 2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 15:14:03.154518 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152139 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 15:14:03.154518 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152142 2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 15:14:03.154518 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152145 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 15:14:03.154518 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152148 2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 15:14:03.154518 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152151 2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 15:14:03.154518 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152154 2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 15:14:03.154518 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152157 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 15:14:03.154518 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152160 2571 feature_gate.go:328] unrecognized feature gate: Example Jun 14 15:14:03.154518 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152162 2571 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 15:14:03.154518 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152165 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 15:14:03.154518 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152168 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 15:14:03.154518 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152170 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 15:14:03.154518 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152173 2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 15:14:03.155005 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152176 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 15:14:03.155005 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152178 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 15:14:03.155005 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152183 2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 15:14:03.155005 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152187 2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 15:14:03.155005 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152190 2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 15:14:03.155005 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152193 2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 15:14:03.155005 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152195 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 15:14:03.155005 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152198 2571 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 15:14:03.155005 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152200 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 15:14:03.155005 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152203 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 15:14:03.155005 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152205 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 15:14:03.155005 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152208 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 15:14:03.155005 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152210 2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 15:14:03.155005 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152214 2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 15:14:03.155005 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152216 2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 15:14:03.155005 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152219 2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 15:14:03.155005 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152221 2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 15:14:03.155005 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152224 2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 15:14:03.155005 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152226 2571 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 15:14:03.155005 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152230 2571 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 15:14:03.155513 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152234 2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 15:14:03.155513 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152237 2571 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 15:14:03.155513 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152240 2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 15:14:03.155513 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152243 2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 15:14:03.155513 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152247 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 15:14:03.155513 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152250 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 15:14:03.155513 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152253 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 15:14:03.155513 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152256 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 15:14:03.155513 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152258 2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 15:14:03.155513 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152261 2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 15:14:03.155513 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152263 2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 15:14:03.155513 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152266 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 15:14:03.155513 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152268 2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 15:14:03.155513 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152271 2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 15:14:03.155513 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152273 2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 15:14:03.155513 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152276 2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 15:14:03.155513 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152279 2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 15:14:03.155513 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152281 2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 15:14:03.155513 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152284 2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 15:14:03.155513 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152734 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 15:14:03.155998 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152746 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 15:14:03.155998 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152750 2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 15:14:03.155998 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152753 2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 15:14:03.155998 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152757 2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 15:14:03.155998 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152760 2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 15:14:03.155998 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152763 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 15:14:03.155998 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152766 2571 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 15:14:03.155998 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152770 2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 15:14:03.155998 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152773 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 15:14:03.155998 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152778 2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 15:14:03.155998 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152782 2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 15:14:03.155998 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152785 2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 15:14:03.155998 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152788 2571 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 15:14:03.155998 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152791 2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 15:14:03.155998 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152794 2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 15:14:03.155998 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152796 2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 15:14:03.155998 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152799 2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 15:14:03.155998 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152803 2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 15:14:03.155998 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152805 2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 15:14:03.155998 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152808 2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 15:14:03.156495 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152811 2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 15:14:03.156495 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152813 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 15:14:03.156495 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152816 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 15:14:03.156495 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152819 2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 15:14:03.156495 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152821 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 15:14:03.156495 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152824 2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 15:14:03.156495 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152826 2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 15:14:03.156495 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152829 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 15:14:03.156495 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152832 2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 15:14:03.156495 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152834 2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 15:14:03.156495 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152837 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 15:14:03.156495 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152839 2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 15:14:03.156495 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152843 2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 15:14:03.156495 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152846 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 15:14:03.156495 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152849 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 15:14:03.156495 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152852 2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 15:14:03.156495 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152855 2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 15:14:03.156495 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152857 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 15:14:03.156495 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152860 2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 15:14:03.156957 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152863 2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 15:14:03.156957 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152865 2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 15:14:03.156957 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152868 2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 15:14:03.156957 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152871 2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 15:14:03.156957 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152873 2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 15:14:03.156957 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152876 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 15:14:03.156957 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152878 2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 15:14:03.156957 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152881 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 15:14:03.156957 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152884 2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 15:14:03.156957 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152886 2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 15:14:03.156957 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152889 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 15:14:03.156957 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152891 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 15:14:03.156957 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152894 2571 feature_gate.go:328] unrecognized feature gate: Example Jun 14 15:14:03.156957 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152897 2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 15:14:03.156957 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152899 2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 15:14:03.156957 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152903 2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 15:14:03.156957 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152907 2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 15:14:03.156957 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152909 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 15:14:03.156957 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152912 2571 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 15:14:03.156957 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152915 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 15:14:03.157453 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152918 2571 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 15:14:03.157453 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152921 2571 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 15:14:03.157453 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152923 2571 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 15:14:03.157453 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152926 2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 15:14:03.157453 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152928 2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 15:14:03.157453 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152933 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 15:14:03.157453 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152936 2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 15:14:03.157453 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152939 2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 15:14:03.157453 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152942 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 15:14:03.157453 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152944 2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 15:14:03.157453 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152947 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 15:14:03.157453 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152949 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 15:14:03.157453 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152952 2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 15:14:03.157453 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152955 2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 15:14:03.157453 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152957 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 15:14:03.157453 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152959 2571 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 15:14:03.157453 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152962 2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 15:14:03.157453 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152964 2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 15:14:03.157453 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152967 2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 15:14:03.157453 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152970 2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 15:14:03.157932 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152972 2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 15:14:03.157932 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152974 2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 15:14:03.157932 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152977 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 15:14:03.157932 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152979 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 15:14:03.157932 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152982 2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 15:14:03.157932 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152984 2571 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 15:14:03.157932 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152987 2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 15:14:03.157932 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152989 2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 15:14:03.157932 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152991 2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 15:14:03.157932 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152994 2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 15:14:03.157932 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.152997 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 15:14:03.157932 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.153000 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 15:14:03.157932 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.153002 2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 15:14:03.157932 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.153005 2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 15:14:03.157932 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.153007 2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 15:14:03.157932 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.153012 2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 15:14:03.157932 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.153016 2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 15:14:03.157932 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.153024 2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 15:14:03.157932 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.153027 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 15:14:03.157932 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153110 2571 flags.go:64] FLAG: --address="0.0.0.0" Jun 14 15:14:03.158435 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153118 2571 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 14 15:14:03.158435 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153126 2571 flags.go:64] FLAG: --anonymous-auth="true" Jun 14 15:14:03.158435 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153131 2571 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 14 15:14:03.158435 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153135 2571 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 14 15:14:03.158435 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153138 2571 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 14 15:14:03.158435 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153143 2571 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 14 15:14:03.158435 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153147 2571 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 14 15:14:03.158435 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153150 2571 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 14 15:14:03.158435 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153154 2571 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 14 15:14:03.158435 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153157 2571 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 14 15:14:03.158435 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153161 2571 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 14 15:14:03.158435 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153164 2571 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 14 15:14:03.158435 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153167 2571 flags.go:64] FLAG: --cgroup-root="" Jun 14 15:14:03.158435 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153170 2571 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 14 15:14:03.158435 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153173 2571 flags.go:64] FLAG: --client-ca-file="" Jun 14 15:14:03.158435 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153176 2571 flags.go:64] FLAG: --cloud-provider="external" Jun 14 15:14:03.158435 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153179 2571 flags.go:64] FLAG: --cluster-dns="[]" Jun 14 15:14:03.158435 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153183 2571 flags.go:64] FLAG: --cluster-domain="" Jun 14 15:14:03.158435 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153186 2571 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 14 15:14:03.158435 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153189 2571 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 14 15:14:03.158435 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153192 2571 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 14 15:14:03.158435 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153196 2571 flags.go:64] FLAG: --container-log-max-files="5" Jun 14 15:14:03.158435 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153200 2571 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 14 15:14:03.158435 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153203 2571 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 14 15:14:03.159003 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153206 2571 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 14 15:14:03.159003 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153210 2571 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 14 15:14:03.159003 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153213 2571 flags.go:64] FLAG: --contention-profiling="false" Jun 14 15:14:03.159003 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153216 2571 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 14 15:14:03.159003 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153219 2571 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 14 15:14:03.159003 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153224 2571 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 14 15:14:03.159003 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153228 2571 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 14 15:14:03.159003 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153232 2571 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 14 15:14:03.159003 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153236 2571 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 14 15:14:03.159003 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153238 2571 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 14 15:14:03.159003 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153241 2571 flags.go:64] FLAG: --enable-load-reader="false" Jun 14 15:14:03.159003 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153244 2571 flags.go:64] FLAG: --enable-server="true" Jun 14 15:14:03.159003 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153247 2571 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 14 15:14:03.159003 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153252 2571 flags.go:64] FLAG: --event-burst="100" Jun 14 15:14:03.159003 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153255 2571 flags.go:64] FLAG: --event-qps="50" Jun 14 15:14:03.159003 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153258 2571 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 14 15:14:03.159003 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153261 2571 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 14 15:14:03.159003 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153264 2571 flags.go:64] FLAG: --eviction-hard="" Jun 14 15:14:03.159003 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153267 2571 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 14 15:14:03.159003 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153271 2571 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 14 15:14:03.159003 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153273 2571 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 14 15:14:03.159003 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153276 2571 flags.go:64] FLAG: --eviction-soft="" Jun 14 15:14:03.159003 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153279 2571 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 14 15:14:03.159003 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153282 2571 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 14 15:14:03.159003 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153285 2571 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 14 15:14:03.159690 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153288 2571 flags.go:64] FLAG: --experimental-mounter-path="" Jun 14 15:14:03.159690 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153291 2571 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 14 15:14:03.159690 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153294 2571 flags.go:64] FLAG: --fail-swap-on="true" Jun 14 15:14:03.159690 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153297 2571 flags.go:64] FLAG: --feature-gates="" Jun 14 15:14:03.159690 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153301 2571 flags.go:64] FLAG: --file-check-frequency="20s" Jun 14 15:14:03.159690 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153304 2571 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 14 15:14:03.159690 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153307 2571 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 14 15:14:03.159690 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153310 2571 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 14 15:14:03.159690 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153314 2571 flags.go:64] FLAG: --healthz-port="10248" Jun 14 15:14:03.159690 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153317 2571 flags.go:64] FLAG: --help="false" Jun 14 15:14:03.159690 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153320 2571 flags.go:64] FLAG: --hostname-override="ip-10-0-140-30.ec2.internal" Jun 14 15:14:03.159690 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153323 2571 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 14 15:14:03.159690 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153327 2571 flags.go:64] FLAG: --http-check-frequency="20s" Jun 14 15:14:03.159690 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153330 2571 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 14 15:14:03.159690 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153333 2571 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 14 15:14:03.159690 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153337 2571 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 14 15:14:03.159690 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153340 2571 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 14 15:14:03.159690 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153344 2571 flags.go:64] FLAG: --image-service-endpoint="" Jun 14 15:14:03.159690 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153347 2571 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 14 15:14:03.159690 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153349 2571 flags.go:64] FLAG: --kube-api-burst="100" Jun 14 15:14:03.159690 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153352 2571 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 14 15:14:03.159690 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153355 2571 flags.go:64] FLAG: --kube-api-qps="50" Jun 14 15:14:03.159690 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153358 2571 flags.go:64] FLAG: --kube-reserved="" Jun 14 15:14:03.159690 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153361 2571 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 14 15:14:03.160283 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153364 2571 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 14 15:14:03.160283 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153367 2571 flags.go:64] FLAG: --kubelet-cgroups="" Jun 14 15:14:03.160283 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153370 2571 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 14 15:14:03.160283 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153373 2571 flags.go:64] FLAG: --lock-file="" Jun 14 15:14:03.160283 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153376 2571 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 14 15:14:03.160283 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153378 2571 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 14 15:14:03.160283 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153381 2571 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 14 15:14:03.160283 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153387 2571 flags.go:64] FLAG: --log-json-split-stream="false" Jun 14 15:14:03.160283 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153389 2571 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 14 15:14:03.160283 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153392 2571 flags.go:64] FLAG: --log-text-split-stream="false" Jun 14 15:14:03.160283 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153395 2571 flags.go:64] FLAG: --logging-format="text" Jun 14 15:14:03.160283 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153398 2571 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 14 15:14:03.160283 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153401 2571 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 14 15:14:03.160283 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153404 2571 flags.go:64] FLAG: --manifest-url="" Jun 14 15:14:03.160283 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153407 2571 flags.go:64] FLAG: --manifest-url-header="" Jun 14 15:14:03.160283 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153411 2571 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 14 15:14:03.160283 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153414 2571 flags.go:64] FLAG: --max-open-files="1000000" Jun 14 15:14:03.160283 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153418 2571 flags.go:64] FLAG: --max-pods="110" Jun 14 15:14:03.160283 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153421 2571 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 14 15:14:03.160283 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153424 2571 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 14 15:14:03.160283 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153429 2571 flags.go:64] FLAG: --memory-manager-policy="None" Jun 14 15:14:03.160283 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153431 2571 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 14 15:14:03.160283 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153434 2571 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 14 15:14:03.160283 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153437 2571 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 14 15:14:03.160283 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153440 2571 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 14 15:14:03.160933 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153449 2571 flags.go:64] FLAG: --node-status-max-images="50" Jun 14 15:14:03.160933 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153452 2571 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 14 15:14:03.160933 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153455 2571 flags.go:64] FLAG: --oom-score-adj="-999" Jun 14 15:14:03.160933 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153458 2571 flags.go:64] FLAG: --pod-cidr="" Jun 14 15:14:03.160933 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153461 2571 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4a2e90c8ef7d783e4d635e24fb09435f5e1f6e954583512c0944f9e57bc77b52" Jun 14 15:14:03.160933 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153467 2571 flags.go:64] FLAG: --pod-manifest-path="" Jun 14 15:14:03.160933 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153470 2571 flags.go:64] FLAG: --pod-max-pids="-1" Jun 14 15:14:03.160933 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153473 2571 flags.go:64] FLAG: --pods-per-core="0" Jun 14 15:14:03.160933 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153476 2571 flags.go:64] FLAG: --port="10250" Jun 14 15:14:03.160933 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153479 2571 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 14 15:14:03.160933 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153482 2571 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-01fb41c685fe843f8" Jun 14 15:14:03.160933 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153485 2571 flags.go:64] FLAG: --qos-reserved="" Jun 14 15:14:03.160933 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153488 2571 flags.go:64] FLAG: --read-only-port="10255" Jun 14 15:14:03.160933 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153490 2571 flags.go:64] FLAG: --register-node="true" Jun 14 15:14:03.160933 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153494 2571 flags.go:64] FLAG: --register-with-taints="" Jun 14 15:14:03.160933 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153497 2571 flags.go:64] FLAG: --registry-burst="10" Jun 14 15:14:03.160933 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153500 2571 flags.go:64] FLAG: --registry-qps="5" Jun 14 15:14:03.160933 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153503 2571 flags.go:64] FLAG: --reserved-cpus="" Jun 14 15:14:03.160933 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153506 2571 flags.go:64] FLAG: --reserved-memory="" Jun 14 15:14:03.160933 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153510 2571 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 14 15:14:03.160933 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153513 2571 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 14 15:14:03.160933 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153516 2571 flags.go:64] FLAG: --rotate-certificates="false" Jun 14 15:14:03.160933 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153519 2571 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 14 15:14:03.160933 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153522 2571 flags.go:64] FLAG: --runonce="false" Jun 14 15:14:03.160933 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153525 2571 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 14 15:14:03.161795 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153528 2571 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 14 15:14:03.161795 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153531 2571 flags.go:64] FLAG: --seccomp-default="false" Jun 14 15:14:03.161795 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153534 2571 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 14 15:14:03.161795 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153538 2571 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 14 15:14:03.161795 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153541 2571 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 14 15:14:03.161795 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153545 2571 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 14 15:14:03.161795 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153548 2571 flags.go:64] FLAG: --storage-driver-password="root" Jun 14 15:14:03.161795 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153551 2571 flags.go:64] FLAG: --storage-driver-secure="false" Jun 14 15:14:03.161795 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153554 2571 flags.go:64] FLAG: --storage-driver-table="stats" Jun 14 15:14:03.161795 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153556 2571 flags.go:64] FLAG: --storage-driver-user="root" Jun 14 15:14:03.161795 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153559 2571 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 14 15:14:03.161795 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153562 2571 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 14 15:14:03.161795 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153565 2571 flags.go:64] FLAG: --system-cgroups="" Jun 14 15:14:03.161795 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153568 2571 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 14 15:14:03.161795 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153574 2571 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 14 15:14:03.161795 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153577 2571 flags.go:64] FLAG: --tls-cert-file="" Jun 14 15:14:03.161795 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153580 2571 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 14 15:14:03.161795 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153584 2571 flags.go:64] FLAG: --tls-min-version="" Jun 14 15:14:03.161795 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153586 2571 flags.go:64] FLAG: --tls-private-key-file="" Jun 14 15:14:03.161795 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153589 2571 flags.go:64] FLAG: --topology-manager-policy="none" Jun 14 15:14:03.161795 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153592 2571 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 14 15:14:03.161795 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153595 2571 flags.go:64] FLAG: --topology-manager-scope="container" Jun 14 15:14:03.161795 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153598 2571 flags.go:64] FLAG: --v="2" Jun 14 15:14:03.161795 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153602 2571 flags.go:64] FLAG: --version="false" Jun 14 15:14:03.161795 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153606 2571 flags.go:64] FLAG: --vmodule="" Jun 14 15:14:03.162653 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153610 2571 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 14 15:14:03.162653 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.153615 2571 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 14 15:14:03.162653 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.153730 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 15:14:03.162653 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.153733 2571 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 15:14:03.162653 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.153736 2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 15:14:03.162653 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.153740 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 15:14:03.162653 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.153743 2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 15:14:03.162653 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.153746 2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 15:14:03.162653 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.153748 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 15:14:03.162653 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.153751 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 15:14:03.162653 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.153755 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 15:14:03.162653 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.153758 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 15:14:03.162653 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.153761 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 15:14:03.162653 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.153764 2571 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 15:14:03.162653 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.153766 2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 15:14:03.162653 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.153769 2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 15:14:03.162653 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.153773 2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 15:14:03.162653 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.153776 2571 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 15:14:03.162653 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.153778 2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 15:14:03.162653 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.153781 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 15:14:03.163175 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.153783 2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 15:14:03.163175 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.153786 2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 15:14:03.163175 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.153788 2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 15:14:03.163175 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.153791 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 15:14:03.163175 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.153793 2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 15:14:03.163175 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.153796 2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 15:14:03.163175 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.153801 2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 15:14:03.163175 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.153804 2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 15:14:03.163175 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.153808 2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 15:14:03.163175 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.153811 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 15:14:03.163175 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.153813 2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 15:14:03.163175 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.153816 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 15:14:03.163175 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.153820 2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 15:14:03.163175 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.153825 2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 15:14:03.163175 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.153828 2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 15:14:03.163175 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.153831 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 15:14:03.163175 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.153835 2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 15:14:03.163175 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.153839 2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 15:14:03.163652 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.153842 2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 15:14:03.163652 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.153845 2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 15:14:03.163652 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.153848 2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 15:14:03.163652 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.153850 2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 15:14:03.163652 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.153854 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 15:14:03.163652 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.153857 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 15:14:03.163652 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.153860 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 15:14:03.163652 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.153862 2571 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 15:14:03.163652 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.153865 2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 15:14:03.163652 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.153868 2571 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 15:14:03.163652 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.153870 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 15:14:03.163652 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.153873 2571 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 15:14:03.163652 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.153876 2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 15:14:03.163652 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.153878 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 15:14:03.163652 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.153881 2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 15:14:03.163652 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.153884 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 15:14:03.163652 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.153886 2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 15:14:03.163652 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.153889 2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 15:14:03.163652 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.153891 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 15:14:03.163652 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.153894 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 15:14:03.164153 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.153896 2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 15:14:03.164153 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.153898 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 15:14:03.164153 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.153901 2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 15:14:03.164153 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.153904 2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 15:14:03.164153 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.153906 2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 15:14:03.164153 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.153909 2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 15:14:03.164153 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.153911 2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 15:14:03.164153 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.153915 2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 15:14:03.164153 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.153918 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 15:14:03.164153 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.153920 2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 15:14:03.164153 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.153923 2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 15:14:03.164153 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.153925 2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 15:14:03.164153 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.153928 2571 feature_gate.go:328] unrecognized feature gate: Example Jun 14 15:14:03.164153 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.153930 2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 15:14:03.164153 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.153933 2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 15:14:03.164153 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.153935 2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 15:14:03.164153 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.153939 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 15:14:03.164153 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.153942 2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 15:14:03.164153 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.153944 2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 15:14:03.164153 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.153947 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 15:14:03.164650 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.153949 2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 15:14:03.164650 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.153952 2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 15:14:03.164650 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.153955 2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 15:14:03.164650 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.153958 2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 15:14:03.164650 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.153960 2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 15:14:03.164650 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.153963 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 15:14:03.164650 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.153966 2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 15:14:03.164650 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.153969 2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 15:14:03.164650 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.153972 2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 15:14:03.164650 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.153974 2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 15:14:03.164650 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.153977 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 15:14:03.164650 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.153979 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 15:14:03.164650 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.153982 2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 15:14:03.164650 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.153984 2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 15:14:03.164650 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.153987 2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 15:14:03.164650 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.153989 2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 15:14:03.164650 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.153992 2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 15:14:03.164650 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.153994 2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 15:14:03.164650 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.153997 2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 15:14:03.164650 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.154002 2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 15:14:03.165150 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.154004 2571 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 15:14:03.165150 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.154007 2571 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 15:14:03.165150 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.154010 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 15:14:03.165150 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.154731 2571 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 14 15:14:03.165150 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.163441 2571 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 14 15:14:03.165150 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.163462 2571 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 14 15:14:03.165150 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.164203 2571 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 14 15:14:03.165150 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.164214 2571 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 14 15:14:03.165150 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164275 2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 15:14:03.165150 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164282 2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 15:14:03.165150 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164285 2571 feature_gate.go:328] unrecognized feature gate: Example Jun 14 15:14:03.165150 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164290 2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 15:14:03.165150 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164293 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 15:14:03.165150 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164296 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 15:14:03.165150 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164299 2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 15:14:03.165532 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164302 2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 15:14:03.165532 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164304 2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 15:14:03.165532 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164307 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 15:14:03.165532 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164310 2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 15:14:03.165532 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164312 2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 15:14:03.165532 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164315 2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 15:14:03.165532 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164318 2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 15:14:03.165532 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164320 2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 15:14:03.165532 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164323 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 15:14:03.165532 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164325 2571 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 15:14:03.165532 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164328 2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 15:14:03.165532 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164331 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 15:14:03.165532 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164333 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 15:14:03.165532 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164336 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 15:14:03.165532 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164339 2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 15:14:03.165532 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164341 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 15:14:03.165532 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164344 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 15:14:03.165532 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164347 2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 15:14:03.165532 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164349 2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 15:14:03.165532 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164352 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 15:14:03.166122 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164354 2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 15:14:03.166122 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164357 2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 15:14:03.166122 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164361 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 15:14:03.166122 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164364 2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 15:14:03.166122 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164367 2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 15:14:03.166122 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164370 2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 15:14:03.166122 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164372 2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 15:14:03.166122 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164377 2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 15:14:03.166122 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164380 2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 15:14:03.166122 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164384 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 15:14:03.166122 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164386 2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 15:14:03.166122 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164389 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 15:14:03.166122 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164392 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 15:14:03.166122 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164395 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 15:14:03.166122 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164397 2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 15:14:03.166122 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164400 2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 15:14:03.166122 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164403 2571 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 15:14:03.166122 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164405 2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 15:14:03.166122 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164408 2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 15:14:03.166602 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164412 2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 15:14:03.166602 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164415 2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 15:14:03.166602 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164417 2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 15:14:03.166602 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164420 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 15:14:03.166602 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164423 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 15:14:03.166602 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164425 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 15:14:03.166602 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164428 2571 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 15:14:03.166602 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164431 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 15:14:03.166602 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164434 2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 15:14:03.166602 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164437 2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 15:14:03.166602 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164439 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 15:14:03.166602 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164443 2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 15:14:03.166602 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164446 2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 15:14:03.166602 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164448 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 15:14:03.166602 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164451 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 15:14:03.166602 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164454 2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 15:14:03.166602 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164458 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 15:14:03.166602 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164460 2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 15:14:03.166602 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164463 2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 15:14:03.166602 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164466 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 15:14:03.167109 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164470 2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 15:14:03.167109 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164474 2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 15:14:03.167109 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164477 2571 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 15:14:03.167109 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164480 2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 15:14:03.167109 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164483 2571 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 15:14:03.167109 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164486 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 15:14:03.167109 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164488 2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 15:14:03.167109 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164491 2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 15:14:03.167109 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164494 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 15:14:03.167109 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164497 2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 15:14:03.167109 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164499 2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 15:14:03.167109 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164502 2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 15:14:03.167109 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164506 2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 15:14:03.167109 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164510 2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 15:14:03.167109 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164513 2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 15:14:03.167109 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164516 2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 15:14:03.167109 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164518 2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 15:14:03.167109 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164521 2571 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 15:14:03.167109 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164523 2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 15:14:03.167560 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164526 2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 15:14:03.167560 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164529 2571 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 15:14:03.167560 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164531 2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 15:14:03.167560 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164534 2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 15:14:03.167560 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164537 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 15:14:03.167560 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164540 2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 15:14:03.167560 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164542 2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 15:14:03.167560 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164545 2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 15:14:03.167560 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164548 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 15:14:03.167560 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164551 2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 15:14:03.167560 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164554 2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 15:14:03.167560 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164557 2571 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 15:14:03.167560 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164560 2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 15:14:03.167560 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164562 2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 15:14:03.167560 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.164567 2571 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 14 15:14:03.167934 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164685 2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 15:14:03.167934 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164689 2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 15:14:03.167934 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164692 2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 15:14:03.167934 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164695 2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 15:14:03.167934 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164698 2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 15:14:03.167934 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164701 2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 15:14:03.167934 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164704 2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 15:14:03.167934 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164707 2571 feature_gate.go:328] unrecognized feature gate: Example Jun 14 15:14:03.167934 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164710 2571 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 15:14:03.167934 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164713 2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 15:14:03.167934 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164715 2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 15:14:03.167934 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164718 2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 15:14:03.167934 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164721 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 15:14:03.167934 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164724 2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 15:14:03.167934 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164726 2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 15:14:03.167934 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164729 2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 15:14:03.167934 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164732 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 15:14:03.167934 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164734 2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 15:14:03.167934 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164737 2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 15:14:03.167934 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164739 2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 15:14:03.168488 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164742 2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 15:14:03.168488 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164744 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 15:14:03.168488 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164747 2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 15:14:03.168488 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164750 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 15:14:03.168488 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164752 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 15:14:03.168488 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164755 2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 15:14:03.168488 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164758 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 15:14:03.168488 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164761 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 15:14:03.168488 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164764 2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 15:14:03.168488 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164766 2571 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 15:14:03.168488 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164769 2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 15:14:03.168488 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164772 2571 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 15:14:03.168488 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164775 2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 15:14:03.168488 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164778 2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 15:14:03.168488 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164782 2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 15:14:03.168488 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164785 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 15:14:03.168488 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164788 2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 15:14:03.168488 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164791 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 15:14:03.168488 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164794 2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 15:14:03.168950 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164797 2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 15:14:03.168950 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164799 2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 15:14:03.168950 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164802 2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 15:14:03.168950 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164804 2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 15:14:03.168950 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164807 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 15:14:03.168950 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164809 2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 15:14:03.168950 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164813 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 15:14:03.168950 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164816 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 15:14:03.168950 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164818 2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 15:14:03.168950 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164820 2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 15:14:03.168950 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164823 2571 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 15:14:03.168950 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164825 2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 15:14:03.168950 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164828 2571 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 15:14:03.168950 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164830 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 15:14:03.168950 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164833 2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 15:14:03.168950 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164835 2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 15:14:03.168950 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164838 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 15:14:03.168950 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164841 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 15:14:03.168950 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164844 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 15:14:03.168950 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164846 2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 15:14:03.169442 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164849 2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 15:14:03.169442 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164852 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 15:14:03.169442 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164854 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 15:14:03.169442 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164857 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 15:14:03.169442 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164859 2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 15:14:03.169442 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164862 2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 15:14:03.169442 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164864 2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 15:14:03.169442 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164867 2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 15:14:03.169442 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164869 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 15:14:03.169442 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164872 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 15:14:03.169442 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164874 2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 15:14:03.169442 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164878 2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 15:14:03.169442 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164881 2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 15:14:03.169442 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164884 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 15:14:03.169442 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164886 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 15:14:03.169442 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164889 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 15:14:03.169442 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164891 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 15:14:03.169442 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164893 2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 15:14:03.169442 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164896 2571 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 15:14:03.169442 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164899 2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 15:14:03.169958 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164902 2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 15:14:03.169958 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164904 2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 15:14:03.169958 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164907 2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 15:14:03.169958 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164909 2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 15:14:03.169958 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164911 2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 15:14:03.169958 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164914 2571 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 15:14:03.169958 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164917 2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 15:14:03.169958 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164919 2571 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 15:14:03.169958 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164922 2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 15:14:03.169958 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164924 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 15:14:03.169958 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164927 2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 15:14:03.169958 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164931 2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 15:14:03.169958 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164935 2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 15:14:03.169958 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164938 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 15:14:03.169958 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164941 2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 15:14:03.169958 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164944 2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 15:14:03.169958 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164946 2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 15:14:03.169958 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164949 2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 15:14:03.169958 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164951 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 15:14:03.170444 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:03.164954 2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 15:14:03.170444 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.164959 2571 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 14 15:14:03.170444 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.165114 2571 server.go:962] "Client rotation is on, will bootstrap in background" Jun 14 15:14:03.170444 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.167433 2571 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 14 15:14:03.170444 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.168890 2571 server.go:1019] "Starting client certificate rotation" Jun 14 15:14:03.170444 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.168990 2571 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 14 15:14:03.170444 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.169026 2571 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 14 15:14:03.171664 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.171649 2571 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 14 15:14:03.173309 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.173286 2571 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 14 15:14:03.184074 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.184039 2571 log.go:25] "Validated CRI v1 runtime API" Jun 14 15:14:03.191490 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.191472 2571 log.go:25] "Validated CRI v1 image API" Jun 14 15:14:03.192268 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.192255 2571 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 14 15:14:03.195644 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.195624 2571 fs.go:135] Filesystem UUIDs: map[08f447f8-0b1d-4b21-b029-1072f92740d1:/dev/nvme0n1p4 682fe090-e143-4b19-b7ac-0c3aef117750:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jun 14 15:14:03.195716 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.195643 2571 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 14 15:14:03.202333 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.202193 2571 manager.go:216] Machine: {Timestamp:2026-06-14 15:14:03.200905111 +0000 UTC m=+0.382387618 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3096034 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2d93dfc85bc2f65dcdea05c231c716 SystemUUID:ec2d93df-c85b-c2f6-5dcd-ea05c231c716 BootID:c868f73f-04b1-4d06-8443-18b0be8ef4d1 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:06:f5:ee:da:7b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:06:f5:ee:da:7b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:06:0a:62:30:50:ba Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 14 15:14:03.202333 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.202321 2571 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 14 15:14:03.202487 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.202414 2571 manager.go:232] Version: {KernelVersion:5.14.0-570.120.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260608-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 14 15:14:03.204535 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.204461 2571 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 14 15:14:03.204894 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.204577 2571 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-30.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 14 15:14:03.205849 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.205827 2571 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 14 15:14:03.206281 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.206269 2571 topology_manager.go:138] "Creating topology manager with none policy" Jun 14 15:14:03.206319 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.206285 2571 container_manager_linux.go:309] "Creating device plugin manager" Jun 14 15:14:03.206319 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.206294 2571 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 14 15:14:03.207471 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.207460 2571 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 14 15:14:03.209095 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.209084 2571 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 14 15:14:03.212289 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.212277 2571 state_mem.go:36] "Initialized new in-memory state store" Jun 14 15:14:03.212599 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.212589 2571 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 14 15:14:03.212636 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.212621 2571 kubelet.go:486] "Attempting to sync node with API server" Jun 14 15:14:03.212636 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.212631 2571 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 14 15:14:03.212697 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.212646 2571 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 14 15:14:03.212697 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.212656 2571 kubelet.go:398] "Adding apiserver pod source" Jun 14 15:14:03.212697 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.212665 2571 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 14 15:14:03.213231 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.213219 2571 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 14 15:14:03.213289 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.213242 2571 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 14 15:14:03.215851 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.215830 2571 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 14 15:14:03.217646 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.217631 2571 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 14 15:14:03.217727 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.217662 2571 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 14 15:14:03.217832 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.217822 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 14 15:14:03.217863 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.217837 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 14 15:14:03.217863 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.217843 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 14 15:14:03.217863 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.217849 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 14 15:14:03.217863 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.217857 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 14 15:14:03.217863 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.217864 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 14 15:14:03.218506 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.218496 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 14 15:14:03.218506 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.218506 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 14 15:14:03.218571 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.218513 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 14 15:14:03.218571 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.218519 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 14 15:14:03.218571 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.218527 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 14 15:14:03.218571 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.218534 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 14 15:14:03.220232 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.220217 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 14 15:14:03.220232 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.220232 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 14 15:14:03.222645 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.222622 2571 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-30.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 14 15:14:03.222735 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:03.222628 2571 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-30.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 14 15:14:03.222735 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:03.222679 2571 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 14 15:14:03.223730 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.223715 2571 server.go:1268] "Started kubelet" Jun 14 15:14:03.223808 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.223765 2571 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 14 15:14:03.224034 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.223855 2571 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 14 15:14:03.224203 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.224187 2571 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 14 15:14:03.224763 ip-10-0-140-30 systemd[1]: Started Kubernetes Kubelet. Jun 14 15:14:03.226504 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.226467 2571 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 14 15:14:03.226798 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.226783 2571 server.go:310] "Adding debug handlers to kubelet server" Jun 14 15:14:03.231249 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:03.231227 2571 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 14 15:14:03.231724 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.231708 2571 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vsb88" Jun 14 15:14:03.231944 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:03.230905 2571 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-30.ec2.internal.18b8fb6033739a47 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-30.ec2.internal,UID:ip-10-0-140-30.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-30.ec2.internal,},FirstTimestamp:2026-06-14 15:14:03.223677511 +0000 UTC m=+0.405160019,LastTimestamp:2026-06-14 15:14:03.223677511 +0000 UTC m=+0.405160019,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-30.ec2.internal,}" Jun 14 15:14:03.232341 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.232320 2571 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 14 15:14:03.232423 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.232336 2571 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 14 15:14:03.232591 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:03.232570 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-30.ec2.internal\" not found" Jun 14 15:14:03.233739 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.233720 2571 factory.go:55] Registering systemd factory Jun 14 15:14:03.233739 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.233742 2571 factory.go:223] Registration of the systemd container factory successfully Jun 14 15:14:03.234032 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.234018 2571 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 14 15:14:03.234148 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.234138 2571 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 14 15:14:03.234455 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.234443 2571 reconstruct.go:97] "Volume reconstruction finished" Jun 14 15:14:03.234554 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.234536 2571 reconciler.go:29] "Reconciler: start to sync state" Jun 14 15:14:03.234554 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.234499 2571 factory.go:153] Registering CRI-O factory Jun 14 15:14:03.234667 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.234567 2571 factory.go:223] Registration of the crio container factory successfully Jun 14 15:14:03.234667 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.234621 2571 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 14 15:14:03.234667 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.234644 2571 factory.go:103] Registering Raw factory Jun 14 15:14:03.234667 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.234659 2571 manager.go:1196] Started watching for new ooms in manager Jun 14 15:14:03.235008 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.234989 2571 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 14 15:14:03.235257 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.235245 2571 manager.go:349] Starting recovery of all containers Jun 14 15:14:03.240060 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.240019 2571 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vsb88" Jun 14 15:14:03.244192 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:03.244003 2571 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 14 15:14:03.244826 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:03.244795 2571 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-30.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 14 15:14:03.246673 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.246656 2571 manager.go:354] Recovery completed Jun 14 15:14:03.247840 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:03.247811 2571 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jun 14 15:14:03.250871 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.250860 2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 15:14:03.253468 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.253450 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-30.ec2.internal" event="NodeHasSufficientMemory" Jun 14 15:14:03.253526 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.253479 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-30.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 15:14:03.253526 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.253489 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-30.ec2.internal" event="NodeHasSufficientPID" Jun 14 15:14:03.254064 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.254029 2571 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 14 15:14:03.254064 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.254058 2571 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 14 15:14:03.254206 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.254064 2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 15:14:03.254206 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.254077 2571 state_mem.go:36] "Initialized new in-memory state store" Jun 14 15:14:03.254748 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.254734 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-30.ec2.internal" event="NodeHasSufficientMemory" Jun 14 15:14:03.254804 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.254760 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-30.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 15:14:03.254804 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.254770 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-30.ec2.internal" event="NodeHasSufficientPID" Jun 14 15:14:03.255138 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.255124 2571 policy_none.go:49] "None policy: Start" Jun 14 15:14:03.255200 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.255141 2571 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 14 15:14:03.255200 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.255155 2571 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 14 15:14:03.256105 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.256092 2571 policy_none.go:47] "Start" Jun 14 15:14:03.296661 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.296646 2571 manager.go:337] "Starting Device Plugin manager" Jun 14 15:14:03.304359 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:03.296688 2571 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 14 15:14:03.304359 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.296701 2571 server.go:87] "Starting device plugin registration server" Jun 14 15:14:03.304359 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.296967 2571 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 14 15:14:03.304359 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.296979 2571 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 14 15:14:03.304359 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.297096 2571 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 14 15:14:03.304359 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.297211 2571 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 14 15:14:03.304359 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.297221 2571 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 14 15:14:03.304359 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:03.297743 2571 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 14 15:14:03.304359 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:03.297795 2571 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-30.ec2.internal\" not found" Jun 14 15:14:03.304359 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.297861 2571 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 14 15:14:03.304359 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.299116 2571 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 14 15:14:03.304359 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.299152 2571 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 14 15:14:03.304359 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.299169 2571 kubelet.go:2448] "Starting kubelet main sync loop" Jun 14 15:14:03.304359 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:03.299202 2571 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 14 15:14:03.304359 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.301703 2571 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 15:14:03.398227 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.398114 2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 15:14:03.399303 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.399266 2571 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-30.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-30.ec2.internal"] Jun 14 15:14:03.399449 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.399314 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-30.ec2.internal" event="NodeHasSufficientMemory" Jun 14 15:14:03.399449 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.399346 2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 15:14:03.399449 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.399353 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-30.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 15:14:03.399449 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.399368 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-30.ec2.internal" event="NodeHasSufficientPID" Jun 14 15:14:03.399449 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.399399 2571 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-30.ec2.internal" Jun 14 15:14:03.400790 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.400773 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-30.ec2.internal" event="NodeHasSufficientMemory" Jun 14 15:14:03.400883 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.400801 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-30.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 15:14:03.400883 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.400840 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-30.ec2.internal" event="NodeHasSufficientPID" Jun 14 15:14:03.403085 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.403070 2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 15:14:03.403172 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.403155 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-30.ec2.internal" Jun 14 15:14:03.403231 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.403195 2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 15:14:03.403829 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.403812 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-30.ec2.internal" event="NodeHasSufficientMemory" Jun 14 15:14:03.403881 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.403844 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-30.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 15:14:03.403881 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.403854 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-30.ec2.internal" event="NodeHasSufficientPID" Jun 14 15:14:03.403940 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.403814 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-30.ec2.internal" event="NodeHasSufficientMemory" Jun 14 15:14:03.403940 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.403925 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-30.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 15:14:03.403940 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.403937 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-30.ec2.internal" event="NodeHasSufficientPID" Jun 14 15:14:03.406031 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.406012 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-30.ec2.internal" Jun 14 15:14:03.406098 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.406073 2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 15:14:03.407033 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.407017 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-30.ec2.internal" event="NodeHasSufficientMemory" Jun 14 15:14:03.407124 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.407067 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-30.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 15:14:03.407124 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.407081 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-30.ec2.internal" event="NodeHasSufficientPID" Jun 14 15:14:03.409125 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.409108 2571 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-30.ec2.internal" Jun 14 15:14:03.409200 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:03.409135 2571 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-30.ec2.internal\": node \"ip-10-0-140-30.ec2.internal\" not found" Jun 14 15:14:03.426322 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:03.426290 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-30.ec2.internal\" not found" Jun 14 15:14:03.434296 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:03.434271 2571 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-30.ec2.internal\" not found" node="ip-10-0-140-30.ec2.internal" Jun 14 15:14:03.439089 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:03.439071 2571 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-30.ec2.internal\" not found" node="ip-10-0-140-30.ec2.internal" Jun 14 15:14:03.526689 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:03.526659 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-30.ec2.internal\" not found" Jun 14 15:14:03.535061 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.535025 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/69720275ea361bf0c01701aa7368a435-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-30.ec2.internal\" (UID: \"69720275ea361bf0c01701aa7368a435\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-30.ec2.internal" Jun 14 15:14:03.535165 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.535075 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/69720275ea361bf0c01701aa7368a435-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-30.ec2.internal\" (UID: \"69720275ea361bf0c01701aa7368a435\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-30.ec2.internal" Jun 14 15:14:03.535165 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.535102 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/50126b156a8d7ec40dc0a7da700bcb71-config\") pod \"kube-apiserver-proxy-ip-10-0-140-30.ec2.internal\" (UID: \"50126b156a8d7ec40dc0a7da700bcb71\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-30.ec2.internal" Jun 14 15:14:03.627455 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:03.627424 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-30.ec2.internal\" not found" Jun 14 15:14:03.635758 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.635731 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/69720275ea361bf0c01701aa7368a435-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-30.ec2.internal\" (UID: \"69720275ea361bf0c01701aa7368a435\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-30.ec2.internal" Jun 14 15:14:03.635871 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.635765 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/69720275ea361bf0c01701aa7368a435-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-30.ec2.internal\" (UID: \"69720275ea361bf0c01701aa7368a435\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-30.ec2.internal" Jun 14 15:14:03.635871 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.635786 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/50126b156a8d7ec40dc0a7da700bcb71-config\") pod \"kube-apiserver-proxy-ip-10-0-140-30.ec2.internal\" (UID: \"50126b156a8d7ec40dc0a7da700bcb71\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-30.ec2.internal" Jun 14 15:14:03.635871 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.635830 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/50126b156a8d7ec40dc0a7da700bcb71-config\") pod \"kube-apiserver-proxy-ip-10-0-140-30.ec2.internal\" (UID: \"50126b156a8d7ec40dc0a7da700bcb71\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-30.ec2.internal" Jun 14 15:14:03.635871 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.635829 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/69720275ea361bf0c01701aa7368a435-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-30.ec2.internal\" (UID: \"69720275ea361bf0c01701aa7368a435\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-30.ec2.internal" Jun 14 15:14:03.635871 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.635848 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/69720275ea361bf0c01701aa7368a435-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-30.ec2.internal\" (UID: \"69720275ea361bf0c01701aa7368a435\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-30.ec2.internal" Jun 14 15:14:03.728343 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:03.728256 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-30.ec2.internal\" not found" Jun 14 15:14:03.737783 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.737756 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-30.ec2.internal" Jun 14 15:14:03.743936 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:03.743913 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-30.ec2.internal" Jun 14 15:14:03.829403 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:03.829371 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-30.ec2.internal\" not found" Jun 14 15:14:03.929916 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:03.929893 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-30.ec2.internal\" not found" Jun 14 15:14:04.030615 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:04.030531 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-30.ec2.internal\" not found" Jun 14 15:14:04.131300 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:04.131262 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-30.ec2.internal\" not found" Jun 14 15:14:04.167938 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:04.167902 2571 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 14 15:14:04.168898 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:04.168094 2571 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 14 15:14:04.231931 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:04.231901 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-30.ec2.internal\" not found" Jun 14 15:14:04.245391 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:04.245362 2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-13 15:09:03 +0000 UTC" deadline="2028-02-11 06:59:08.467015943 +0000 UTC" Jun 14 15:14:04.245391 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:04.245388 2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14559h45m4.221631391s" Jun 14 15:14:04.284590 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:04.284527 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50126b156a8d7ec40dc0a7da700bcb71.slice/crio-41aebcaa81c74167702389ddd1496af580cced294bf51babaff5da73de3648e0 WatchSource:0}: Error finding container 41aebcaa81c74167702389ddd1496af580cced294bf51babaff5da73de3648e0: Status 404 returned error can't find the container with id 41aebcaa81c74167702389ddd1496af580cced294bf51babaff5da73de3648e0 Jun 14 15:14:04.289145 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:04.289128 2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 14 15:14:04.301886 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:04.301851 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-30.ec2.internal" event={"ID":"69720275ea361bf0c01701aa7368a435","Type":"ContainerStarted","Data":"90cdceef3f1bd7dd618474fd42b0e6340fdc899565950540a74f0ab07861fdae"} Jun 14 15:14:04.302860 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:04.302844 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-30.ec2.internal" event={"ID":"50126b156a8d7ec40dc0a7da700bcb71","Type":"ContainerStarted","Data":"41aebcaa81c74167702389ddd1496af580cced294bf51babaff5da73de3648e0"} Jun 14 15:14:04.333010 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:04.332986 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-30.ec2.internal\" not found" Jun 14 15:14:04.433443 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:04.433414 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-30.ec2.internal\" not found" Jun 14 15:14:04.534470 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:04.534222 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-30.ec2.internal\" not found" Jun 14 15:14:04.536673 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:04.536611 2571 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 15:14:04.617298 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:04.617269 2571 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 15:14:04.635322 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:04.635281 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-30.ec2.internal\" not found" Jun 14 15:14:04.736235 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:04.736185 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-30.ec2.internal\" not found" Jun 14 15:14:04.816226 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:04.816130 2571 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 15:14:04.833319 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:04.833107 2571 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-30.ec2.internal" Jun 14 15:14:04.845122 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:04.845040 2571 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 14 15:14:04.846183 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:04.846163 2571 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-30.ec2.internal" Jun 14 15:14:04.855617 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:04.855594 2571 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 14 15:14:05.092216 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.092143 2571 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 15:14:05.213847 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.213810 2571 apiserver.go:52] "Watching apiserver" Jun 14 15:14:05.221069 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.221029 2571 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 14 15:14:05.221475 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.221452 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-nb6vz","openshift-ovn-kubernetes/ovnkube-node-ltnnm","kube-system/konnectivity-agent-59js7","kube-system/kube-apiserver-proxy-ip-10-0-140-30.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vlqmf","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-30.ec2.internal","openshift-multus/multus-additional-cni-plugins-kn9qq","openshift-network-diagnostics/network-check-target-jqckm","openshift-network-operator/iptables-alerter-r5pb4","kube-system/global-pull-secret-syncer-lfxgl","openshift-cluster-node-tuning-operator/tuned-xg8b5","openshift-dns/node-resolver-8w5cg","openshift-image-registry/node-ca-5fg9d","openshift-multus/multus-nlqnj"] Jun 14 15:14:05.223911 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.223892 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lfxgl" Jun 14 15:14:05.224029 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:05.223977 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lfxgl" podUID="15bccd1f-7f51-4c8b-8b76-75481887049f" Jun 14 15:14:05.226029 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.226010 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5fg9d" Jun 14 15:14:05.228176 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.228152 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-59js7" Jun 14 15:14:05.230248 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.230231 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-nlqnj" Jun 14 15:14:05.232542 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.232525 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vlqmf" Jun 14 15:14:05.233076 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.233057 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 14 15:14:05.233076 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.233074 2571 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 14 15:14:05.233980 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.233735 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 14 15:14:05.233980 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.233772 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 14 15:14:05.233980 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.233775 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 14 15:14:05.233980 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.233891 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 14 15:14:05.233980 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.233925 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 14 15:14:05.234352 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.234020 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-sc95z\"" Jun 14 15:14:05.234352 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.234058 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-hm9ps\"" Jun 14 15:14:05.234352 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.234084 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 14 15:14:05.234352 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.234020 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-npgqt\"" Jun 14 15:14:05.234658 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.234639 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 14 15:14:05.234875 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.234853 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 14 15:14:05.235485 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.235451 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 14 15:14:05.235563 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.235471 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 14 15:14:05.235623 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.235604 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-bqrrv\"" Jun 14 15:14:05.235840 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.235723 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jqckm" Jun 14 15:14:05.235840 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:05.235797 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jqckm" podUID="5769083d-c587-4660-a48d-2c58b8eccc78" Jun 14 15:14:05.238316 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.238295 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-r5pb4" Jun 14 15:14:05.239493 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.239421 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 14 15:14:05.240587 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.240564 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kn9qq" Jun 14 15:14:05.241698 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.241655 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 14 15:14:05.241945 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.241771 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 14 15:14:05.241945 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.241878 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-q5jlg\"" Jun 14 15:14:05.242208 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.242191 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 14 15:14:05.243431 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.243016 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ltnnm" Jun 14 15:14:05.243431 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.243145 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-rntc4\"" Jun 14 15:14:05.243682 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.243662 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/87a9a729-3c3f-451a-bcd6-c8726159c1c0-host-run-netns\") pod \"multus-nlqnj\" (UID: \"87a9a729-3c3f-451a-bcd6-c8726159c1c0\") " pod="openshift-multus/multus-nlqnj" Jun 14 15:14:05.243755 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.243696 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/87a9a729-3c3f-451a-bcd6-c8726159c1c0-etc-kubernetes\") pod \"multus-nlqnj\" (UID: \"87a9a729-3c3f-451a-bcd6-c8726159c1c0\") " pod="openshift-multus/multus-nlqnj" Jun 14 15:14:05.243755 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.243747 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/87a9a729-3c3f-451a-bcd6-c8726159c1c0-host-var-lib-kubelet\") pod \"multus-nlqnj\" (UID: \"87a9a729-3c3f-451a-bcd6-c8726159c1c0\") " pod="openshift-multus/multus-nlqnj" Jun 14 15:14:05.243848 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.243780 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76clw\" (UniqueName: \"kubernetes.io/projected/87a9a729-3c3f-451a-bcd6-c8726159c1c0-kube-api-access-76clw\") pod \"multus-nlqnj\" (UID: \"87a9a729-3c3f-451a-bcd6-c8726159c1c0\") " pod="openshift-multus/multus-nlqnj" Jun 14 15:14:05.243848 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.243811 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/87a9a729-3c3f-451a-bcd6-c8726159c1c0-multus-cni-dir\") pod \"multus-nlqnj\" (UID: \"87a9a729-3c3f-451a-bcd6-c8726159c1c0\") " pod="openshift-multus/multus-nlqnj" Jun 14 15:14:05.243848 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.243837 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/87a9a729-3c3f-451a-bcd6-c8726159c1c0-cni-binary-copy\") pod \"multus-nlqnj\" (UID: \"87a9a729-3c3f-451a-bcd6-c8726159c1c0\") " pod="openshift-multus/multus-nlqnj" Jun 14 15:14:05.244037 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.243861 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/87a9a729-3c3f-451a-bcd6-c8726159c1c0-multus-daemon-config\") pod \"multus-nlqnj\" (UID: \"87a9a729-3c3f-451a-bcd6-c8726159c1c0\") " pod="openshift-multus/multus-nlqnj" Jun 14 15:14:05.244037 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.243884 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/581eef2b-70ee-4bb7-b721-fac3d801a93a-device-dir\") pod \"aws-ebs-csi-driver-node-vlqmf\" (UID: \"581eef2b-70ee-4bb7-b721-fac3d801a93a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vlqmf" Jun 14 15:14:05.244037 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.243909 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtb6n\" (UniqueName: \"kubernetes.io/projected/581eef2b-70ee-4bb7-b721-fac3d801a93a-kube-api-access-gtb6n\") pod \"aws-ebs-csi-driver-node-vlqmf\" (UID: \"581eef2b-70ee-4bb7-b721-fac3d801a93a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vlqmf" Jun 14 15:14:05.244037 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.243967 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbvld\" (UniqueName: \"kubernetes.io/projected/5ffbcb60-2145-4431-b8e8-0f7528cb4851-kube-api-access-jbvld\") pod \"node-ca-5fg9d\" (UID: \"5ffbcb60-2145-4431-b8e8-0f7528cb4851\") " pod="openshift-image-registry/node-ca-5fg9d" Jun 14 15:14:05.244037 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.243992 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0c99e6cb-ee5c-45c5-9635-839d2f237c0b-konnectivity-ca\") pod \"konnectivity-agent-59js7\" (UID: \"0c99e6cb-ee5c-45c5-9635-839d2f237c0b\") " pod="kube-system/konnectivity-agent-59js7" Jun 14 15:14:05.244037 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.244015 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/87a9a729-3c3f-451a-bcd6-c8726159c1c0-multus-socket-dir-parent\") pod \"multus-nlqnj\" (UID: \"87a9a729-3c3f-451a-bcd6-c8726159c1c0\") " pod="openshift-multus/multus-nlqnj" Jun 14 15:14:05.244358 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.244072 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/87a9a729-3c3f-451a-bcd6-c8726159c1c0-multus-conf-dir\") pod \"multus-nlqnj\" (UID: \"87a9a729-3c3f-451a-bcd6-c8726159c1c0\") " pod="openshift-multus/multus-nlqnj" Jun 14 15:14:05.244358 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.244104 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/581eef2b-70ee-4bb7-b721-fac3d801a93a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vlqmf\" (UID: \"581eef2b-70ee-4bb7-b721-fac3d801a93a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vlqmf" Jun 14 15:14:05.244358 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.244130 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/581eef2b-70ee-4bb7-b721-fac3d801a93a-sys-fs\") pod \"aws-ebs-csi-driver-node-vlqmf\" (UID: \"581eef2b-70ee-4bb7-b721-fac3d801a93a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vlqmf" Jun 14 15:14:05.244358 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.244153 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/15bccd1f-7f51-4c8b-8b76-75481887049f-original-pull-secret\") pod \"global-pull-secret-syncer-lfxgl\" (UID: \"15bccd1f-7f51-4c8b-8b76-75481887049f\") " pod="kube-system/global-pull-secret-syncer-lfxgl" Jun 14 15:14:05.244358 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.244212 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/87a9a729-3c3f-451a-bcd6-c8726159c1c0-host-run-k8s-cni-cncf-io\") pod \"multus-nlqnj\" (UID: \"87a9a729-3c3f-451a-bcd6-c8726159c1c0\") " pod="openshift-multus/multus-nlqnj" Jun 14 15:14:05.244358 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.244235 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/87a9a729-3c3f-451a-bcd6-c8726159c1c0-host-var-lib-cni-multus\") pod \"multus-nlqnj\" (UID: \"87a9a729-3c3f-451a-bcd6-c8726159c1c0\") " pod="openshift-multus/multus-nlqnj" Jun 14 15:14:05.244358 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.244256 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 14 15:14:05.244358 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.244260 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wln4b\" (UniqueName: \"kubernetes.io/projected/5769083d-c587-4660-a48d-2c58b8eccc78-kube-api-access-wln4b\") pod \"network-check-target-jqckm\" (UID: \"5769083d-c587-4660-a48d-2c58b8eccc78\") " pod="openshift-network-diagnostics/network-check-target-jqckm" Jun 14 15:14:05.244358 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.244280 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0c99e6cb-ee5c-45c5-9635-839d2f237c0b-agent-certs\") pod \"konnectivity-agent-59js7\" (UID: \"0c99e6cb-ee5c-45c5-9635-839d2f237c0b\") " pod="kube-system/konnectivity-agent-59js7" Jun 14 15:14:05.244358 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.244296 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/87a9a729-3c3f-451a-bcd6-c8726159c1c0-system-cni-dir\") pod \"multus-nlqnj\" (UID: \"87a9a729-3c3f-451a-bcd6-c8726159c1c0\") " pod="openshift-multus/multus-nlqnj" Jun 14 15:14:05.244358 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.244320 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/87a9a729-3c3f-451a-bcd6-c8726159c1c0-host-var-lib-cni-bin\") pod \"multus-nlqnj\" (UID: \"87a9a729-3c3f-451a-bcd6-c8726159c1c0\") " pod="openshift-multus/multus-nlqnj" Jun 14 15:14:05.244358 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.244345 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/87a9a729-3c3f-451a-bcd6-c8726159c1c0-host-run-multus-certs\") pod \"multus-nlqnj\" (UID: \"87a9a729-3c3f-451a-bcd6-c8726159c1c0\") " pod="openshift-multus/multus-nlqnj" Jun 14 15:14:05.244943 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.244367 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/581eef2b-70ee-4bb7-b721-fac3d801a93a-etc-selinux\") pod \"aws-ebs-csi-driver-node-vlqmf\" (UID: \"581eef2b-70ee-4bb7-b721-fac3d801a93a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vlqmf" Jun 14 15:14:05.244943 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.244408 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/15bccd1f-7f51-4c8b-8b76-75481887049f-dbus\") pod \"global-pull-secret-syncer-lfxgl\" (UID: \"15bccd1f-7f51-4c8b-8b76-75481887049f\") " pod="kube-system/global-pull-secret-syncer-lfxgl" Jun 14 15:14:05.244943 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.244436 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/87a9a729-3c3f-451a-bcd6-c8726159c1c0-hostroot\") pod \"multus-nlqnj\" (UID: \"87a9a729-3c3f-451a-bcd6-c8726159c1c0\") " pod="openshift-multus/multus-nlqnj" Jun 14 15:14:05.244943 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.244468 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 14 15:14:05.244943 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.244475 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/581eef2b-70ee-4bb7-b721-fac3d801a93a-registration-dir\") pod \"aws-ebs-csi-driver-node-vlqmf\" (UID: \"581eef2b-70ee-4bb7-b721-fac3d801a93a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vlqmf" Jun 14 15:14:05.244943 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.244506 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/15bccd1f-7f51-4c8b-8b76-75481887049f-kubelet-config\") pod \"global-pull-secret-syncer-lfxgl\" (UID: \"15bccd1f-7f51-4c8b-8b76-75481887049f\") " pod="kube-system/global-pull-secret-syncer-lfxgl" Jun 14 15:14:05.244943 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.244531 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/87a9a729-3c3f-451a-bcd6-c8726159c1c0-cnibin\") pod \"multus-nlqnj\" (UID: \"87a9a729-3c3f-451a-bcd6-c8726159c1c0\") " pod="openshift-multus/multus-nlqnj" Jun 14 15:14:05.244943 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.244561 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/581eef2b-70ee-4bb7-b721-fac3d801a93a-socket-dir\") pod \"aws-ebs-csi-driver-node-vlqmf\" (UID: \"581eef2b-70ee-4bb7-b721-fac3d801a93a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vlqmf" Jun 14 15:14:05.244943 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.244589 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5ffbcb60-2145-4431-b8e8-0f7528cb4851-host\") pod \"node-ca-5fg9d\" (UID: \"5ffbcb60-2145-4431-b8e8-0f7528cb4851\") " pod="openshift-image-registry/node-ca-5fg9d" Jun 14 15:14:05.244943 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.244632 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5ffbcb60-2145-4431-b8e8-0f7528cb4851-serviceca\") pod \"node-ca-5fg9d\" (UID: \"5ffbcb60-2145-4431-b8e8-0f7528cb4851\") " pod="openshift-image-registry/node-ca-5fg9d" Jun 14 15:14:05.244943 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.244660 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/87a9a729-3c3f-451a-bcd6-c8726159c1c0-os-release\") pod \"multus-nlqnj\" (UID: \"87a9a729-3c3f-451a-bcd6-c8726159c1c0\") " pod="openshift-multus/multus-nlqnj" Jun 14 15:14:05.245554 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.245400 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nb6vz" Jun 14 15:14:05.245554 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:05.245469 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nb6vz" podUID="d0df8c3a-2915-4563-8f78-1bf2e8d5a27f" Jun 14 15:14:05.250015 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.249992 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-xg8b5" Jun 14 15:14:05.252294 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.252275 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8w5cg" Jun 14 15:14:05.257702 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.257564 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 14 15:14:05.257702 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.257591 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-fnbbp\"" Jun 14 15:14:05.257702 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.257584 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 14 15:14:05.257702 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.257587 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 14 15:14:05.258131 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.258011 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 14 15:14:05.258712 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.258694 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 14 15:14:05.260328 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.260175 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 14 15:14:05.260418 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.260389 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 14 15:14:05.260418 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.260409 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 14 15:14:05.264205 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.264181 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-2d2sm\"" Jun 14 15:14:05.265383 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.265362 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-7pjzg\"" Jun 14 15:14:05.265383 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.265386 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 14 15:14:05.265553 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.265468 2571 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 14 15:14:05.266060 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.266026 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 14 15:14:05.336940 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.336908 2571 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 14 15:14:05.344664 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.344584 2571 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-zjjwx" Jun 14 15:14:05.344847 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.344822 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ee9ddc42-3dac-47b7-a02b-899fc13a7467-ovn-node-metrics-cert\") pod \"ovnkube-node-ltnnm\" (UID: \"ee9ddc42-3dac-47b7-a02b-899fc13a7467\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltnnm" Jun 14 15:14:05.344923 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.344862 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfff6\" (UniqueName: \"kubernetes.io/projected/61fac2bb-36e8-4862-82b0-39169b4fa9cd-kube-api-access-dfff6\") pod \"node-resolver-8w5cg\" (UID: \"61fac2bb-36e8-4862-82b0-39169b4fa9cd\") " pod="openshift-dns/node-resolver-8w5cg" Jun 14 15:14:05.344923 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.344893 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/87a9a729-3c3f-451a-bcd6-c8726159c1c0-host-var-lib-kubelet\") pod \"multus-nlqnj\" (UID: \"87a9a729-3c3f-451a-bcd6-c8726159c1c0\") " pod="openshift-multus/multus-nlqnj" Jun 14 15:14:05.345022 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.344923 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ee9ddc42-3dac-47b7-a02b-899fc13a7467-host-cni-bin\") pod \"ovnkube-node-ltnnm\" (UID: \"ee9ddc42-3dac-47b7-a02b-899fc13a7467\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltnnm" Jun 14 15:14:05.345022 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.344948 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ee9ddc42-3dac-47b7-a02b-899fc13a7467-host-cni-netd\") pod \"ovnkube-node-ltnnm\" (UID: \"ee9ddc42-3dac-47b7-a02b-899fc13a7467\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltnnm" Jun 14 15:14:05.345022 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.344957 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/87a9a729-3c3f-451a-bcd6-c8726159c1c0-host-var-lib-kubelet\") pod \"multus-nlqnj\" (UID: \"87a9a729-3c3f-451a-bcd6-c8726159c1c0\") " pod="openshift-multus/multus-nlqnj" Jun 14 15:14:05.345022 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.344972 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ee9ddc42-3dac-47b7-a02b-899fc13a7467-env-overrides\") pod \"ovnkube-node-ltnnm\" (UID: \"ee9ddc42-3dac-47b7-a02b-899fc13a7467\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltnnm" Jun 14 15:14:05.345022 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.345010 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/87a9a729-3c3f-451a-bcd6-c8726159c1c0-multus-cni-dir\") pod \"multus-nlqnj\" (UID: \"87a9a729-3c3f-451a-bcd6-c8726159c1c0\") " pod="openshift-multus/multus-nlqnj" Jun 14 15:14:05.345272 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.345037 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/87a9a729-3c3f-451a-bcd6-c8726159c1c0-cni-binary-copy\") pod \"multus-nlqnj\" (UID: \"87a9a729-3c3f-451a-bcd6-c8726159c1c0\") " pod="openshift-multus/multus-nlqnj" Jun 14 15:14:05.345272 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.345075 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/87a9a729-3c3f-451a-bcd6-c8726159c1c0-multus-daemon-config\") pod \"multus-nlqnj\" (UID: \"87a9a729-3c3f-451a-bcd6-c8726159c1c0\") " pod="openshift-multus/multus-nlqnj" Jun 14 15:14:05.345272 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.345098 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/581eef2b-70ee-4bb7-b721-fac3d801a93a-device-dir\") pod \"aws-ebs-csi-driver-node-vlqmf\" (UID: \"581eef2b-70ee-4bb7-b721-fac3d801a93a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vlqmf" Jun 14 15:14:05.345272 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.345119 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gtb6n\" (UniqueName: \"kubernetes.io/projected/581eef2b-70ee-4bb7-b721-fac3d801a93a-kube-api-access-gtb6n\") pod \"aws-ebs-csi-driver-node-vlqmf\" (UID: \"581eef2b-70ee-4bb7-b721-fac3d801a93a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vlqmf" Jun 14 15:14:05.345272 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.345125 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/87a9a729-3c3f-451a-bcd6-c8726159c1c0-multus-cni-dir\") pod \"multus-nlqnj\" (UID: \"87a9a729-3c3f-451a-bcd6-c8726159c1c0\") " pod="openshift-multus/multus-nlqnj" Jun 14 15:14:05.345272 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.345144 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ee9ddc42-3dac-47b7-a02b-899fc13a7467-host-kubelet\") pod \"ovnkube-node-ltnnm\" (UID: \"ee9ddc42-3dac-47b7-a02b-899fc13a7467\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltnnm" Jun 14 15:14:05.345272 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.345163 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/87a9a729-3c3f-451a-bcd6-c8726159c1c0-multus-socket-dir-parent\") pod \"multus-nlqnj\" (UID: \"87a9a729-3c3f-451a-bcd6-c8726159c1c0\") " pod="openshift-multus/multus-nlqnj" Jun 14 15:14:05.345272 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.345178 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/87a9a729-3c3f-451a-bcd6-c8726159c1c0-multus-conf-dir\") pod \"multus-nlqnj\" (UID: \"87a9a729-3c3f-451a-bcd6-c8726159c1c0\") " pod="openshift-multus/multus-nlqnj" Jun 14 15:14:05.345272 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.345181 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/581eef2b-70ee-4bb7-b721-fac3d801a93a-device-dir\") pod \"aws-ebs-csi-driver-node-vlqmf\" (UID: \"581eef2b-70ee-4bb7-b721-fac3d801a93a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vlqmf" Jun 14 15:14:05.345272 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.345194 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9jc7\" (UniqueName: \"kubernetes.io/projected/73a47e15-a8cc-45e8-8138-d62372b4b753-kube-api-access-c9jc7\") pod \"multus-additional-cni-plugins-kn9qq\" (UID: \"73a47e15-a8cc-45e8-8138-d62372b4b753\") " pod="openshift-multus/multus-additional-cni-plugins-kn9qq" Jun 14 15:14:05.345272 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.345211 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9dca9a08-6b6e-43a2-a5ea-9a7ceca39f2e-host\") pod \"tuned-xg8b5\" (UID: \"9dca9a08-6b6e-43a2-a5ea-9a7ceca39f2e\") " pod="openshift-cluster-node-tuning-operator/tuned-xg8b5" Jun 14 15:14:05.345272 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.345235 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ee9ddc42-3dac-47b7-a02b-899fc13a7467-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ltnnm\" (UID: \"ee9ddc42-3dac-47b7-a02b-899fc13a7467\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltnnm" Jun 14 15:14:05.345272 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.345264 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/15bccd1f-7f51-4c8b-8b76-75481887049f-original-pull-secret\") pod \"global-pull-secret-syncer-lfxgl\" (UID: \"15bccd1f-7f51-4c8b-8b76-75481887049f\") " pod="kube-system/global-pull-secret-syncer-lfxgl" Jun 14 15:14:05.345848 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.345291 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9dca9a08-6b6e-43a2-a5ea-9a7ceca39f2e-etc-kubernetes\") pod \"tuned-xg8b5\" (UID: \"9dca9a08-6b6e-43a2-a5ea-9a7ceca39f2e\") " pod="openshift-cluster-node-tuning-operator/tuned-xg8b5" Jun 14 15:14:05.345848 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.345313 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9dca9a08-6b6e-43a2-a5ea-9a7ceca39f2e-etc-systemd\") pod \"tuned-xg8b5\" (UID: \"9dca9a08-6b6e-43a2-a5ea-9a7ceca39f2e\") " pod="openshift-cluster-node-tuning-operator/tuned-xg8b5" Jun 14 15:14:05.345848 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.345337 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9dca9a08-6b6e-43a2-a5ea-9a7ceca39f2e-lib-modules\") pod \"tuned-xg8b5\" (UID: \"9dca9a08-6b6e-43a2-a5ea-9a7ceca39f2e\") " pod="openshift-cluster-node-tuning-operator/tuned-xg8b5" Jun 14 15:14:05.345848 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.345359 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ee9ddc42-3dac-47b7-a02b-899fc13a7467-run-systemd\") pod \"ovnkube-node-ltnnm\" (UID: \"ee9ddc42-3dac-47b7-a02b-899fc13a7467\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltnnm" Jun 14 15:14:05.345848 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.345381 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btwj5\" (UniqueName: \"kubernetes.io/projected/ee9ddc42-3dac-47b7-a02b-899fc13a7467-kube-api-access-btwj5\") pod \"ovnkube-node-ltnnm\" (UID: \"ee9ddc42-3dac-47b7-a02b-899fc13a7467\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltnnm" Jun 14 15:14:05.345848 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.345416 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/87a9a729-3c3f-451a-bcd6-c8726159c1c0-host-run-multus-certs\") pod \"multus-nlqnj\" (UID: \"87a9a729-3c3f-451a-bcd6-c8726159c1c0\") " pod="openshift-multus/multus-nlqnj" Jun 14 15:14:05.345848 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.345441 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/581eef2b-70ee-4bb7-b721-fac3d801a93a-etc-selinux\") pod \"aws-ebs-csi-driver-node-vlqmf\" (UID: \"581eef2b-70ee-4bb7-b721-fac3d801a93a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vlqmf" Jun 14 15:14:05.345848 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.345497 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbc77\" (UniqueName: \"kubernetes.io/projected/93923012-e70e-49c0-9578-f00c009dc2a6-kube-api-access-fbc77\") pod \"iptables-alerter-r5pb4\" (UID: \"93923012-e70e-49c0-9578-f00c009dc2a6\") " pod="openshift-network-operator/iptables-alerter-r5pb4" Jun 14 15:14:05.345848 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.345515 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/73a47e15-a8cc-45e8-8138-d62372b4b753-os-release\") pod \"multus-additional-cni-plugins-kn9qq\" (UID: \"73a47e15-a8cc-45e8-8138-d62372b4b753\") " pod="openshift-multus/multus-additional-cni-plugins-kn9qq" Jun 14 15:14:05.345848 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.345537 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9dca9a08-6b6e-43a2-a5ea-9a7ceca39f2e-tmp\") pod \"tuned-xg8b5\" (UID: \"9dca9a08-6b6e-43a2-a5ea-9a7ceca39f2e\") " pod="openshift-cluster-node-tuning-operator/tuned-xg8b5" Jun 14 15:14:05.345848 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.345561 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ee9ddc42-3dac-47b7-a02b-899fc13a7467-host-slash\") pod \"ovnkube-node-ltnnm\" (UID: \"ee9ddc42-3dac-47b7-a02b-899fc13a7467\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltnnm" Jun 14 15:14:05.345848 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.345584 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ee9ddc42-3dac-47b7-a02b-899fc13a7467-log-socket\") pod \"ovnkube-node-ltnnm\" (UID: \"ee9ddc42-3dac-47b7-a02b-899fc13a7467\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltnnm" Jun 14 15:14:05.345848 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:05.345613 2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 15:14:05.345848 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.345637 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/581eef2b-70ee-4bb7-b721-fac3d801a93a-registration-dir\") pod \"aws-ebs-csi-driver-node-vlqmf\" (UID: \"581eef2b-70ee-4bb7-b721-fac3d801a93a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vlqmf" Jun 14 15:14:05.345848 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.345652 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/581eef2b-70ee-4bb7-b721-fac3d801a93a-etc-selinux\") pod \"aws-ebs-csi-driver-node-vlqmf\" (UID: \"581eef2b-70ee-4bb7-b721-fac3d801a93a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vlqmf" Jun 14 15:14:05.345848 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.345668 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9dca9a08-6b6e-43a2-a5ea-9a7ceca39f2e-var-lib-kubelet\") pod \"tuned-xg8b5\" (UID: \"9dca9a08-6b6e-43a2-a5ea-9a7ceca39f2e\") " pod="openshift-cluster-node-tuning-operator/tuned-xg8b5" Jun 14 15:14:05.345848 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.345683 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/87a9a729-3c3f-451a-bcd6-c8726159c1c0-multus-conf-dir\") pod \"multus-nlqnj\" (UID: \"87a9a729-3c3f-451a-bcd6-c8726159c1c0\") " pod="openshift-multus/multus-nlqnj" Jun 14 15:14:05.346570 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:05.345693 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15bccd1f-7f51-4c8b-8b76-75481887049f-original-pull-secret podName:15bccd1f-7f51-4c8b-8b76-75481887049f nodeName:}" failed. No retries permitted until 2026-06-14 15:14:05.845671645 +0000 UTC m=+3.027154154 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/15bccd1f-7f51-4c8b-8b76-75481887049f-original-pull-secret") pod "global-pull-secret-syncer-lfxgl" (UID: "15bccd1f-7f51-4c8b-8b76-75481887049f") : object "kube-system"/"original-pull-secret" not registered Jun 14 15:14:05.346570 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.345736 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjjgg\" (UniqueName: \"kubernetes.io/projected/9dca9a08-6b6e-43a2-a5ea-9a7ceca39f2e-kube-api-access-cjjgg\") pod \"tuned-xg8b5\" (UID: \"9dca9a08-6b6e-43a2-a5ea-9a7ceca39f2e\") " pod="openshift-cluster-node-tuning-operator/tuned-xg8b5" Jun 14 15:14:05.346570 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.345752 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/87a9a729-3c3f-451a-bcd6-c8726159c1c0-multus-socket-dir-parent\") pod \"multus-nlqnj\" (UID: \"87a9a729-3c3f-451a-bcd6-c8726159c1c0\") " pod="openshift-multus/multus-nlqnj" Jun 14 15:14:05.346570 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.345770 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/87a9a729-3c3f-451a-bcd6-c8726159c1c0-cni-binary-copy\") pod \"multus-nlqnj\" (UID: \"87a9a729-3c3f-451a-bcd6-c8726159c1c0\") " pod="openshift-multus/multus-nlqnj" Jun 14 15:14:05.346570 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.345772 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ee9ddc42-3dac-47b7-a02b-899fc13a7467-ovnkube-config\") pod \"ovnkube-node-ltnnm\" (UID: \"ee9ddc42-3dac-47b7-a02b-899fc13a7467\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltnnm" Jun 14 15:14:05.346570 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.345773 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/87a9a729-3c3f-451a-bcd6-c8726159c1c0-multus-daemon-config\") pod \"multus-nlqnj\" (UID: \"87a9a729-3c3f-451a-bcd6-c8726159c1c0\") " pod="openshift-multus/multus-nlqnj" Jun 14 15:14:05.346570 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.345794 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/87a9a729-3c3f-451a-bcd6-c8726159c1c0-host-run-multus-certs\") pod \"multus-nlqnj\" (UID: \"87a9a729-3c3f-451a-bcd6-c8726159c1c0\") " pod="openshift-multus/multus-nlqnj" Jun 14 15:14:05.346570 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.345807 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/581eef2b-70ee-4bb7-b721-fac3d801a93a-registration-dir\") pod \"aws-ebs-csi-driver-node-vlqmf\" (UID: \"581eef2b-70ee-4bb7-b721-fac3d801a93a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vlqmf" Jun 14 15:14:05.346570 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.345817 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/15bccd1f-7f51-4c8b-8b76-75481887049f-kubelet-config\") pod \"global-pull-secret-syncer-lfxgl\" (UID: \"15bccd1f-7f51-4c8b-8b76-75481887049f\") " pod="kube-system/global-pull-secret-syncer-lfxgl" Jun 14 15:14:05.346570 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.345847 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/87a9a729-3c3f-451a-bcd6-c8726159c1c0-cnibin\") pod \"multus-nlqnj\" (UID: \"87a9a729-3c3f-451a-bcd6-c8726159c1c0\") " pod="openshift-multus/multus-nlqnj" Jun 14 15:14:05.346570 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.345859 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/15bccd1f-7f51-4c8b-8b76-75481887049f-kubelet-config\") pod \"global-pull-secret-syncer-lfxgl\" (UID: \"15bccd1f-7f51-4c8b-8b76-75481887049f\") " pod="kube-system/global-pull-secret-syncer-lfxgl" Jun 14 15:14:05.346570 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.345886 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/581eef2b-70ee-4bb7-b721-fac3d801a93a-socket-dir\") pod \"aws-ebs-csi-driver-node-vlqmf\" (UID: \"581eef2b-70ee-4bb7-b721-fac3d801a93a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vlqmf" Jun 14 15:14:05.346570 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.345912 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/93923012-e70e-49c0-9578-f00c009dc2a6-host-slash\") pod \"iptables-alerter-r5pb4\" (UID: \"93923012-e70e-49c0-9578-f00c009dc2a6\") " pod="openshift-network-operator/iptables-alerter-r5pb4" Jun 14 15:14:05.346570 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.345958 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ee9ddc42-3dac-47b7-a02b-899fc13a7467-etc-openvswitch\") pod \"ovnkube-node-ltnnm\" (UID: \"ee9ddc42-3dac-47b7-a02b-899fc13a7467\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltnnm" Jun 14 15:14:05.346570 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.345978 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ee9ddc42-3dac-47b7-a02b-899fc13a7467-run-ovn\") pod \"ovnkube-node-ltnnm\" (UID: \"ee9ddc42-3dac-47b7-a02b-899fc13a7467\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltnnm" Jun 14 15:14:05.346570 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.345982 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/87a9a729-3c3f-451a-bcd6-c8726159c1c0-cnibin\") pod \"multus-nlqnj\" (UID: \"87a9a729-3c3f-451a-bcd6-c8726159c1c0\") " pod="openshift-multus/multus-nlqnj" Jun 14 15:14:05.347326 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.345999 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ee9ddc42-3dac-47b7-a02b-899fc13a7467-node-log\") pod \"ovnkube-node-ltnnm\" (UID: \"ee9ddc42-3dac-47b7-a02b-899fc13a7467\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltnnm" Jun 14 15:14:05.347326 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.346023 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/87a9a729-3c3f-451a-bcd6-c8726159c1c0-os-release\") pod \"multus-nlqnj\" (UID: \"87a9a729-3c3f-451a-bcd6-c8726159c1c0\") " pod="openshift-multus/multus-nlqnj" Jun 14 15:14:05.347326 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.346020 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/581eef2b-70ee-4bb7-b721-fac3d801a93a-socket-dir\") pod \"aws-ebs-csi-driver-node-vlqmf\" (UID: \"581eef2b-70ee-4bb7-b721-fac3d801a93a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vlqmf" Jun 14 15:14:05.347326 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.346073 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/87a9a729-3c3f-451a-bcd6-c8726159c1c0-host-run-netns\") pod \"multus-nlqnj\" (UID: \"87a9a729-3c3f-451a-bcd6-c8726159c1c0\") " pod="openshift-multus/multus-nlqnj" Jun 14 15:14:05.347326 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.346093 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/87a9a729-3c3f-451a-bcd6-c8726159c1c0-etc-kubernetes\") pod \"multus-nlqnj\" (UID: \"87a9a729-3c3f-451a-bcd6-c8726159c1c0\") " pod="openshift-multus/multus-nlqnj" Jun 14 15:14:05.347326 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.346107 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/87a9a729-3c3f-451a-bcd6-c8726159c1c0-host-run-netns\") pod \"multus-nlqnj\" (UID: \"87a9a729-3c3f-451a-bcd6-c8726159c1c0\") " pod="openshift-multus/multus-nlqnj" Jun 14 15:14:05.347326 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.346114 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/87a9a729-3c3f-451a-bcd6-c8726159c1c0-os-release\") pod \"multus-nlqnj\" (UID: \"87a9a729-3c3f-451a-bcd6-c8726159c1c0\") " pod="openshift-multus/multus-nlqnj" Jun 14 15:14:05.347326 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.346110 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9dca9a08-6b6e-43a2-a5ea-9a7ceca39f2e-sys\") pod \"tuned-xg8b5\" (UID: \"9dca9a08-6b6e-43a2-a5ea-9a7ceca39f2e\") " pod="openshift-cluster-node-tuning-operator/tuned-xg8b5" Jun 14 15:14:05.347326 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.346153 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/87a9a729-3c3f-451a-bcd6-c8726159c1c0-etc-kubernetes\") pod \"multus-nlqnj\" (UID: \"87a9a729-3c3f-451a-bcd6-c8726159c1c0\") " pod="openshift-multus/multus-nlqnj" Jun 14 15:14:05.347326 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.346179 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ee9ddc42-3dac-47b7-a02b-899fc13a7467-var-lib-openvswitch\") pod \"ovnkube-node-ltnnm\" (UID: \"ee9ddc42-3dac-47b7-a02b-899fc13a7467\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltnnm" Jun 14 15:14:05.347326 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.346213 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9dca9a08-6b6e-43a2-a5ea-9a7ceca39f2e-etc-sysconfig\") pod \"tuned-xg8b5\" (UID: \"9dca9a08-6b6e-43a2-a5ea-9a7ceca39f2e\") " pod="openshift-cluster-node-tuning-operator/tuned-xg8b5" Jun 14 15:14:05.347326 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.346244 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/61fac2bb-36e8-4862-82b0-39169b4fa9cd-hosts-file\") pod \"node-resolver-8w5cg\" (UID: \"61fac2bb-36e8-4862-82b0-39169b4fa9cd\") " pod="openshift-dns/node-resolver-8w5cg" Jun 14 15:14:05.347326 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.346305 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76clw\" (UniqueName: \"kubernetes.io/projected/87a9a729-3c3f-451a-bcd6-c8726159c1c0-kube-api-access-76clw\") pod \"multus-nlqnj\" (UID: \"87a9a729-3c3f-451a-bcd6-c8726159c1c0\") " pod="openshift-multus/multus-nlqnj" Jun 14 15:14:05.347326 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.346335 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0df8c3a-2915-4563-8f78-1bf2e8d5a27f-metrics-certs\") pod \"network-metrics-daemon-nb6vz\" (UID: \"d0df8c3a-2915-4563-8f78-1bf2e8d5a27f\") " pod="openshift-multus/network-metrics-daemon-nb6vz" Jun 14 15:14:05.347326 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.346361 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbvld\" (UniqueName: \"kubernetes.io/projected/5ffbcb60-2145-4431-b8e8-0f7528cb4851-kube-api-access-jbvld\") pod \"node-ca-5fg9d\" (UID: \"5ffbcb60-2145-4431-b8e8-0f7528cb4851\") " pod="openshift-image-registry/node-ca-5fg9d" Jun 14 15:14:05.347326 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.346384 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0c99e6cb-ee5c-45c5-9635-839d2f237c0b-konnectivity-ca\") pod \"konnectivity-agent-59js7\" (UID: \"0c99e6cb-ee5c-45c5-9635-839d2f237c0b\") " pod="kube-system/konnectivity-agent-59js7" Jun 14 15:14:05.347326 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.346407 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/581eef2b-70ee-4bb7-b721-fac3d801a93a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vlqmf\" (UID: \"581eef2b-70ee-4bb7-b721-fac3d801a93a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vlqmf" Jun 14 15:14:05.348039 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.346431 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/581eef2b-70ee-4bb7-b721-fac3d801a93a-sys-fs\") pod \"aws-ebs-csi-driver-node-vlqmf\" (UID: \"581eef2b-70ee-4bb7-b721-fac3d801a93a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vlqmf" Jun 14 15:14:05.348039 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.346454 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9dca9a08-6b6e-43a2-a5ea-9a7ceca39f2e-etc-sysctl-conf\") pod \"tuned-xg8b5\" (UID: \"9dca9a08-6b6e-43a2-a5ea-9a7ceca39f2e\") " pod="openshift-cluster-node-tuning-operator/tuned-xg8b5" Jun 14 15:14:05.348039 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.346490 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/87a9a729-3c3f-451a-bcd6-c8726159c1c0-host-run-k8s-cni-cncf-io\") pod \"multus-nlqnj\" (UID: \"87a9a729-3c3f-451a-bcd6-c8726159c1c0\") " pod="openshift-multus/multus-nlqnj" Jun 14 15:14:05.348039 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.346521 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/87a9a729-3c3f-451a-bcd6-c8726159c1c0-host-var-lib-cni-multus\") pod \"multus-nlqnj\" (UID: \"87a9a729-3c3f-451a-bcd6-c8726159c1c0\") " pod="openshift-multus/multus-nlqnj" Jun 14 15:14:05.348039 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.346515 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/581eef2b-70ee-4bb7-b721-fac3d801a93a-sys-fs\") pod \"aws-ebs-csi-driver-node-vlqmf\" (UID: \"581eef2b-70ee-4bb7-b721-fac3d801a93a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vlqmf" Jun 14 15:14:05.348039 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.346555 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wln4b\" (UniqueName: \"kubernetes.io/projected/5769083d-c587-4660-a48d-2c58b8eccc78-kube-api-access-wln4b\") pod \"network-check-target-jqckm\" (UID: \"5769083d-c587-4660-a48d-2c58b8eccc78\") " pod="openshift-network-diagnostics/network-check-target-jqckm" Jun 14 15:14:05.348039 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.346571 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/581eef2b-70ee-4bb7-b721-fac3d801a93a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vlqmf\" (UID: \"581eef2b-70ee-4bb7-b721-fac3d801a93a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vlqmf" Jun 14 15:14:05.348039 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.346585 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/73a47e15-a8cc-45e8-8138-d62372b4b753-system-cni-dir\") pod \"multus-additional-cni-plugins-kn9qq\" (UID: \"73a47e15-a8cc-45e8-8138-d62372b4b753\") " pod="openshift-multus/multus-additional-cni-plugins-kn9qq" Jun 14 15:14:05.348039 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.346608 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/87a9a729-3c3f-451a-bcd6-c8726159c1c0-host-run-k8s-cni-cncf-io\") pod \"multus-nlqnj\" (UID: \"87a9a729-3c3f-451a-bcd6-c8726159c1c0\") " pod="openshift-multus/multus-nlqnj" Jun 14 15:14:05.348039 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.346612 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/73a47e15-a8cc-45e8-8138-d62372b4b753-cni-binary-copy\") pod \"multus-additional-cni-plugins-kn9qq\" (UID: \"73a47e15-a8cc-45e8-8138-d62372b4b753\") " pod="openshift-multus/multus-additional-cni-plugins-kn9qq" Jun 14 15:14:05.348039 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.346556 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/87a9a729-3c3f-451a-bcd6-c8726159c1c0-host-var-lib-cni-multus\") pod \"multus-nlqnj\" (UID: \"87a9a729-3c3f-451a-bcd6-c8726159c1c0\") " pod="openshift-multus/multus-nlqnj" Jun 14 15:14:05.348039 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.346662 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/73a47e15-a8cc-45e8-8138-d62372b4b753-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kn9qq\" (UID: \"73a47e15-a8cc-45e8-8138-d62372b4b753\") " pod="openshift-multus/multus-additional-cni-plugins-kn9qq" Jun 14 15:14:05.348039 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.346699 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9dca9a08-6b6e-43a2-a5ea-9a7ceca39f2e-etc-modprobe-d\") pod \"tuned-xg8b5\" (UID: \"9dca9a08-6b6e-43a2-a5ea-9a7ceca39f2e\") " pod="openshift-cluster-node-tuning-operator/tuned-xg8b5" Jun 14 15:14:05.348039 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.346726 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ee9ddc42-3dac-47b7-a02b-899fc13a7467-systemd-units\") pod \"ovnkube-node-ltnnm\" (UID: \"ee9ddc42-3dac-47b7-a02b-899fc13a7467\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltnnm" Jun 14 15:14:05.348039 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.346757 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0c99e6cb-ee5c-45c5-9635-839d2f237c0b-agent-certs\") pod \"konnectivity-agent-59js7\" (UID: \"0c99e6cb-ee5c-45c5-9635-839d2f237c0b\") " pod="kube-system/konnectivity-agent-59js7" Jun 14 15:14:05.348039 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.346781 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/87a9a729-3c3f-451a-bcd6-c8726159c1c0-system-cni-dir\") pod \"multus-nlqnj\" (UID: \"87a9a729-3c3f-451a-bcd6-c8726159c1c0\") " pod="openshift-multus/multus-nlqnj" Jun 14 15:14:05.348039 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.346806 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/87a9a729-3c3f-451a-bcd6-c8726159c1c0-host-var-lib-cni-bin\") pod \"multus-nlqnj\" (UID: \"87a9a729-3c3f-451a-bcd6-c8726159c1c0\") " pod="openshift-multus/multus-nlqnj" Jun 14 15:14:05.348638 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.346857 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/87a9a729-3c3f-451a-bcd6-c8726159c1c0-host-var-lib-cni-bin\") pod \"multus-nlqnj\" (UID: \"87a9a729-3c3f-451a-bcd6-c8726159c1c0\") " pod="openshift-multus/multus-nlqnj" Jun 14 15:14:05.348638 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.346900 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/87a9a729-3c3f-451a-bcd6-c8726159c1c0-system-cni-dir\") pod \"multus-nlqnj\" (UID: \"87a9a729-3c3f-451a-bcd6-c8726159c1c0\") " pod="openshift-multus/multus-nlqnj" Jun 14 15:14:05.348638 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.346953 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/73a47e15-a8cc-45e8-8138-d62372b4b753-cnibin\") pod \"multus-additional-cni-plugins-kn9qq\" (UID: \"73a47e15-a8cc-45e8-8138-d62372b4b753\") " pod="openshift-multus/multus-additional-cni-plugins-kn9qq" Jun 14 15:14:05.348638 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.346968 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0c99e6cb-ee5c-45c5-9635-839d2f237c0b-konnectivity-ca\") pod \"konnectivity-agent-59js7\" (UID: \"0c99e6cb-ee5c-45c5-9635-839d2f237c0b\") " pod="kube-system/konnectivity-agent-59js7" Jun 14 15:14:05.348638 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.346980 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ee9ddc42-3dac-47b7-a02b-899fc13a7467-host-run-netns\") pod \"ovnkube-node-ltnnm\" (UID: \"ee9ddc42-3dac-47b7-a02b-899fc13a7467\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltnnm" Jun 14 15:14:05.348638 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.347013 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ee9ddc42-3dac-47b7-a02b-899fc13a7467-host-run-ovn-kubernetes\") pod \"ovnkube-node-ltnnm\" (UID: \"ee9ddc42-3dac-47b7-a02b-899fc13a7467\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltnnm" Jun 14 15:14:05.348638 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.347107 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rlhb\" (UniqueName: \"kubernetes.io/projected/d0df8c3a-2915-4563-8f78-1bf2e8d5a27f-kube-api-access-6rlhb\") pod \"network-metrics-daemon-nb6vz\" (UID: \"d0df8c3a-2915-4563-8f78-1bf2e8d5a27f\") " pod="openshift-multus/network-metrics-daemon-nb6vz" Jun 14 15:14:05.348638 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.347171 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/15bccd1f-7f51-4c8b-8b76-75481887049f-dbus\") pod \"global-pull-secret-syncer-lfxgl\" (UID: \"15bccd1f-7f51-4c8b-8b76-75481887049f\") " pod="kube-system/global-pull-secret-syncer-lfxgl" Jun 14 15:14:05.348638 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.347219 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/87a9a729-3c3f-451a-bcd6-c8726159c1c0-hostroot\") pod \"multus-nlqnj\" (UID: \"87a9a729-3c3f-451a-bcd6-c8726159c1c0\") " pod="openshift-multus/multus-nlqnj" Jun 14 15:14:05.348638 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.347244 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/73a47e15-a8cc-45e8-8138-d62372b4b753-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kn9qq\" (UID: \"73a47e15-a8cc-45e8-8138-d62372b4b753\") " pod="openshift-multus/multus-additional-cni-plugins-kn9qq" Jun 14 15:14:05.348638 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.347269 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ee9ddc42-3dac-47b7-a02b-899fc13a7467-run-openvswitch\") pod \"ovnkube-node-ltnnm\" (UID: \"ee9ddc42-3dac-47b7-a02b-899fc13a7467\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltnnm" Jun 14 15:14:05.348638 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.347299 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/61fac2bb-36e8-4862-82b0-39169b4fa9cd-tmp-dir\") pod \"node-resolver-8w5cg\" (UID: \"61fac2bb-36e8-4862-82b0-39169b4fa9cd\") " pod="openshift-dns/node-resolver-8w5cg" Jun 14 15:14:05.348638 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.347319 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/15bccd1f-7f51-4c8b-8b76-75481887049f-dbus\") pod \"global-pull-secret-syncer-lfxgl\" (UID: \"15bccd1f-7f51-4c8b-8b76-75481887049f\") " pod="kube-system/global-pull-secret-syncer-lfxgl" Jun 14 15:14:05.348638 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.347320 2571 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 14 15:14:05.348638 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.347347 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/93923012-e70e-49c0-9578-f00c009dc2a6-iptables-alerter-script\") pod \"iptables-alerter-r5pb4\" (UID: \"93923012-e70e-49c0-9578-f00c009dc2a6\") " pod="openshift-network-operator/iptables-alerter-r5pb4" Jun 14 15:14:05.348638 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.347357 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/87a9a729-3c3f-451a-bcd6-c8726159c1c0-hostroot\") pod \"multus-nlqnj\" (UID: \"87a9a729-3c3f-451a-bcd6-c8726159c1c0\") " pod="openshift-multus/multus-nlqnj" Jun 14 15:14:05.348638 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.347373 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9dca9a08-6b6e-43a2-a5ea-9a7ceca39f2e-etc-sysctl-d\") pod \"tuned-xg8b5\" (UID: \"9dca9a08-6b6e-43a2-a5ea-9a7ceca39f2e\") " pod="openshift-cluster-node-tuning-operator/tuned-xg8b5" Jun 14 15:14:05.349195 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.347405 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9dca9a08-6b6e-43a2-a5ea-9a7ceca39f2e-run\") pod \"tuned-xg8b5\" (UID: \"9dca9a08-6b6e-43a2-a5ea-9a7ceca39f2e\") " pod="openshift-cluster-node-tuning-operator/tuned-xg8b5" Jun 14 15:14:05.349195 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.347428 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ee9ddc42-3dac-47b7-a02b-899fc13a7467-ovnkube-script-lib\") pod \"ovnkube-node-ltnnm\" (UID: \"ee9ddc42-3dac-47b7-a02b-899fc13a7467\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltnnm" Jun 14 15:14:05.349195 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.347452 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5ffbcb60-2145-4431-b8e8-0f7528cb4851-host\") pod \"node-ca-5fg9d\" (UID: \"5ffbcb60-2145-4431-b8e8-0f7528cb4851\") " pod="openshift-image-registry/node-ca-5fg9d" Jun 14 15:14:05.349195 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.347476 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5ffbcb60-2145-4431-b8e8-0f7528cb4851-serviceca\") pod \"node-ca-5fg9d\" (UID: \"5ffbcb60-2145-4431-b8e8-0f7528cb4851\") " pod="openshift-image-registry/node-ca-5fg9d" Jun 14 15:14:05.349195 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.347527 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/73a47e15-a8cc-45e8-8138-d62372b4b753-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kn9qq\" (UID: \"73a47e15-a8cc-45e8-8138-d62372b4b753\") " pod="openshift-multus/multus-additional-cni-plugins-kn9qq" Jun 14 15:14:05.349195 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.347550 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5ffbcb60-2145-4431-b8e8-0f7528cb4851-host\") pod \"node-ca-5fg9d\" (UID: \"5ffbcb60-2145-4431-b8e8-0f7528cb4851\") " pod="openshift-image-registry/node-ca-5fg9d" Jun 14 15:14:05.349195 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.347552 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9dca9a08-6b6e-43a2-a5ea-9a7ceca39f2e-etc-tuned\") pod \"tuned-xg8b5\" (UID: \"9dca9a08-6b6e-43a2-a5ea-9a7ceca39f2e\") " pod="openshift-cluster-node-tuning-operator/tuned-xg8b5" Jun 14 15:14:05.349195 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.347941 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5ffbcb60-2145-4431-b8e8-0f7528cb4851-serviceca\") pod \"node-ca-5fg9d\" (UID: \"5ffbcb60-2145-4431-b8e8-0f7528cb4851\") " pod="openshift-image-registry/node-ca-5fg9d" Jun 14 15:14:05.350614 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.350596 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0c99e6cb-ee5c-45c5-9635-839d2f237c0b-agent-certs\") pod \"konnectivity-agent-59js7\" (UID: \"0c99e6cb-ee5c-45c5-9635-839d2f237c0b\") " pod="kube-system/konnectivity-agent-59js7" Jun 14 15:14:05.352875 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.352826 2571 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-zjjwx" Jun 14 15:14:05.367347 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:05.367318 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 15:14:05.367347 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:05.367347 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 15:14:05.367564 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:05.367362 2571 projected.go:196] Error preparing data for projected volume kube-api-access-wln4b for pod openshift-network-diagnostics/network-check-target-jqckm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 15:14:05.367564 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:05.367438 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5769083d-c587-4660-a48d-2c58b8eccc78-kube-api-access-wln4b podName:5769083d-c587-4660-a48d-2c58b8eccc78 nodeName:}" failed. No retries permitted until 2026-06-14 15:14:05.867416782 +0000 UTC m=+3.048899277 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-wln4b" (UniqueName: "kubernetes.io/projected/5769083d-c587-4660-a48d-2c58b8eccc78-kube-api-access-wln4b") pod "network-check-target-jqckm" (UID: "5769083d-c587-4660-a48d-2c58b8eccc78") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 15:14:05.368566 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.368531 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-76clw\" (UniqueName: \"kubernetes.io/projected/87a9a729-3c3f-451a-bcd6-c8726159c1c0-kube-api-access-76clw\") pod \"multus-nlqnj\" (UID: \"87a9a729-3c3f-451a-bcd6-c8726159c1c0\") " pod="openshift-multus/multus-nlqnj" Jun 14 15:14:05.369025 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.369002 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbvld\" (UniqueName: \"kubernetes.io/projected/5ffbcb60-2145-4431-b8e8-0f7528cb4851-kube-api-access-jbvld\") pod \"node-ca-5fg9d\" (UID: \"5ffbcb60-2145-4431-b8e8-0f7528cb4851\") " pod="openshift-image-registry/node-ca-5fg9d" Jun 14 15:14:05.369920 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.369901 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtb6n\" (UniqueName: \"kubernetes.io/projected/581eef2b-70ee-4bb7-b721-fac3d801a93a-kube-api-access-gtb6n\") pod \"aws-ebs-csi-driver-node-vlqmf\" (UID: \"581eef2b-70ee-4bb7-b721-fac3d801a93a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vlqmf" Jun 14 15:14:05.448448 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.448401 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9dca9a08-6b6e-43a2-a5ea-9a7ceca39f2e-sys\") pod \"tuned-xg8b5\" (UID: \"9dca9a08-6b6e-43a2-a5ea-9a7ceca39f2e\") " pod="openshift-cluster-node-tuning-operator/tuned-xg8b5" Jun 14 15:14:05.448448 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.448453 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ee9ddc42-3dac-47b7-a02b-899fc13a7467-var-lib-openvswitch\") pod \"ovnkube-node-ltnnm\" (UID: \"ee9ddc42-3dac-47b7-a02b-899fc13a7467\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltnnm" Jun 14 15:14:05.448743 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.448482 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9dca9a08-6b6e-43a2-a5ea-9a7ceca39f2e-etc-sysconfig\") pod \"tuned-xg8b5\" (UID: \"9dca9a08-6b6e-43a2-a5ea-9a7ceca39f2e\") " pod="openshift-cluster-node-tuning-operator/tuned-xg8b5" Jun 14 15:14:05.448743 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.448515 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9dca9a08-6b6e-43a2-a5ea-9a7ceca39f2e-sys\") pod \"tuned-xg8b5\" (UID: \"9dca9a08-6b6e-43a2-a5ea-9a7ceca39f2e\") " pod="openshift-cluster-node-tuning-operator/tuned-xg8b5" Jun 14 15:14:05.448743 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.448506 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/61fac2bb-36e8-4862-82b0-39169b4fa9cd-hosts-file\") pod \"node-resolver-8w5cg\" (UID: \"61fac2bb-36e8-4862-82b0-39169b4fa9cd\") " pod="openshift-dns/node-resolver-8w5cg" Jun 14 15:14:05.448743 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.448538 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ee9ddc42-3dac-47b7-a02b-899fc13a7467-var-lib-openvswitch\") pod \"ovnkube-node-ltnnm\" (UID: \"ee9ddc42-3dac-47b7-a02b-899fc13a7467\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltnnm" Jun 14 15:14:05.448743 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.448580 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0df8c3a-2915-4563-8f78-1bf2e8d5a27f-metrics-certs\") pod \"network-metrics-daemon-nb6vz\" (UID: \"d0df8c3a-2915-4563-8f78-1bf2e8d5a27f\") " pod="openshift-multus/network-metrics-daemon-nb6vz" Jun 14 15:14:05.448743 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.448605 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9dca9a08-6b6e-43a2-a5ea-9a7ceca39f2e-etc-sysctl-conf\") pod \"tuned-xg8b5\" (UID: \"9dca9a08-6b6e-43a2-a5ea-9a7ceca39f2e\") " pod="openshift-cluster-node-tuning-operator/tuned-xg8b5" Jun 14 15:14:05.448743 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.448576 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9dca9a08-6b6e-43a2-a5ea-9a7ceca39f2e-etc-sysconfig\") pod \"tuned-xg8b5\" (UID: \"9dca9a08-6b6e-43a2-a5ea-9a7ceca39f2e\") " pod="openshift-cluster-node-tuning-operator/tuned-xg8b5" Jun 14 15:14:05.448743 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.448644 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/73a47e15-a8cc-45e8-8138-d62372b4b753-system-cni-dir\") pod \"multus-additional-cni-plugins-kn9qq\" (UID: \"73a47e15-a8cc-45e8-8138-d62372b4b753\") " pod="openshift-multus/multus-additional-cni-plugins-kn9qq" Jun 14 15:14:05.448743 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.448682 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/73a47e15-a8cc-45e8-8138-d62372b4b753-system-cni-dir\") pod \"multus-additional-cni-plugins-kn9qq\" (UID: \"73a47e15-a8cc-45e8-8138-d62372b4b753\") " pod="openshift-multus/multus-additional-cni-plugins-kn9qq" Jun 14 15:14:05.448743 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.448697 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/73a47e15-a8cc-45e8-8138-d62372b4b753-cni-binary-copy\") pod \"multus-additional-cni-plugins-kn9qq\" (UID: \"73a47e15-a8cc-45e8-8138-d62372b4b753\") " pod="openshift-multus/multus-additional-cni-plugins-kn9qq" Jun 14 15:14:05.448743 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.448705 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/61fac2bb-36e8-4862-82b0-39169b4fa9cd-hosts-file\") pod \"node-resolver-8w5cg\" (UID: \"61fac2bb-36e8-4862-82b0-39169b4fa9cd\") " pod="openshift-dns/node-resolver-8w5cg" Jun 14 15:14:05.448743 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.448726 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/73a47e15-a8cc-45e8-8138-d62372b4b753-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kn9qq\" (UID: \"73a47e15-a8cc-45e8-8138-d62372b4b753\") " pod="openshift-multus/multus-additional-cni-plugins-kn9qq" Jun 14 15:14:05.449278 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.449163 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9dca9a08-6b6e-43a2-a5ea-9a7ceca39f2e-etc-modprobe-d\") pod \"tuned-xg8b5\" (UID: \"9dca9a08-6b6e-43a2-a5ea-9a7ceca39f2e\") " pod="openshift-cluster-node-tuning-operator/tuned-xg8b5" Jun 14 15:14:05.449334 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:05.449313 2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 15:14:05.449442 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:05.449412 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0df8c3a-2915-4563-8f78-1bf2e8d5a27f-metrics-certs podName:d0df8c3a-2915-4563-8f78-1bf2e8d5a27f nodeName:}" failed. No retries permitted until 2026-06-14 15:14:05.949382335 +0000 UTC m=+3.130864835 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d0df8c3a-2915-4563-8f78-1bf2e8d5a27f-metrics-certs") pod "network-metrics-daemon-nb6vz" (UID: "d0df8c3a-2915-4563-8f78-1bf2e8d5a27f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 15:14:05.449805 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.449782 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9dca9a08-6b6e-43a2-a5ea-9a7ceca39f2e-etc-modprobe-d\") pod \"tuned-xg8b5\" (UID: \"9dca9a08-6b6e-43a2-a5ea-9a7ceca39f2e\") " pod="openshift-cluster-node-tuning-operator/tuned-xg8b5" Jun 14 15:14:05.449880 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.449844 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ee9ddc42-3dac-47b7-a02b-899fc13a7467-systemd-units\") pod \"ovnkube-node-ltnnm\" (UID: \"ee9ddc42-3dac-47b7-a02b-899fc13a7467\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltnnm" Jun 14 15:14:05.449880 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.448770 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9dca9a08-6b6e-43a2-a5ea-9a7ceca39f2e-etc-sysctl-conf\") pod \"tuned-xg8b5\" (UID: \"9dca9a08-6b6e-43a2-a5ea-9a7ceca39f2e\") " pod="openshift-cluster-node-tuning-operator/tuned-xg8b5" Jun 14 15:14:05.449984 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.449878 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/73a47e15-a8cc-45e8-8138-d62372b4b753-cnibin\") pod \"multus-additional-cni-plugins-kn9qq\" (UID: \"73a47e15-a8cc-45e8-8138-d62372b4b753\") " pod="openshift-multus/multus-additional-cni-plugins-kn9qq" Jun 14 15:14:05.449984 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.449912 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ee9ddc42-3dac-47b7-a02b-899fc13a7467-host-run-netns\") pod \"ovnkube-node-ltnnm\" (UID: \"ee9ddc42-3dac-47b7-a02b-899fc13a7467\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltnnm" Jun 14 15:14:05.449984 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.449945 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ee9ddc42-3dac-47b7-a02b-899fc13a7467-host-run-ovn-kubernetes\") pod \"ovnkube-node-ltnnm\" (UID: \"ee9ddc42-3dac-47b7-a02b-899fc13a7467\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltnnm" Jun 14 15:14:05.449984 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.449958 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/73a47e15-a8cc-45e8-8138-d62372b4b753-cni-binary-copy\") pod \"multus-additional-cni-plugins-kn9qq\" (UID: \"73a47e15-a8cc-45e8-8138-d62372b4b753\") " pod="openshift-multus/multus-additional-cni-plugins-kn9qq" Jun 14 15:14:05.449984 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.449960 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ee9ddc42-3dac-47b7-a02b-899fc13a7467-systemd-units\") pod \"ovnkube-node-ltnnm\" (UID: \"ee9ddc42-3dac-47b7-a02b-899fc13a7467\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltnnm" Jun 14 15:14:05.449984 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.449977 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rlhb\" (UniqueName: \"kubernetes.io/projected/d0df8c3a-2915-4563-8f78-1bf2e8d5a27f-kube-api-access-6rlhb\") pod \"network-metrics-daemon-nb6vz\" (UID: \"d0df8c3a-2915-4563-8f78-1bf2e8d5a27f\") " pod="openshift-multus/network-metrics-daemon-nb6vz" Jun 14 15:14:05.450305 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.450012 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/73a47e15-a8cc-45e8-8138-d62372b4b753-cnibin\") pod \"multus-additional-cni-plugins-kn9qq\" (UID: \"73a47e15-a8cc-45e8-8138-d62372b4b753\") " pod="openshift-multus/multus-additional-cni-plugins-kn9qq" Jun 14 15:14:05.450305 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.450013 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/73a47e15-a8cc-45e8-8138-d62372b4b753-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kn9qq\" (UID: \"73a47e15-a8cc-45e8-8138-d62372b4b753\") " pod="openshift-multus/multus-additional-cni-plugins-kn9qq" Jun 14 15:14:05.450305 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.450073 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ee9ddc42-3dac-47b7-a02b-899fc13a7467-host-run-ovn-kubernetes\") pod \"ovnkube-node-ltnnm\" (UID: \"ee9ddc42-3dac-47b7-a02b-899fc13a7467\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltnnm" Jun 14 15:14:05.450305 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.450083 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ee9ddc42-3dac-47b7-a02b-899fc13a7467-run-openvswitch\") pod \"ovnkube-node-ltnnm\" (UID: \"ee9ddc42-3dac-47b7-a02b-899fc13a7467\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltnnm" Jun 14 15:14:05.450305 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.450160 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ee9ddc42-3dac-47b7-a02b-899fc13a7467-run-openvswitch\") pod \"ovnkube-node-ltnnm\" (UID: \"ee9ddc42-3dac-47b7-a02b-899fc13a7467\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltnnm" Jun 14 15:14:05.450543 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.450308 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/73a47e15-a8cc-45e8-8138-d62372b4b753-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kn9qq\" (UID: \"73a47e15-a8cc-45e8-8138-d62372b4b753\") " pod="openshift-multus/multus-additional-cni-plugins-kn9qq" Jun 14 15:14:05.450543 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.450451 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ee9ddc42-3dac-47b7-a02b-899fc13a7467-host-run-netns\") pod \"ovnkube-node-ltnnm\" (UID: \"ee9ddc42-3dac-47b7-a02b-899fc13a7467\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltnnm" Jun 14 15:14:05.450699 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.450598 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/73a47e15-a8cc-45e8-8138-d62372b4b753-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kn9qq\" (UID: \"73a47e15-a8cc-45e8-8138-d62372b4b753\") " pod="openshift-multus/multus-additional-cni-plugins-kn9qq" Jun 14 15:14:05.452507 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.452468 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/61fac2bb-36e8-4862-82b0-39169b4fa9cd-tmp-dir\") pod \"node-resolver-8w5cg\" (UID: \"61fac2bb-36e8-4862-82b0-39169b4fa9cd\") " pod="openshift-dns/node-resolver-8w5cg" Jun 14 15:14:05.452672 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.452534 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/93923012-e70e-49c0-9578-f00c009dc2a6-iptables-alerter-script\") pod \"iptables-alerter-r5pb4\" (UID: \"93923012-e70e-49c0-9578-f00c009dc2a6\") " pod="openshift-network-operator/iptables-alerter-r5pb4" Jun 14 15:14:05.452672 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.452570 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9dca9a08-6b6e-43a2-a5ea-9a7ceca39f2e-etc-sysctl-d\") pod \"tuned-xg8b5\" (UID: \"9dca9a08-6b6e-43a2-a5ea-9a7ceca39f2e\") " pod="openshift-cluster-node-tuning-operator/tuned-xg8b5" Jun 14 15:14:05.452672 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.452595 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9dca9a08-6b6e-43a2-a5ea-9a7ceca39f2e-run\") pod \"tuned-xg8b5\" (UID: \"9dca9a08-6b6e-43a2-a5ea-9a7ceca39f2e\") " pod="openshift-cluster-node-tuning-operator/tuned-xg8b5" Jun 14 15:14:05.452672 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.452625 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ee9ddc42-3dac-47b7-a02b-899fc13a7467-ovnkube-script-lib\") pod \"ovnkube-node-ltnnm\" (UID: \"ee9ddc42-3dac-47b7-a02b-899fc13a7467\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltnnm" Jun 14 15:14:05.452672 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.452662 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/73a47e15-a8cc-45e8-8138-d62372b4b753-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kn9qq\" (UID: \"73a47e15-a8cc-45e8-8138-d62372b4b753\") " pod="openshift-multus/multus-additional-cni-plugins-kn9qq" Jun 14 15:14:05.452910 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.452692 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9dca9a08-6b6e-43a2-a5ea-9a7ceca39f2e-etc-tuned\") pod \"tuned-xg8b5\" (UID: \"9dca9a08-6b6e-43a2-a5ea-9a7ceca39f2e\") " pod="openshift-cluster-node-tuning-operator/tuned-xg8b5" Jun 14 15:14:05.452910 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.452723 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ee9ddc42-3dac-47b7-a02b-899fc13a7467-ovn-node-metrics-cert\") pod \"ovnkube-node-ltnnm\" (UID: \"ee9ddc42-3dac-47b7-a02b-899fc13a7467\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltnnm" Jun 14 15:14:05.452910 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.452749 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfff6\" (UniqueName: \"kubernetes.io/projected/61fac2bb-36e8-4862-82b0-39169b4fa9cd-kube-api-access-dfff6\") pod \"node-resolver-8w5cg\" (UID: \"61fac2bb-36e8-4862-82b0-39169b4fa9cd\") " pod="openshift-dns/node-resolver-8w5cg" Jun 14 15:14:05.452910 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.452782 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ee9ddc42-3dac-47b7-a02b-899fc13a7467-host-cni-bin\") pod \"ovnkube-node-ltnnm\" (UID: \"ee9ddc42-3dac-47b7-a02b-899fc13a7467\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltnnm" Jun 14 15:14:05.452910 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.452809 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ee9ddc42-3dac-47b7-a02b-899fc13a7467-host-cni-netd\") pod \"ovnkube-node-ltnnm\" (UID: \"ee9ddc42-3dac-47b7-a02b-899fc13a7467\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltnnm" Jun 14 15:14:05.452910 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.452846 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ee9ddc42-3dac-47b7-a02b-899fc13a7467-env-overrides\") pod \"ovnkube-node-ltnnm\" (UID: \"ee9ddc42-3dac-47b7-a02b-899fc13a7467\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltnnm" Jun 14 15:14:05.452910 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.452877 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ee9ddc42-3dac-47b7-a02b-899fc13a7467-host-kubelet\") pod \"ovnkube-node-ltnnm\" (UID: \"ee9ddc42-3dac-47b7-a02b-899fc13a7467\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltnnm" Jun 14 15:14:05.453220 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.452911 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9jc7\" (UniqueName: \"kubernetes.io/projected/73a47e15-a8cc-45e8-8138-d62372b4b753-kube-api-access-c9jc7\") pod \"multus-additional-cni-plugins-kn9qq\" (UID: \"73a47e15-a8cc-45e8-8138-d62372b4b753\") " pod="openshift-multus/multus-additional-cni-plugins-kn9qq" Jun 14 15:14:05.453220 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.452941 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9dca9a08-6b6e-43a2-a5ea-9a7ceca39f2e-host\") pod \"tuned-xg8b5\" (UID: \"9dca9a08-6b6e-43a2-a5ea-9a7ceca39f2e\") " pod="openshift-cluster-node-tuning-operator/tuned-xg8b5" Jun 14 15:14:05.453220 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.452971 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ee9ddc42-3dac-47b7-a02b-899fc13a7467-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ltnnm\" (UID: \"ee9ddc42-3dac-47b7-a02b-899fc13a7467\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltnnm" Jun 14 15:14:05.453220 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.453021 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9dca9a08-6b6e-43a2-a5ea-9a7ceca39f2e-etc-kubernetes\") pod \"tuned-xg8b5\" (UID: \"9dca9a08-6b6e-43a2-a5ea-9a7ceca39f2e\") " pod="openshift-cluster-node-tuning-operator/tuned-xg8b5" Jun 14 15:14:05.453220 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.453072 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9dca9a08-6b6e-43a2-a5ea-9a7ceca39f2e-etc-systemd\") pod \"tuned-xg8b5\" (UID: \"9dca9a08-6b6e-43a2-a5ea-9a7ceca39f2e\") " pod="openshift-cluster-node-tuning-operator/tuned-xg8b5" Jun 14 15:14:05.453220 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.453101 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9dca9a08-6b6e-43a2-a5ea-9a7ceca39f2e-lib-modules\") pod \"tuned-xg8b5\" (UID: \"9dca9a08-6b6e-43a2-a5ea-9a7ceca39f2e\") " pod="openshift-cluster-node-tuning-operator/tuned-xg8b5" Jun 14 15:14:05.453474 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.453437 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ee9ddc42-3dac-47b7-a02b-899fc13a7467-run-systemd\") pod \"ovnkube-node-ltnnm\" (UID: \"ee9ddc42-3dac-47b7-a02b-899fc13a7467\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltnnm" Jun 14 15:14:05.453524 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.453490 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btwj5\" (UniqueName: \"kubernetes.io/projected/ee9ddc42-3dac-47b7-a02b-899fc13a7467-kube-api-access-btwj5\") pod \"ovnkube-node-ltnnm\" (UID: \"ee9ddc42-3dac-47b7-a02b-899fc13a7467\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltnnm" Jun 14 15:14:05.454451 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.453592 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9dca9a08-6b6e-43a2-a5ea-9a7ceca39f2e-lib-modules\") pod \"tuned-xg8b5\" (UID: \"9dca9a08-6b6e-43a2-a5ea-9a7ceca39f2e\") " pod="openshift-cluster-node-tuning-operator/tuned-xg8b5" Jun 14 15:14:05.454451 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.453704 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbc77\" (UniqueName: \"kubernetes.io/projected/93923012-e70e-49c0-9578-f00c009dc2a6-kube-api-access-fbc77\") pod \"iptables-alerter-r5pb4\" (UID: \"93923012-e70e-49c0-9578-f00c009dc2a6\") " pod="openshift-network-operator/iptables-alerter-r5pb4" Jun 14 15:14:05.454451 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.453815 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/73a47e15-a8cc-45e8-8138-d62372b4b753-os-release\") pod \"multus-additional-cni-plugins-kn9qq\" (UID: \"73a47e15-a8cc-45e8-8138-d62372b4b753\") " pod="openshift-multus/multus-additional-cni-plugins-kn9qq" Jun 14 15:14:05.454451 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.453849 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9dca9a08-6b6e-43a2-a5ea-9a7ceca39f2e-etc-sysctl-d\") pod \"tuned-xg8b5\" (UID: \"9dca9a08-6b6e-43a2-a5ea-9a7ceca39f2e\") " pod="openshift-cluster-node-tuning-operator/tuned-xg8b5" Jun 14 15:14:05.454451 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.453872 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9dca9a08-6b6e-43a2-a5ea-9a7ceca39f2e-tmp\") pod \"tuned-xg8b5\" (UID: \"9dca9a08-6b6e-43a2-a5ea-9a7ceca39f2e\") " pod="openshift-cluster-node-tuning-operator/tuned-xg8b5" Jun 14 15:14:05.454451 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.453912 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ee9ddc42-3dac-47b7-a02b-899fc13a7467-run-systemd\") pod \"ovnkube-node-ltnnm\" (UID: \"ee9ddc42-3dac-47b7-a02b-899fc13a7467\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltnnm" Jun 14 15:14:05.454451 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.453912 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ee9ddc42-3dac-47b7-a02b-899fc13a7467-host-slash\") pod \"ovnkube-node-ltnnm\" (UID: \"ee9ddc42-3dac-47b7-a02b-899fc13a7467\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltnnm" Jun 14 15:14:05.454451 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.453964 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ee9ddc42-3dac-47b7-a02b-899fc13a7467-log-socket\") pod \"ovnkube-node-ltnnm\" (UID: \"ee9ddc42-3dac-47b7-a02b-899fc13a7467\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltnnm" Jun 14 15:14:05.454451 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.453976 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/73a47e15-a8cc-45e8-8138-d62372b4b753-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kn9qq\" (UID: \"73a47e15-a8cc-45e8-8138-d62372b4b753\") " pod="openshift-multus/multus-additional-cni-plugins-kn9qq" Jun 14 15:14:05.454451 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.453965 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ee9ddc42-3dac-47b7-a02b-899fc13a7467-host-slash\") pod \"ovnkube-node-ltnnm\" (UID: \"ee9ddc42-3dac-47b7-a02b-899fc13a7467\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltnnm" Jun 14 15:14:05.454451 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.453997 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/61fac2bb-36e8-4862-82b0-39169b4fa9cd-tmp-dir\") pod \"node-resolver-8w5cg\" (UID: \"61fac2bb-36e8-4862-82b0-39169b4fa9cd\") " pod="openshift-dns/node-resolver-8w5cg" Jun 14 15:14:05.454451 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.454034 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ee9ddc42-3dac-47b7-a02b-899fc13a7467-log-socket\") pod \"ovnkube-node-ltnnm\" (UID: \"ee9ddc42-3dac-47b7-a02b-899fc13a7467\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltnnm" Jun 14 15:14:05.454451 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.454059 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9dca9a08-6b6e-43a2-a5ea-9a7ceca39f2e-run\") pod \"tuned-xg8b5\" (UID: \"9dca9a08-6b6e-43a2-a5ea-9a7ceca39f2e\") " pod="openshift-cluster-node-tuning-operator/tuned-xg8b5" Jun 14 15:14:05.454451 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.454096 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ee9ddc42-3dac-47b7-a02b-899fc13a7467-host-cni-bin\") pod \"ovnkube-node-ltnnm\" (UID: \"ee9ddc42-3dac-47b7-a02b-899fc13a7467\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltnnm" Jun 14 15:14:05.454451 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.454101 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ee9ddc42-3dac-47b7-a02b-899fc13a7467-ovnkube-script-lib\") pod \"ovnkube-node-ltnnm\" (UID: \"ee9ddc42-3dac-47b7-a02b-899fc13a7467\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltnnm" Jun 14 15:14:05.454451 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.454130 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ee9ddc42-3dac-47b7-a02b-899fc13a7467-host-cni-netd\") pod \"ovnkube-node-ltnnm\" (UID: \"ee9ddc42-3dac-47b7-a02b-899fc13a7467\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltnnm" Jun 14 15:14:05.454451 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.454099 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9dca9a08-6b6e-43a2-a5ea-9a7ceca39f2e-var-lib-kubelet\") pod \"tuned-xg8b5\" (UID: \"9dca9a08-6b6e-43a2-a5ea-9a7ceca39f2e\") " pod="openshift-cluster-node-tuning-operator/tuned-xg8b5" Jun 14 15:14:05.454451 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.454143 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/73a47e15-a8cc-45e8-8138-d62372b4b753-os-release\") pod \"multus-additional-cni-plugins-kn9qq\" (UID: \"73a47e15-a8cc-45e8-8138-d62372b4b753\") " pod="openshift-multus/multus-additional-cni-plugins-kn9qq" Jun 14 15:14:05.455647 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.454145 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9dca9a08-6b6e-43a2-a5ea-9a7ceca39f2e-var-lib-kubelet\") pod \"tuned-xg8b5\" (UID: \"9dca9a08-6b6e-43a2-a5ea-9a7ceca39f2e\") " pod="openshift-cluster-node-tuning-operator/tuned-xg8b5" Jun 14 15:14:05.455647 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.454182 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjjgg\" (UniqueName: \"kubernetes.io/projected/9dca9a08-6b6e-43a2-a5ea-9a7ceca39f2e-kube-api-access-cjjgg\") pod \"tuned-xg8b5\" (UID: \"9dca9a08-6b6e-43a2-a5ea-9a7ceca39f2e\") " pod="openshift-cluster-node-tuning-operator/tuned-xg8b5" Jun 14 15:14:05.455647 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.454215 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ee9ddc42-3dac-47b7-a02b-899fc13a7467-ovnkube-config\") pod \"ovnkube-node-ltnnm\" (UID: \"ee9ddc42-3dac-47b7-a02b-899fc13a7467\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltnnm" Jun 14 15:14:05.455647 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.454253 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/93923012-e70e-49c0-9578-f00c009dc2a6-host-slash\") pod \"iptables-alerter-r5pb4\" (UID: \"93923012-e70e-49c0-9578-f00c009dc2a6\") " pod="openshift-network-operator/iptables-alerter-r5pb4" Jun 14 15:14:05.455647 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.454302 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ee9ddc42-3dac-47b7-a02b-899fc13a7467-etc-openvswitch\") pod \"ovnkube-node-ltnnm\" (UID: \"ee9ddc42-3dac-47b7-a02b-899fc13a7467\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltnnm" Jun 14 15:14:05.455647 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.454364 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ee9ddc42-3dac-47b7-a02b-899fc13a7467-etc-openvswitch\") pod \"ovnkube-node-ltnnm\" (UID: \"ee9ddc42-3dac-47b7-a02b-899fc13a7467\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltnnm" Jun 14 15:14:05.455647 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.454355 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9dca9a08-6b6e-43a2-a5ea-9a7ceca39f2e-host\") pod \"tuned-xg8b5\" (UID: \"9dca9a08-6b6e-43a2-a5ea-9a7ceca39f2e\") " pod="openshift-cluster-node-tuning-operator/tuned-xg8b5" Jun 14 15:14:05.455647 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.454577 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ee9ddc42-3dac-47b7-a02b-899fc13a7467-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ltnnm\" (UID: \"ee9ddc42-3dac-47b7-a02b-899fc13a7467\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltnnm" Jun 14 15:14:05.455647 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.454649 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9dca9a08-6b6e-43a2-a5ea-9a7ceca39f2e-etc-kubernetes\") pod \"tuned-xg8b5\" (UID: \"9dca9a08-6b6e-43a2-a5ea-9a7ceca39f2e\") " pod="openshift-cluster-node-tuning-operator/tuned-xg8b5" Jun 14 15:14:05.455647 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.454708 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9dca9a08-6b6e-43a2-a5ea-9a7ceca39f2e-etc-systemd\") pod \"tuned-xg8b5\" (UID: \"9dca9a08-6b6e-43a2-a5ea-9a7ceca39f2e\") " pod="openshift-cluster-node-tuning-operator/tuned-xg8b5" Jun 14 15:14:05.455647 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.454865 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/93923012-e70e-49c0-9578-f00c009dc2a6-iptables-alerter-script\") pod \"iptables-alerter-r5pb4\" (UID: \"93923012-e70e-49c0-9578-f00c009dc2a6\") " pod="openshift-network-operator/iptables-alerter-r5pb4" Jun 14 15:14:05.455647 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.454999 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ee9ddc42-3dac-47b7-a02b-899fc13a7467-env-overrides\") pod \"ovnkube-node-ltnnm\" (UID: \"ee9ddc42-3dac-47b7-a02b-899fc13a7467\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltnnm" Jun 14 15:14:05.455647 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.455179 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/93923012-e70e-49c0-9578-f00c009dc2a6-host-slash\") pod \"iptables-alerter-r5pb4\" (UID: \"93923012-e70e-49c0-9578-f00c009dc2a6\") " pod="openshift-network-operator/iptables-alerter-r5pb4" Jun 14 15:14:05.455647 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.455221 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ee9ddc42-3dac-47b7-a02b-899fc13a7467-ovnkube-config\") pod \"ovnkube-node-ltnnm\" (UID: \"ee9ddc42-3dac-47b7-a02b-899fc13a7467\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltnnm" Jun 14 15:14:05.455647 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.455221 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ee9ddc42-3dac-47b7-a02b-899fc13a7467-run-ovn\") pod \"ovnkube-node-ltnnm\" (UID: \"ee9ddc42-3dac-47b7-a02b-899fc13a7467\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltnnm" Jun 14 15:14:05.455647 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.455276 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ee9ddc42-3dac-47b7-a02b-899fc13a7467-run-ovn\") pod \"ovnkube-node-ltnnm\" (UID: \"ee9ddc42-3dac-47b7-a02b-899fc13a7467\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltnnm" Jun 14 15:14:05.455647 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.455313 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ee9ddc42-3dac-47b7-a02b-899fc13a7467-node-log\") pod \"ovnkube-node-ltnnm\" (UID: \"ee9ddc42-3dac-47b7-a02b-899fc13a7467\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltnnm" Jun 14 15:14:05.455647 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.455356 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ee9ddc42-3dac-47b7-a02b-899fc13a7467-node-log\") pod \"ovnkube-node-ltnnm\" (UID: \"ee9ddc42-3dac-47b7-a02b-899fc13a7467\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltnnm" Jun 14 15:14:05.456523 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.455476 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ee9ddc42-3dac-47b7-a02b-899fc13a7467-host-kubelet\") pod \"ovnkube-node-ltnnm\" (UID: \"ee9ddc42-3dac-47b7-a02b-899fc13a7467\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltnnm" Jun 14 15:14:05.457236 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.457211 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ee9ddc42-3dac-47b7-a02b-899fc13a7467-ovn-node-metrics-cert\") pod \"ovnkube-node-ltnnm\" (UID: \"ee9ddc42-3dac-47b7-a02b-899fc13a7467\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltnnm" Jun 14 15:14:05.457236 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.457219 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9dca9a08-6b6e-43a2-a5ea-9a7ceca39f2e-tmp\") pod \"tuned-xg8b5\" (UID: \"9dca9a08-6b6e-43a2-a5ea-9a7ceca39f2e\") " pod="openshift-cluster-node-tuning-operator/tuned-xg8b5" Jun 14 15:14:05.457375 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.457246 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9dca9a08-6b6e-43a2-a5ea-9a7ceca39f2e-etc-tuned\") pod \"tuned-xg8b5\" (UID: \"9dca9a08-6b6e-43a2-a5ea-9a7ceca39f2e\") " pod="openshift-cluster-node-tuning-operator/tuned-xg8b5" Jun 14 15:14:05.473393 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.473353 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfff6\" (UniqueName: \"kubernetes.io/projected/61fac2bb-36e8-4862-82b0-39169b4fa9cd-kube-api-access-dfff6\") pod \"node-resolver-8w5cg\" (UID: \"61fac2bb-36e8-4862-82b0-39169b4fa9cd\") " pod="openshift-dns/node-resolver-8w5cg" Jun 14 15:14:05.474588 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.474556 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbc77\" (UniqueName: \"kubernetes.io/projected/93923012-e70e-49c0-9578-f00c009dc2a6-kube-api-access-fbc77\") pod \"iptables-alerter-r5pb4\" (UID: \"93923012-e70e-49c0-9578-f00c009dc2a6\") " pod="openshift-network-operator/iptables-alerter-r5pb4" Jun 14 15:14:05.474588 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.474575 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9jc7\" (UniqueName: \"kubernetes.io/projected/73a47e15-a8cc-45e8-8138-d62372b4b753-kube-api-access-c9jc7\") pod \"multus-additional-cni-plugins-kn9qq\" (UID: \"73a47e15-a8cc-45e8-8138-d62372b4b753\") " pod="openshift-multus/multus-additional-cni-plugins-kn9qq" Jun 14 15:14:05.474897 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.474874 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-btwj5\" (UniqueName: \"kubernetes.io/projected/ee9ddc42-3dac-47b7-a02b-899fc13a7467-kube-api-access-btwj5\") pod \"ovnkube-node-ltnnm\" (UID: \"ee9ddc42-3dac-47b7-a02b-899fc13a7467\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltnnm" Jun 14 15:14:05.477688 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.477651 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rlhb\" (UniqueName: \"kubernetes.io/projected/d0df8c3a-2915-4563-8f78-1bf2e8d5a27f-kube-api-access-6rlhb\") pod \"network-metrics-daemon-nb6vz\" (UID: \"d0df8c3a-2915-4563-8f78-1bf2e8d5a27f\") " pod="openshift-multus/network-metrics-daemon-nb6vz" Jun 14 15:14:05.479638 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.479612 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjjgg\" (UniqueName: \"kubernetes.io/projected/9dca9a08-6b6e-43a2-a5ea-9a7ceca39f2e-kube-api-access-cjjgg\") pod \"tuned-xg8b5\" (UID: \"9dca9a08-6b6e-43a2-a5ea-9a7ceca39f2e\") " pod="openshift-cluster-node-tuning-operator/tuned-xg8b5" Jun 14 15:14:05.537996 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.537925 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5fg9d" Jun 14 15:14:05.545497 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.545476 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-59js7" Jun 14 15:14:05.554016 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.553992 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-nlqnj" Jun 14 15:14:05.561680 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.561661 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vlqmf" Jun 14 15:14:05.569427 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.569407 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-r5pb4" Jun 14 15:14:05.574987 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.574968 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kn9qq" Jun 14 15:14:05.582339 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.582317 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ltnnm" Jun 14 15:14:05.589971 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.589943 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-xg8b5" Jun 14 15:14:05.595820 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.595761 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8w5cg" Jun 14 15:14:05.858450 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.858353 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/15bccd1f-7f51-4c8b-8b76-75481887049f-original-pull-secret\") pod \"global-pull-secret-syncer-lfxgl\" (UID: \"15bccd1f-7f51-4c8b-8b76-75481887049f\") " pod="kube-system/global-pull-secret-syncer-lfxgl" Jun 14 15:14:05.858604 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:05.858519 2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 15:14:05.858604 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:05.858600 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15bccd1f-7f51-4c8b-8b76-75481887049f-original-pull-secret podName:15bccd1f-7f51-4c8b-8b76-75481887049f nodeName:}" failed. No retries permitted until 2026-06-14 15:14:06.858581033 +0000 UTC m=+4.040063530 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/15bccd1f-7f51-4c8b-8b76-75481887049f-original-pull-secret") pod "global-pull-secret-syncer-lfxgl" (UID: "15bccd1f-7f51-4c8b-8b76-75481887049f") : object "kube-system"/"original-pull-secret" not registered Jun 14 15:14:05.959405 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.959367 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0df8c3a-2915-4563-8f78-1bf2e8d5a27f-metrics-certs\") pod \"network-metrics-daemon-nb6vz\" (UID: \"d0df8c3a-2915-4563-8f78-1bf2e8d5a27f\") " pod="openshift-multus/network-metrics-daemon-nb6vz" Jun 14 15:14:05.959405 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:05.959407 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wln4b\" (UniqueName: \"kubernetes.io/projected/5769083d-c587-4660-a48d-2c58b8eccc78-kube-api-access-wln4b\") pod \"network-check-target-jqckm\" (UID: \"5769083d-c587-4660-a48d-2c58b8eccc78\") " pod="openshift-network-diagnostics/network-check-target-jqckm" Jun 14 15:14:05.959640 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:05.959537 2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 15:14:05.959640 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:05.959579 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 15:14:05.959640 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:05.959599 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 15:14:05.959640 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:05.959618 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0df8c3a-2915-4563-8f78-1bf2e8d5a27f-metrics-certs podName:d0df8c3a-2915-4563-8f78-1bf2e8d5a27f nodeName:}" failed. No retries permitted until 2026-06-14 15:14:06.9595957 +0000 UTC m=+4.141078217 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d0df8c3a-2915-4563-8f78-1bf2e8d5a27f-metrics-certs") pod "network-metrics-daemon-nb6vz" (UID: "d0df8c3a-2915-4563-8f78-1bf2e8d5a27f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 15:14:05.959640 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:05.959619 2571 projected.go:196] Error preparing data for projected volume kube-api-access-wln4b for pod openshift-network-diagnostics/network-check-target-jqckm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 15:14:05.959874 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:05.959658 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5769083d-c587-4660-a48d-2c58b8eccc78-kube-api-access-wln4b podName:5769083d-c587-4660-a48d-2c58b8eccc78 nodeName:}" failed. No retries permitted until 2026-06-14 15:14:06.959650115 +0000 UTC m=+4.141132608 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-wln4b" (UniqueName: "kubernetes.io/projected/5769083d-c587-4660-a48d-2c58b8eccc78-kube-api-access-wln4b") pod "network-check-target-jqckm" (UID: "5769083d-c587-4660-a48d-2c58b8eccc78") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 15:14:06.128490 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:06.128464 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61fac2bb_36e8_4862_82b0_39169b4fa9cd.slice/crio-454378a84455bda40888d0fc076b8bc8845d1732f335430a1cd492698858b370 WatchSource:0}: Error finding container 454378a84455bda40888d0fc076b8bc8845d1732f335430a1cd492698858b370: Status 404 returned error can't find the container with id 454378a84455bda40888d0fc076b8bc8845d1732f335430a1cd492698858b370 Jun 14 15:14:06.129335 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:06.129310 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87a9a729_3c3f_451a_bcd6_c8726159c1c0.slice/crio-25a99e4eb5e24932d5331d0fcd8b2a04b3461fa0972b4c40c13ec98674ca7b1f WatchSource:0}: Error finding container 25a99e4eb5e24932d5331d0fcd8b2a04b3461fa0972b4c40c13ec98674ca7b1f: Status 404 returned error can't find the container with id 25a99e4eb5e24932d5331d0fcd8b2a04b3461fa0972b4c40c13ec98674ca7b1f Jun 14 15:14:06.130125 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:06.130099 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93923012_e70e_49c0_9578_f00c009dc2a6.slice/crio-a205516aeb758a44570ad34b74a1d9d58ea6d31ab33bb41ef5d53babccaf8e12 WatchSource:0}: Error finding container a205516aeb758a44570ad34b74a1d9d58ea6d31ab33bb41ef5d53babccaf8e12: Status 404 returned error can't find the container with id a205516aeb758a44570ad34b74a1d9d58ea6d31ab33bb41ef5d53babccaf8e12 Jun 14 15:14:06.134130 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:06.134103 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73a47e15_a8cc_45e8_8138_d62372b4b753.slice/crio-f28de263e440790f55fc52b5bf13a9af57c4beced13116afe5fc986c89587fbd WatchSource:0}: Error finding container f28de263e440790f55fc52b5bf13a9af57c4beced13116afe5fc986c89587fbd: Status 404 returned error can't find the container with id f28de263e440790f55fc52b5bf13a9af57c4beced13116afe5fc986c89587fbd Jun 14 15:14:06.138193 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:06.138167 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c99e6cb_ee5c_45c5_9635_839d2f237c0b.slice/crio-f65dbd4b881bd58d0782ffb7913f20874800b3f97f2f9ab696f5b222d5265b8d WatchSource:0}: Error finding container f65dbd4b881bd58d0782ffb7913f20874800b3f97f2f9ab696f5b222d5265b8d: Status 404 returned error can't find the container with id f65dbd4b881bd58d0782ffb7913f20874800b3f97f2f9ab696f5b222d5265b8d Jun 14 15:14:06.138962 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:06.138867 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ffbcb60_2145_4431_b8e8_0f7528cb4851.slice/crio-d46c595b15e1b54a464e51a1de891f782dfa91592c60e31657e280b21048b9e7 WatchSource:0}: Error finding container d46c595b15e1b54a464e51a1de891f782dfa91592c60e31657e280b21048b9e7: Status 404 returned error can't find the container with id d46c595b15e1b54a464e51a1de891f782dfa91592c60e31657e280b21048b9e7 Jun 14 15:14:06.140650 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:06.140584 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9dca9a08_6b6e_43a2_a5ea_9a7ceca39f2e.slice/crio-46ad56108aba3b5ece613884c4cb87211b9ebc9033fb7fb7b59f10efc0e5a670 WatchSource:0}: Error finding container 46ad56108aba3b5ece613884c4cb87211b9ebc9033fb7fb7b59f10efc0e5a670: Status 404 returned error can't find the container with id 46ad56108aba3b5ece613884c4cb87211b9ebc9033fb7fb7b59f10efc0e5a670 Jun 14 15:14:06.140913 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:06.140857 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod581eef2b_70ee_4bb7_b721_fac3d801a93a.slice/crio-eef1a1b9b9c909973f748959a1a2b8c61af6bdf2eefcb4029d9501c71dc77990 WatchSource:0}: Error finding container eef1a1b9b9c909973f748959a1a2b8c61af6bdf2eefcb4029d9501c71dc77990: Status 404 returned error can't find the container with id eef1a1b9b9c909973f748959a1a2b8c61af6bdf2eefcb4029d9501c71dc77990 Jun 14 15:14:06.141516 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:06.141443 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee9ddc42_3dac_47b7_a02b_899fc13a7467.slice/crio-427598f3431724e0139d917659b14d09a37ccf3605f2bd0d56516ce0e9367d77 WatchSource:0}: Error finding container 427598f3431724e0139d917659b14d09a37ccf3605f2bd0d56516ce0e9367d77: Status 404 returned error can't find the container with id 427598f3431724e0139d917659b14d09a37ccf3605f2bd0d56516ce0e9367d77 Jun 14 15:14:06.299855 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:06.299653 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jqckm" Jun 14 15:14:06.300239 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:06.299972 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jqckm" podUID="5769083d-c587-4660-a48d-2c58b8eccc78" Jun 14 15:14:06.307714 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:06.307690 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5fg9d" event={"ID":"5ffbcb60-2145-4431-b8e8-0f7528cb4851","Type":"ContainerStarted","Data":"d46c595b15e1b54a464e51a1de891f782dfa91592c60e31657e280b21048b9e7"} Jun 14 15:14:06.308831 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:06.308811 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kn9qq" event={"ID":"73a47e15-a8cc-45e8-8138-d62372b4b753","Type":"ContainerStarted","Data":"f28de263e440790f55fc52b5bf13a9af57c4beced13116afe5fc986c89587fbd"} Jun 14 15:14:06.312706 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:06.312681 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-59js7" event={"ID":"0c99e6cb-ee5c-45c5-9635-839d2f237c0b","Type":"ContainerStarted","Data":"f65dbd4b881bd58d0782ffb7913f20874800b3f97f2f9ab696f5b222d5265b8d"} Jun 14 15:14:06.313852 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:06.313829 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-r5pb4" event={"ID":"93923012-e70e-49c0-9578-f00c009dc2a6","Type":"ContainerStarted","Data":"a205516aeb758a44570ad34b74a1d9d58ea6d31ab33bb41ef5d53babccaf8e12"} Jun 14 15:14:06.315788 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:06.315731 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-30.ec2.internal" event={"ID":"50126b156a8d7ec40dc0a7da700bcb71","Type":"ContainerStarted","Data":"a65615174b3f41326f9594ff197ccc78d9d89770dda5e40a7e0175b1542b634a"} Jun 14 15:14:06.316784 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:06.316767 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ltnnm" event={"ID":"ee9ddc42-3dac-47b7-a02b-899fc13a7467","Type":"ContainerStarted","Data":"427598f3431724e0139d917659b14d09a37ccf3605f2bd0d56516ce0e9367d77"} Jun 14 15:14:06.317785 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:06.317759 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vlqmf" event={"ID":"581eef2b-70ee-4bb7-b721-fac3d801a93a","Type":"ContainerStarted","Data":"eef1a1b9b9c909973f748959a1a2b8c61af6bdf2eefcb4029d9501c71dc77990"} Jun 14 15:14:06.318875 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:06.318850 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-xg8b5" event={"ID":"9dca9a08-6b6e-43a2-a5ea-9a7ceca39f2e","Type":"ContainerStarted","Data":"46ad56108aba3b5ece613884c4cb87211b9ebc9033fb7fb7b59f10efc0e5a670"} Jun 14 15:14:06.319856 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:06.319837 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-nlqnj" event={"ID":"87a9a729-3c3f-451a-bcd6-c8726159c1c0","Type":"ContainerStarted","Data":"25a99e4eb5e24932d5331d0fcd8b2a04b3461fa0972b4c40c13ec98674ca7b1f"} Jun 14 15:14:06.320851 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:06.320834 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8w5cg" event={"ID":"61fac2bb-36e8-4862-82b0-39169b4fa9cd","Type":"ContainerStarted","Data":"454378a84455bda40888d0fc076b8bc8845d1732f335430a1cd492698858b370"} Jun 14 15:14:06.331568 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:06.331534 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-30.ec2.internal" podStartSLOduration=2.331523619 podStartE2EDuration="2.331523619s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 15:14:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:14:06.33133946 +0000 UTC m=+3.512821987" watchObservedRunningTime="2026-06-14 15:14:06.331523619 +0000 UTC m=+3.513006148" Jun 14 15:14:06.357695 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:06.357628 2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-13 15:09:05 +0000 UTC" deadline="2028-03-19 22:57:50.184630516 +0000 UTC" Jun 14 15:14:06.357695 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:06.357694 2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15463h43m43.826942067s" Jun 14 15:14:06.868106 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:06.867397 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/15bccd1f-7f51-4c8b-8b76-75481887049f-original-pull-secret\") pod \"global-pull-secret-syncer-lfxgl\" (UID: \"15bccd1f-7f51-4c8b-8b76-75481887049f\") " pod="kube-system/global-pull-secret-syncer-lfxgl" Jun 14 15:14:06.868106 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:06.867619 2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 15:14:06.868106 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:06.867685 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15bccd1f-7f51-4c8b-8b76-75481887049f-original-pull-secret podName:15bccd1f-7f51-4c8b-8b76-75481887049f nodeName:}" failed. No retries permitted until 2026-06-14 15:14:08.867665406 +0000 UTC m=+6.049147901 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/15bccd1f-7f51-4c8b-8b76-75481887049f-original-pull-secret") pod "global-pull-secret-syncer-lfxgl" (UID: "15bccd1f-7f51-4c8b-8b76-75481887049f") : object "kube-system"/"original-pull-secret" not registered Jun 14 15:14:06.968624 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:06.968584 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0df8c3a-2915-4563-8f78-1bf2e8d5a27f-metrics-certs\") pod \"network-metrics-daemon-nb6vz\" (UID: \"d0df8c3a-2915-4563-8f78-1bf2e8d5a27f\") " pod="openshift-multus/network-metrics-daemon-nb6vz" Jun 14 15:14:06.968807 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:06.968640 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wln4b\" (UniqueName: \"kubernetes.io/projected/5769083d-c587-4660-a48d-2c58b8eccc78-kube-api-access-wln4b\") pod \"network-check-target-jqckm\" (UID: \"5769083d-c587-4660-a48d-2c58b8eccc78\") " pod="openshift-network-diagnostics/network-check-target-jqckm" Jun 14 15:14:06.968865 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:06.968811 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 15:14:06.968865 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:06.968829 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 15:14:06.968865 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:06.968841 2571 projected.go:196] Error preparing data for projected volume kube-api-access-wln4b for pod openshift-network-diagnostics/network-check-target-jqckm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 15:14:06.969015 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:06.968899 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5769083d-c587-4660-a48d-2c58b8eccc78-kube-api-access-wln4b podName:5769083d-c587-4660-a48d-2c58b8eccc78 nodeName:}" failed. No retries permitted until 2026-06-14 15:14:08.968881201 +0000 UTC m=+6.150363698 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-wln4b" (UniqueName: "kubernetes.io/projected/5769083d-c587-4660-a48d-2c58b8eccc78-kube-api-access-wln4b") pod "network-check-target-jqckm" (UID: "5769083d-c587-4660-a48d-2c58b8eccc78") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 15:14:06.969328 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:06.969298 2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 15:14:06.969398 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:06.969349 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0df8c3a-2915-4563-8f78-1bf2e8d5a27f-metrics-certs podName:d0df8c3a-2915-4563-8f78-1bf2e8d5a27f nodeName:}" failed. No retries permitted until 2026-06-14 15:14:08.969332152 +0000 UTC m=+6.150814662 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d0df8c3a-2915-4563-8f78-1bf2e8d5a27f-metrics-certs") pod "network-metrics-daemon-nb6vz" (UID: "d0df8c3a-2915-4563-8f78-1bf2e8d5a27f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 15:14:07.300087 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:07.300001 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nb6vz" Jun 14 15:14:07.300509 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:07.300158 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nb6vz" podUID="d0df8c3a-2915-4563-8f78-1bf2e8d5a27f" Jun 14 15:14:07.303111 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:07.300666 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lfxgl" Jun 14 15:14:07.303111 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:07.300762 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lfxgl" podUID="15bccd1f-7f51-4c8b-8b76-75481887049f" Jun 14 15:14:07.358172 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:07.358118 2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-13 15:09:05 +0000 UTC" deadline="2028-01-08 14:39:28.695347352 +0000 UTC" Jun 14 15:14:07.358172 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:07.358149 2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13751h25m21.337202945s" Jun 14 15:14:07.358539 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:07.358501 2571 generic.go:356] "Generic (PLEG): container finished" podID="69720275ea361bf0c01701aa7368a435" containerID="211e4cc7682f163a099f557a7d595ecd45a70df6e33abab0d134c58e800c191f" exitCode=0 Jun 14 15:14:07.358701 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:07.358564 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-30.ec2.internal" event={"ID":"69720275ea361bf0c01701aa7368a435","Type":"ContainerDied","Data":"211e4cc7682f163a099f557a7d595ecd45a70df6e33abab0d134c58e800c191f"} Jun 14 15:14:08.300111 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:08.300082 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jqckm" Jun 14 15:14:08.300607 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:08.300205 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jqckm" podUID="5769083d-c587-4660-a48d-2c58b8eccc78" Jun 14 15:14:08.383939 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:08.383900 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-30.ec2.internal" event={"ID":"69720275ea361bf0c01701aa7368a435","Type":"ContainerStarted","Data":"76993ac98a14956725c73605478176ae2b6f55e7c6f4c2c8b2af0a0afe29aa3b"} Jun 14 15:14:08.883727 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:08.883680 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/15bccd1f-7f51-4c8b-8b76-75481887049f-original-pull-secret\") pod \"global-pull-secret-syncer-lfxgl\" (UID: \"15bccd1f-7f51-4c8b-8b76-75481887049f\") " pod="kube-system/global-pull-secret-syncer-lfxgl" Jun 14 15:14:08.883957 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:08.883876 2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 15:14:08.883957 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:08.883939 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15bccd1f-7f51-4c8b-8b76-75481887049f-original-pull-secret podName:15bccd1f-7f51-4c8b-8b76-75481887049f nodeName:}" failed. No retries permitted until 2026-06-14 15:14:12.883920084 +0000 UTC m=+10.065402589 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/15bccd1f-7f51-4c8b-8b76-75481887049f-original-pull-secret") pod "global-pull-secret-syncer-lfxgl" (UID: "15bccd1f-7f51-4c8b-8b76-75481887049f") : object "kube-system"/"original-pull-secret" not registered Jun 14 15:14:08.984783 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:08.984731 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0df8c3a-2915-4563-8f78-1bf2e8d5a27f-metrics-certs\") pod \"network-metrics-daemon-nb6vz\" (UID: \"d0df8c3a-2915-4563-8f78-1bf2e8d5a27f\") " pod="openshift-multus/network-metrics-daemon-nb6vz" Jun 14 15:14:08.984783 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:08.984783 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wln4b\" (UniqueName: \"kubernetes.io/projected/5769083d-c587-4660-a48d-2c58b8eccc78-kube-api-access-wln4b\") pod \"network-check-target-jqckm\" (UID: \"5769083d-c587-4660-a48d-2c58b8eccc78\") " pod="openshift-network-diagnostics/network-check-target-jqckm" Jun 14 15:14:08.985030 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:08.984888 2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 15:14:08.985030 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:08.984927 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 15:14:08.985030 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:08.984952 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 15:14:08.985030 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:08.984965 2571 projected.go:196] Error preparing data for projected volume kube-api-access-wln4b for pod openshift-network-diagnostics/network-check-target-jqckm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 15:14:08.985030 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:08.984967 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0df8c3a-2915-4563-8f78-1bf2e8d5a27f-metrics-certs podName:d0df8c3a-2915-4563-8f78-1bf2e8d5a27f nodeName:}" failed. No retries permitted until 2026-06-14 15:14:12.984946189 +0000 UTC m=+10.166428689 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d0df8c3a-2915-4563-8f78-1bf2e8d5a27f-metrics-certs") pod "network-metrics-daemon-nb6vz" (UID: "d0df8c3a-2915-4563-8f78-1bf2e8d5a27f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 15:14:08.985030 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:08.985016 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5769083d-c587-4660-a48d-2c58b8eccc78-kube-api-access-wln4b podName:5769083d-c587-4660-a48d-2c58b8eccc78 nodeName:}" failed. No retries permitted until 2026-06-14 15:14:12.984998868 +0000 UTC m=+10.166481379 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-wln4b" (UniqueName: "kubernetes.io/projected/5769083d-c587-4660-a48d-2c58b8eccc78-kube-api-access-wln4b") pod "network-check-target-jqckm" (UID: "5769083d-c587-4660-a48d-2c58b8eccc78") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 15:14:09.299997 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:09.299919 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lfxgl" Jun 14 15:14:09.300173 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:09.300079 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lfxgl" podUID="15bccd1f-7f51-4c8b-8b76-75481887049f" Jun 14 15:14:09.300584 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:09.300443 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nb6vz" Jun 14 15:14:09.300584 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:09.300544 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nb6vz" podUID="d0df8c3a-2915-4563-8f78-1bf2e8d5a27f" Jun 14 15:14:10.300216 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:10.300178 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jqckm" Jun 14 15:14:10.300673 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:10.300344 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jqckm" podUID="5769083d-c587-4660-a48d-2c58b8eccc78" Jun 14 15:14:11.303533 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:11.303096 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lfxgl" Jun 14 15:14:11.303533 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:11.303219 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lfxgl" podUID="15bccd1f-7f51-4c8b-8b76-75481887049f" Jun 14 15:14:11.303533 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:11.303277 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nb6vz" Jun 14 15:14:11.303533 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:11.303394 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nb6vz" podUID="d0df8c3a-2915-4563-8f78-1bf2e8d5a27f" Jun 14 15:14:12.300023 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:12.299779 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jqckm" Jun 14 15:14:12.300023 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:12.299947 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jqckm" podUID="5769083d-c587-4660-a48d-2c58b8eccc78" Jun 14 15:14:12.922116 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:12.922075 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/15bccd1f-7f51-4c8b-8b76-75481887049f-original-pull-secret\") pod \"global-pull-secret-syncer-lfxgl\" (UID: \"15bccd1f-7f51-4c8b-8b76-75481887049f\") " pod="kube-system/global-pull-secret-syncer-lfxgl" Jun 14 15:14:12.922676 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:12.922283 2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 15:14:12.922676 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:12.922368 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15bccd1f-7f51-4c8b-8b76-75481887049f-original-pull-secret podName:15bccd1f-7f51-4c8b-8b76-75481887049f nodeName:}" failed. No retries permitted until 2026-06-14 15:14:20.922346463 +0000 UTC m=+18.103828965 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/15bccd1f-7f51-4c8b-8b76-75481887049f-original-pull-secret") pod "global-pull-secret-syncer-lfxgl" (UID: "15bccd1f-7f51-4c8b-8b76-75481887049f") : object "kube-system"/"original-pull-secret" not registered Jun 14 15:14:13.023453 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:13.022903 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0df8c3a-2915-4563-8f78-1bf2e8d5a27f-metrics-certs\") pod \"network-metrics-daemon-nb6vz\" (UID: \"d0df8c3a-2915-4563-8f78-1bf2e8d5a27f\") " pod="openshift-multus/network-metrics-daemon-nb6vz" Jun 14 15:14:13.023453 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:13.022956 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wln4b\" (UniqueName: \"kubernetes.io/projected/5769083d-c587-4660-a48d-2c58b8eccc78-kube-api-access-wln4b\") pod \"network-check-target-jqckm\" (UID: \"5769083d-c587-4660-a48d-2c58b8eccc78\") " pod="openshift-network-diagnostics/network-check-target-jqckm" Jun 14 15:14:13.023453 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:13.023058 2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 15:14:13.023453 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:13.023120 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 15:14:13.023453 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:13.023135 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0df8c3a-2915-4563-8f78-1bf2e8d5a27f-metrics-certs podName:d0df8c3a-2915-4563-8f78-1bf2e8d5a27f nodeName:}" failed. No retries permitted until 2026-06-14 15:14:21.02311512 +0000 UTC m=+18.204597620 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d0df8c3a-2915-4563-8f78-1bf2e8d5a27f-metrics-certs") pod "network-metrics-daemon-nb6vz" (UID: "d0df8c3a-2915-4563-8f78-1bf2e8d5a27f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 15:14:13.023453 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:13.023141 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 15:14:13.023453 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:13.023155 2571 projected.go:196] Error preparing data for projected volume kube-api-access-wln4b for pod openshift-network-diagnostics/network-check-target-jqckm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 15:14:13.023453 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:13.023205 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5769083d-c587-4660-a48d-2c58b8eccc78-kube-api-access-wln4b podName:5769083d-c587-4660-a48d-2c58b8eccc78 nodeName:}" failed. No retries permitted until 2026-06-14 15:14:21.023188176 +0000 UTC m=+18.204670678 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-wln4b" (UniqueName: "kubernetes.io/projected/5769083d-c587-4660-a48d-2c58b8eccc78-kube-api-access-wln4b") pod "network-check-target-jqckm" (UID: "5769083d-c587-4660-a48d-2c58b8eccc78") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 15:14:13.303480 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:13.302873 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lfxgl" Jun 14 15:14:13.303480 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:13.302897 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nb6vz" Jun 14 15:14:13.303480 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:13.302998 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lfxgl" podUID="15bccd1f-7f51-4c8b-8b76-75481887049f" Jun 14 15:14:13.303480 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:13.303114 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nb6vz" podUID="d0df8c3a-2915-4563-8f78-1bf2e8d5a27f" Jun 14 15:14:14.299737 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:14.299650 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jqckm" Jun 14 15:14:14.300237 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:14.299785 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jqckm" podUID="5769083d-c587-4660-a48d-2c58b8eccc78" Jun 14 15:14:15.299644 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:15.299579 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nb6vz" Jun 14 15:14:15.299809 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:15.299727 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nb6vz" podUID="d0df8c3a-2915-4563-8f78-1bf2e8d5a27f" Jun 14 15:14:15.300190 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:15.299579 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lfxgl" Jun 14 15:14:15.300247 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:15.300189 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lfxgl" podUID="15bccd1f-7f51-4c8b-8b76-75481887049f" Jun 14 15:14:16.299938 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:16.299904 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jqckm" Jun 14 15:14:16.300378 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:16.300020 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jqckm" podUID="5769083d-c587-4660-a48d-2c58b8eccc78" Jun 14 15:14:17.299391 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:17.299352 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nb6vz" Jun 14 15:14:17.299588 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:17.299410 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lfxgl" Jun 14 15:14:17.299588 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:17.299500 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nb6vz" podUID="d0df8c3a-2915-4563-8f78-1bf2e8d5a27f" Jun 14 15:14:17.299693 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:17.299641 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lfxgl" podUID="15bccd1f-7f51-4c8b-8b76-75481887049f" Jun 14 15:14:18.300294 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:18.300262 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jqckm" Jun 14 15:14:18.300743 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:18.300375 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jqckm" podUID="5769083d-c587-4660-a48d-2c58b8eccc78" Jun 14 15:14:19.299855 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:19.299822 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nb6vz" Jun 14 15:14:19.300040 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:19.299968 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nb6vz" podUID="d0df8c3a-2915-4563-8f78-1bf2e8d5a27f" Jun 14 15:14:19.300119 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:19.300033 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lfxgl" Jun 14 15:14:19.300179 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:19.300155 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lfxgl" podUID="15bccd1f-7f51-4c8b-8b76-75481887049f" Jun 14 15:14:20.299850 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:20.299817 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jqckm" Jun 14 15:14:20.300335 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:20.299944 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jqckm" podUID="5769083d-c587-4660-a48d-2c58b8eccc78" Jun 14 15:14:20.980344 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:20.980292 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/15bccd1f-7f51-4c8b-8b76-75481887049f-original-pull-secret\") pod \"global-pull-secret-syncer-lfxgl\" (UID: \"15bccd1f-7f51-4c8b-8b76-75481887049f\") " pod="kube-system/global-pull-secret-syncer-lfxgl" Jun 14 15:14:20.980535 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:20.980451 2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 15:14:20.980535 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:20.980525 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15bccd1f-7f51-4c8b-8b76-75481887049f-original-pull-secret podName:15bccd1f-7f51-4c8b-8b76-75481887049f nodeName:}" failed. No retries permitted until 2026-06-14 15:14:36.980505769 +0000 UTC m=+34.161988262 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/15bccd1f-7f51-4c8b-8b76-75481887049f-original-pull-secret") pod "global-pull-secret-syncer-lfxgl" (UID: "15bccd1f-7f51-4c8b-8b76-75481887049f") : object "kube-system"/"original-pull-secret" not registered Jun 14 15:14:21.081442 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:21.081404 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0df8c3a-2915-4563-8f78-1bf2e8d5a27f-metrics-certs\") pod \"network-metrics-daemon-nb6vz\" (UID: \"d0df8c3a-2915-4563-8f78-1bf2e8d5a27f\") " pod="openshift-multus/network-metrics-daemon-nb6vz" Jun 14 15:14:21.081442 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:21.081445 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wln4b\" (UniqueName: \"kubernetes.io/projected/5769083d-c587-4660-a48d-2c58b8eccc78-kube-api-access-wln4b\") pod \"network-check-target-jqckm\" (UID: \"5769083d-c587-4660-a48d-2c58b8eccc78\") " pod="openshift-network-diagnostics/network-check-target-jqckm" Jun 14 15:14:21.081662 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:21.081555 2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 15:14:21.081662 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:21.081568 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 15:14:21.081662 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:21.081584 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 15:14:21.081662 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:21.081595 2571 projected.go:196] Error preparing data for projected volume kube-api-access-wln4b for pod openshift-network-diagnostics/network-check-target-jqckm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 15:14:21.081662 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:21.081628 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0df8c3a-2915-4563-8f78-1bf2e8d5a27f-metrics-certs podName:d0df8c3a-2915-4563-8f78-1bf2e8d5a27f nodeName:}" failed. No retries permitted until 2026-06-14 15:14:37.081609084 +0000 UTC m=+34.263091590 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d0df8c3a-2915-4563-8f78-1bf2e8d5a27f-metrics-certs") pod "network-metrics-daemon-nb6vz" (UID: "d0df8c3a-2915-4563-8f78-1bf2e8d5a27f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 15:14:21.081662 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:21.081647 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5769083d-c587-4660-a48d-2c58b8eccc78-kube-api-access-wln4b podName:5769083d-c587-4660-a48d-2c58b8eccc78 nodeName:}" failed. No retries permitted until 2026-06-14 15:14:37.081638095 +0000 UTC m=+34.263120592 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-wln4b" (UniqueName: "kubernetes.io/projected/5769083d-c587-4660-a48d-2c58b8eccc78-kube-api-access-wln4b") pod "network-check-target-jqckm" (UID: "5769083d-c587-4660-a48d-2c58b8eccc78") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 15:14:21.300348 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:21.300255 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nb6vz" Jun 14 15:14:21.300809 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:21.300407 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nb6vz" podUID="d0df8c3a-2915-4563-8f78-1bf2e8d5a27f" Jun 14 15:14:21.300809 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:21.300259 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lfxgl" Jun 14 15:14:21.300918 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:21.300857 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lfxgl" podUID="15bccd1f-7f51-4c8b-8b76-75481887049f" Jun 14 15:14:22.300180 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:22.300146 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jqckm" Jun 14 15:14:22.300371 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:22.300269 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jqckm" podUID="5769083d-c587-4660-a48d-2c58b8eccc78" Jun 14 15:14:23.300776 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:23.300740 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lfxgl" Jun 14 15:14:23.301288 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:23.300882 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nb6vz" Jun 14 15:14:23.301288 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:23.300880 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lfxgl" podUID="15bccd1f-7f51-4c8b-8b76-75481887049f" Jun 14 15:14:23.301288 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:23.301001 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nb6vz" podUID="d0df8c3a-2915-4563-8f78-1bf2e8d5a27f" Jun 14 15:14:24.299743 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:24.299714 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jqckm" Jun 14 15:14:24.299879 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:24.299801 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jqckm" podUID="5769083d-c587-4660-a48d-2c58b8eccc78" Jun 14 15:14:25.300749 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:25.300425 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nb6vz" Jun 14 15:14:25.301396 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:25.300471 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lfxgl" Jun 14 15:14:25.301396 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:25.300853 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nb6vz" podUID="d0df8c3a-2915-4563-8f78-1bf2e8d5a27f" Jun 14 15:14:25.301396 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:25.300948 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lfxgl" podUID="15bccd1f-7f51-4c8b-8b76-75481887049f" Jun 14 15:14:25.417189 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:25.417083 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5fg9d" event={"ID":"5ffbcb60-2145-4431-b8e8-0f7528cb4851","Type":"ContainerStarted","Data":"0fc1e67f2f42dd82663ecf5e8015535d7bb45902cdfe86180ff2eb2bbad2a74c"} Jun 14 15:14:25.418664 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:25.418633 2571 generic.go:356] "Generic (PLEG): container finished" podID="73a47e15-a8cc-45e8-8138-d62372b4b753" containerID="051b157acbdcb3fa4080708499464bf77d15b082074b3707bc8c4d5d45a70a83" exitCode=0 Jun 14 15:14:25.418790 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:25.418714 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kn9qq" event={"ID":"73a47e15-a8cc-45e8-8138-d62372b4b753","Type":"ContainerDied","Data":"051b157acbdcb3fa4080708499464bf77d15b082074b3707bc8c4d5d45a70a83"} Jun 14 15:14:25.421006 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:25.420984 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-59js7" event={"ID":"0c99e6cb-ee5c-45c5-9635-839d2f237c0b","Type":"ContainerStarted","Data":"f5be32135af97dd53a6afdcfde1eaf5d6c1908ddfcb216823a79e0a0e5790062"} Jun 14 15:14:25.424253 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:25.424233 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ltnnm_ee9ddc42-3dac-47b7-a02b-899fc13a7467/ovn-acl-logging/0.log" Jun 14 15:14:25.424738 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:25.424720 2571 generic.go:356] "Generic (PLEG): container finished" podID="ee9ddc42-3dac-47b7-a02b-899fc13a7467" containerID="bffc89c4e751cb66b1b36df2f872b16053e7411fb6189fa0e91bd73179d8574f" exitCode=1 Jun 14 15:14:25.424834 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:25.424781 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ltnnm" event={"ID":"ee9ddc42-3dac-47b7-a02b-899fc13a7467","Type":"ContainerStarted","Data":"2e9e5622aa926f79a4326519be8e54f8c14e1b65c30a22b0df9cf32d182008ff"} Jun 14 15:14:25.424834 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:25.424825 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ltnnm" event={"ID":"ee9ddc42-3dac-47b7-a02b-899fc13a7467","Type":"ContainerStarted","Data":"9d6275fda7ea71de9f3cac997d711de0348535461ba963ecddc58bfb5e7b11f7"} Jun 14 15:14:25.424941 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:25.424856 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ltnnm" event={"ID":"ee9ddc42-3dac-47b7-a02b-899fc13a7467","Type":"ContainerStarted","Data":"c90a71404349f331e8dc5381e446302de03f275d87be04e1bb92eed91e73acb7"} Jun 14 15:14:25.424941 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:25.424882 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ltnnm" event={"ID":"ee9ddc42-3dac-47b7-a02b-899fc13a7467","Type":"ContainerStarted","Data":"10190269fa170f0eecde12e89d9f1410104c883ed2d08a17e04d56175d7a1fda"} Jun 14 15:14:25.424941 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:25.424909 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ltnnm" event={"ID":"ee9ddc42-3dac-47b7-a02b-899fc13a7467","Type":"ContainerDied","Data":"bffc89c4e751cb66b1b36df2f872b16053e7411fb6189fa0e91bd73179d8574f"} Jun 14 15:14:25.424941 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:25.424938 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ltnnm" event={"ID":"ee9ddc42-3dac-47b7-a02b-899fc13a7467","Type":"ContainerStarted","Data":"baa8f4208d04f977990cda14b7a61ee47246f5de81e022a5ed6b226e3e7a1efe"} Jun 14 15:14:25.427311 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:25.427289 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vlqmf" event={"ID":"581eef2b-70ee-4bb7-b721-fac3d801a93a","Type":"ContainerStarted","Data":"411391040b2bb29d1bf736588814639483f32ba5a701a0c86ffa2002a6ea7eab"} Jun 14 15:14:25.428943 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:25.428781 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-xg8b5" event={"ID":"9dca9a08-6b6e-43a2-a5ea-9a7ceca39f2e","Type":"ContainerStarted","Data":"97d64c7e8c16b5b1362ff14d662e7ade2d4817f70c74f1f2d44ae477abef27d4"} Jun 14 15:14:25.430476 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:25.430452 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-nlqnj" event={"ID":"87a9a729-3c3f-451a-bcd6-c8726159c1c0","Type":"ContainerStarted","Data":"5f8aec23f83aa636e72f79f32bfe6f98c7a3d0afaa5be7adca443bbc9cccb499"} Jun 14 15:14:25.431920 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:25.431873 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8w5cg" event={"ID":"61fac2bb-36e8-4862-82b0-39169b4fa9cd","Type":"ContainerStarted","Data":"0a477e4575f88380396db188c3b7cada3da1b8352d225f6a2fe19b4caa3e41a6"} Jun 14 15:14:25.435274 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:25.435235 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-5fg9d" podStartSLOduration=3.9687166400000002 podStartE2EDuration="22.435221989s" totalImagesPullingTime="18.466505349s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 15:14:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:14:25.435216873 +0000 UTC m=+22.616699391" watchObservedRunningTime="2026-06-14 15:14:25.435221989 +0000 UTC m=+22.616704507" Jun 14 15:14:25.435792 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:25.435648 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-30.ec2.internal" podStartSLOduration=21.435640239 podStartE2EDuration="21.435640239s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 15:14:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:14:08.402704666 +0000 UTC m=+5.584187183" watchObservedRunningTime="2026-06-14 15:14:25.435640239 +0000 UTC m=+22.617122758" Jun 14 15:14:25.469555 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:25.469505 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-xg8b5" podStartSLOduration=4.000927113 podStartE2EDuration="22.469493014s" totalImagesPullingTime="18.468565901s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 15:14:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:14:25.469222232 +0000 UTC m=+22.650704750" watchObservedRunningTime="2026-06-14 15:14:25.469493014 +0000 UTC m=+22.650975563" Jun 14 15:14:25.493682 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:25.493631 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-59js7" podStartSLOduration=12.409219535 podStartE2EDuration="22.493614745s" totalImagesPullingTime="10.08439521s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:14:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:14:25.493590836 +0000 UTC m=+22.675073352" watchObservedRunningTime="2026-06-14 15:14:25.493614745 +0000 UTC m=+22.675097265" Jun 14 15:14:25.518550 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:25.518508 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-8w5cg" podStartSLOduration=4.063042096 podStartE2EDuration="22.518495658s" totalImagesPullingTime="18.455453562s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 15:14:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:14:25.518133269 +0000 UTC m=+22.699615788" watchObservedRunningTime="2026-06-14 15:14:25.518495658 +0000 UTC m=+22.699978174" Jun 14 15:14:25.542126 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:25.542070 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-nlqnj" podStartSLOduration=4.047715375 podStartE2EDuration="22.542041695s" totalImagesPullingTime="18.49432632s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 15:14:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:14:25.541074373 +0000 UTC m=+22.722556890" watchObservedRunningTime="2026-06-14 15:14:25.542041695 +0000 UTC m=+22.723524211" Jun 14 15:14:25.548606 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:25.548558 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:14:26.120001 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:26.119976 2571 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 14 15:14:26.299806 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:26.299726 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jqckm" Jun 14 15:14:26.299957 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:26.299839 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jqckm" podUID="5769083d-c587-4660-a48d-2c58b8eccc78" Jun 14 15:14:26.308958 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:26.308862 2571 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-14T15:14:26.119993866Z","UUID":"dd1d6d85-e666-4cae-9a64-9bdf89c01f60","Handler":null,"Name":"","Endpoint":""} Jun 14 15:14:26.310527 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:26.310486 2571 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 14 15:14:26.310527 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:26.310528 2571 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 14 15:14:26.368307 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:26.368270 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-59js7" Jun 14 15:14:26.368908 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:26.368888 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-59js7" Jun 14 15:14:26.439502 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:26.439465 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vlqmf" event={"ID":"581eef2b-70ee-4bb7-b721-fac3d801a93a","Type":"ContainerStarted","Data":"6bc2c4586773a59dd820e8fb6ba5416f4e25fe647dc1c601463a6b5569d444c9"} Jun 14 15:14:26.441129 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:26.441086 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-r5pb4" event={"ID":"93923012-e70e-49c0-9578-f00c009dc2a6","Type":"ContainerStarted","Data":"f6c28858653a6ec70623b4c6c94aaeab7b7562c84fcaa8b8a30bb0177b9bdb5d"} Jun 14 15:14:26.441854 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:26.441830 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-59js7" Jun 14 15:14:26.442303 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:26.442284 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-59js7" Jun 14 15:14:26.456868 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:26.456811 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-r5pb4" podStartSLOduration=4.981586803 podStartE2EDuration="23.456789335s" totalImagesPullingTime="18.475202532s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 15:14:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:14:26.456421288 +0000 UTC m=+23.637903803" watchObservedRunningTime="2026-06-14 15:14:26.456789335 +0000 UTC m=+23.638271851" Jun 14 15:14:26.706462 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:26.706383 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:14:26.902136 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:26.902101 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:14:27.115314 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:27.115247 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:14:27.179346 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:27.179311 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:14:27.299817 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:27.299788 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lfxgl" Jun 14 15:14:27.299817 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:27.299827 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nb6vz" Jun 14 15:14:27.300099 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:27.299928 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lfxgl" podUID="15bccd1f-7f51-4c8b-8b76-75481887049f" Jun 14 15:14:27.300170 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:27.300097 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nb6vz" podUID="d0df8c3a-2915-4563-8f78-1bf2e8d5a27f" Jun 14 15:14:27.311030 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:27.311004 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:14:27.517243 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:27.517206 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:14:27.745514 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:27.745436 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:14:28.100816 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:28.100596 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:14:28.299717 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:28.299689 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jqckm" Jun 14 15:14:28.299902 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:28.299803 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jqckm" podUID="5769083d-c587-4660-a48d-2c58b8eccc78" Jun 14 15:14:28.449508 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:28.449426 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ltnnm_ee9ddc42-3dac-47b7-a02b-899fc13a7467/ovn-acl-logging/0.log" Jun 14 15:14:28.449942 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:28.449872 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ltnnm" event={"ID":"ee9ddc42-3dac-47b7-a02b-899fc13a7467","Type":"ContainerStarted","Data":"edfc301032dcd8afc50c3c545eb4b8c7b3cb171ab1f8801ddc3269e33a4d1d94"} Jun 14 15:14:28.452105 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:28.452079 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vlqmf" event={"ID":"581eef2b-70ee-4bb7-b721-fac3d801a93a","Type":"ContainerStarted","Data":"d63b659c2eeec7a06c273fa23e17def86090110b9ee3c05f32f73a21061d5200"} Jun 14 15:14:28.488856 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:28.488809 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vlqmf" podStartSLOduration=4.732137644 podStartE2EDuration="25.488792049s" totalImagesPullingTime="20.756654405s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 15:14:03 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:14:28.487739655 +0000 UTC m=+25.669222171" watchObservedRunningTime="2026-06-14 15:14:28.488792049 +0000 UTC m=+25.670274564" Jun 14 15:14:28.586664 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:28.586630 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:14:28.747234 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:28.747161 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:14:28.935782 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:28.935752 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:14:29.109686 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:29.109604 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:14:29.299753 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:29.299720 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lfxgl" Jun 14 15:14:29.299913 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:29.299838 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lfxgl" podUID="15bccd1f-7f51-4c8b-8b76-75481887049f" Jun 14 15:14:29.299913 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:29.299721 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nb6vz" Jun 14 15:14:29.300037 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:29.299928 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nb6vz" podUID="d0df8c3a-2915-4563-8f78-1bf2e8d5a27f" Jun 14 15:14:29.311419 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:29.311387 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:14:29.501158 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:29.501088 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:14:30.299894 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:30.299738 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jqckm" Jun 14 15:14:30.300068 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:30.299992 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jqckm" podUID="5769083d-c587-4660-a48d-2c58b8eccc78" Jun 14 15:14:30.358621 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:30.358588 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:14:30.443008 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:30.442981 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:14:30.458515 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:30.458481 2571 generic.go:356] "Generic (PLEG): container finished" podID="73a47e15-a8cc-45e8-8138-d62372b4b753" containerID="43ed2ba852c287e75ea7259a59018031efab436b8c278b5246308e75a0d86235" exitCode=0 Jun 14 15:14:30.458692 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:30.458527 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kn9qq" event={"ID":"73a47e15-a8cc-45e8-8138-d62372b4b753","Type":"ContainerDied","Data":"43ed2ba852c287e75ea7259a59018031efab436b8c278b5246308e75a0d86235"} Jun 14 15:14:30.462134 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:30.462117 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ltnnm_ee9ddc42-3dac-47b7-a02b-899fc13a7467/ovn-acl-logging/0.log" Jun 14 15:14:30.462482 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:30.462461 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ltnnm" event={"ID":"ee9ddc42-3dac-47b7-a02b-899fc13a7467","Type":"ContainerStarted","Data":"11d96f913885ff84f33b814b6508660cd7c4184758863646898b22313103fa52"} Jun 14 15:14:30.462755 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:30.462733 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ltnnm" Jun 14 15:14:30.462981 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:30.462965 2571 scope.go:117] "RemoveContainer" containerID="bffc89c4e751cb66b1b36df2f872b16053e7411fb6189fa0e91bd73179d8574f" Jun 14 15:14:30.480219 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:30.480199 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ltnnm" Jun 14 15:14:30.716597 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:30.716515 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:14:30.780381 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:30.780350 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:14:31.105571 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:31.105488 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:14:31.299448 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:31.299416 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lfxgl" Jun 14 15:14:31.299657 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:31.299418 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nb6vz" Jun 14 15:14:31.299657 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:31.299541 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lfxgl" podUID="15bccd1f-7f51-4c8b-8b76-75481887049f" Jun 14 15:14:31.299657 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:31.299597 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nb6vz" podUID="d0df8c3a-2915-4563-8f78-1bf2e8d5a27f" Jun 14 15:14:31.307701 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:31.307676 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:14:31.468037 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:31.467971 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ltnnm_ee9ddc42-3dac-47b7-a02b-899fc13a7467/ovn-acl-logging/0.log" Jun 14 15:14:31.468324 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:31.468304 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ltnnm" event={"ID":"ee9ddc42-3dac-47b7-a02b-899fc13a7467","Type":"ContainerStarted","Data":"18377609a765fcb8f601e024a2b3ad7954b85c934e09e2c98bf6efbcdd497156"} Jun 14 15:14:31.468475 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:31.468462 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ltnnm" Jun 14 15:14:31.468531 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:31.468518 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ltnnm" Jun 14 15:14:31.483156 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:31.483135 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ltnnm" Jun 14 15:14:31.501239 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:31.501202 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-ltnnm" podStartSLOduration=9.977998477 podStartE2EDuration="28.501189139s" totalImagesPullingTime="18.523190662s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 15:14:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:14:31.499407367 +0000 UTC m=+28.680889883" watchObservedRunningTime="2026-06-14 15:14:31.501189139 +0000 UTC m=+28.682671654" Jun 14 15:14:31.925493 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:31.925459 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:14:32.142897 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:32.142819 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:14:32.213155 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:32.213128 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:14:32.299507 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:32.299476 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jqckm" Jun 14 15:14:32.299652 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:32.299586 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jqckm" podUID="5769083d-c587-4660-a48d-2c58b8eccc78" Jun 14 15:14:32.472582 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:32.472546 2571 generic.go:356] "Generic (PLEG): container finished" podID="73a47e15-a8cc-45e8-8138-d62372b4b753" containerID="5d435cf4d892f69c4d13b5b8b82f651ce154f15ca89291f1970e467a0da09eeb" exitCode=0 Jun 14 15:14:32.472747 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:32.472632 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kn9qq" event={"ID":"73a47e15-a8cc-45e8-8138-d62372b4b753","Type":"ContainerDied","Data":"5d435cf4d892f69c4d13b5b8b82f651ce154f15ca89291f1970e467a0da09eeb"} Jun 14 15:14:32.502100 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:32.502028 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:14:32.721443 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:32.721411 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:14:32.907340 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:32.907251 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:14:33.301122 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:33.301094 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lfxgl" Jun 14 15:14:33.301122 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:33.301124 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nb6vz" Jun 14 15:14:33.301655 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:33.301177 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lfxgl" podUID="15bccd1f-7f51-4c8b-8b76-75481887049f" Jun 14 15:14:33.301655 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:33.301300 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nb6vz" podUID="d0df8c3a-2915-4563-8f78-1bf2e8d5a27f" Jun 14 15:14:33.317934 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:33.317891 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:14:34.148374 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:34.148344 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:14:34.239834 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:34.239805 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:14:34.299562 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:34.299532 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jqckm" Jun 14 15:14:34.299696 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:34.299637 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jqckm" podUID="5769083d-c587-4660-a48d-2c58b8eccc78" Jun 14 15:14:34.341752 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:34.341726 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:14:34.426412 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:34.426319 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:14:34.481124 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:34.481082 2571 generic.go:356] "Generic (PLEG): container finished" podID="73a47e15-a8cc-45e8-8138-d62372b4b753" containerID="1431cb5dce1a133da48612dc0bf43a02a4839d4c6612ad68a289aa38adbbd7fb" exitCode=0 Jun 14 15:14:34.481124 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:34.481121 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kn9qq" event={"ID":"73a47e15-a8cc-45e8-8138-d62372b4b753","Type":"ContainerDied","Data":"1431cb5dce1a133da48612dc0bf43a02a4839d4c6612ad68a289aa38adbbd7fb"} Jun 14 15:14:34.580104 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:34.580069 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:14:34.736527 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:34.736500 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:14:34.829458 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:34.829420 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:14:34.937551 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:34.937516 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:14:35.145593 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:35.145501 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:14:35.241950 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:35.241914 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:14:35.300321 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:35.300288 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nb6vz" Jun 14 15:14:35.300519 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:35.300334 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lfxgl" Jun 14 15:14:35.300519 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:35.300431 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nb6vz" podUID="d0df8c3a-2915-4563-8f78-1bf2e8d5a27f" Jun 14 15:14:35.300639 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:35.300530 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lfxgl" podUID="15bccd1f-7f51-4c8b-8b76-75481887049f" Jun 14 15:14:35.528674 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:35.528639 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:14:35.633267 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:35.633235 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:14:35.734852 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:35.734818 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:14:35.830459 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:35.830373 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:14:36.023188 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:36.023147 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:14:36.116712 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:36.116626 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:14:36.214991 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:36.214966 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:14:36.300103 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:36.300073 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jqckm" Jun 14 15:14:36.300282 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:36.300188 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jqckm" podUID="5769083d-c587-4660-a48d-2c58b8eccc78" Jun 14 15:14:37.006640 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:37.006597 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/15bccd1f-7f51-4c8b-8b76-75481887049f-original-pull-secret\") pod \"global-pull-secret-syncer-lfxgl\" (UID: \"15bccd1f-7f51-4c8b-8b76-75481887049f\") " pod="kube-system/global-pull-secret-syncer-lfxgl" Jun 14 15:14:37.007264 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:37.006774 2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 15:14:37.007264 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:37.006851 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15bccd1f-7f51-4c8b-8b76-75481887049f-original-pull-secret podName:15bccd1f-7f51-4c8b-8b76-75481887049f nodeName:}" failed. No retries permitted until 2026-06-14 15:15:09.006832076 +0000 UTC m=+66.188314570 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/15bccd1f-7f51-4c8b-8b76-75481887049f-original-pull-secret") pod "global-pull-secret-syncer-lfxgl" (UID: "15bccd1f-7f51-4c8b-8b76-75481887049f") : object "kube-system"/"original-pull-secret" not registered Jun 14 15:14:37.107211 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:37.107176 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0df8c3a-2915-4563-8f78-1bf2e8d5a27f-metrics-certs\") pod \"network-metrics-daemon-nb6vz\" (UID: \"d0df8c3a-2915-4563-8f78-1bf2e8d5a27f\") " pod="openshift-multus/network-metrics-daemon-nb6vz" Jun 14 15:14:37.107211 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:37.107216 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wln4b\" (UniqueName: \"kubernetes.io/projected/5769083d-c587-4660-a48d-2c58b8eccc78-kube-api-access-wln4b\") pod \"network-check-target-jqckm\" (UID: \"5769083d-c587-4660-a48d-2c58b8eccc78\") " pod="openshift-network-diagnostics/network-check-target-jqckm" Jun 14 15:14:37.107429 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:37.107324 2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 15:14:37.107429 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:37.107336 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 15:14:37.107429 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:37.107349 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 15:14:37.107429 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:37.107361 2571 projected.go:196] Error preparing data for projected volume kube-api-access-wln4b for pod openshift-network-diagnostics/network-check-target-jqckm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 15:14:37.107429 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:37.107391 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0df8c3a-2915-4563-8f78-1bf2e8d5a27f-metrics-certs podName:d0df8c3a-2915-4563-8f78-1bf2e8d5a27f nodeName:}" failed. No retries permitted until 2026-06-14 15:15:09.107372939 +0000 UTC m=+66.288855446 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d0df8c3a-2915-4563-8f78-1bf2e8d5a27f-metrics-certs") pod "network-metrics-daemon-nb6vz" (UID: "d0df8c3a-2915-4563-8f78-1bf2e8d5a27f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 15:14:37.107429 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:37.107407 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5769083d-c587-4660-a48d-2c58b8eccc78-kube-api-access-wln4b podName:5769083d-c587-4660-a48d-2c58b8eccc78 nodeName:}" failed. No retries permitted until 2026-06-14 15:15:09.107399584 +0000 UTC m=+66.288882083 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-wln4b" (UniqueName: "kubernetes.io/projected/5769083d-c587-4660-a48d-2c58b8eccc78-kube-api-access-wln4b") pod "network-check-target-jqckm" (UID: "5769083d-c587-4660-a48d-2c58b8eccc78") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 15:14:37.300024 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:37.299939 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lfxgl" Jun 14 15:14:37.300216 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:37.299939 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nb6vz" Jun 14 15:14:37.300216 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:37.300089 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lfxgl" podUID="15bccd1f-7f51-4c8b-8b76-75481887049f" Jun 14 15:14:37.300216 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:37.300141 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nb6vz" podUID="d0df8c3a-2915-4563-8f78-1bf2e8d5a27f" Jun 14 15:14:38.299834 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:38.299799 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jqckm" Jun 14 15:14:38.300328 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:38.299927 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jqckm" podUID="5769083d-c587-4660-a48d-2c58b8eccc78" Jun 14 15:14:39.299634 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:39.299594 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nb6vz" Jun 14 15:14:39.299800 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:39.299642 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lfxgl" Jun 14 15:14:39.299800 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:39.299723 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nb6vz" podUID="d0df8c3a-2915-4563-8f78-1bf2e8d5a27f" Jun 14 15:14:39.299875 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:39.299834 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lfxgl" podUID="15bccd1f-7f51-4c8b-8b76-75481887049f" Jun 14 15:14:39.495582 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:39.495551 2571 generic.go:356] "Generic (PLEG): container finished" podID="73a47e15-a8cc-45e8-8138-d62372b4b753" containerID="ea4f7dbc4b755609eca36afe0b3e0a2ce2505c894d62540be4f4edb42c8fa019" exitCode=0 Jun 14 15:14:39.495745 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:39.495614 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kn9qq" event={"ID":"73a47e15-a8cc-45e8-8138-d62372b4b753","Type":"ContainerDied","Data":"ea4f7dbc4b755609eca36afe0b3e0a2ce2505c894d62540be4f4edb42c8fa019"} Jun 14 15:14:40.299363 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:40.299331 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jqckm" Jun 14 15:14:40.299533 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:40.299427 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jqckm" podUID="5769083d-c587-4660-a48d-2c58b8eccc78" Jun 14 15:14:40.500614 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:40.500582 2571 generic.go:356] "Generic (PLEG): container finished" podID="73a47e15-a8cc-45e8-8138-d62372b4b753" containerID="ad38e3bbf34804506102174fe3eaf4aab91f6d9230ab3e2a6723b66a559403e7" exitCode=0 Jun 14 15:14:40.500993 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:40.500646 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kn9qq" event={"ID":"73a47e15-a8cc-45e8-8138-d62372b4b753","Type":"ContainerDied","Data":"ad38e3bbf34804506102174fe3eaf4aab91f6d9230ab3e2a6723b66a559403e7"} Jun 14 15:14:40.837036 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:40.836934 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:14:41.299743 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:41.299710 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nb6vz" Jun 14 15:14:41.299743 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:41.299727 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lfxgl" Jun 14 15:14:41.299980 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:41.299818 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nb6vz" podUID="d0df8c3a-2915-4563-8f78-1bf2e8d5a27f" Jun 14 15:14:41.300040 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:41.299970 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lfxgl" podUID="15bccd1f-7f51-4c8b-8b76-75481887049f" Jun 14 15:14:41.506774 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:41.506738 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kn9qq" event={"ID":"73a47e15-a8cc-45e8-8138-d62372b4b753","Type":"ContainerStarted","Data":"f93e2a766ba60472d65f1a278a78275b27185cc8e46f0583716adae5e17d8c9b"} Jun 14 15:14:41.531783 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:41.531735 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-kn9qq" podStartSLOduration=9.408461004 podStartE2EDuration="38.531720558s" totalImagesPullingTime="29.123259554s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 15:14:03 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:14:41.531552632 +0000 UTC m=+38.713035151" watchObservedRunningTime="2026-06-14 15:14:41.531720558 +0000 UTC m=+38.713203073" Jun 14 15:14:42.300160 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:42.300131 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jqckm" Jun 14 15:14:42.300331 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:42.300227 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jqckm" podUID="5769083d-c587-4660-a48d-2c58b8eccc78" Jun 14 15:14:43.194512 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:43.194474 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:14:43.300649 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:43.300624 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lfxgl" Jun 14 15:14:43.300786 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:43.300708 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lfxgl" podUID="15bccd1f-7f51-4c8b-8b76-75481887049f" Jun 14 15:14:43.300857 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:43.300798 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nb6vz" Jun 14 15:14:43.300938 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:43.300918 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nb6vz" podUID="d0df8c3a-2915-4563-8f78-1bf2e8d5a27f" Jun 14 15:14:43.455063 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:43.454952 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:14:43.555520 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:43.555480 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:14:44.299531 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:44.299481 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jqckm" Jun 14 15:14:44.299955 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:44.299601 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jqckm" podUID="5769083d-c587-4660-a48d-2c58b8eccc78" Jun 14 15:14:45.300136 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:45.300103 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nb6vz" Jun 14 15:14:45.300477 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:45.300218 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nb6vz" podUID="d0df8c3a-2915-4563-8f78-1bf2e8d5a27f" Jun 14 15:14:45.300477 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:45.300276 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lfxgl" Jun 14 15:14:45.300477 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:45.300389 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lfxgl" podUID="15bccd1f-7f51-4c8b-8b76-75481887049f" Jun 14 15:14:46.299452 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:46.299422 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jqckm" Jun 14 15:14:46.299641 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:46.299524 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jqckm" podUID="5769083d-c587-4660-a48d-2c58b8eccc78" Jun 14 15:14:46.327307 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:46.327277 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:14:46.508099 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:46.508063 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:14:46.680527 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:46.680440 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:14:46.777230 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:46.777199 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:14:46.845145 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:46.845102 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:14:47.266932 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:47.266902 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:14:47.300239 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:47.300212 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lfxgl" Jun 14 15:14:47.300239 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:47.300230 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nb6vz" Jun 14 15:14:47.300422 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:47.300343 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lfxgl" podUID="15bccd1f-7f51-4c8b-8b76-75481887049f" Jun 14 15:14:47.300498 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:47.300476 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nb6vz" podUID="d0df8c3a-2915-4563-8f78-1bf2e8d5a27f" Jun 14 15:14:47.324334 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:47.324304 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:14:48.029008 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:48.028952 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lfxgl"] Jun 14 15:14:48.030380 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:48.029178 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lfxgl" Jun 14 15:14:48.030380 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:48.029311 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lfxgl" podUID="15bccd1f-7f51-4c8b-8b76-75481887049f" Jun 14 15:14:48.030578 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:48.030547 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jqckm"] Jun 14 15:14:48.030704 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:48.030689 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jqckm" Jun 14 15:14:48.030868 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:48.030844 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jqckm" podUID="5769083d-c587-4660-a48d-2c58b8eccc78" Jun 14 15:14:48.031752 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:48.031727 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-nb6vz"] Jun 14 15:14:48.031861 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:48.031829 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nb6vz" Jun 14 15:14:48.032005 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:48.031983 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nb6vz" podUID="d0df8c3a-2915-4563-8f78-1bf2e8d5a27f" Jun 14 15:14:48.549664 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:48.549630 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:14:48.619309 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:48.619278 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:14:48.701087 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:48.701062 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:14:48.830362 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:48.830330 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:14:48.932589 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:48.932555 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:14:49.258624 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:49.258594 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:14:49.299785 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:49.299747 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nb6vz" Jun 14 15:14:49.299785 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:49.299772 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lfxgl" Jun 14 15:14:49.300026 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:49.299747 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jqckm" Jun 14 15:14:49.300026 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:49.299873 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nb6vz" podUID="d0df8c3a-2915-4563-8f78-1bf2e8d5a27f" Jun 14 15:14:49.300026 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:49.299985 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jqckm" podUID="5769083d-c587-4660-a48d-2c58b8eccc78" Jun 14 15:14:49.300208 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:49.300083 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lfxgl" podUID="15bccd1f-7f51-4c8b-8b76-75481887049f" Jun 14 15:14:51.216654 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:51.216618 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:14:51.300264 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:51.300237 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jqckm" Jun 14 15:14:51.300387 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:51.300242 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lfxgl" Jun 14 15:14:51.300387 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:51.300345 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jqckm" podUID="5769083d-c587-4660-a48d-2c58b8eccc78" Jun 14 15:14:51.300488 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:51.300445 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lfxgl" podUID="15bccd1f-7f51-4c8b-8b76-75481887049f" Jun 14 15:14:51.300488 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:51.300237 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nb6vz" Jun 14 15:14:51.300560 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:51.300547 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nb6vz" podUID="d0df8c3a-2915-4563-8f78-1bf2e8d5a27f" Jun 14 15:14:51.307837 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:51.307803 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:14:51.609279 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:51.609194 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-30.ec2.internal" event="NodeReady" Jun 14 15:14:51.609420 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:51.609317 2571 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 14 15:14:51.650461 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:51.650425 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-kqsrl"] Jun 14 15:14:51.682923 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:51.682884 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-j62hw"] Jun 14 15:14:51.683109 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:51.683017 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kqsrl" Jun 14 15:14:51.686459 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:51.685673 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-f445z\"" Jun 14 15:14:51.686459 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:51.685997 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 14 15:14:51.686459 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:51.686265 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 14 15:14:51.696539 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:51.696510 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kqsrl"] Jun 14 15:14:51.696662 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:51.696548 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-j62hw"] Jun 14 15:14:51.696662 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:51.696563 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-mx6n9"] Jun 14 15:14:51.696662 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:51.696618 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-j62hw" Jun 14 15:14:51.698806 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:51.698778 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 14 15:14:51.698806 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:51.698786 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 14 15:14:51.698989 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:51.698809 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-pgwvt\"" Jun 14 15:14:51.698989 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:51.698828 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 14 15:14:51.714698 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:51.714666 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mx6n9"] Jun 14 15:14:51.714876 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:51.714809 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mx6n9" Jun 14 15:14:51.717276 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:51.717252 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 14 15:14:51.717403 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:51.717288 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 14 15:14:51.717403 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:51.717252 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-cmj6n\"" Jun 14 15:14:51.717403 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:51.717252 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 14 15:14:51.717403 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:51.717314 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 14 15:14:51.718878 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:51.718857 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/194b5b96-5a7b-4760-874c-903e5e9dce48-config-volume\") pod \"dns-default-kqsrl\" (UID: \"194b5b96-5a7b-4760-874c-903e5e9dce48\") " pod="openshift-dns/dns-default-kqsrl" Jun 14 15:14:51.718979 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:51.718887 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gctrf\" (UniqueName: \"kubernetes.io/projected/194b5b96-5a7b-4760-874c-903e5e9dce48-kube-api-access-gctrf\") pod \"dns-default-kqsrl\" (UID: \"194b5b96-5a7b-4760-874c-903e5e9dce48\") " pod="openshift-dns/dns-default-kqsrl" Jun 14 15:14:51.718979 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:51.718912 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8aa56d5d-e118-4630-a660-9f86ab228a8b-cert\") pod \"ingress-canary-j62hw\" (UID: \"8aa56d5d-e118-4630-a660-9f86ab228a8b\") " pod="openshift-ingress-canary/ingress-canary-j62hw" Jun 14 15:14:51.719089 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:51.718974 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkgv7\" (UniqueName: \"kubernetes.io/projected/8aa56d5d-e118-4630-a660-9f86ab228a8b-kube-api-access-gkgv7\") pod \"ingress-canary-j62hw\" (UID: \"8aa56d5d-e118-4630-a660-9f86ab228a8b\") " pod="openshift-ingress-canary/ingress-canary-j62hw" Jun 14 15:14:51.719089 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:51.719070 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/194b5b96-5a7b-4760-874c-903e5e9dce48-metrics-tls\") pod \"dns-default-kqsrl\" (UID: \"194b5b96-5a7b-4760-874c-903e5e9dce48\") " pod="openshift-dns/dns-default-kqsrl" Jun 14 15:14:51.719172 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:51.719120 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/194b5b96-5a7b-4760-874c-903e5e9dce48-tmp-dir\") pod \"dns-default-kqsrl\" (UID: \"194b5b96-5a7b-4760-874c-903e5e9dce48\") " pod="openshift-dns/dns-default-kqsrl" Jun 14 15:14:51.778773 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:51.778735 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:14:51.819909 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:51.819871 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b19af6b9-4b2a-44ea-b9b1-e01f23b73630-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mx6n9\" (UID: \"b19af6b9-4b2a-44ea-b9b1-e01f23b73630\") " pod="openshift-insights/insights-runtime-extractor-mx6n9" Jun 14 15:14:51.820081 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:51.819932 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b19af6b9-4b2a-44ea-b9b1-e01f23b73630-data-volume\") pod \"insights-runtime-extractor-mx6n9\" (UID: \"b19af6b9-4b2a-44ea-b9b1-e01f23b73630\") " pod="openshift-insights/insights-runtime-extractor-mx6n9" Jun 14 15:14:51.820081 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:51.819959 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/194b5b96-5a7b-4760-874c-903e5e9dce48-config-volume\") pod \"dns-default-kqsrl\" (UID: \"194b5b96-5a7b-4760-874c-903e5e9dce48\") " pod="openshift-dns/dns-default-kqsrl" Jun 14 15:14:51.820081 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:51.819984 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gctrf\" (UniqueName: \"kubernetes.io/projected/194b5b96-5a7b-4760-874c-903e5e9dce48-kube-api-access-gctrf\") pod \"dns-default-kqsrl\" (UID: \"194b5b96-5a7b-4760-874c-903e5e9dce48\") " pod="openshift-dns/dns-default-kqsrl" Jun 14 15:14:51.820081 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:51.820010 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b19af6b9-4b2a-44ea-b9b1-e01f23b73630-crio-socket\") pod \"insights-runtime-extractor-mx6n9\" (UID: \"b19af6b9-4b2a-44ea-b9b1-e01f23b73630\") " pod="openshift-insights/insights-runtime-extractor-mx6n9" Jun 14 15:14:51.820278 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:51.820083 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8aa56d5d-e118-4630-a660-9f86ab228a8b-cert\") pod \"ingress-canary-j62hw\" (UID: \"8aa56d5d-e118-4630-a660-9f86ab228a8b\") " pod="openshift-ingress-canary/ingress-canary-j62hw" Jun 14 15:14:51.820278 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:51.820122 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gkgv7\" (UniqueName: \"kubernetes.io/projected/8aa56d5d-e118-4630-a660-9f86ab228a8b-kube-api-access-gkgv7\") pod \"ingress-canary-j62hw\" (UID: \"8aa56d5d-e118-4630-a660-9f86ab228a8b\") " pod="openshift-ingress-canary/ingress-canary-j62hw" Jun 14 15:14:51.820278 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:51.820153 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/194b5b96-5a7b-4760-874c-903e5e9dce48-metrics-tls\") pod \"dns-default-kqsrl\" (UID: \"194b5b96-5a7b-4760-874c-903e5e9dce48\") " pod="openshift-dns/dns-default-kqsrl" Jun 14 15:14:51.820278 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:51.820175 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b19af6b9-4b2a-44ea-b9b1-e01f23b73630-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mx6n9\" (UID: \"b19af6b9-4b2a-44ea-b9b1-e01f23b73630\") " pod="openshift-insights/insights-runtime-extractor-mx6n9" Jun 14 15:14:51.820278 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:51.820193 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h94p8\" (UniqueName: \"kubernetes.io/projected/b19af6b9-4b2a-44ea-b9b1-e01f23b73630-kube-api-access-h94p8\") pod \"insights-runtime-extractor-mx6n9\" (UID: \"b19af6b9-4b2a-44ea-b9b1-e01f23b73630\") " pod="openshift-insights/insights-runtime-extractor-mx6n9" Jun 14 15:14:51.820278 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:51.820226 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/194b5b96-5a7b-4760-874c-903e5e9dce48-tmp-dir\") pod \"dns-default-kqsrl\" (UID: \"194b5b96-5a7b-4760-874c-903e5e9dce48\") " pod="openshift-dns/dns-default-kqsrl" Jun 14 15:14:51.820558 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:51.820541 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/194b5b96-5a7b-4760-874c-903e5e9dce48-tmp-dir\") pod \"dns-default-kqsrl\" (UID: \"194b5b96-5a7b-4760-874c-903e5e9dce48\") " pod="openshift-dns/dns-default-kqsrl" Jun 14 15:14:51.820651 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:51.820630 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/194b5b96-5a7b-4760-874c-903e5e9dce48-config-volume\") pod \"dns-default-kqsrl\" (UID: \"194b5b96-5a7b-4760-874c-903e5e9dce48\") " pod="openshift-dns/dns-default-kqsrl" Jun 14 15:14:51.823942 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:51.823922 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/194b5b96-5a7b-4760-874c-903e5e9dce48-metrics-tls\") pod \"dns-default-kqsrl\" (UID: \"194b5b96-5a7b-4760-874c-903e5e9dce48\") " pod="openshift-dns/dns-default-kqsrl" Jun 14 15:14:51.824162 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:51.824145 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8aa56d5d-e118-4630-a660-9f86ab228a8b-cert\") pod \"ingress-canary-j62hw\" (UID: \"8aa56d5d-e118-4630-a660-9f86ab228a8b\") " pod="openshift-ingress-canary/ingress-canary-j62hw" Jun 14 15:14:51.828129 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:51.828108 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkgv7\" (UniqueName: \"kubernetes.io/projected/8aa56d5d-e118-4630-a660-9f86ab228a8b-kube-api-access-gkgv7\") pod \"ingress-canary-j62hw\" (UID: \"8aa56d5d-e118-4630-a660-9f86ab228a8b\") " pod="openshift-ingress-canary/ingress-canary-j62hw" Jun 14 15:14:51.828247 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:51.828219 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gctrf\" (UniqueName: \"kubernetes.io/projected/194b5b96-5a7b-4760-874c-903e5e9dce48-kube-api-access-gctrf\") pod \"dns-default-kqsrl\" (UID: \"194b5b96-5a7b-4760-874c-903e5e9dce48\") " pod="openshift-dns/dns-default-kqsrl" Jun 14 15:14:51.905475 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:51.905389 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:14:51.921495 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:51.921471 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b19af6b9-4b2a-44ea-b9b1-e01f23b73630-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mx6n9\" (UID: \"b19af6b9-4b2a-44ea-b9b1-e01f23b73630\") " pod="openshift-insights/insights-runtime-extractor-mx6n9" Jun 14 15:14:51.921559 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:51.921502 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h94p8\" (UniqueName: \"kubernetes.io/projected/b19af6b9-4b2a-44ea-b9b1-e01f23b73630-kube-api-access-h94p8\") pod \"insights-runtime-extractor-mx6n9\" (UID: \"b19af6b9-4b2a-44ea-b9b1-e01f23b73630\") " pod="openshift-insights/insights-runtime-extractor-mx6n9" Jun 14 15:14:51.921559 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:51.921528 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b19af6b9-4b2a-44ea-b9b1-e01f23b73630-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mx6n9\" (UID: \"b19af6b9-4b2a-44ea-b9b1-e01f23b73630\") " pod="openshift-insights/insights-runtime-extractor-mx6n9" Jun 14 15:14:51.921622 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:51.921563 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b19af6b9-4b2a-44ea-b9b1-e01f23b73630-data-volume\") pod \"insights-runtime-extractor-mx6n9\" (UID: \"b19af6b9-4b2a-44ea-b9b1-e01f23b73630\") " pod="openshift-insights/insights-runtime-extractor-mx6n9" Jun 14 15:14:51.921622 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:51.921587 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b19af6b9-4b2a-44ea-b9b1-e01f23b73630-crio-socket\") pod \"insights-runtime-extractor-mx6n9\" (UID: \"b19af6b9-4b2a-44ea-b9b1-e01f23b73630\") " pod="openshift-insights/insights-runtime-extractor-mx6n9" Jun 14 15:14:51.921742 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:51.921730 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b19af6b9-4b2a-44ea-b9b1-e01f23b73630-crio-socket\") pod \"insights-runtime-extractor-mx6n9\" (UID: \"b19af6b9-4b2a-44ea-b9b1-e01f23b73630\") " pod="openshift-insights/insights-runtime-extractor-mx6n9" Jun 14 15:14:51.922001 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:51.921987 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b19af6b9-4b2a-44ea-b9b1-e01f23b73630-data-volume\") pod \"insights-runtime-extractor-mx6n9\" (UID: \"b19af6b9-4b2a-44ea-b9b1-e01f23b73630\") " pod="openshift-insights/insights-runtime-extractor-mx6n9" Jun 14 15:14:51.922158 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:51.922142 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b19af6b9-4b2a-44ea-b9b1-e01f23b73630-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mx6n9\" (UID: \"b19af6b9-4b2a-44ea-b9b1-e01f23b73630\") " pod="openshift-insights/insights-runtime-extractor-mx6n9" Jun 14 15:14:51.923743 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:51.923724 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b19af6b9-4b2a-44ea-b9b1-e01f23b73630-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mx6n9\" (UID: \"b19af6b9-4b2a-44ea-b9b1-e01f23b73630\") " pod="openshift-insights/insights-runtime-extractor-mx6n9" Jun 14 15:14:51.930586 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:51.930567 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h94p8\" (UniqueName: \"kubernetes.io/projected/b19af6b9-4b2a-44ea-b9b1-e01f23b73630-kube-api-access-h94p8\") pod \"insights-runtime-extractor-mx6n9\" (UID: \"b19af6b9-4b2a-44ea-b9b1-e01f23b73630\") " pod="openshift-insights/insights-runtime-extractor-mx6n9" Jun 14 15:14:51.995631 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:51.995592 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kqsrl" Jun 14 15:14:52.004713 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:52.004690 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-j62hw" Jun 14 15:14:52.024170 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:52.024144 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mx6n9" Jun 14 15:14:52.218246 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:52.218037 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-j62hw"] Jun 14 15:14:52.220477 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:52.220448 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kqsrl"] Jun 14 15:14:52.222232 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:52.222197 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8aa56d5d_e118_4630_a660_9f86ab228a8b.slice/crio-c05685427b5850c9c3d86c5b4022c36a39e3f01a62a9c758e496f32174c9973d WatchSource:0}: Error finding container c05685427b5850c9c3d86c5b4022c36a39e3f01a62a9c758e496f32174c9973d: Status 404 returned error can't find the container with id c05685427b5850c9c3d86c5b4022c36a39e3f01a62a9c758e496f32174c9973d Jun 14 15:14:52.224937 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:52.224913 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod194b5b96_5a7b_4760_874c_903e5e9dce48.slice/crio-7f39e3a16afc69e2ba1c909e8f8861c68dbcc9a11ad5ae689b31a459561d2498 WatchSource:0}: Error finding container 7f39e3a16afc69e2ba1c909e8f8861c68dbcc9a11ad5ae689b31a459561d2498: Status 404 returned error can't find the container with id 7f39e3a16afc69e2ba1c909e8f8861c68dbcc9a11ad5ae689b31a459561d2498 Jun 14 15:14:52.236809 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:52.236724 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mx6n9"] Jun 14 15:14:52.241601 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:52.241572 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb19af6b9_4b2a_44ea_b9b1_e01f23b73630.slice/crio-26feb7509f4dcbeb0531c3136c7dad7cd32202c471d58ed6864bc09513b1eeef WatchSource:0}: Error finding container 26feb7509f4dcbeb0531c3136c7dad7cd32202c471d58ed6864bc09513b1eeef: Status 404 returned error can't find the container with id 26feb7509f4dcbeb0531c3136c7dad7cd32202c471d58ed6864bc09513b1eeef Jun 14 15:14:52.533118 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:52.533080 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mx6n9" event={"ID":"b19af6b9-4b2a-44ea-b9b1-e01f23b73630","Type":"ContainerStarted","Data":"26feb7509f4dcbeb0531c3136c7dad7cd32202c471d58ed6864bc09513b1eeef"} Jun 14 15:14:52.534091 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:52.534070 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-j62hw" event={"ID":"8aa56d5d-e118-4630-a660-9f86ab228a8b","Type":"ContainerStarted","Data":"c05685427b5850c9c3d86c5b4022c36a39e3f01a62a9c758e496f32174c9973d"} Jun 14 15:14:52.534995 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:52.534972 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kqsrl" event={"ID":"194b5b96-5a7b-4760-874c-903e5e9dce48","Type":"ContainerStarted","Data":"7f39e3a16afc69e2ba1c909e8f8861c68dbcc9a11ad5ae689b31a459561d2498"} Jun 14 15:14:53.302512 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:53.302478 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nb6vz" Jun 14 15:14:53.303106 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:53.302886 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lfxgl" Jun 14 15:14:53.303529 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:53.303507 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jqckm" Jun 14 15:14:53.308936 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:53.308909 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 14 15:14:53.309186 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:53.309163 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 14 15:14:53.309385 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:53.309369 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rlkml\"" Jun 14 15:14:53.309812 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:53.309471 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 14 15:14:53.309812 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:53.309372 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-txhsx\"" Jun 14 15:14:53.309812 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:53.309680 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 14 15:14:54.483003 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:54.482968 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:14:54.548588 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:54.548550 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:14:54.609032 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:54.609000 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:14:56.738611 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:56.738549 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:14:56.779728 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:56.779705 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-864fcfc6f9-jxj67"] Jun 14 15:14:56.813581 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:56.813560 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-864fcfc6f9-jxj67"] Jun 14 15:14:56.813685 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:56.813670 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-jxj67" Jun 14 15:14:56.817006 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:56.816858 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 14 15:14:56.817006 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:56.816877 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 14 15:14:56.817006 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:56.816900 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 14 15:14:56.817006 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:56.816859 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 14 15:14:56.817006 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:56.816904 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 14 15:14:56.817006 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:56.816911 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-jpsdw\"" Jun 14 15:14:56.834604 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:56.834582 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:14:56.855850 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:56.855821 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8cdf0eed-1609-41e4-b2d9-ead3616e5dff-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-864fcfc6f9-jxj67\" (UID: \"8cdf0eed-1609-41e4-b2d9-ead3616e5dff\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-jxj67" Jun 14 15:14:56.855965 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:56.855894 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8cdf0eed-1609-41e4-b2d9-ead3616e5dff-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-jxj67\" (UID: \"8cdf0eed-1609-41e4-b2d9-ead3616e5dff\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-jxj67" Jun 14 15:14:56.855965 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:56.855928 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbv47\" (UniqueName: \"kubernetes.io/projected/8cdf0eed-1609-41e4-b2d9-ead3616e5dff-kube-api-access-kbv47\") pod \"prometheus-operator-864fcfc6f9-jxj67\" (UID: \"8cdf0eed-1609-41e4-b2d9-ead3616e5dff\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-jxj67" Jun 14 15:14:56.855965 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:56.855947 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8cdf0eed-1609-41e4-b2d9-ead3616e5dff-metrics-client-ca\") pod \"prometheus-operator-864fcfc6f9-jxj67\" (UID: \"8cdf0eed-1609-41e4-b2d9-ead3616e5dff\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-jxj67" Jun 14 15:14:56.956536 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:56.956457 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8cdf0eed-1609-41e4-b2d9-ead3616e5dff-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-864fcfc6f9-jxj67\" (UID: \"8cdf0eed-1609-41e4-b2d9-ead3616e5dff\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-jxj67" Jun 14 15:14:56.956536 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:56.956520 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8cdf0eed-1609-41e4-b2d9-ead3616e5dff-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-jxj67\" (UID: \"8cdf0eed-1609-41e4-b2d9-ead3616e5dff\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-jxj67" Jun 14 15:14:56.956761 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:56.956553 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbv47\" (UniqueName: \"kubernetes.io/projected/8cdf0eed-1609-41e4-b2d9-ead3616e5dff-kube-api-access-kbv47\") pod \"prometheus-operator-864fcfc6f9-jxj67\" (UID: \"8cdf0eed-1609-41e4-b2d9-ead3616e5dff\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-jxj67" Jun 14 15:14:56.956761 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:56.956579 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8cdf0eed-1609-41e4-b2d9-ead3616e5dff-metrics-client-ca\") pod \"prometheus-operator-864fcfc6f9-jxj67\" (UID: \"8cdf0eed-1609-41e4-b2d9-ead3616e5dff\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-jxj67" Jun 14 15:14:56.956856 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:56.956807 2571 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jun 14 15:14:56.956910 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:14:56.956878 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8cdf0eed-1609-41e4-b2d9-ead3616e5dff-prometheus-operator-tls podName:8cdf0eed-1609-41e4-b2d9-ead3616e5dff nodeName:}" failed. No retries permitted until 2026-06-14 15:14:57.456857899 +0000 UTC m=+54.638340409 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/8cdf0eed-1609-41e4-b2d9-ead3616e5dff-prometheus-operator-tls") pod "prometheus-operator-864fcfc6f9-jxj67" (UID: "8cdf0eed-1609-41e4-b2d9-ead3616e5dff") : secret "prometheus-operator-tls" not found Jun 14 15:14:56.957424 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:56.957381 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8cdf0eed-1609-41e4-b2d9-ead3616e5dff-metrics-client-ca\") pod \"prometheus-operator-864fcfc6f9-jxj67\" (UID: \"8cdf0eed-1609-41e4-b2d9-ead3616e5dff\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-jxj67" Jun 14 15:14:56.960378 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:56.960354 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8cdf0eed-1609-41e4-b2d9-ead3616e5dff-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-864fcfc6f9-jxj67\" (UID: \"8cdf0eed-1609-41e4-b2d9-ead3616e5dff\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-jxj67" Jun 14 15:14:56.965188 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:56.965166 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbv47\" (UniqueName: \"kubernetes.io/projected/8cdf0eed-1609-41e4-b2d9-ead3616e5dff-kube-api-access-kbv47\") pod \"prometheus-operator-864fcfc6f9-jxj67\" (UID: \"8cdf0eed-1609-41e4-b2d9-ead3616e5dff\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-jxj67" Jun 14 15:14:57.002396 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:57.002362 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:14:57.104000 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:57.103966 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:14:57.460565 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:57.460533 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8cdf0eed-1609-41e4-b2d9-ead3616e5dff-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-jxj67\" (UID: \"8cdf0eed-1609-41e4-b2d9-ead3616e5dff\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-jxj67" Jun 14 15:14:57.463400 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:57.463375 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8cdf0eed-1609-41e4-b2d9-ead3616e5dff-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-jxj67\" (UID: \"8cdf0eed-1609-41e4-b2d9-ead3616e5dff\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-jxj67" Jun 14 15:14:57.723490 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:57.723347 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-jxj67" Jun 14 15:14:57.885016 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:57.884983 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-864fcfc6f9-jxj67"] Jun 14 15:14:57.896147 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:57.896117 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cdf0eed_1609_41e4_b2d9_ead3616e5dff.slice/crio-cb8e731bfd3a8ce73744ad62799b22b21d71c8e8688ad701617bfb7bd85217ca WatchSource:0}: Error finding container cb8e731bfd3a8ce73744ad62799b22b21d71c8e8688ad701617bfb7bd85217ca: Status 404 returned error can't find the container with id cb8e731bfd3a8ce73744ad62799b22b21d71c8e8688ad701617bfb7bd85217ca Jun 14 15:14:58.551817 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:58.551784 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mx6n9" event={"ID":"b19af6b9-4b2a-44ea-b9b1-e01f23b73630","Type":"ContainerStarted","Data":"f960d7885013cab6e4e27165e8729023b1a67ea6f52e7e164f098812371708cc"} Jun 14 15:14:58.553563 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:58.553534 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kqsrl" event={"ID":"194b5b96-5a7b-4760-874c-903e5e9dce48","Type":"ContainerStarted","Data":"a81f36eda53fa0db99d48187e67fff2a4661bfd00247515d0748927efea2aa68"} Jun 14 15:14:58.553691 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:58.553574 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kqsrl" event={"ID":"194b5b96-5a7b-4760-874c-903e5e9dce48","Type":"ContainerStarted","Data":"fb468d7347d7fee329c508f7f547e15b0941027402052ee4eda6f6f437f2ce81"} Jun 14 15:14:58.553691 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:58.553652 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-kqsrl" Jun 14 15:14:58.555244 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:58.555214 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-jxj67" event={"ID":"8cdf0eed-1609-41e4-b2d9-ead3616e5dff","Type":"ContainerStarted","Data":"cb8e731bfd3a8ce73744ad62799b22b21d71c8e8688ad701617bfb7bd85217ca"} Jun 14 15:14:58.556749 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:58.556726 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-j62hw" event={"ID":"8aa56d5d-e118-4630-a660-9f86ab228a8b","Type":"ContainerStarted","Data":"a05131f63e536575e04811eeabc68c71a889827d0770d84009acf4faf55dd455"} Jun 14 15:14:58.570620 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:58.570565 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-kqsrl" podStartSLOduration=2.201293259 podStartE2EDuration="7.570545866s" totalImagesPullingTime="5.369252607s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:14:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:14:58.569817357 +0000 UTC m=+55.751299874" watchObservedRunningTime="2026-06-14 15:14:58.570545866 +0000 UTC m=+55.752028382" Jun 14 15:14:58.585344 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:58.584959 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-j62hw" podStartSLOduration=2.212838003 podStartE2EDuration="7.584943743s" totalImagesPullingTime="5.37210574s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:14:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:14:58.584103465 +0000 UTC m=+55.765585982" watchObservedRunningTime="2026-06-14 15:14:58.584943743 +0000 UTC m=+55.766426260" Jun 14 15:14:59.394702 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:59.394247 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-789fd8ccdf-hq298"] Jun 14 15:14:59.405742 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:59.405725 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-789fd8ccdf-hq298" Jun 14 15:14:59.408700 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:59.408675 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-789fd8ccdf-hq298"] Jun 14 15:14:59.408801 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:59.408684 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 14 15:14:59.408801 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:59.408723 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-mzggm\"" Jun 14 15:14:59.408938 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:59.408919 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 14 15:14:59.409558 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:59.409409 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 14 15:14:59.409558 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:59.409524 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 14 15:14:59.409711 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:59.409605 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 14 15:14:59.409817 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:59.409800 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 14 15:14:59.409878 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:59.409868 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 14 15:14:59.415458 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:59.415436 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 14 15:14:59.475479 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:59.475452 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a4adcc78-5391-4999-9c4e-e8760476d22d-oauth-serving-cert\") pod \"console-789fd8ccdf-hq298\" (UID: \"a4adcc78-5391-4999-9c4e-e8760476d22d\") " pod="openshift-console/console-789fd8ccdf-hq298" Jun 14 15:14:59.475572 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:59.475485 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a4adcc78-5391-4999-9c4e-e8760476d22d-console-serving-cert\") pod \"console-789fd8ccdf-hq298\" (UID: \"a4adcc78-5391-4999-9c4e-e8760476d22d\") " pod="openshift-console/console-789fd8ccdf-hq298" Jun 14 15:14:59.475614 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:59.475584 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a4adcc78-5391-4999-9c4e-e8760476d22d-service-ca\") pod \"console-789fd8ccdf-hq298\" (UID: \"a4adcc78-5391-4999-9c4e-e8760476d22d\") " pod="openshift-console/console-789fd8ccdf-hq298" Jun 14 15:14:59.475648 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:59.475622 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a4adcc78-5391-4999-9c4e-e8760476d22d-console-oauth-config\") pod \"console-789fd8ccdf-hq298\" (UID: \"a4adcc78-5391-4999-9c4e-e8760476d22d\") " pod="openshift-console/console-789fd8ccdf-hq298" Jun 14 15:14:59.475648 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:59.475641 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4adcc78-5391-4999-9c4e-e8760476d22d-trusted-ca-bundle\") pod \"console-789fd8ccdf-hq298\" (UID: \"a4adcc78-5391-4999-9c4e-e8760476d22d\") " pod="openshift-console/console-789fd8ccdf-hq298" Jun 14 15:14:59.475735 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:59.475660 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76nvr\" (UniqueName: \"kubernetes.io/projected/a4adcc78-5391-4999-9c4e-e8760476d22d-kube-api-access-76nvr\") pod \"console-789fd8ccdf-hq298\" (UID: \"a4adcc78-5391-4999-9c4e-e8760476d22d\") " pod="openshift-console/console-789fd8ccdf-hq298" Jun 14 15:14:59.475735 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:59.475689 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a4adcc78-5391-4999-9c4e-e8760476d22d-console-config\") pod \"console-789fd8ccdf-hq298\" (UID: \"a4adcc78-5391-4999-9c4e-e8760476d22d\") " pod="openshift-console/console-789fd8ccdf-hq298" Jun 14 15:14:59.561663 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:59.561636 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mx6n9" event={"ID":"b19af6b9-4b2a-44ea-b9b1-e01f23b73630","Type":"ContainerStarted","Data":"c0b50905c6fd18975ebf0474a53c93b4a79403f27cb679914621171d82bf4be0"} Jun 14 15:14:59.576274 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:59.576256 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a4adcc78-5391-4999-9c4e-e8760476d22d-console-config\") pod \"console-789fd8ccdf-hq298\" (UID: \"a4adcc78-5391-4999-9c4e-e8760476d22d\") " pod="openshift-console/console-789fd8ccdf-hq298" Jun 14 15:14:59.576366 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:59.576302 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a4adcc78-5391-4999-9c4e-e8760476d22d-oauth-serving-cert\") pod \"console-789fd8ccdf-hq298\" (UID: \"a4adcc78-5391-4999-9c4e-e8760476d22d\") " pod="openshift-console/console-789fd8ccdf-hq298" Jun 14 15:14:59.576366 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:59.576321 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a4adcc78-5391-4999-9c4e-e8760476d22d-console-serving-cert\") pod \"console-789fd8ccdf-hq298\" (UID: \"a4adcc78-5391-4999-9c4e-e8760476d22d\") " pod="openshift-console/console-789fd8ccdf-hq298" Jun 14 15:14:59.576366 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:59.576358 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a4adcc78-5391-4999-9c4e-e8760476d22d-service-ca\") pod \"console-789fd8ccdf-hq298\" (UID: \"a4adcc78-5391-4999-9c4e-e8760476d22d\") " pod="openshift-console/console-789fd8ccdf-hq298" Jun 14 15:14:59.576498 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:59.576375 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a4adcc78-5391-4999-9c4e-e8760476d22d-console-oauth-config\") pod \"console-789fd8ccdf-hq298\" (UID: \"a4adcc78-5391-4999-9c4e-e8760476d22d\") " pod="openshift-console/console-789fd8ccdf-hq298" Jun 14 15:14:59.576498 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:59.576391 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4adcc78-5391-4999-9c4e-e8760476d22d-trusted-ca-bundle\") pod \"console-789fd8ccdf-hq298\" (UID: \"a4adcc78-5391-4999-9c4e-e8760476d22d\") " pod="openshift-console/console-789fd8ccdf-hq298" Jun 14 15:14:59.576498 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:59.576409 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76nvr\" (UniqueName: \"kubernetes.io/projected/a4adcc78-5391-4999-9c4e-e8760476d22d-kube-api-access-76nvr\") pod \"console-789fd8ccdf-hq298\" (UID: \"a4adcc78-5391-4999-9c4e-e8760476d22d\") " pod="openshift-console/console-789fd8ccdf-hq298" Jun 14 15:14:59.577064 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:59.577006 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a4adcc78-5391-4999-9c4e-e8760476d22d-console-config\") pod \"console-789fd8ccdf-hq298\" (UID: \"a4adcc78-5391-4999-9c4e-e8760476d22d\") " pod="openshift-console/console-789fd8ccdf-hq298" Jun 14 15:14:59.577064 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:59.577031 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a4adcc78-5391-4999-9c4e-e8760476d22d-service-ca\") pod \"console-789fd8ccdf-hq298\" (UID: \"a4adcc78-5391-4999-9c4e-e8760476d22d\") " pod="openshift-console/console-789fd8ccdf-hq298" Jun 14 15:14:59.577187 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:59.577109 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a4adcc78-5391-4999-9c4e-e8760476d22d-oauth-serving-cert\") pod \"console-789fd8ccdf-hq298\" (UID: \"a4adcc78-5391-4999-9c4e-e8760476d22d\") " pod="openshift-console/console-789fd8ccdf-hq298" Jun 14 15:14:59.577292 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:59.577274 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4adcc78-5391-4999-9c4e-e8760476d22d-trusted-ca-bundle\") pod \"console-789fd8ccdf-hq298\" (UID: \"a4adcc78-5391-4999-9c4e-e8760476d22d\") " pod="openshift-console/console-789fd8ccdf-hq298" Jun 14 15:14:59.580078 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:59.580036 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a4adcc78-5391-4999-9c4e-e8760476d22d-console-oauth-config\") pod \"console-789fd8ccdf-hq298\" (UID: \"a4adcc78-5391-4999-9c4e-e8760476d22d\") " pod="openshift-console/console-789fd8ccdf-hq298" Jun 14 15:14:59.580157 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:59.580107 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a4adcc78-5391-4999-9c4e-e8760476d22d-console-serving-cert\") pod \"console-789fd8ccdf-hq298\" (UID: \"a4adcc78-5391-4999-9c4e-e8760476d22d\") " pod="openshift-console/console-789fd8ccdf-hq298" Jun 14 15:14:59.584034 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:59.584016 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-76nvr\" (UniqueName: \"kubernetes.io/projected/a4adcc78-5391-4999-9c4e-e8760476d22d-kube-api-access-76nvr\") pod \"console-789fd8ccdf-hq298\" (UID: \"a4adcc78-5391-4999-9c4e-e8760476d22d\") " pod="openshift-console/console-789fd8ccdf-hq298" Jun 14 15:14:59.716861 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:59.716837 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-789fd8ccdf-hq298" Jun 14 15:14:59.866845 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:14:59.866626 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-789fd8ccdf-hq298"] Jun 14 15:14:59.870935 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:14:59.870911 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4adcc78_5391_4999_9c4e_e8760476d22d.slice/crio-5a68cab7a6b9319a20cc24784c44642439e8406881495c6bc4a8439fdf43b086 WatchSource:0}: Error finding container 5a68cab7a6b9319a20cc24784c44642439e8406881495c6bc4a8439fdf43b086: Status 404 returned error can't find the container with id 5a68cab7a6b9319a20cc24784c44642439e8406881495c6bc4a8439fdf43b086 Jun 14 15:15:00.022308 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:00.022225 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:15:00.568258 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:00.568150 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-jxj67" event={"ID":"8cdf0eed-1609-41e4-b2d9-ead3616e5dff","Type":"ContainerStarted","Data":"e3987100d5bd27d1a548784352c8a0dfa4540534463de864f4a93dcfab41bab2"} Jun 14 15:15:00.569252 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:00.569192 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-jxj67" event={"ID":"8cdf0eed-1609-41e4-b2d9-ead3616e5dff","Type":"ContainerStarted","Data":"bb3959194a0ac274358c795a78bd081a2a2316ed717aa6129e967a1e0372d733"} Jun 14 15:15:00.570673 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:00.570615 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-789fd8ccdf-hq298" event={"ID":"a4adcc78-5391-4999-9c4e-e8760476d22d","Type":"ContainerStarted","Data":"5a68cab7a6b9319a20cc24784c44642439e8406881495c6bc4a8439fdf43b086"} Jun 14 15:15:00.596989 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:00.596941 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-jxj67" podStartSLOduration=2.79848418 podStartE2EDuration="4.596923241s" totalImagesPullingTime="1.798439061s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:14:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:15:00.596634405 +0000 UTC m=+57.778116925" watchObservedRunningTime="2026-06-14 15:15:00.596923241 +0000 UTC m=+57.778405794" Jun 14 15:15:00.646995 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:00.646952 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:15:00.747018 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:00.746978 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:15:01.597568 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:01.597509 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:15:01.665294 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:01.665267 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:15:01.864219 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:01.864132 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:15:02.015062 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:02.015011 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:15:02.113446 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:02.113390 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:15:02.222427 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:02.222376 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:15:02.279653 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:02.277385 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-d2tck"] Jun 14 15:15:02.284179 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:02.284126 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-d2tck" Jun 14 15:15:02.287570 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:02.287529 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 14 15:15:02.287782 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:02.287681 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-j8zrl\"" Jun 14 15:15:02.288230 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:02.288197 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 14 15:15:02.288396 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:02.288254 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 14 15:15:02.354502 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:02.354466 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:15:02.404660 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:02.404627 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c371278d-8f71-4604-9fe4-26a12d97fbb8-node-exporter-wtmp\") pod \"node-exporter-d2tck\" (UID: \"c371278d-8f71-4604-9fe4-26a12d97fbb8\") " pod="openshift-monitoring/node-exporter-d2tck" Jun 14 15:15:02.404832 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:02.404686 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c371278d-8f71-4604-9fe4-26a12d97fbb8-root\") pod \"node-exporter-d2tck\" (UID: \"c371278d-8f71-4604-9fe4-26a12d97fbb8\") " pod="openshift-monitoring/node-exporter-d2tck" Jun 14 15:15:02.404832 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:02.404755 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c371278d-8f71-4604-9fe4-26a12d97fbb8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-d2tck\" (UID: \"c371278d-8f71-4604-9fe4-26a12d97fbb8\") " pod="openshift-monitoring/node-exporter-d2tck" Jun 14 15:15:02.404832 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:02.404776 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c371278d-8f71-4604-9fe4-26a12d97fbb8-node-exporter-tls\") pod \"node-exporter-d2tck\" (UID: \"c371278d-8f71-4604-9fe4-26a12d97fbb8\") " pod="openshift-monitoring/node-exporter-d2tck" Jun 14 15:15:02.405010 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:02.404877 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c371278d-8f71-4604-9fe4-26a12d97fbb8-sys\") pod \"node-exporter-d2tck\" (UID: \"c371278d-8f71-4604-9fe4-26a12d97fbb8\") " pod="openshift-monitoring/node-exporter-d2tck" Jun 14 15:15:02.405010 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:02.404917 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c371278d-8f71-4604-9fe4-26a12d97fbb8-node-exporter-accelerators-collector-config\") pod \"node-exporter-d2tck\" (UID: \"c371278d-8f71-4604-9fe4-26a12d97fbb8\") " pod="openshift-monitoring/node-exporter-d2tck" Jun 14 15:15:02.405010 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:02.404951 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4w77l\" (UniqueName: \"kubernetes.io/projected/c371278d-8f71-4604-9fe4-26a12d97fbb8-kube-api-access-4w77l\") pod \"node-exporter-d2tck\" (UID: \"c371278d-8f71-4604-9fe4-26a12d97fbb8\") " pod="openshift-monitoring/node-exporter-d2tck" Jun 14 15:15:02.405160 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:02.405014 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c371278d-8f71-4604-9fe4-26a12d97fbb8-metrics-client-ca\") pod \"node-exporter-d2tck\" (UID: \"c371278d-8f71-4604-9fe4-26a12d97fbb8\") " pod="openshift-monitoring/node-exporter-d2tck" Jun 14 15:15:02.405160 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:02.405058 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c371278d-8f71-4604-9fe4-26a12d97fbb8-node-exporter-textfile\") pod \"node-exporter-d2tck\" (UID: \"c371278d-8f71-4604-9fe4-26a12d97fbb8\") " pod="openshift-monitoring/node-exporter-d2tck" Jun 14 15:15:02.488735 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:02.488616 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:15:02.505971 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:02.505934 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c371278d-8f71-4604-9fe4-26a12d97fbb8-root\") pod \"node-exporter-d2tck\" (UID: \"c371278d-8f71-4604-9fe4-26a12d97fbb8\") " pod="openshift-monitoring/node-exporter-d2tck" Jun 14 15:15:02.506175 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:02.505990 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c371278d-8f71-4604-9fe4-26a12d97fbb8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-d2tck\" (UID: \"c371278d-8f71-4604-9fe4-26a12d97fbb8\") " pod="openshift-monitoring/node-exporter-d2tck" Jun 14 15:15:02.506175 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:02.506023 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c371278d-8f71-4604-9fe4-26a12d97fbb8-node-exporter-tls\") pod \"node-exporter-d2tck\" (UID: \"c371278d-8f71-4604-9fe4-26a12d97fbb8\") " pod="openshift-monitoring/node-exporter-d2tck" Jun 14 15:15:02.506175 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:02.506080 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c371278d-8f71-4604-9fe4-26a12d97fbb8-sys\") pod \"node-exporter-d2tck\" (UID: \"c371278d-8f71-4604-9fe4-26a12d97fbb8\") " pod="openshift-monitoring/node-exporter-d2tck" Jun 14 15:15:02.506175 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:02.506081 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c371278d-8f71-4604-9fe4-26a12d97fbb8-root\") pod \"node-exporter-d2tck\" (UID: \"c371278d-8f71-4604-9fe4-26a12d97fbb8\") " pod="openshift-monitoring/node-exporter-d2tck" Jun 14 15:15:02.506175 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:02.506109 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c371278d-8f71-4604-9fe4-26a12d97fbb8-node-exporter-accelerators-collector-config\") pod \"node-exporter-d2tck\" (UID: \"c371278d-8f71-4604-9fe4-26a12d97fbb8\") " pod="openshift-monitoring/node-exporter-d2tck" Jun 14 15:15:02.506175 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:02.506141 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4w77l\" (UniqueName: \"kubernetes.io/projected/c371278d-8f71-4604-9fe4-26a12d97fbb8-kube-api-access-4w77l\") pod \"node-exporter-d2tck\" (UID: \"c371278d-8f71-4604-9fe4-26a12d97fbb8\") " pod="openshift-monitoring/node-exporter-d2tck" Jun 14 15:15:02.506175 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:02.506156 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c371278d-8f71-4604-9fe4-26a12d97fbb8-sys\") pod \"node-exporter-d2tck\" (UID: \"c371278d-8f71-4604-9fe4-26a12d97fbb8\") " pod="openshift-monitoring/node-exporter-d2tck" Jun 14 15:15:02.506175 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:02.506173 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c371278d-8f71-4604-9fe4-26a12d97fbb8-metrics-client-ca\") pod \"node-exporter-d2tck\" (UID: \"c371278d-8f71-4604-9fe4-26a12d97fbb8\") " pod="openshift-monitoring/node-exporter-d2tck" Jun 14 15:15:02.506557 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:15:02.506206 2571 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 14 15:15:02.506557 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:15:02.506274 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c371278d-8f71-4604-9fe4-26a12d97fbb8-node-exporter-tls podName:c371278d-8f71-4604-9fe4-26a12d97fbb8 nodeName:}" failed. No retries permitted until 2026-06-14 15:15:03.006254071 +0000 UTC m=+60.187736570 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/c371278d-8f71-4604-9fe4-26a12d97fbb8-node-exporter-tls") pod "node-exporter-d2tck" (UID: "c371278d-8f71-4604-9fe4-26a12d97fbb8") : secret "node-exporter-tls" not found Jun 14 15:15:02.506557 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:02.506206 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c371278d-8f71-4604-9fe4-26a12d97fbb8-node-exporter-textfile\") pod \"node-exporter-d2tck\" (UID: \"c371278d-8f71-4604-9fe4-26a12d97fbb8\") " pod="openshift-monitoring/node-exporter-d2tck" Jun 14 15:15:02.506557 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:02.506431 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c371278d-8f71-4604-9fe4-26a12d97fbb8-node-exporter-wtmp\") pod \"node-exporter-d2tck\" (UID: \"c371278d-8f71-4604-9fe4-26a12d97fbb8\") " pod="openshift-monitoring/node-exporter-d2tck" Jun 14 15:15:02.506762 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:02.506566 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c371278d-8f71-4604-9fe4-26a12d97fbb8-node-exporter-wtmp\") pod \"node-exporter-d2tck\" (UID: \"c371278d-8f71-4604-9fe4-26a12d97fbb8\") " pod="openshift-monitoring/node-exporter-d2tck" Jun 14 15:15:02.506814 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:02.506759 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c371278d-8f71-4604-9fe4-26a12d97fbb8-node-exporter-textfile\") pod \"node-exporter-d2tck\" (UID: \"c371278d-8f71-4604-9fe4-26a12d97fbb8\") " pod="openshift-monitoring/node-exporter-d2tck" Jun 14 15:15:02.506866 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:02.506845 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c371278d-8f71-4604-9fe4-26a12d97fbb8-node-exporter-accelerators-collector-config\") pod \"node-exporter-d2tck\" (UID: \"c371278d-8f71-4604-9fe4-26a12d97fbb8\") " pod="openshift-monitoring/node-exporter-d2tck" Jun 14 15:15:02.506866 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:02.506858 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c371278d-8f71-4604-9fe4-26a12d97fbb8-metrics-client-ca\") pod \"node-exporter-d2tck\" (UID: \"c371278d-8f71-4604-9fe4-26a12d97fbb8\") " pod="openshift-monitoring/node-exporter-d2tck" Jun 14 15:15:02.510328 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:02.510298 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c371278d-8f71-4604-9fe4-26a12d97fbb8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-d2tck\" (UID: \"c371278d-8f71-4604-9fe4-26a12d97fbb8\") " pod="openshift-monitoring/node-exporter-d2tck" Jun 14 15:15:02.516778 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:02.516748 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4w77l\" (UniqueName: \"kubernetes.io/projected/c371278d-8f71-4604-9fe4-26a12d97fbb8-kube-api-access-4w77l\") pod \"node-exporter-d2tck\" (UID: \"c371278d-8f71-4604-9fe4-26a12d97fbb8\") " pod="openshift-monitoring/node-exporter-d2tck" Jun 14 15:15:02.591536 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:02.591496 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:15:02.810136 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:02.810020 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:15:02.911427 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:02.911391 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:15:03.010116 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:03.010082 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c371278d-8f71-4604-9fe4-26a12d97fbb8-node-exporter-tls\") pod \"node-exporter-d2tck\" (UID: \"c371278d-8f71-4604-9fe4-26a12d97fbb8\") " pod="openshift-monitoring/node-exporter-d2tck" Jun 14 15:15:03.012375 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:03.012358 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c371278d-8f71-4604-9fe4-26a12d97fbb8-node-exporter-tls\") pod \"node-exporter-d2tck\" (UID: \"c371278d-8f71-4604-9fe4-26a12d97fbb8\") " pod="openshift-monitoring/node-exporter-d2tck" Jun 14 15:15:03.187703 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:03.187624 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:15:03.198741 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:03.198712 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-d2tck" Jun 14 15:15:03.208811 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:15:03.208779 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc371278d_8f71_4604_9fe4_26a12d97fbb8.slice/crio-c94ddfd6ca64f9d1ce2f64041ff28106e2cec4b3f67b2c576dd89082856ca00b WatchSource:0}: Error finding container c94ddfd6ca64f9d1ce2f64041ff28106e2cec4b3f67b2c576dd89082856ca00b: Status 404 returned error can't find the container with id c94ddfd6ca64f9d1ce2f64041ff28106e2cec4b3f67b2c576dd89082856ca00b Jun 14 15:15:03.289443 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:03.289406 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:15:03.335991 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:03.335960 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 14 15:15:03.340441 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:03.340416 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:15:03.346240 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:03.346208 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 14 15:15:03.346240 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:03.346228 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 14 15:15:03.346443 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:03.346229 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 14 15:15:03.346443 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:03.346366 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 14 15:15:03.346443 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:03.346368 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-kp98l\"" Jun 14 15:15:03.346443 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:03.346383 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 14 15:15:03.346610 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:03.346498 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 14 15:15:03.346610 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:03.346576 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 14 15:15:03.346610 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:03.346588 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 14 15:15:03.347807 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:03.347791 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 14 15:15:03.374973 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:03.374941 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 14 15:15:03.383307 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:03.383279 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:15:03.412706 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:03.412646 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/54e15401-8c4e-40c5-9634-d39a7c387073-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"54e15401-8c4e-40c5-9634-d39a7c387073\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:15:03.412706 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:03.412693 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/54e15401-8c4e-40c5-9634-d39a7c387073-web-config\") pod \"alertmanager-main-0\" (UID: \"54e15401-8c4e-40c5-9634-d39a7c387073\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:15:03.412920 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:03.412739 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/54e15401-8c4e-40c5-9634-d39a7c387073-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"54e15401-8c4e-40c5-9634-d39a7c387073\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:15:03.412920 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:03.412767 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54e15401-8c4e-40c5-9634-d39a7c387073-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"54e15401-8c4e-40c5-9634-d39a7c387073\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:15:03.412920 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:03.412799 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/54e15401-8c4e-40c5-9634-d39a7c387073-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"54e15401-8c4e-40c5-9634-d39a7c387073\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:15:03.412920 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:03.412820 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/54e15401-8c4e-40c5-9634-d39a7c387073-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"54e15401-8c4e-40c5-9634-d39a7c387073\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:15:03.412920 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:03.412864 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrq6b\" (UniqueName: \"kubernetes.io/projected/54e15401-8c4e-40c5-9634-d39a7c387073-kube-api-access-jrq6b\") pod \"alertmanager-main-0\" (UID: \"54e15401-8c4e-40c5-9634-d39a7c387073\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:15:03.412920 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:03.412896 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/54e15401-8c4e-40c5-9634-d39a7c387073-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"54e15401-8c4e-40c5-9634-d39a7c387073\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:15:03.413205 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:03.412927 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/54e15401-8c4e-40c5-9634-d39a7c387073-config-out\") pod \"alertmanager-main-0\" (UID: \"54e15401-8c4e-40c5-9634-d39a7c387073\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:15:03.413205 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:03.412958 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/54e15401-8c4e-40c5-9634-d39a7c387073-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"54e15401-8c4e-40c5-9634-d39a7c387073\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:15:03.413205 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:03.413006 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/54e15401-8c4e-40c5-9634-d39a7c387073-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"54e15401-8c4e-40c5-9634-d39a7c387073\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:15:03.413205 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:03.413040 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/54e15401-8c4e-40c5-9634-d39a7c387073-config-volume\") pod \"alertmanager-main-0\" (UID: \"54e15401-8c4e-40c5-9634-d39a7c387073\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:15:03.413205 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:03.413114 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/54e15401-8c4e-40c5-9634-d39a7c387073-tls-assets\") pod \"alertmanager-main-0\" (UID: \"54e15401-8c4e-40c5-9634-d39a7c387073\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:15:03.457851 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:03.457822 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:15:03.487121 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:03.487096 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ltnnm" Jun 14 15:15:03.513553 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:03.513520 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/54e15401-8c4e-40c5-9634-d39a7c387073-tls-assets\") pod \"alertmanager-main-0\" (UID: \"54e15401-8c4e-40c5-9634-d39a7c387073\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:15:03.513731 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:03.513574 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/54e15401-8c4e-40c5-9634-d39a7c387073-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"54e15401-8c4e-40c5-9634-d39a7c387073\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:15:03.513731 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:03.513603 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/54e15401-8c4e-40c5-9634-d39a7c387073-web-config\") pod \"alertmanager-main-0\" (UID: \"54e15401-8c4e-40c5-9634-d39a7c387073\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:15:03.513731 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:03.513645 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/54e15401-8c4e-40c5-9634-d39a7c387073-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"54e15401-8c4e-40c5-9634-d39a7c387073\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:15:03.513912 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:03.513881 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54e15401-8c4e-40c5-9634-d39a7c387073-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"54e15401-8c4e-40c5-9634-d39a7c387073\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:15:03.513966 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:03.513933 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/54e15401-8c4e-40c5-9634-d39a7c387073-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"54e15401-8c4e-40c5-9634-d39a7c387073\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:15:03.513966 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:03.513956 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/54e15401-8c4e-40c5-9634-d39a7c387073-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"54e15401-8c4e-40c5-9634-d39a7c387073\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:15:03.514078 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:03.513999 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrq6b\" (UniqueName: \"kubernetes.io/projected/54e15401-8c4e-40c5-9634-d39a7c387073-kube-api-access-jrq6b\") pod \"alertmanager-main-0\" (UID: \"54e15401-8c4e-40c5-9634-d39a7c387073\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:15:03.514078 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:03.514067 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/54e15401-8c4e-40c5-9634-d39a7c387073-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"54e15401-8c4e-40c5-9634-d39a7c387073\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:15:03.514170 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:03.514094 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/54e15401-8c4e-40c5-9634-d39a7c387073-config-out\") pod \"alertmanager-main-0\" (UID: \"54e15401-8c4e-40c5-9634-d39a7c387073\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:15:03.514170 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:03.514121 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/54e15401-8c4e-40c5-9634-d39a7c387073-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"54e15401-8c4e-40c5-9634-d39a7c387073\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:15:03.514170 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:03.514162 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/54e15401-8c4e-40c5-9634-d39a7c387073-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"54e15401-8c4e-40c5-9634-d39a7c387073\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:15:03.514303 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:03.514199 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/54e15401-8c4e-40c5-9634-d39a7c387073-config-volume\") pod \"alertmanager-main-0\" (UID: \"54e15401-8c4e-40c5-9634-d39a7c387073\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:15:03.514367 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:15:03.514338 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/54e15401-8c4e-40c5-9634-d39a7c387073-alertmanager-trusted-ca-bundle podName:54e15401-8c4e-40c5-9634-d39a7c387073 nodeName:}" failed. No retries permitted until 2026-06-14 15:15:04.014309762 +0000 UTC m=+61.195792275 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/54e15401-8c4e-40c5-9634-d39a7c387073-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "54e15401-8c4e-40c5-9634-d39a7c387073") : configmap references non-existent config key: ca-bundle.crt Jun 14 15:15:03.515923 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:03.515892 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/54e15401-8c4e-40c5-9634-d39a7c387073-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"54e15401-8c4e-40c5-9634-d39a7c387073\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:15:03.516220 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:03.516190 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/54e15401-8c4e-40c5-9634-d39a7c387073-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"54e15401-8c4e-40c5-9634-d39a7c387073\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:15:03.516756 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:03.516733 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/54e15401-8c4e-40c5-9634-d39a7c387073-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"54e15401-8c4e-40c5-9634-d39a7c387073\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:15:03.516862 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:03.516800 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/54e15401-8c4e-40c5-9634-d39a7c387073-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"54e15401-8c4e-40c5-9634-d39a7c387073\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:15:03.517468 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:03.517446 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/54e15401-8c4e-40c5-9634-d39a7c387073-tls-assets\") pod \"alertmanager-main-0\" (UID: \"54e15401-8c4e-40c5-9634-d39a7c387073\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:15:03.517678 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:03.517658 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/54e15401-8c4e-40c5-9634-d39a7c387073-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"54e15401-8c4e-40c5-9634-d39a7c387073\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:15:03.517765 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:03.517687 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/54e15401-8c4e-40c5-9634-d39a7c387073-web-config\") pod \"alertmanager-main-0\" (UID: \"54e15401-8c4e-40c5-9634-d39a7c387073\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:15:03.517830 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:03.517784 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/54e15401-8c4e-40c5-9634-d39a7c387073-config-out\") pod \"alertmanager-main-0\" (UID: \"54e15401-8c4e-40c5-9634-d39a7c387073\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:15:03.518816 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:03.518784 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/54e15401-8c4e-40c5-9634-d39a7c387073-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"54e15401-8c4e-40c5-9634-d39a7c387073\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:15:03.519112 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:03.519094 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/54e15401-8c4e-40c5-9634-d39a7c387073-config-volume\") pod \"alertmanager-main-0\" (UID: \"54e15401-8c4e-40c5-9634-d39a7c387073\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:15:03.519541 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:03.519526 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/54e15401-8c4e-40c5-9634-d39a7c387073-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"54e15401-8c4e-40c5-9634-d39a7c387073\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:15:03.523670 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:03.523651 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrq6b\" (UniqueName: \"kubernetes.io/projected/54e15401-8c4e-40c5-9634-d39a7c387073-kube-api-access-jrq6b\") pod \"alertmanager-main-0\" (UID: \"54e15401-8c4e-40c5-9634-d39a7c387073\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:15:03.584125 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:03.584089 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mx6n9" event={"ID":"b19af6b9-4b2a-44ea-b9b1-e01f23b73630","Type":"ContainerStarted","Data":"8610324ce84e779498f6174cd04571d9325edef36b9f6321e7fb2157aa13183c"} Jun 14 15:15:03.587282 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:03.587252 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-789fd8ccdf-hq298" event={"ID":"a4adcc78-5391-4999-9c4e-e8760476d22d","Type":"ContainerStarted","Data":"d9039c04901964edeb31bbde05028cb6c1e96d541c48fa804d72f7b7cc336a8a"} Jun 14 15:15:03.588407 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:03.588386 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-d2tck" event={"ID":"c371278d-8f71-4604-9fe4-26a12d97fbb8","Type":"ContainerStarted","Data":"c94ddfd6ca64f9d1ce2f64041ff28106e2cec4b3f67b2c576dd89082856ca00b"} Jun 14 15:15:03.607532 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:03.607492 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-mx6n9" podStartSLOduration=2.450935234 podStartE2EDuration="12.607478449s" totalImagesPullingTime="10.156543215s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 15:14:51 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:15:03.607024971 +0000 UTC m=+60.788507523" watchObservedRunningTime="2026-06-14 15:15:03.607478449 +0000 UTC m=+60.788960965" Jun 14 15:15:03.630407 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:03.630362 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-789fd8ccdf-hq298" podStartSLOduration=1.872600168 podStartE2EDuration="4.630347809s" totalImagesPullingTime="2.757747641s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:14:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:15:03.629840643 +0000 UTC m=+60.811323159" watchObservedRunningTime="2026-06-14 15:15:03.630347809 +0000 UTC m=+60.811830325" Jun 14 15:15:03.635984 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:03.635947 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:15:03.714539 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:03.714435 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:15:04.018939 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:04.018850 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54e15401-8c4e-40c5-9634-d39a7c387073-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"54e15401-8c4e-40c5-9634-d39a7c387073\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:15:04.019914 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:04.019887 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54e15401-8c4e-40c5-9634-d39a7c387073-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"54e15401-8c4e-40c5-9634-d39a7c387073\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:15:04.049287 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:04.049253 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:15:04.229218 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:04.229188 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:15:04.252149 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:04.252122 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:15:04.354292 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:04.354256 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5b985bcb8d-n7p54"] Jun 14 15:15:04.357032 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:04.357012 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5b985bcb8d-n7p54" Jun 14 15:15:04.359499 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:04.359477 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 14 15:15:04.359604 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:04.359528 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-7mk4x\"" Jun 14 15:15:04.360267 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:04.360248 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 14 15:15:04.360363 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:04.360297 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 14 15:15:04.360529 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:04.360514 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-3kv7jgref6vj8\"" Jun 14 15:15:04.363060 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:04.362327 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 14 15:15:04.364386 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:04.364364 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 14 15:15:04.374860 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:04.374834 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5b985bcb8d-n7p54"] Jun 14 15:15:04.387863 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:04.387833 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 14 15:15:04.391859 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:15:04.391836 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54e15401_8c4e_40c5_9634_d39a7c387073.slice/crio-b65891ac6b3b4de94c2c13f02f3cc90df8c482ec53a17686523734baa682c1e9 WatchSource:0}: Error finding container b65891ac6b3b4de94c2c13f02f3cc90df8c482ec53a17686523734baa682c1e9: Status 404 returned error can't find the container with id b65891ac6b3b4de94c2c13f02f3cc90df8c482ec53a17686523734baa682c1e9 Jun 14 15:15:04.422142 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:04.422094 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0395b7ba-7aa2-4729-9706-5b2550c71e8a-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5b985bcb8d-n7p54\" (UID: \"0395b7ba-7aa2-4729-9706-5b2550c71e8a\") " pod="openshift-monitoring/thanos-querier-5b985bcb8d-n7p54" Jun 14 15:15:04.422142 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:04.422144 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/0395b7ba-7aa2-4729-9706-5b2550c71e8a-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5b985bcb8d-n7p54\" (UID: \"0395b7ba-7aa2-4729-9706-5b2550c71e8a\") " pod="openshift-monitoring/thanos-querier-5b985bcb8d-n7p54" Jun 14 15:15:04.422393 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:04.422165 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/0395b7ba-7aa2-4729-9706-5b2550c71e8a-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5b985bcb8d-n7p54\" (UID: \"0395b7ba-7aa2-4729-9706-5b2550c71e8a\") " pod="openshift-monitoring/thanos-querier-5b985bcb8d-n7p54" Jun 14 15:15:04.422393 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:04.422201 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r86hs\" (UniqueName: \"kubernetes.io/projected/0395b7ba-7aa2-4729-9706-5b2550c71e8a-kube-api-access-r86hs\") pod \"thanos-querier-5b985bcb8d-n7p54\" (UID: \"0395b7ba-7aa2-4729-9706-5b2550c71e8a\") " pod="openshift-monitoring/thanos-querier-5b985bcb8d-n7p54" Jun 14 15:15:04.422393 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:04.422226 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0395b7ba-7aa2-4729-9706-5b2550c71e8a-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5b985bcb8d-n7p54\" (UID: \"0395b7ba-7aa2-4729-9706-5b2550c71e8a\") " pod="openshift-monitoring/thanos-querier-5b985bcb8d-n7p54" Jun 14 15:15:04.422393 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:04.422283 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0395b7ba-7aa2-4729-9706-5b2550c71e8a-secret-grpc-tls\") pod \"thanos-querier-5b985bcb8d-n7p54\" (UID: \"0395b7ba-7aa2-4729-9706-5b2550c71e8a\") " pod="openshift-monitoring/thanos-querier-5b985bcb8d-n7p54" Jun 14 15:15:04.422393 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:04.422343 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/0395b7ba-7aa2-4729-9706-5b2550c71e8a-secret-thanos-querier-tls\") pod \"thanos-querier-5b985bcb8d-n7p54\" (UID: \"0395b7ba-7aa2-4729-9706-5b2550c71e8a\") " pod="openshift-monitoring/thanos-querier-5b985bcb8d-n7p54" Jun 14 15:15:04.422393 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:04.422362 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0395b7ba-7aa2-4729-9706-5b2550c71e8a-metrics-client-ca\") pod \"thanos-querier-5b985bcb8d-n7p54\" (UID: \"0395b7ba-7aa2-4729-9706-5b2550c71e8a\") " pod="openshift-monitoring/thanos-querier-5b985bcb8d-n7p54" Jun 14 15:15:04.523727 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:04.523695 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0395b7ba-7aa2-4729-9706-5b2550c71e8a-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5b985bcb8d-n7p54\" (UID: \"0395b7ba-7aa2-4729-9706-5b2550c71e8a\") " pod="openshift-monitoring/thanos-querier-5b985bcb8d-n7p54" Jun 14 15:15:04.523921 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:04.523735 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/0395b7ba-7aa2-4729-9706-5b2550c71e8a-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5b985bcb8d-n7p54\" (UID: \"0395b7ba-7aa2-4729-9706-5b2550c71e8a\") " pod="openshift-monitoring/thanos-querier-5b985bcb8d-n7p54" Jun 14 15:15:04.523921 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:04.523757 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/0395b7ba-7aa2-4729-9706-5b2550c71e8a-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5b985bcb8d-n7p54\" (UID: \"0395b7ba-7aa2-4729-9706-5b2550c71e8a\") " pod="openshift-monitoring/thanos-querier-5b985bcb8d-n7p54" Jun 14 15:15:04.523921 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:04.523822 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r86hs\" (UniqueName: \"kubernetes.io/projected/0395b7ba-7aa2-4729-9706-5b2550c71e8a-kube-api-access-r86hs\") pod \"thanos-querier-5b985bcb8d-n7p54\" (UID: \"0395b7ba-7aa2-4729-9706-5b2550c71e8a\") " pod="openshift-monitoring/thanos-querier-5b985bcb8d-n7p54" Jun 14 15:15:04.523921 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:04.523877 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0395b7ba-7aa2-4729-9706-5b2550c71e8a-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5b985bcb8d-n7p54\" (UID: \"0395b7ba-7aa2-4729-9706-5b2550c71e8a\") " pod="openshift-monitoring/thanos-querier-5b985bcb8d-n7p54" Jun 14 15:15:04.523921 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:04.523918 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0395b7ba-7aa2-4729-9706-5b2550c71e8a-secret-grpc-tls\") pod \"thanos-querier-5b985bcb8d-n7p54\" (UID: \"0395b7ba-7aa2-4729-9706-5b2550c71e8a\") " pod="openshift-monitoring/thanos-querier-5b985bcb8d-n7p54" Jun 14 15:15:04.524225 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:04.523986 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/0395b7ba-7aa2-4729-9706-5b2550c71e8a-secret-thanos-querier-tls\") pod \"thanos-querier-5b985bcb8d-n7p54\" (UID: \"0395b7ba-7aa2-4729-9706-5b2550c71e8a\") " pod="openshift-monitoring/thanos-querier-5b985bcb8d-n7p54" Jun 14 15:15:04.524225 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:04.524010 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0395b7ba-7aa2-4729-9706-5b2550c71e8a-metrics-client-ca\") pod \"thanos-querier-5b985bcb8d-n7p54\" (UID: \"0395b7ba-7aa2-4729-9706-5b2550c71e8a\") " pod="openshift-monitoring/thanos-querier-5b985bcb8d-n7p54" Jun 14 15:15:04.524881 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:04.524852 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0395b7ba-7aa2-4729-9706-5b2550c71e8a-metrics-client-ca\") pod \"thanos-querier-5b985bcb8d-n7p54\" (UID: \"0395b7ba-7aa2-4729-9706-5b2550c71e8a\") " pod="openshift-monitoring/thanos-querier-5b985bcb8d-n7p54" Jun 14 15:15:04.526806 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:04.526773 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0395b7ba-7aa2-4729-9706-5b2550c71e8a-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5b985bcb8d-n7p54\" (UID: \"0395b7ba-7aa2-4729-9706-5b2550c71e8a\") " pod="openshift-monitoring/thanos-querier-5b985bcb8d-n7p54" Jun 14 15:15:04.526907 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:04.526805 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/0395b7ba-7aa2-4729-9706-5b2550c71e8a-secret-thanos-querier-tls\") pod \"thanos-querier-5b985bcb8d-n7p54\" (UID: \"0395b7ba-7aa2-4729-9706-5b2550c71e8a\") " pod="openshift-monitoring/thanos-querier-5b985bcb8d-n7p54" Jun 14 15:15:04.526907 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:04.526877 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0395b7ba-7aa2-4729-9706-5b2550c71e8a-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5b985bcb8d-n7p54\" (UID: \"0395b7ba-7aa2-4729-9706-5b2550c71e8a\") " pod="openshift-monitoring/thanos-querier-5b985bcb8d-n7p54" Jun 14 15:15:04.526974 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:04.526955 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/0395b7ba-7aa2-4729-9706-5b2550c71e8a-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5b985bcb8d-n7p54\" (UID: \"0395b7ba-7aa2-4729-9706-5b2550c71e8a\") " pod="openshift-monitoring/thanos-querier-5b985bcb8d-n7p54" Jun 14 15:15:04.527005 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:04.526990 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/0395b7ba-7aa2-4729-9706-5b2550c71e8a-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5b985bcb8d-n7p54\" (UID: \"0395b7ba-7aa2-4729-9706-5b2550c71e8a\") " pod="openshift-monitoring/thanos-querier-5b985bcb8d-n7p54" Jun 14 15:15:04.527117 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:04.527099 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0395b7ba-7aa2-4729-9706-5b2550c71e8a-secret-grpc-tls\") pod \"thanos-querier-5b985bcb8d-n7p54\" (UID: \"0395b7ba-7aa2-4729-9706-5b2550c71e8a\") " pod="openshift-monitoring/thanos-querier-5b985bcb8d-n7p54" Jun 14 15:15:04.537486 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:04.537461 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r86hs\" (UniqueName: \"kubernetes.io/projected/0395b7ba-7aa2-4729-9706-5b2550c71e8a-kube-api-access-r86hs\") pod \"thanos-querier-5b985bcb8d-n7p54\" (UID: \"0395b7ba-7aa2-4729-9706-5b2550c71e8a\") " pod="openshift-monitoring/thanos-querier-5b985bcb8d-n7p54" Jun 14 15:15:04.593834 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:04.593732 2571 generic.go:356] "Generic (PLEG): container finished" podID="c371278d-8f71-4604-9fe4-26a12d97fbb8" containerID="f0075007887ad15309f58893aa2e70764db5c43b6b72854fd2e86ed5ef1db6ee" exitCode=0 Jun 14 15:15:04.593834 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:04.593816 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-d2tck" event={"ID":"c371278d-8f71-4604-9fe4-26a12d97fbb8","Type":"ContainerDied","Data":"f0075007887ad15309f58893aa2e70764db5c43b6b72854fd2e86ed5ef1db6ee"} Jun 14 15:15:04.595228 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:04.595195 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"54e15401-8c4e-40c5-9634-d39a7c387073","Type":"ContainerStarted","Data":"b65891ac6b3b4de94c2c13f02f3cc90df8c482ec53a17686523734baa682c1e9"} Jun 14 15:15:04.667988 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:04.667958 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5b985bcb8d-n7p54" Jun 14 15:15:04.806813 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:04.806775 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5b985bcb8d-n7p54"] Jun 14 15:15:04.811394 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:15:04.811368 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0395b7ba_7aa2_4729_9706_5b2550c71e8a.slice/crio-4f6c441628b5b4915e11852d1fc5da91ef373647bb0acad4d762a243f733ae78 WatchSource:0}: Error finding container 4f6c441628b5b4915e11852d1fc5da91ef373647bb0acad4d762a243f733ae78: Status 404 returned error can't find the container with id 4f6c441628b5b4915e11852d1fc5da91ef373647bb0acad4d762a243f733ae78 Jun 14 15:15:05.290097 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:05.290034 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:15:05.390349 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:05.390302 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:15:05.494183 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:05.494147 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:15:05.601686 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:05.601580 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-d2tck" event={"ID":"c371278d-8f71-4604-9fe4-26a12d97fbb8","Type":"ContainerStarted","Data":"1219360985b7d43f7ecd4d008d16e2d5f0a2ec33fe5eab18624e7fb38bc01cae"} Jun 14 15:15:05.601686 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:05.601645 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-d2tck" event={"ID":"c371278d-8f71-4604-9fe4-26a12d97fbb8","Type":"ContainerStarted","Data":"ae0a5768f4879b8be38fabe443f2818bf6d597cddd709356bdeb1c06f6cbc02c"} Jun 14 15:15:05.603556 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:05.603528 2571 generic.go:356] "Generic (PLEG): container finished" podID="54e15401-8c4e-40c5-9634-d39a7c387073" containerID="651adaba339b8df78437c88d7efb6122a3d2dd04e577f16b33e2aa7137ed09d3" exitCode=0 Jun 14 15:15:05.603692 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:05.603612 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"54e15401-8c4e-40c5-9634-d39a7c387073","Type":"ContainerDied","Data":"651adaba339b8df78437c88d7efb6122a3d2dd04e577f16b33e2aa7137ed09d3"} Jun 14 15:15:05.605214 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:05.605188 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5b985bcb8d-n7p54" event={"ID":"0395b7ba-7aa2-4729-9706-5b2550c71e8a","Type":"ContainerStarted","Data":"4f6c441628b5b4915e11852d1fc5da91ef373647bb0acad4d762a243f733ae78"} Jun 14 15:15:05.611089 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:05.611065 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:15:05.624139 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:05.624085 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-d2tck" podStartSLOduration=2.655596271 podStartE2EDuration="3.624066201s" totalImagesPullingTime="903.434769ms" totalInitContainerRuntime="65.035161ms" isStatefulPod=true podCreationTimestamp="2026-06-14 15:15:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:15:05.623129054 +0000 UTC m=+62.804611571" watchObservedRunningTime="2026-06-14 15:15:05.624066201 +0000 UTC m=+62.805548717" Jun 14 15:15:05.715231 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:05.715182 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:15:05.813068 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:05.813017 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:15:05.913173 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:05.913087 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:15:06.965230 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:06.965190 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:15:06.973796 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:06.973767 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-8xxdz"] Jun 14 15:15:06.977491 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:06.977473 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-589576dfc7-8xxdz" Jun 14 15:15:06.979765 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:06.979743 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 14 15:15:06.980085 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:06.980058 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-z9vmh\"" Jun 14 15:15:06.989720 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:06.989694 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-8xxdz"] Jun 14 15:15:07.050586 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:07.050565 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c127cc7e-7761-45e9-96ab-64ce18e83b21-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-8xxdz\" (UID: \"c127cc7e-7761-45e9-96ab-64ce18e83b21\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-8xxdz" Jun 14 15:15:07.050675 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:07.050599 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6nvln\" (UniqueName: \"kubernetes.io/projected/c127cc7e-7761-45e9-96ab-64ce18e83b21-kube-api-access-6nvln\") pod \"monitoring-plugin-589576dfc7-8xxdz\" (UID: \"c127cc7e-7761-45e9-96ab-64ce18e83b21\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-8xxdz" Jun 14 15:15:07.062724 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:07.062698 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:15:07.151585 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:07.151233 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c127cc7e-7761-45e9-96ab-64ce18e83b21-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-8xxdz\" (UID: \"c127cc7e-7761-45e9-96ab-64ce18e83b21\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-8xxdz" Jun 14 15:15:07.151585 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:07.151277 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nvln\" (UniqueName: \"kubernetes.io/projected/c127cc7e-7761-45e9-96ab-64ce18e83b21-kube-api-access-6nvln\") pod \"monitoring-plugin-589576dfc7-8xxdz\" (UID: \"c127cc7e-7761-45e9-96ab-64ce18e83b21\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-8xxdz" Jun 14 15:15:07.151585 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:15:07.151360 2571 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jun 14 15:15:07.151585 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:15:07.151421 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c127cc7e-7761-45e9-96ab-64ce18e83b21-monitoring-plugin-cert podName:c127cc7e-7761-45e9-96ab-64ce18e83b21 nodeName:}" failed. No retries permitted until 2026-06-14 15:15:07.651403509 +0000 UTC m=+64.832886004 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/c127cc7e-7761-45e9-96ab-64ce18e83b21-monitoring-plugin-cert") pod "monitoring-plugin-589576dfc7-8xxdz" (UID: "c127cc7e-7761-45e9-96ab-64ce18e83b21") : secret "monitoring-plugin-cert" not found Jun 14 15:15:07.159837 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:07.159819 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6nvln\" (UniqueName: \"kubernetes.io/projected/c127cc7e-7761-45e9-96ab-64ce18e83b21-kube-api-access-6nvln\") pod \"monitoring-plugin-589576dfc7-8xxdz\" (UID: \"c127cc7e-7761-45e9-96ab-64ce18e83b21\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-8xxdz" Jun 14 15:15:07.617652 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:07.617567 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"54e15401-8c4e-40c5-9634-d39a7c387073","Type":"ContainerStarted","Data":"9475a24e9a88b27ef1d87d2a63b4d6cc144a8270f57430bb5944c0679dd5836e"} Jun 14 15:15:07.617652 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:07.617635 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"54e15401-8c4e-40c5-9634-d39a7c387073","Type":"ContainerStarted","Data":"3d40f5c12d51ac944cd82d22b2a6ac6670d468071dda1484cfc8d5d4014fc31f"} Jun 14 15:15:07.617844 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:07.617669 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"54e15401-8c4e-40c5-9634-d39a7c387073","Type":"ContainerStarted","Data":"b7bf6cd2a19f363c23a2060c850521764244abc06efcb7ffc1539f7b3eb25637"} Jun 14 15:15:07.617844 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:07.617705 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"54e15401-8c4e-40c5-9634-d39a7c387073","Type":"ContainerStarted","Data":"a479aed77f25eb0d09225338b84c529cb831a170530d7a420ebefbe703abf0b1"} Jun 14 15:15:07.617844 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:07.617728 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"54e15401-8c4e-40c5-9634-d39a7c387073","Type":"ContainerStarted","Data":"9f074957ff99c29ede0e04be9f6698a25581a5c89daa14e95e94233d7d84a261"} Jun 14 15:15:07.619425 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:07.619405 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5b985bcb8d-n7p54" event={"ID":"0395b7ba-7aa2-4729-9706-5b2550c71e8a","Type":"ContainerStarted","Data":"a6acef2a586505601a482d00f47de20b85c8a96515a5244273b1553c53c2e230"} Jun 14 15:15:07.619524 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:07.619463 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5b985bcb8d-n7p54" event={"ID":"0395b7ba-7aa2-4729-9706-5b2550c71e8a","Type":"ContainerStarted","Data":"8cb6a209442508c946fbfdcc0e85a09649224678d8d2624d291da8117013f74c"} Jun 14 15:15:07.619524 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:07.619488 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5b985bcb8d-n7p54" event={"ID":"0395b7ba-7aa2-4729-9706-5b2550c71e8a","Type":"ContainerStarted","Data":"ee83a55b0a9781b2e91986c01337b0613cb7b763c776990afec481b7d3601a1b"} Jun 14 15:15:07.655799 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:07.655767 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c127cc7e-7761-45e9-96ab-64ce18e83b21-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-8xxdz\" (UID: \"c127cc7e-7761-45e9-96ab-64ce18e83b21\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-8xxdz" Jun 14 15:15:07.655954 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:15:07.655933 2571 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jun 14 15:15:07.656024 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:15:07.656013 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c127cc7e-7761-45e9-96ab-64ce18e83b21-monitoring-plugin-cert podName:c127cc7e-7761-45e9-96ab-64ce18e83b21 nodeName:}" failed. No retries permitted until 2026-06-14 15:15:08.655992392 +0000 UTC m=+65.837474889 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/c127cc7e-7761-45e9-96ab-64ce18e83b21-monitoring-plugin-cert") pod "monitoring-plugin-589576dfc7-8xxdz" (UID: "c127cc7e-7761-45e9-96ab-64ce18e83b21") : secret "monitoring-plugin-cert" not found Jun 14 15:15:07.804751 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:07.804712 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:15:07.871869 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:07.871789 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:15:08.545608 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:08.545554 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:15:08.564087 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:08.564060 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-kqsrl" Jun 14 15:15:08.618547 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:08.618516 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 14 15:15:08.621335 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:08.621292 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:15:08.625683 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:08.624761 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 14 15:15:08.625683 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:08.624827 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 14 15:15:08.625683 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:08.624966 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 14 15:15:08.625683 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:08.625021 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 14 15:15:08.625683 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:08.625268 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-657mqonmbikr3\"" Jun 14 15:15:08.625683 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:08.625598 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 14 15:15:08.625683 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:08.625608 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 14 15:15:08.626126 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:08.625805 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-vlrxf\"" Jun 14 15:15:08.626126 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:08.625873 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 14 15:15:08.626338 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:08.626292 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 14 15:15:08.626338 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:08.626304 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 14 15:15:08.627411 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:08.626990 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 14 15:15:08.627411 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:08.627238 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 14 15:15:08.630029 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:08.629663 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 14 15:15:08.630029 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:08.629873 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 14 15:15:08.632025 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:08.631999 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 14 15:15:08.632136 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:08.632080 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"54e15401-8c4e-40c5-9634-d39a7c387073","Type":"ContainerStarted","Data":"702eeea4d9df47f9a510794e1bcb02c1f77567bdb1691b067e7b868e798905a6"} Jun 14 15:15:08.637250 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:08.637217 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5b985bcb8d-n7p54" event={"ID":"0395b7ba-7aa2-4729-9706-5b2550c71e8a","Type":"ContainerStarted","Data":"2a72dec9832e0c2781df22f3763bfcc35e6b4d29590d20729d0a8999bdd73972"} Jun 14 15:15:08.637339 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:08.637289 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5b985bcb8d-n7p54" event={"ID":"0395b7ba-7aa2-4729-9706-5b2550c71e8a","Type":"ContainerStarted","Data":"e265fc53b8d48bc99ca274968bb0311324fb089cf3d69a9557cfd9b9cb2aefea"} Jun 14 15:15:08.637339 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:08.637331 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5b985bcb8d-n7p54" event={"ID":"0395b7ba-7aa2-4729-9706-5b2550c71e8a","Type":"ContainerStarted","Data":"2f1f0abfe7c2e21fc0efa2182444d0b8c8e13b364ab3ca436b5c2547bef3a244"} Jun 14 15:15:08.637457 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:08.637375 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5b985bcb8d-n7p54" Jun 14 15:15:08.637565 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:08.637544 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 14 15:15:08.650165 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:08.650142 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 14 15:15:08.663713 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:08.663668 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c127cc7e-7761-45e9-96ab-64ce18e83b21-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-8xxdz\" (UID: \"c127cc7e-7761-45e9-96ab-64ce18e83b21\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-8xxdz" Jun 14 15:15:08.666595 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:08.666563 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c127cc7e-7761-45e9-96ab-64ce18e83b21-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-8xxdz\" (UID: \"c127cc7e-7761-45e9-96ab-64ce18e83b21\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-8xxdz" Jun 14 15:15:08.689398 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:08.689367 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:15:08.715720 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:08.715668 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.69648688 podStartE2EDuration="5.715650059s" totalImagesPullingTime="3.003560124s" totalInitContainerRuntime="15.603055ms" isStatefulPod=false podCreationTimestamp="2026-06-14 15:15:03 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:15:08.71259974 +0000 UTC m=+65.894082270" watchObservedRunningTime="2026-06-14 15:15:08.715650059 +0000 UTC m=+65.897132579" Jun 14 15:15:08.738307 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:08.736807 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5b985bcb8d-n7p54" podStartSLOduration=1.7986432479999999 podStartE2EDuration="4.736785761s" totalImagesPullingTime="2.938142513s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:15:04 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:15:08.735463234 +0000 UTC m=+65.916945758" watchObservedRunningTime="2026-06-14 15:15:08.736785761 +0000 UTC m=+65.918268278" Jun 14 15:15:08.764627 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:08.764474 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/dee50442-134a-4024-81d4-c55d01e8c965-config\") pod \"prometheus-k8s-0\" (UID: \"dee50442-134a-4024-81d4-c55d01e8c965\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:15:08.764627 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:08.764519 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dee50442-134a-4024-81d4-c55d01e8c965-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"dee50442-134a-4024-81d4-c55d01e8c965\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:15:08.764627 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:08.764544 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wxfn\" (UniqueName: \"kubernetes.io/projected/dee50442-134a-4024-81d4-c55d01e8c965-kube-api-access-4wxfn\") pod \"prometheus-k8s-0\" (UID: \"dee50442-134a-4024-81d4-c55d01e8c965\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:15:08.764627 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:08.764572 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dee50442-134a-4024-81d4-c55d01e8c965-config-out\") pod \"prometheus-k8s-0\" (UID: \"dee50442-134a-4024-81d4-c55d01e8c965\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:15:08.764627 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:08.764595 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dee50442-134a-4024-81d4-c55d01e8c965-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"dee50442-134a-4024-81d4-c55d01e8c965\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:15:08.764953 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:08.764634 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/dee50442-134a-4024-81d4-c55d01e8c965-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"dee50442-134a-4024-81d4-c55d01e8c965\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:15:08.764953 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:08.764663 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/dee50442-134a-4024-81d4-c55d01e8c965-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"dee50442-134a-4024-81d4-c55d01e8c965\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:15:08.764953 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:08.764736 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dee50442-134a-4024-81d4-c55d01e8c965-web-config\") pod \"prometheus-k8s-0\" (UID: \"dee50442-134a-4024-81d4-c55d01e8c965\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:15:08.764953 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:08.764829 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/dee50442-134a-4024-81d4-c55d01e8c965-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"dee50442-134a-4024-81d4-c55d01e8c965\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:15:08.764953 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:08.764897 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dee50442-134a-4024-81d4-c55d01e8c965-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dee50442-134a-4024-81d4-c55d01e8c965\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:15:08.765223 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:08.765013 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/dee50442-134a-4024-81d4-c55d01e8c965-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"dee50442-134a-4024-81d4-c55d01e8c965\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:15:08.765223 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:08.765036 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/dee50442-134a-4024-81d4-c55d01e8c965-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"dee50442-134a-4024-81d4-c55d01e8c965\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:15:08.765223 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:08.765154 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dee50442-134a-4024-81d4-c55d01e8c965-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dee50442-134a-4024-81d4-c55d01e8c965\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:15:08.765379 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:08.765279 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/dee50442-134a-4024-81d4-c55d01e8c965-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"dee50442-134a-4024-81d4-c55d01e8c965\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:15:08.765594 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:08.765567 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/dee50442-134a-4024-81d4-c55d01e8c965-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"dee50442-134a-4024-81d4-c55d01e8c965\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:15:08.765740 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:08.765720 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/dee50442-134a-4024-81d4-c55d01e8c965-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"dee50442-134a-4024-81d4-c55d01e8c965\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:15:08.765800 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:08.765749 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/dee50442-134a-4024-81d4-c55d01e8c965-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"dee50442-134a-4024-81d4-c55d01e8c965\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:15:08.765800 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:08.765793 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dee50442-134a-4024-81d4-c55d01e8c965-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dee50442-134a-4024-81d4-c55d01e8c965\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:15:08.765903 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:08.765821 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dee50442-134a-4024-81d4-c55d01e8c965-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"dee50442-134a-4024-81d4-c55d01e8c965\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:15:08.765903 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:08.765874 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dee50442-134a-4024-81d4-c55d01e8c965-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"dee50442-134a-4024-81d4-c55d01e8c965\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:15:08.790127 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:08.790090 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-589576dfc7-8xxdz" Jun 14 15:15:08.867198 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:08.867167 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dee50442-134a-4024-81d4-c55d01e8c965-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dee50442-134a-4024-81d4-c55d01e8c965\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:15:08.867198 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:08.867203 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dee50442-134a-4024-81d4-c55d01e8c965-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"dee50442-134a-4024-81d4-c55d01e8c965\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:15:08.867425 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:08.867222 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dee50442-134a-4024-81d4-c55d01e8c965-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"dee50442-134a-4024-81d4-c55d01e8c965\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:15:08.867425 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:08.867246 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/dee50442-134a-4024-81d4-c55d01e8c965-config\") pod \"prometheus-k8s-0\" (UID: \"dee50442-134a-4024-81d4-c55d01e8c965\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:15:08.867425 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:08.867262 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dee50442-134a-4024-81d4-c55d01e8c965-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"dee50442-134a-4024-81d4-c55d01e8c965\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:15:08.867425 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:08.867279 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wxfn\" (UniqueName: \"kubernetes.io/projected/dee50442-134a-4024-81d4-c55d01e8c965-kube-api-access-4wxfn\") pod \"prometheus-k8s-0\" (UID: \"dee50442-134a-4024-81d4-c55d01e8c965\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:15:08.867425 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:08.867295 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dee50442-134a-4024-81d4-c55d01e8c965-config-out\") pod \"prometheus-k8s-0\" (UID: \"dee50442-134a-4024-81d4-c55d01e8c965\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:15:08.867425 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:08.867309 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dee50442-134a-4024-81d4-c55d01e8c965-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"dee50442-134a-4024-81d4-c55d01e8c965\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:15:08.867425 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:08.867328 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/dee50442-134a-4024-81d4-c55d01e8c965-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"dee50442-134a-4024-81d4-c55d01e8c965\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:15:08.867425 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:08.867344 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/dee50442-134a-4024-81d4-c55d01e8c965-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"dee50442-134a-4024-81d4-c55d01e8c965\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:15:08.867425 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:08.867359 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dee50442-134a-4024-81d4-c55d01e8c965-web-config\") pod \"prometheus-k8s-0\" (UID: \"dee50442-134a-4024-81d4-c55d01e8c965\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:15:08.867864 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:08.867639 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/dee50442-134a-4024-81d4-c55d01e8c965-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"dee50442-134a-4024-81d4-c55d01e8c965\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:15:08.867864 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:08.867664 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dee50442-134a-4024-81d4-c55d01e8c965-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dee50442-134a-4024-81d4-c55d01e8c965\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:15:08.867864 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:08.867688 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/dee50442-134a-4024-81d4-c55d01e8c965-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"dee50442-134a-4024-81d4-c55d01e8c965\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:15:08.867864 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:08.867714 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/dee50442-134a-4024-81d4-c55d01e8c965-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"dee50442-134a-4024-81d4-c55d01e8c965\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:15:08.867864 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:08.867754 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dee50442-134a-4024-81d4-c55d01e8c965-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dee50442-134a-4024-81d4-c55d01e8c965\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:15:08.867864 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:08.867823 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/dee50442-134a-4024-81d4-c55d01e8c965-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"dee50442-134a-4024-81d4-c55d01e8c965\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:15:08.867864 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:08.867861 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/dee50442-134a-4024-81d4-c55d01e8c965-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"dee50442-134a-4024-81d4-c55d01e8c965\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:15:08.868215 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:08.867913 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/dee50442-134a-4024-81d4-c55d01e8c965-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"dee50442-134a-4024-81d4-c55d01e8c965\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:15:08.868215 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:08.867937 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/dee50442-134a-4024-81d4-c55d01e8c965-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"dee50442-134a-4024-81d4-c55d01e8c965\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:15:08.868724 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:08.868696 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dee50442-134a-4024-81d4-c55d01e8c965-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"dee50442-134a-4024-81d4-c55d01e8c965\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:15:08.868724 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:08.868710 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dee50442-134a-4024-81d4-c55d01e8c965-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dee50442-134a-4024-81d4-c55d01e8c965\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:15:08.869015 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:08.868911 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dee50442-134a-4024-81d4-c55d01e8c965-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dee50442-134a-4024-81d4-c55d01e8c965\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:15:08.869776 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:08.869353 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/dee50442-134a-4024-81d4-c55d01e8c965-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"dee50442-134a-4024-81d4-c55d01e8c965\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:15:08.869776 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:08.869626 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/dee50442-134a-4024-81d4-c55d01e8c965-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"dee50442-134a-4024-81d4-c55d01e8c965\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:15:08.871215 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:08.871137 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dee50442-134a-4024-81d4-c55d01e8c965-config-out\") pod \"prometheus-k8s-0\" (UID: \"dee50442-134a-4024-81d4-c55d01e8c965\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:15:08.872392 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:08.871677 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/dee50442-134a-4024-81d4-c55d01e8c965-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"dee50442-134a-4024-81d4-c55d01e8c965\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:15:08.872392 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:08.872155 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/dee50442-134a-4024-81d4-c55d01e8c965-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"dee50442-134a-4024-81d4-c55d01e8c965\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:15:08.872392 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:08.872226 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/dee50442-134a-4024-81d4-c55d01e8c965-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"dee50442-134a-4024-81d4-c55d01e8c965\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:15:08.872608 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:08.872443 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/dee50442-134a-4024-81d4-c55d01e8c965-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"dee50442-134a-4024-81d4-c55d01e8c965\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:15:08.873507 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:08.873138 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dee50442-134a-4024-81d4-c55d01e8c965-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"dee50442-134a-4024-81d4-c55d01e8c965\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:15:08.873603 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:08.873528 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/dee50442-134a-4024-81d4-c55d01e8c965-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"dee50442-134a-4024-81d4-c55d01e8c965\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:15:08.873679 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:08.873656 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dee50442-134a-4024-81d4-c55d01e8c965-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dee50442-134a-4024-81d4-c55d01e8c965\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:15:08.875349 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:08.874008 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/dee50442-134a-4024-81d4-c55d01e8c965-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"dee50442-134a-4024-81d4-c55d01e8c965\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:15:08.875349 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:08.874104 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/dee50442-134a-4024-81d4-c55d01e8c965-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"dee50442-134a-4024-81d4-c55d01e8c965\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:15:08.875349 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:08.874632 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dee50442-134a-4024-81d4-c55d01e8c965-web-config\") pod \"prometheus-k8s-0\" (UID: \"dee50442-134a-4024-81d4-c55d01e8c965\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:15:08.875349 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:08.874987 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dee50442-134a-4024-81d4-c55d01e8c965-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"dee50442-134a-4024-81d4-c55d01e8c965\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:15:08.875349 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:08.875145 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/dee50442-134a-4024-81d4-c55d01e8c965-config\") pod \"prometheus-k8s-0\" (UID: \"dee50442-134a-4024-81d4-c55d01e8c965\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:15:08.879068 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:08.878861 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dee50442-134a-4024-81d4-c55d01e8c965-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"dee50442-134a-4024-81d4-c55d01e8c965\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:15:08.880000 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:08.879978 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wxfn\" (UniqueName: \"kubernetes.io/projected/dee50442-134a-4024-81d4-c55d01e8c965-kube-api-access-4wxfn\") pod \"prometheus-k8s-0\" (UID: \"dee50442-134a-4024-81d4-c55d01e8c965\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:15:08.935391 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:08.935355 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-8xxdz"] Jun 14 15:15:08.938552 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:08.938528 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:15:08.939232 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:15:08.939204 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc127cc7e_7761_45e9_96ab_64ce18e83b21.slice/crio-c4226bb3676b5631376428e5cf2ab017475cf3d600a82fad23556512b7a8d90b WatchSource:0}: Error finding container c4226bb3676b5631376428e5cf2ab017475cf3d600a82fad23556512b7a8d90b: Status 404 returned error can't find the container with id c4226bb3676b5631376428e5cf2ab017475cf3d600a82fad23556512b7a8d90b Jun 14 15:15:09.070560 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:09.070483 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/15bccd1f-7f51-4c8b-8b76-75481887049f-original-pull-secret\") pod \"global-pull-secret-syncer-lfxgl\" (UID: \"15bccd1f-7f51-4c8b-8b76-75481887049f\") " pod="kube-system/global-pull-secret-syncer-lfxgl" Jun 14 15:15:09.072706 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:09.072685 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 14 15:15:09.083819 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:09.083790 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/15bccd1f-7f51-4c8b-8b76-75481887049f-original-pull-secret\") pod \"global-pull-secret-syncer-lfxgl\" (UID: \"15bccd1f-7f51-4c8b-8b76-75481887049f\") " pod="kube-system/global-pull-secret-syncer-lfxgl" Jun 14 15:15:09.091067 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:09.091029 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 14 15:15:09.094060 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:15:09.094023 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddee50442_134a_4024_81d4_c55d01e8c965.slice/crio-4a9c45f1371d21cb974eb864154f56ffbf1f0d638a5baf8a6e0b6e801c1aa546 WatchSource:0}: Error finding container 4a9c45f1371d21cb974eb864154f56ffbf1f0d638a5baf8a6e0b6e801c1aa546: Status 404 returned error can't find the container with id 4a9c45f1371d21cb974eb864154f56ffbf1f0d638a5baf8a6e0b6e801c1aa546 Jun 14 15:15:09.171811 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:09.171773 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wln4b\" (UniqueName: \"kubernetes.io/projected/5769083d-c587-4660-a48d-2c58b8eccc78-kube-api-access-wln4b\") pod \"network-check-target-jqckm\" (UID: \"5769083d-c587-4660-a48d-2c58b8eccc78\") " pod="openshift-network-diagnostics/network-check-target-jqckm" Jun 14 15:15:09.172004 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:09.171859 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0df8c3a-2915-4563-8f78-1bf2e8d5a27f-metrics-certs\") pod \"network-metrics-daemon-nb6vz\" (UID: \"d0df8c3a-2915-4563-8f78-1bf2e8d5a27f\") " pod="openshift-multus/network-metrics-daemon-nb6vz" Jun 14 15:15:09.174456 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:09.174426 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 14 15:15:09.174456 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:09.174456 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 14 15:15:09.184727 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:09.184703 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0df8c3a-2915-4563-8f78-1bf2e8d5a27f-metrics-certs\") pod \"network-metrics-daemon-nb6vz\" (UID: \"d0df8c3a-2915-4563-8f78-1bf2e8d5a27f\") " pod="openshift-multus/network-metrics-daemon-nb6vz" Jun 14 15:15:09.185001 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:09.184983 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 14 15:15:09.195366 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:09.195333 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wln4b\" (UniqueName: \"kubernetes.io/projected/5769083d-c587-4660-a48d-2c58b8eccc78-kube-api-access-wln4b\") pod \"network-check-target-jqckm\" (UID: \"5769083d-c587-4660-a48d-2c58b8eccc78\") " pod="openshift-network-diagnostics/network-check-target-jqckm" Jun 14 15:15:09.223766 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:09.223737 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rlkml\"" Jun 14 15:15:09.231616 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:09.231599 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nb6vz" Jun 14 15:15:09.231712 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:09.231679 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lfxgl" Jun 14 15:15:09.241708 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:09.241686 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-txhsx\"" Jun 14 15:15:09.250501 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:09.250474 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jqckm" Jun 14 15:15:09.377552 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:09.377524 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-nb6vz"] Jun 14 15:15:09.384274 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:15:09.384247 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0df8c3a_2915_4563_8f78_1bf2e8d5a27f.slice/crio-a203f281c82e72d965388a1a28c3e185e26b5e583c57acac0e0f53057dbfec1f WatchSource:0}: Error finding container a203f281c82e72d965388a1a28c3e185e26b5e583c57acac0e0f53057dbfec1f: Status 404 returned error can't find the container with id a203f281c82e72d965388a1a28c3e185e26b5e583c57acac0e0f53057dbfec1f Jun 14 15:15:09.397536 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:09.397508 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lfxgl"] Jun 14 15:15:09.400266 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:15:09.400239 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15bccd1f_7f51_4c8b_8b76_75481887049f.slice/crio-e29d0163a0d858fe890b162efaaa9c825ded8deefa5c23cbe6b9913cc7e35f9a WatchSource:0}: Error finding container e29d0163a0d858fe890b162efaaa9c825ded8deefa5c23cbe6b9913cc7e35f9a: Status 404 returned error can't find the container with id e29d0163a0d858fe890b162efaaa9c825ded8deefa5c23cbe6b9913cc7e35f9a Jun 14 15:15:09.413726 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:09.413702 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jqckm"] Jun 14 15:15:09.417028 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:15:09.417005 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5769083d_c587_4660_a48d_2c58b8eccc78.slice/crio-1b44cd66f41811693ce6fc502f892d5d1f19be3d277cab9e331a665eda8376a6 WatchSource:0}: Error finding container 1b44cd66f41811693ce6fc502f892d5d1f19be3d277cab9e331a665eda8376a6: Status 404 returned error can't find the container with id 1b44cd66f41811693ce6fc502f892d5d1f19be3d277cab9e331a665eda8376a6 Jun 14 15:15:09.643917 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:09.643826 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lfxgl" event={"ID":"15bccd1f-7f51-4c8b-8b76-75481887049f","Type":"ContainerStarted","Data":"e29d0163a0d858fe890b162efaaa9c825ded8deefa5c23cbe6b9913cc7e35f9a"} Jun 14 15:15:09.645222 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:09.645184 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nb6vz" event={"ID":"d0df8c3a-2915-4563-8f78-1bf2e8d5a27f","Type":"ContainerStarted","Data":"a203f281c82e72d965388a1a28c3e185e26b5e583c57acac0e0f53057dbfec1f"} Jun 14 15:15:09.647002 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:09.646970 2571 generic.go:356] "Generic (PLEG): container finished" podID="dee50442-134a-4024-81d4-c55d01e8c965" containerID="56f684949369ac75afe596ab0ed4595b12c394edaa8ff6c32951861d3478675b" exitCode=0 Jun 14 15:15:09.647143 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:09.647072 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dee50442-134a-4024-81d4-c55d01e8c965","Type":"ContainerDied","Data":"56f684949369ac75afe596ab0ed4595b12c394edaa8ff6c32951861d3478675b"} Jun 14 15:15:09.647214 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:09.647143 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dee50442-134a-4024-81d4-c55d01e8c965","Type":"ContainerStarted","Data":"4a9c45f1371d21cb974eb864154f56ffbf1f0d638a5baf8a6e0b6e801c1aa546"} Jun 14 15:15:09.648539 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:09.648519 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-589576dfc7-8xxdz" event={"ID":"c127cc7e-7761-45e9-96ab-64ce18e83b21","Type":"ContainerStarted","Data":"c4226bb3676b5631376428e5cf2ab017475cf3d600a82fad23556512b7a8d90b"} Jun 14 15:15:09.650738 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:09.650715 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jqckm" event={"ID":"5769083d-c587-4660-a48d-2c58b8eccc78","Type":"ContainerStarted","Data":"1b44cd66f41811693ce6fc502f892d5d1f19be3d277cab9e331a665eda8376a6"} Jun 14 15:15:09.717575 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:09.717543 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-789fd8ccdf-hq298" Jun 14 15:15:09.717731 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:09.717596 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-789fd8ccdf-hq298" Jun 14 15:15:09.718801 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:09.718778 2571 patch_prober.go:28] interesting pod/console-789fd8ccdf-hq298 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.10:8443/health\": dial tcp 10.134.0.10:8443: connect: connection refused" start-of-body= Jun 14 15:15:09.718897 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:09.718825 2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-789fd8ccdf-hq298" podUID="a4adcc78-5391-4999-9c4e-e8760476d22d" containerName="console" probeResult="failure" output="Get \"https://10.134.0.10:8443/health\": dial tcp 10.134.0.10:8443: connect: connection refused" Jun 14 15:15:10.556507 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:10.556466 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:15:10.656811 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:10.656759 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:15:10.757189 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:10.757114 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:15:10.863280 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:10.863137 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:15:10.935310 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:10.935261 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:15:11.018467 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:11.018432 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-789fd8ccdf-hq298"] Jun 14 15:15:11.056444 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:11.055062 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-677d66c595-bwlrh"] Jun 14 15:15:11.062299 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:11.061917 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-677d66c595-bwlrh" Jun 14 15:15:11.078466 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:11.078234 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-677d66c595-bwlrh"] Jun 14 15:15:11.192285 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:11.192239 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/66766fa4-3b87-4ccd-9c27-899d8e3ed5df-oauth-serving-cert\") pod \"console-677d66c595-bwlrh\" (UID: \"66766fa4-3b87-4ccd-9c27-899d8e3ed5df\") " pod="openshift-console/console-677d66c595-bwlrh" Jun 14 15:15:11.192438 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:11.192416 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/66766fa4-3b87-4ccd-9c27-899d8e3ed5df-console-config\") pod \"console-677d66c595-bwlrh\" (UID: \"66766fa4-3b87-4ccd-9c27-899d8e3ed5df\") " pod="openshift-console/console-677d66c595-bwlrh" Jun 14 15:15:11.192495 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:11.192474 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pphf2\" (UniqueName: \"kubernetes.io/projected/66766fa4-3b87-4ccd-9c27-899d8e3ed5df-kube-api-access-pphf2\") pod \"console-677d66c595-bwlrh\" (UID: \"66766fa4-3b87-4ccd-9c27-899d8e3ed5df\") " pod="openshift-console/console-677d66c595-bwlrh" Jun 14 15:15:11.192575 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:11.192516 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66766fa4-3b87-4ccd-9c27-899d8e3ed5df-trusted-ca-bundle\") pod \"console-677d66c595-bwlrh\" (UID: \"66766fa4-3b87-4ccd-9c27-899d8e3ed5df\") " pod="openshift-console/console-677d66c595-bwlrh" Jun 14 15:15:11.192575 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:11.192546 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/66766fa4-3b87-4ccd-9c27-899d8e3ed5df-console-serving-cert\") pod \"console-677d66c595-bwlrh\" (UID: \"66766fa4-3b87-4ccd-9c27-899d8e3ed5df\") " pod="openshift-console/console-677d66c595-bwlrh" Jun 14 15:15:11.192691 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:11.192575 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/66766fa4-3b87-4ccd-9c27-899d8e3ed5df-console-oauth-config\") pod \"console-677d66c595-bwlrh\" (UID: \"66766fa4-3b87-4ccd-9c27-899d8e3ed5df\") " pod="openshift-console/console-677d66c595-bwlrh" Jun 14 15:15:11.192691 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:11.192609 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/66766fa4-3b87-4ccd-9c27-899d8e3ed5df-service-ca\") pod \"console-677d66c595-bwlrh\" (UID: \"66766fa4-3b87-4ccd-9c27-899d8e3ed5df\") " pod="openshift-console/console-677d66c595-bwlrh" Jun 14 15:15:11.294101 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:11.293313 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66766fa4-3b87-4ccd-9c27-899d8e3ed5df-trusted-ca-bundle\") pod \"console-677d66c595-bwlrh\" (UID: \"66766fa4-3b87-4ccd-9c27-899d8e3ed5df\") " pod="openshift-console/console-677d66c595-bwlrh" Jun 14 15:15:11.294101 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:11.293357 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/66766fa4-3b87-4ccd-9c27-899d8e3ed5df-console-serving-cert\") pod \"console-677d66c595-bwlrh\" (UID: \"66766fa4-3b87-4ccd-9c27-899d8e3ed5df\") " pod="openshift-console/console-677d66c595-bwlrh" Jun 14 15:15:11.294101 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:11.293391 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/66766fa4-3b87-4ccd-9c27-899d8e3ed5df-console-oauth-config\") pod \"console-677d66c595-bwlrh\" (UID: \"66766fa4-3b87-4ccd-9c27-899d8e3ed5df\") " pod="openshift-console/console-677d66c595-bwlrh" Jun 14 15:15:11.294101 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:11.293424 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/66766fa4-3b87-4ccd-9c27-899d8e3ed5df-service-ca\") pod \"console-677d66c595-bwlrh\" (UID: \"66766fa4-3b87-4ccd-9c27-899d8e3ed5df\") " pod="openshift-console/console-677d66c595-bwlrh" Jun 14 15:15:11.294101 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:11.293499 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/66766fa4-3b87-4ccd-9c27-899d8e3ed5df-oauth-serving-cert\") pod \"console-677d66c595-bwlrh\" (UID: \"66766fa4-3b87-4ccd-9c27-899d8e3ed5df\") " pod="openshift-console/console-677d66c595-bwlrh" Jun 14 15:15:11.294101 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:11.293546 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/66766fa4-3b87-4ccd-9c27-899d8e3ed5df-console-config\") pod \"console-677d66c595-bwlrh\" (UID: \"66766fa4-3b87-4ccd-9c27-899d8e3ed5df\") " pod="openshift-console/console-677d66c595-bwlrh" Jun 14 15:15:11.294101 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:11.293577 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pphf2\" (UniqueName: \"kubernetes.io/projected/66766fa4-3b87-4ccd-9c27-899d8e3ed5df-kube-api-access-pphf2\") pod \"console-677d66c595-bwlrh\" (UID: \"66766fa4-3b87-4ccd-9c27-899d8e3ed5df\") " pod="openshift-console/console-677d66c595-bwlrh" Jun 14 15:15:11.294776 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:11.294734 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66766fa4-3b87-4ccd-9c27-899d8e3ed5df-trusted-ca-bundle\") pod \"console-677d66c595-bwlrh\" (UID: \"66766fa4-3b87-4ccd-9c27-899d8e3ed5df\") " pod="openshift-console/console-677d66c595-bwlrh" Jun 14 15:15:11.294776 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:11.294746 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/66766fa4-3b87-4ccd-9c27-899d8e3ed5df-service-ca\") pod \"console-677d66c595-bwlrh\" (UID: \"66766fa4-3b87-4ccd-9c27-899d8e3ed5df\") " pod="openshift-console/console-677d66c595-bwlrh" Jun 14 15:15:11.295213 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:11.295167 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/66766fa4-3b87-4ccd-9c27-899d8e3ed5df-oauth-serving-cert\") pod \"console-677d66c595-bwlrh\" (UID: \"66766fa4-3b87-4ccd-9c27-899d8e3ed5df\") " pod="openshift-console/console-677d66c595-bwlrh" Jun 14 15:15:11.295403 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:11.295383 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/66766fa4-3b87-4ccd-9c27-899d8e3ed5df-console-config\") pod \"console-677d66c595-bwlrh\" (UID: \"66766fa4-3b87-4ccd-9c27-899d8e3ed5df\") " pod="openshift-console/console-677d66c595-bwlrh" Jun 14 15:15:11.298701 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:11.298649 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/66766fa4-3b87-4ccd-9c27-899d8e3ed5df-console-oauth-config\") pod \"console-677d66c595-bwlrh\" (UID: \"66766fa4-3b87-4ccd-9c27-899d8e3ed5df\") " pod="openshift-console/console-677d66c595-bwlrh" Jun 14 15:15:11.300710 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:11.300682 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/66766fa4-3b87-4ccd-9c27-899d8e3ed5df-console-serving-cert\") pod \"console-677d66c595-bwlrh\" (UID: \"66766fa4-3b87-4ccd-9c27-899d8e3ed5df\") " pod="openshift-console/console-677d66c595-bwlrh" Jun 14 15:15:11.310296 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:11.310233 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pphf2\" (UniqueName: \"kubernetes.io/projected/66766fa4-3b87-4ccd-9c27-899d8e3ed5df-kube-api-access-pphf2\") pod \"console-677d66c595-bwlrh\" (UID: \"66766fa4-3b87-4ccd-9c27-899d8e3ed5df\") " pod="openshift-console/console-677d66c595-bwlrh" Jun 14 15:15:11.379657 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:11.379622 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-677d66c595-bwlrh" Jun 14 15:15:11.587661 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:11.587589 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-677d66c595-bwlrh"] Jun 14 15:15:11.591989 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:15:11.591957 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66766fa4_3b87_4ccd_9c27_899d8e3ed5df.slice/crio-c337866d9238b9ada16c3e615b899b3c2b6d15d36a0ce90ce0a7df16d34510c5 WatchSource:0}: Error finding container c337866d9238b9ada16c3e615b899b3c2b6d15d36a0ce90ce0a7df16d34510c5: Status 404 returned error can't find the container with id c337866d9238b9ada16c3e615b899b3c2b6d15d36a0ce90ce0a7df16d34510c5 Jun 14 15:15:11.609629 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:11.609599 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:15:11.665002 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:11.664692 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-589576dfc7-8xxdz" event={"ID":"c127cc7e-7761-45e9-96ab-64ce18e83b21","Type":"ContainerStarted","Data":"400e1b2f16b803f28ca2a0bb37c91c67af2f7d4786407d722b38346190d1c6cd"} Jun 14 15:15:11.665002 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:11.664924 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-589576dfc7-8xxdz" Jun 14 15:15:11.666475 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:11.666444 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-677d66c595-bwlrh" event={"ID":"66766fa4-3b87-4ccd-9c27-899d8e3ed5df","Type":"ContainerStarted","Data":"c337866d9238b9ada16c3e615b899b3c2b6d15d36a0ce90ce0a7df16d34510c5"} Jun 14 15:15:11.671284 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:11.670957 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nb6vz" event={"ID":"d0df8c3a-2915-4563-8f78-1bf2e8d5a27f","Type":"ContainerStarted","Data":"064f3c9165f7a5e21f1d441c44226eaff6295e08fad3d455abaa6b5b2028d265"} Jun 14 15:15:11.671284 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:11.671008 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nb6vz" event={"ID":"d0df8c3a-2915-4563-8f78-1bf2e8d5a27f","Type":"ContainerStarted","Data":"a8585713878fbdfd685faa20f6b90f5eb949f3ac3b940215f71fbd8dbb64893a"} Jun 14 15:15:11.671698 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:11.671659 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-589576dfc7-8xxdz" Jun 14 15:15:11.691532 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:11.690496 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-589576dfc7-8xxdz" podStartSLOduration=3.4589162030000002 podStartE2EDuration="5.690475426s" totalImagesPullingTime="2.231559223s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:15:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:15:11.689374539 +0000 UTC m=+68.870857055" watchObservedRunningTime="2026-06-14 15:15:11.690475426 +0000 UTC m=+68.871957943" Jun 14 15:15:11.695196 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:11.695135 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:15:11.737553 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:11.737084 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-nb6vz" podStartSLOduration=66.955253095 podStartE2EDuration="1m8.737040299s" totalImagesPullingTime="1.781787204s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:14:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:15:11.711135736 +0000 UTC m=+68.892618253" watchObservedRunningTime="2026-06-14 15:15:11.737040299 +0000 UTC m=+68.918522816" Jun 14 15:15:11.809883 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:11.809801 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:15:11.910956 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:11.910861 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:15:12.680793 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:12.680640 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-677d66c595-bwlrh" event={"ID":"66766fa4-3b87-4ccd-9c27-899d8e3ed5df","Type":"ContainerStarted","Data":"da3d5a38902751e87a45b3b338c072951520b38fd6b3e4a81bb6f0ffc06dab1d"} Jun 14 15:15:12.705179 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:12.704866 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-677d66c595-bwlrh" podStartSLOduration=1.70484402 podStartE2EDuration="1.70484402s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:15:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:15:12.703304115 +0000 UTC m=+69.884786631" watchObservedRunningTime="2026-06-14 15:15:12.70484402 +0000 UTC m=+69.886326537" Jun 14 15:15:13.517902 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:13.517863 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:15:13.582910 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:13.582852 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:15:14.658419 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:14.658384 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5b985bcb8d-n7p54" Jun 14 15:15:15.198382 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:15.198350 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:15:15.302067 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:15.302006 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:15:16.701828 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:16.701795 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jqckm" event={"ID":"5769083d-c587-4660-a48d-2c58b8eccc78","Type":"ContainerStarted","Data":"f8302b5fbb7c9850dbdc54c6f1909aa142706298d3745678b0b318467f0ba14b"} Jun 14 15:15:16.702269 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:16.701911 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-jqckm" Jun 14 15:15:16.703463 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:16.703437 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lfxgl" event={"ID":"15bccd1f-7f51-4c8b-8b76-75481887049f","Type":"ContainerStarted","Data":"0b187ae983dd89bfc77eb063ad159b4c4f5925f8fa8a7db1d1f21b7260ecce8b"} Jun 14 15:15:16.706831 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:16.706810 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dee50442-134a-4024-81d4-c55d01e8c965","Type":"ContainerStarted","Data":"1ad62cf1bf626f62f032e58bf1d90208cee4f00f6777db179e845489f948325d"} Jun 14 15:15:16.706940 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:16.706857 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dee50442-134a-4024-81d4-c55d01e8c965","Type":"ContainerStarted","Data":"678aea388aea933307537af527ff2ef6cc078112896e97f8e1ca2d2376c63360"} Jun 14 15:15:16.706940 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:16.706883 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dee50442-134a-4024-81d4-c55d01e8c965","Type":"ContainerStarted","Data":"14c74afd61e4f24d2a2cac8cc1159bd2599bd34b0122f4b42105343acc90a97e"} Jun 14 15:15:16.706940 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:16.706909 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dee50442-134a-4024-81d4-c55d01e8c965","Type":"ContainerStarted","Data":"31bdcc16778067fa775f68eb8f0492094525299a570ad9915426e1a70c4a9ec0"} Jun 14 15:15:16.706940 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:16.706932 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dee50442-134a-4024-81d4-c55d01e8c965","Type":"ContainerStarted","Data":"74c703f30b0d934c78baa110568b79afa5fb01e2792db5942804697c0864ef83"} Jun 14 15:15:16.707071 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:16.706955 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dee50442-134a-4024-81d4-c55d01e8c965","Type":"ContainerStarted","Data":"cbbadfe5098661c5d84f1a81df62a899bead694016bb00ab557fee7596b60f6d"} Jun 14 15:15:16.721961 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:16.721912 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-jqckm" podStartSLOduration=67.074609002 podStartE2EDuration="1m13.721895195s" totalImagesPullingTime="6.647286193s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:14:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:15:16.720605714 +0000 UTC m=+73.902088231" watchObservedRunningTime="2026-06-14 15:15:16.721895195 +0000 UTC m=+73.903377708" Jun 14 15:15:16.757908 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:16.757836 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.315651367 podStartE2EDuration="8.757811344s" totalImagesPullingTime="6.422911648s" totalInitContainerRuntime="19.248329ms" isStatefulPod=false podCreationTimestamp="2026-06-14 15:15:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:15:16.756130931 +0000 UTC m=+73.937613446" watchObservedRunningTime="2026-06-14 15:15:16.757811344 +0000 UTC m=+73.939293861" Jun 14 15:15:16.776645 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:16.776592 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-lfxgl" podStartSLOduration=67.097208793 podStartE2EDuration="1m13.776572831s" totalImagesPullingTime="6.679364038s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 15:14:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:15:16.775106378 +0000 UTC m=+73.956588900" watchObservedRunningTime="2026-06-14 15:15:16.776572831 +0000 UTC m=+73.958055346" Jun 14 15:15:16.831689 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:16.831651 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:15:16.934258 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:16.934226 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:15:18.938838 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:18.938794 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:15:21.380321 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:21.380286 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-677d66c595-bwlrh" Jun 14 15:15:21.380725 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:21.380342 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-677d66c595-bwlrh" Jun 14 15:15:21.385205 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:21.385180 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-677d66c595-bwlrh" Jun 14 15:15:21.730673 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:21.730645 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-677d66c595-bwlrh" Jun 14 15:15:21.905620 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:21.905592 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:15:22.005238 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:22.005155 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:15:22.064383 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:22.064352 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:15:22.628727 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:22.628694 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:15:22.729335 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:22.729301 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:15:25.843267 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:25.843206 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:15:25.945580 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:25.945547 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:15:28.450063 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:28.450012 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:15:28.516759 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:28.516729 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:15:36.050886 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:36.050820 2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-789fd8ccdf-hq298" podUID="a4adcc78-5391-4999-9c4e-e8760476d22d" containerName="console" containerID="cri-o://d9039c04901964edeb31bbde05028cb6c1e96d541c48fa804d72f7b7cc336a8a" gracePeriod=15 Jun 14 15:15:36.294223 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:36.294195 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-789fd8ccdf-hq298" Jun 14 15:15:36.320995 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:36.320930 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a4adcc78-5391-4999-9c4e-e8760476d22d-oauth-serving-cert\") pod \"a4adcc78-5391-4999-9c4e-e8760476d22d\" (UID: \"a4adcc78-5391-4999-9c4e-e8760476d22d\") " Jun 14 15:15:36.320995 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:36.320978 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-76nvr\" (UniqueName: \"kubernetes.io/projected/a4adcc78-5391-4999-9c4e-e8760476d22d-kube-api-access-76nvr\") pod \"a4adcc78-5391-4999-9c4e-e8760476d22d\" (UID: \"a4adcc78-5391-4999-9c4e-e8760476d22d\") " Jun 14 15:15:36.321195 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:36.321001 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a4adcc78-5391-4999-9c4e-e8760476d22d-service-ca\") pod \"a4adcc78-5391-4999-9c4e-e8760476d22d\" (UID: \"a4adcc78-5391-4999-9c4e-e8760476d22d\") " Jun 14 15:15:36.321195 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:36.321030 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a4adcc78-5391-4999-9c4e-e8760476d22d-console-oauth-config\") pod \"a4adcc78-5391-4999-9c4e-e8760476d22d\" (UID: \"a4adcc78-5391-4999-9c4e-e8760476d22d\") " Jun 14 15:15:36.321195 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:36.321131 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4adcc78-5391-4999-9c4e-e8760476d22d-trusted-ca-bundle\") pod \"a4adcc78-5391-4999-9c4e-e8760476d22d\" (UID: \"a4adcc78-5391-4999-9c4e-e8760476d22d\") " Jun 14 15:15:36.321195 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:36.321168 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a4adcc78-5391-4999-9c4e-e8760476d22d-console-config\") pod \"a4adcc78-5391-4999-9c4e-e8760476d22d\" (UID: \"a4adcc78-5391-4999-9c4e-e8760476d22d\") " Jun 14 15:15:36.321378 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:36.321197 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a4adcc78-5391-4999-9c4e-e8760476d22d-console-serving-cert\") pod \"a4adcc78-5391-4999-9c4e-e8760476d22d\" (UID: \"a4adcc78-5391-4999-9c4e-e8760476d22d\") " Jun 14 15:15:36.321673 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:36.321442 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a4adcc78-5391-4999-9c4e-e8760476d22d-service-ca" (OuterVolumeSpecName: "service-ca") pod "a4adcc78-5391-4999-9c4e-e8760476d22d" (UID: "a4adcc78-5391-4999-9c4e-e8760476d22d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 15:15:36.321794 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:36.321770 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a4adcc78-5391-4999-9c4e-e8760476d22d-console-config" (OuterVolumeSpecName: "console-config") pod "a4adcc78-5391-4999-9c4e-e8760476d22d" (UID: "a4adcc78-5391-4999-9c4e-e8760476d22d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 15:15:36.322090 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:36.322064 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a4adcc78-5391-4999-9c4e-e8760476d22d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a4adcc78-5391-4999-9c4e-e8760476d22d" (UID: "a4adcc78-5391-4999-9c4e-e8760476d22d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 15:15:36.322233 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:36.322198 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a4adcc78-5391-4999-9c4e-e8760476d22d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a4adcc78-5391-4999-9c4e-e8760476d22d" (UID: "a4adcc78-5391-4999-9c4e-e8760476d22d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 15:15:36.323993 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:36.323938 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4adcc78-5391-4999-9c4e-e8760476d22d-kube-api-access-76nvr" (OuterVolumeSpecName: "kube-api-access-76nvr") pod "a4adcc78-5391-4999-9c4e-e8760476d22d" (UID: "a4adcc78-5391-4999-9c4e-e8760476d22d"). InnerVolumeSpecName "kube-api-access-76nvr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 15:15:36.324356 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:36.324317 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a4adcc78-5391-4999-9c4e-e8760476d22d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a4adcc78-5391-4999-9c4e-e8760476d22d" (UID: "a4adcc78-5391-4999-9c4e-e8760476d22d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 15:15:36.324439 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:36.324384 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a4adcc78-5391-4999-9c4e-e8760476d22d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a4adcc78-5391-4999-9c4e-e8760476d22d" (UID: "a4adcc78-5391-4999-9c4e-e8760476d22d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 15:15:36.422196 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:36.422163 2571 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a4adcc78-5391-4999-9c4e-e8760476d22d-console-oauth-config\") on node \"ip-10-0-140-30.ec2.internal\" DevicePath \"\"" Jun 14 15:15:36.422196 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:36.422191 2571 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4adcc78-5391-4999-9c4e-e8760476d22d-trusted-ca-bundle\") on node \"ip-10-0-140-30.ec2.internal\" DevicePath \"\"" Jun 14 15:15:36.422196 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:36.422203 2571 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a4adcc78-5391-4999-9c4e-e8760476d22d-console-config\") on node \"ip-10-0-140-30.ec2.internal\" DevicePath \"\"" Jun 14 15:15:36.422462 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:36.422211 2571 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a4adcc78-5391-4999-9c4e-e8760476d22d-console-serving-cert\") on node \"ip-10-0-140-30.ec2.internal\" DevicePath \"\"" Jun 14 15:15:36.422462 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:36.422221 2571 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a4adcc78-5391-4999-9c4e-e8760476d22d-oauth-serving-cert\") on node \"ip-10-0-140-30.ec2.internal\" DevicePath \"\"" Jun 14 15:15:36.422462 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:36.422229 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-76nvr\" (UniqueName: \"kubernetes.io/projected/a4adcc78-5391-4999-9c4e-e8760476d22d-kube-api-access-76nvr\") on node \"ip-10-0-140-30.ec2.internal\" DevicePath \"\"" Jun 14 15:15:36.422462 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:36.422239 2571 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a4adcc78-5391-4999-9c4e-e8760476d22d-service-ca\") on node \"ip-10-0-140-30.ec2.internal\" DevicePath \"\"" Jun 14 15:15:36.786467 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:36.786433 2571 generic.go:356] "Generic (PLEG): container finished" podID="a4adcc78-5391-4999-9c4e-e8760476d22d" containerID="d9039c04901964edeb31bbde05028cb6c1e96d541c48fa804d72f7b7cc336a8a" exitCode=0 Jun 14 15:15:36.786666 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:36.786491 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-789fd8ccdf-hq298" Jun 14 15:15:36.786666 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:36.786515 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-789fd8ccdf-hq298" event={"ID":"a4adcc78-5391-4999-9c4e-e8760476d22d","Type":"ContainerDied","Data":"d9039c04901964edeb31bbde05028cb6c1e96d541c48fa804d72f7b7cc336a8a"} Jun 14 15:15:36.786666 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:36.786596 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-789fd8ccdf-hq298" event={"ID":"a4adcc78-5391-4999-9c4e-e8760476d22d","Type":"ContainerDied","Data":"5a68cab7a6b9319a20cc24784c44642439e8406881495c6bc4a8439fdf43b086"} Jun 14 15:15:36.786666 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:36.786621 2571 scope.go:117] "RemoveContainer" containerID="d9039c04901964edeb31bbde05028cb6c1e96d541c48fa804d72f7b7cc336a8a" Jun 14 15:15:36.795687 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:36.795671 2571 scope.go:117] "RemoveContainer" containerID="d9039c04901964edeb31bbde05028cb6c1e96d541c48fa804d72f7b7cc336a8a" Jun 14 15:15:36.795940 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:15:36.795917 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9039c04901964edeb31bbde05028cb6c1e96d541c48fa804d72f7b7cc336a8a\": container with ID starting with d9039c04901964edeb31bbde05028cb6c1e96d541c48fa804d72f7b7cc336a8a not found: ID does not exist" containerID="d9039c04901964edeb31bbde05028cb6c1e96d541c48fa804d72f7b7cc336a8a" Jun 14 15:15:36.796015 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:36.795951 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9039c04901964edeb31bbde05028cb6c1e96d541c48fa804d72f7b7cc336a8a"} err="failed to get container status \"d9039c04901964edeb31bbde05028cb6c1e96d541c48fa804d72f7b7cc336a8a\": rpc error: code = NotFound desc = could not find container \"d9039c04901964edeb31bbde05028cb6c1e96d541c48fa804d72f7b7cc336a8a\": container with ID starting with d9039c04901964edeb31bbde05028cb6c1e96d541c48fa804d72f7b7cc336a8a not found: ID does not exist" Jun 14 15:15:36.808858 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:36.808826 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-789fd8ccdf-hq298"] Jun 14 15:15:36.817485 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:36.817464 2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-789fd8ccdf-hq298"] Jun 14 15:15:37.304894 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:37.304863 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a4adcc78-5391-4999-9c4e-e8760476d22d" path="/var/lib/kubelet/pods/a4adcc78-5391-4999-9c4e-e8760476d22d/volumes" Jun 14 15:15:43.448388 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:43.448348 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:15:43.552758 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:43.552724 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:15:46.651782 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:46.651746 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:15:47.714576 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:15:47.714546 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-jqckm" Jun 14 15:16:08.938742 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:08.938704 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:16:08.958442 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:08.958416 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:16:09.921882 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:09.921852 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:16:20.396403 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:20.396372 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:16:21.593413 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:21.593381 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:16:22.073571 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:22.073536 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:16:22.654132 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:22.654099 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 14 15:16:22.654523 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:22.654420 2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="54e15401-8c4e-40c5-9634-d39a7c387073" containerName="alertmanager" containerID="cri-o://9f074957ff99c29ede0e04be9f6698a25581a5c89daa14e95e94233d7d84a261" gracePeriod=120 Jun 14 15:16:22.654523 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:22.654489 2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="54e15401-8c4e-40c5-9634-d39a7c387073" containerName="kube-rbac-proxy-metric" containerID="cri-o://9475a24e9a88b27ef1d87d2a63b4d6cc144a8270f57430bb5944c0679dd5836e" gracePeriod=120 Jun 14 15:16:22.654641 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:22.654524 2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="54e15401-8c4e-40c5-9634-d39a7c387073" containerName="kube-rbac-proxy-web" containerID="cri-o://b7bf6cd2a19f363c23a2060c850521764244abc06efcb7ffc1539f7b3eb25637" gracePeriod=120 Jun 14 15:16:22.654641 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:22.654553 2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="54e15401-8c4e-40c5-9634-d39a7c387073" containerName="config-reloader" containerID="cri-o://a479aed77f25eb0d09225338b84c529cb831a170530d7a420ebefbe703abf0b1" gracePeriod=120 Jun 14 15:16:22.654641 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:22.654579 2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="54e15401-8c4e-40c5-9634-d39a7c387073" containerName="kube-rbac-proxy" containerID="cri-o://3d40f5c12d51ac944cd82d22b2a6ac6670d468071dda1484cfc8d5d4014fc31f" gracePeriod=120 Jun 14 15:16:22.654641 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:22.654618 2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="54e15401-8c4e-40c5-9634-d39a7c387073" containerName="prom-label-proxy" containerID="cri-o://702eeea4d9df47f9a510794e1bcb02c1f77567bdb1691b067e7b868e798905a6" gracePeriod=120 Jun 14 15:16:22.955561 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:22.955535 2571 generic.go:356] "Generic (PLEG): container finished" podID="54e15401-8c4e-40c5-9634-d39a7c387073" containerID="702eeea4d9df47f9a510794e1bcb02c1f77567bdb1691b067e7b868e798905a6" exitCode=0 Jun 14 15:16:22.955561 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:22.955559 2571 generic.go:356] "Generic (PLEG): container finished" podID="54e15401-8c4e-40c5-9634-d39a7c387073" containerID="3d40f5c12d51ac944cd82d22b2a6ac6670d468071dda1484cfc8d5d4014fc31f" exitCode=0 Jun 14 15:16:22.955561 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:22.955566 2571 generic.go:356] "Generic (PLEG): container finished" podID="54e15401-8c4e-40c5-9634-d39a7c387073" containerID="b7bf6cd2a19f363c23a2060c850521764244abc06efcb7ffc1539f7b3eb25637" exitCode=0 Jun 14 15:16:22.955772 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:22.955573 2571 generic.go:356] "Generic (PLEG): container finished" podID="54e15401-8c4e-40c5-9634-d39a7c387073" containerID="a479aed77f25eb0d09225338b84c529cb831a170530d7a420ebefbe703abf0b1" exitCode=0 Jun 14 15:16:22.955772 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:22.955580 2571 generic.go:356] "Generic (PLEG): container finished" podID="54e15401-8c4e-40c5-9634-d39a7c387073" containerID="9f074957ff99c29ede0e04be9f6698a25581a5c89daa14e95e94233d7d84a261" exitCode=0 Jun 14 15:16:22.955772 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:22.955608 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"54e15401-8c4e-40c5-9634-d39a7c387073","Type":"ContainerDied","Data":"702eeea4d9df47f9a510794e1bcb02c1f77567bdb1691b067e7b868e798905a6"} Jun 14 15:16:22.955772 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:22.955667 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"54e15401-8c4e-40c5-9634-d39a7c387073","Type":"ContainerDied","Data":"3d40f5c12d51ac944cd82d22b2a6ac6670d468071dda1484cfc8d5d4014fc31f"} Jun 14 15:16:22.955772 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:22.955693 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"54e15401-8c4e-40c5-9634-d39a7c387073","Type":"ContainerDied","Data":"b7bf6cd2a19f363c23a2060c850521764244abc06efcb7ffc1539f7b3eb25637"} Jun 14 15:16:22.955772 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:22.955716 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"54e15401-8c4e-40c5-9634-d39a7c387073","Type":"ContainerDied","Data":"a479aed77f25eb0d09225338b84c529cb831a170530d7a420ebefbe703abf0b1"} Jun 14 15:16:22.955772 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:22.955738 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"54e15401-8c4e-40c5-9634-d39a7c387073","Type":"ContainerDied","Data":"9f074957ff99c29ede0e04be9f6698a25581a5c89daa14e95e94233d7d84a261"} Jun 14 15:16:23.892495 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:23.892472 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:16:23.963089 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:23.963035 2571 generic.go:356] "Generic (PLEG): container finished" podID="54e15401-8c4e-40c5-9634-d39a7c387073" containerID="9475a24e9a88b27ef1d87d2a63b4d6cc144a8270f57430bb5944c0679dd5836e" exitCode=0 Jun 14 15:16:23.963270 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:23.963092 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"54e15401-8c4e-40c5-9634-d39a7c387073","Type":"ContainerDied","Data":"9475a24e9a88b27ef1d87d2a63b4d6cc144a8270f57430bb5944c0679dd5836e"} Jun 14 15:16:23.963270 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:23.963166 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:16:23.963270 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:23.963191 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"54e15401-8c4e-40c5-9634-d39a7c387073","Type":"ContainerDied","Data":"b65891ac6b3b4de94c2c13f02f3cc90df8c482ec53a17686523734baa682c1e9"} Jun 14 15:16:23.963270 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:23.963243 2571 scope.go:117] "RemoveContainer" containerID="702eeea4d9df47f9a510794e1bcb02c1f77567bdb1691b067e7b868e798905a6" Jun 14 15:16:23.971923 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:23.971895 2571 scope.go:117] "RemoveContainer" containerID="9475a24e9a88b27ef1d87d2a63b4d6cc144a8270f57430bb5944c0679dd5836e" Jun 14 15:16:23.979437 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:23.979415 2571 scope.go:117] "RemoveContainer" containerID="3d40f5c12d51ac944cd82d22b2a6ac6670d468071dda1484cfc8d5d4014fc31f" Jun 14 15:16:23.987424 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:23.987397 2571 scope.go:117] "RemoveContainer" containerID="b7bf6cd2a19f363c23a2060c850521764244abc06efcb7ffc1539f7b3eb25637" Jun 14 15:16:23.995033 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:23.995008 2571 scope.go:117] "RemoveContainer" containerID="a479aed77f25eb0d09225338b84c529cb831a170530d7a420ebefbe703abf0b1" Jun 14 15:16:24.002240 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.002218 2571 scope.go:117] "RemoveContainer" containerID="9f074957ff99c29ede0e04be9f6698a25581a5c89daa14e95e94233d7d84a261" Jun 14 15:16:24.009282 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.009264 2571 scope.go:117] "RemoveContainer" containerID="651adaba339b8df78437c88d7efb6122a3d2dd04e577f16b33e2aa7137ed09d3" Jun 14 15:16:24.009418 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.009394 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/54e15401-8c4e-40c5-9634-d39a7c387073-metrics-client-ca\") pod \"54e15401-8c4e-40c5-9634-d39a7c387073\" (UID: \"54e15401-8c4e-40c5-9634-d39a7c387073\") " Jun 14 15:16:24.009476 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.009439 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/54e15401-8c4e-40c5-9634-d39a7c387073-config-volume\") pod \"54e15401-8c4e-40c5-9634-d39a7c387073\" (UID: \"54e15401-8c4e-40c5-9634-d39a7c387073\") " Jun 14 15:16:24.009476 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.009471 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/54e15401-8c4e-40c5-9634-d39a7c387073-web-config\") pod \"54e15401-8c4e-40c5-9634-d39a7c387073\" (UID: \"54e15401-8c4e-40c5-9634-d39a7c387073\") " Jun 14 15:16:24.009575 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.009507 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/54e15401-8c4e-40c5-9634-d39a7c387073-alertmanager-main-db\") pod \"54e15401-8c4e-40c5-9634-d39a7c387073\" (UID: \"54e15401-8c4e-40c5-9634-d39a7c387073\") " Jun 14 15:16:24.009575 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.009543 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54e15401-8c4e-40c5-9634-d39a7c387073-alertmanager-trusted-ca-bundle\") pod \"54e15401-8c4e-40c5-9634-d39a7c387073\" (UID: \"54e15401-8c4e-40c5-9634-d39a7c387073\") " Jun 14 15:16:24.009575 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.009568 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/54e15401-8c4e-40c5-9634-d39a7c387073-tls-assets\") pod \"54e15401-8c4e-40c5-9634-d39a7c387073\" (UID: \"54e15401-8c4e-40c5-9634-d39a7c387073\") " Jun 14 15:16:24.009724 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.009592 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/54e15401-8c4e-40c5-9634-d39a7c387073-secret-alertmanager-kube-rbac-proxy-web\") pod \"54e15401-8c4e-40c5-9634-d39a7c387073\" (UID: \"54e15401-8c4e-40c5-9634-d39a7c387073\") " Jun 14 15:16:24.009724 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.009620 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/54e15401-8c4e-40c5-9634-d39a7c387073-cluster-tls-config\") pod \"54e15401-8c4e-40c5-9634-d39a7c387073\" (UID: \"54e15401-8c4e-40c5-9634-d39a7c387073\") " Jun 14 15:16:24.009724 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.009648 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/54e15401-8c4e-40c5-9634-d39a7c387073-secret-alertmanager-kube-rbac-proxy-metric\") pod \"54e15401-8c4e-40c5-9634-d39a7c387073\" (UID: \"54e15401-8c4e-40c5-9634-d39a7c387073\") " Jun 14 15:16:24.009724 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.009685 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/54e15401-8c4e-40c5-9634-d39a7c387073-config-out\") pod \"54e15401-8c4e-40c5-9634-d39a7c387073\" (UID: \"54e15401-8c4e-40c5-9634-d39a7c387073\") " Jun 14 15:16:24.009921 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.009748 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jrq6b\" (UniqueName: \"kubernetes.io/projected/54e15401-8c4e-40c5-9634-d39a7c387073-kube-api-access-jrq6b\") pod \"54e15401-8c4e-40c5-9634-d39a7c387073\" (UID: \"54e15401-8c4e-40c5-9634-d39a7c387073\") " Jun 14 15:16:24.009921 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.009779 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/54e15401-8c4e-40c5-9634-d39a7c387073-secret-alertmanager-kube-rbac-proxy\") pod \"54e15401-8c4e-40c5-9634-d39a7c387073\" (UID: \"54e15401-8c4e-40c5-9634-d39a7c387073\") " Jun 14 15:16:24.009921 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.009808 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/54e15401-8c4e-40c5-9634-d39a7c387073-secret-alertmanager-main-tls\") pod \"54e15401-8c4e-40c5-9634-d39a7c387073\" (UID: \"54e15401-8c4e-40c5-9634-d39a7c387073\") " Jun 14 15:16:24.009921 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.009773 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54e15401-8c4e-40c5-9634-d39a7c387073-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "54e15401-8c4e-40c5-9634-d39a7c387073" (UID: "54e15401-8c4e-40c5-9634-d39a7c387073"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 15:16:24.009921 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.009777 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54e15401-8c4e-40c5-9634-d39a7c387073-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "54e15401-8c4e-40c5-9634-d39a7c387073" (UID: "54e15401-8c4e-40c5-9634-d39a7c387073"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 15:16:24.010186 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.009977 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54e15401-8c4e-40c5-9634-d39a7c387073-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "54e15401-8c4e-40c5-9634-d39a7c387073" (UID: "54e15401-8c4e-40c5-9634-d39a7c387073"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 15:16:24.010186 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.010063 2571 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/54e15401-8c4e-40c5-9634-d39a7c387073-metrics-client-ca\") on node \"ip-10-0-140-30.ec2.internal\" DevicePath \"\"" Jun 14 15:16:24.010186 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.010082 2571 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/54e15401-8c4e-40c5-9634-d39a7c387073-alertmanager-main-db\") on node \"ip-10-0-140-30.ec2.internal\" DevicePath \"\"" Jun 14 15:16:24.010186 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.010097 2571 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54e15401-8c4e-40c5-9634-d39a7c387073-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-140-30.ec2.internal\" DevicePath \"\"" Jun 14 15:16:24.013334 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.013293 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54e15401-8c4e-40c5-9634-d39a7c387073-config-out" (OuterVolumeSpecName: "config-out") pod "54e15401-8c4e-40c5-9634-d39a7c387073" (UID: "54e15401-8c4e-40c5-9634-d39a7c387073"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 15:16:24.013770 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.013676 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54e15401-8c4e-40c5-9634-d39a7c387073-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "54e15401-8c4e-40c5-9634-d39a7c387073" (UID: "54e15401-8c4e-40c5-9634-d39a7c387073"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 15:16:24.013770 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.013745 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54e15401-8c4e-40c5-9634-d39a7c387073-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "54e15401-8c4e-40c5-9634-d39a7c387073" (UID: "54e15401-8c4e-40c5-9634-d39a7c387073"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 15:16:24.013985 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.013955 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54e15401-8c4e-40c5-9634-d39a7c387073-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "54e15401-8c4e-40c5-9634-d39a7c387073" (UID: "54e15401-8c4e-40c5-9634-d39a7c387073"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 15:16:24.014091 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.014003 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54e15401-8c4e-40c5-9634-d39a7c387073-kube-api-access-jrq6b" (OuterVolumeSpecName: "kube-api-access-jrq6b") pod "54e15401-8c4e-40c5-9634-d39a7c387073" (UID: "54e15401-8c4e-40c5-9634-d39a7c387073"). InnerVolumeSpecName "kube-api-access-jrq6b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 15:16:24.014429 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.014395 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54e15401-8c4e-40c5-9634-d39a7c387073-config-volume" (OuterVolumeSpecName: "config-volume") pod "54e15401-8c4e-40c5-9634-d39a7c387073" (UID: "54e15401-8c4e-40c5-9634-d39a7c387073"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 15:16:24.014569 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.014542 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54e15401-8c4e-40c5-9634-d39a7c387073-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "54e15401-8c4e-40c5-9634-d39a7c387073" (UID: "54e15401-8c4e-40c5-9634-d39a7c387073"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 15:16:24.014669 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.014646 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54e15401-8c4e-40c5-9634-d39a7c387073-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "54e15401-8c4e-40c5-9634-d39a7c387073" (UID: "54e15401-8c4e-40c5-9634-d39a7c387073"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 15:16:24.017569 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.017546 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54e15401-8c4e-40c5-9634-d39a7c387073-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "54e15401-8c4e-40c5-9634-d39a7c387073" (UID: "54e15401-8c4e-40c5-9634-d39a7c387073"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 15:16:24.024157 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.024131 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54e15401-8c4e-40c5-9634-d39a7c387073-web-config" (OuterVolumeSpecName: "web-config") pod "54e15401-8c4e-40c5-9634-d39a7c387073" (UID: "54e15401-8c4e-40c5-9634-d39a7c387073"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 15:16:24.032026 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.032004 2571 scope.go:117] "RemoveContainer" containerID="702eeea4d9df47f9a510794e1bcb02c1f77567bdb1691b067e7b868e798905a6" Jun 14 15:16:24.032390 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:16:24.032370 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"702eeea4d9df47f9a510794e1bcb02c1f77567bdb1691b067e7b868e798905a6\": container with ID starting with 702eeea4d9df47f9a510794e1bcb02c1f77567bdb1691b067e7b868e798905a6 not found: ID does not exist" containerID="702eeea4d9df47f9a510794e1bcb02c1f77567bdb1691b067e7b868e798905a6" Jun 14 15:16:24.032479 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.032397 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"702eeea4d9df47f9a510794e1bcb02c1f77567bdb1691b067e7b868e798905a6"} err="failed to get container status \"702eeea4d9df47f9a510794e1bcb02c1f77567bdb1691b067e7b868e798905a6\": rpc error: code = NotFound desc = could not find container \"702eeea4d9df47f9a510794e1bcb02c1f77567bdb1691b067e7b868e798905a6\": container with ID starting with 702eeea4d9df47f9a510794e1bcb02c1f77567bdb1691b067e7b868e798905a6 not found: ID does not exist" Jun 14 15:16:24.032479 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.032420 2571 scope.go:117] "RemoveContainer" containerID="9475a24e9a88b27ef1d87d2a63b4d6cc144a8270f57430bb5944c0679dd5836e" Jun 14 15:16:24.032721 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:16:24.032702 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9475a24e9a88b27ef1d87d2a63b4d6cc144a8270f57430bb5944c0679dd5836e\": container with ID starting with 9475a24e9a88b27ef1d87d2a63b4d6cc144a8270f57430bb5944c0679dd5836e not found: ID does not exist" containerID="9475a24e9a88b27ef1d87d2a63b4d6cc144a8270f57430bb5944c0679dd5836e" Jun 14 15:16:24.032758 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.032729 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9475a24e9a88b27ef1d87d2a63b4d6cc144a8270f57430bb5944c0679dd5836e"} err="failed to get container status \"9475a24e9a88b27ef1d87d2a63b4d6cc144a8270f57430bb5944c0679dd5836e\": rpc error: code = NotFound desc = could not find container \"9475a24e9a88b27ef1d87d2a63b4d6cc144a8270f57430bb5944c0679dd5836e\": container with ID starting with 9475a24e9a88b27ef1d87d2a63b4d6cc144a8270f57430bb5944c0679dd5836e not found: ID does not exist" Jun 14 15:16:24.032758 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.032746 2571 scope.go:117] "RemoveContainer" containerID="3d40f5c12d51ac944cd82d22b2a6ac6670d468071dda1484cfc8d5d4014fc31f" Jun 14 15:16:24.032978 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:16:24.032959 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d40f5c12d51ac944cd82d22b2a6ac6670d468071dda1484cfc8d5d4014fc31f\": container with ID starting with 3d40f5c12d51ac944cd82d22b2a6ac6670d468071dda1484cfc8d5d4014fc31f not found: ID does not exist" containerID="3d40f5c12d51ac944cd82d22b2a6ac6670d468071dda1484cfc8d5d4014fc31f" Jun 14 15:16:24.033012 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.032985 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d40f5c12d51ac944cd82d22b2a6ac6670d468071dda1484cfc8d5d4014fc31f"} err="failed to get container status \"3d40f5c12d51ac944cd82d22b2a6ac6670d468071dda1484cfc8d5d4014fc31f\": rpc error: code = NotFound desc = could not find container \"3d40f5c12d51ac944cd82d22b2a6ac6670d468071dda1484cfc8d5d4014fc31f\": container with ID starting with 3d40f5c12d51ac944cd82d22b2a6ac6670d468071dda1484cfc8d5d4014fc31f not found: ID does not exist" Jun 14 15:16:24.033012 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.033003 2571 scope.go:117] "RemoveContainer" containerID="b7bf6cd2a19f363c23a2060c850521764244abc06efcb7ffc1539f7b3eb25637" Jun 14 15:16:24.033286 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:16:24.033268 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b7bf6cd2a19f363c23a2060c850521764244abc06efcb7ffc1539f7b3eb25637\": container with ID starting with b7bf6cd2a19f363c23a2060c850521764244abc06efcb7ffc1539f7b3eb25637 not found: ID does not exist" containerID="b7bf6cd2a19f363c23a2060c850521764244abc06efcb7ffc1539f7b3eb25637" Jun 14 15:16:24.033329 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.033290 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7bf6cd2a19f363c23a2060c850521764244abc06efcb7ffc1539f7b3eb25637"} err="failed to get container status \"b7bf6cd2a19f363c23a2060c850521764244abc06efcb7ffc1539f7b3eb25637\": rpc error: code = NotFound desc = could not find container \"b7bf6cd2a19f363c23a2060c850521764244abc06efcb7ffc1539f7b3eb25637\": container with ID starting with b7bf6cd2a19f363c23a2060c850521764244abc06efcb7ffc1539f7b3eb25637 not found: ID does not exist" Jun 14 15:16:24.033329 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.033303 2571 scope.go:117] "RemoveContainer" containerID="a479aed77f25eb0d09225338b84c529cb831a170530d7a420ebefbe703abf0b1" Jun 14 15:16:24.033541 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:16:24.033525 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a479aed77f25eb0d09225338b84c529cb831a170530d7a420ebefbe703abf0b1\": container with ID starting with a479aed77f25eb0d09225338b84c529cb831a170530d7a420ebefbe703abf0b1 not found: ID does not exist" containerID="a479aed77f25eb0d09225338b84c529cb831a170530d7a420ebefbe703abf0b1" Jun 14 15:16:24.033578 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.033546 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a479aed77f25eb0d09225338b84c529cb831a170530d7a420ebefbe703abf0b1"} err="failed to get container status \"a479aed77f25eb0d09225338b84c529cb831a170530d7a420ebefbe703abf0b1\": rpc error: code = NotFound desc = could not find container \"a479aed77f25eb0d09225338b84c529cb831a170530d7a420ebefbe703abf0b1\": container with ID starting with a479aed77f25eb0d09225338b84c529cb831a170530d7a420ebefbe703abf0b1 not found: ID does not exist" Jun 14 15:16:24.033578 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.033560 2571 scope.go:117] "RemoveContainer" containerID="9f074957ff99c29ede0e04be9f6698a25581a5c89daa14e95e94233d7d84a261" Jun 14 15:16:24.033788 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:16:24.033772 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f074957ff99c29ede0e04be9f6698a25581a5c89daa14e95e94233d7d84a261\": container with ID starting with 9f074957ff99c29ede0e04be9f6698a25581a5c89daa14e95e94233d7d84a261 not found: ID does not exist" containerID="9f074957ff99c29ede0e04be9f6698a25581a5c89daa14e95e94233d7d84a261" Jun 14 15:16:24.033838 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.033790 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f074957ff99c29ede0e04be9f6698a25581a5c89daa14e95e94233d7d84a261"} err="failed to get container status \"9f074957ff99c29ede0e04be9f6698a25581a5c89daa14e95e94233d7d84a261\": rpc error: code = NotFound desc = could not find container \"9f074957ff99c29ede0e04be9f6698a25581a5c89daa14e95e94233d7d84a261\": container with ID starting with 9f074957ff99c29ede0e04be9f6698a25581a5c89daa14e95e94233d7d84a261 not found: ID does not exist" Jun 14 15:16:24.033838 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.033803 2571 scope.go:117] "RemoveContainer" containerID="651adaba339b8df78437c88d7efb6122a3d2dd04e577f16b33e2aa7137ed09d3" Jun 14 15:16:24.034012 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:16:24.033990 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"651adaba339b8df78437c88d7efb6122a3d2dd04e577f16b33e2aa7137ed09d3\": container with ID starting with 651adaba339b8df78437c88d7efb6122a3d2dd04e577f16b33e2aa7137ed09d3 not found: ID does not exist" containerID="651adaba339b8df78437c88d7efb6122a3d2dd04e577f16b33e2aa7137ed09d3" Jun 14 15:16:24.034094 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.034021 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"651adaba339b8df78437c88d7efb6122a3d2dd04e577f16b33e2aa7137ed09d3"} err="failed to get container status \"651adaba339b8df78437c88d7efb6122a3d2dd04e577f16b33e2aa7137ed09d3\": rpc error: code = NotFound desc = could not find container \"651adaba339b8df78437c88d7efb6122a3d2dd04e577f16b33e2aa7137ed09d3\": container with ID starting with 651adaba339b8df78437c88d7efb6122a3d2dd04e577f16b33e2aa7137ed09d3 not found: ID does not exist" Jun 14 15:16:24.111508 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.111465 2571 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/54e15401-8c4e-40c5-9634-d39a7c387073-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-140-30.ec2.internal\" DevicePath \"\"" Jun 14 15:16:24.111508 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.111502 2571 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/54e15401-8c4e-40c5-9634-d39a7c387073-cluster-tls-config\") on node \"ip-10-0-140-30.ec2.internal\" DevicePath \"\"" Jun 14 15:16:24.111508 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.111514 2571 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/54e15401-8c4e-40c5-9634-d39a7c387073-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-140-30.ec2.internal\" DevicePath \"\"" Jun 14 15:16:24.111699 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.111524 2571 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/54e15401-8c4e-40c5-9634-d39a7c387073-config-out\") on node \"ip-10-0-140-30.ec2.internal\" DevicePath \"\"" Jun 14 15:16:24.111699 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.111533 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jrq6b\" (UniqueName: \"kubernetes.io/projected/54e15401-8c4e-40c5-9634-d39a7c387073-kube-api-access-jrq6b\") on node \"ip-10-0-140-30.ec2.internal\" DevicePath \"\"" Jun 14 15:16:24.111699 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.111542 2571 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/54e15401-8c4e-40c5-9634-d39a7c387073-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-140-30.ec2.internal\" DevicePath \"\"" Jun 14 15:16:24.111699 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.111551 2571 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/54e15401-8c4e-40c5-9634-d39a7c387073-secret-alertmanager-main-tls\") on node \"ip-10-0-140-30.ec2.internal\" DevicePath \"\"" Jun 14 15:16:24.111699 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.111560 2571 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/54e15401-8c4e-40c5-9634-d39a7c387073-config-volume\") on node \"ip-10-0-140-30.ec2.internal\" DevicePath \"\"" Jun 14 15:16:24.111699 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.111591 2571 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/54e15401-8c4e-40c5-9634-d39a7c387073-web-config\") on node \"ip-10-0-140-30.ec2.internal\" DevicePath \"\"" Jun 14 15:16:24.111699 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.111599 2571 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/54e15401-8c4e-40c5-9634-d39a7c387073-tls-assets\") on node \"ip-10-0-140-30.ec2.internal\" DevicePath \"\"" Jun 14 15:16:24.286097 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.286065 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 14 15:16:24.289860 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.289840 2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 14 15:16:24.317347 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.317325 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 14 15:16:24.317577 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.317566 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4adcc78-5391-4999-9c4e-e8760476d22d" containerName="console" Jun 14 15:16:24.317629 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.317578 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4adcc78-5391-4999-9c4e-e8760476d22d" containerName="console" Jun 14 15:16:24.317629 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.317588 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54e15401-8c4e-40c5-9634-d39a7c387073" containerName="prom-label-proxy" Jun 14 15:16:24.317629 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.317594 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="54e15401-8c4e-40c5-9634-d39a7c387073" containerName="prom-label-proxy" Jun 14 15:16:24.317629 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.317602 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54e15401-8c4e-40c5-9634-d39a7c387073" containerName="init-config-reloader" Jun 14 15:16:24.317629 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.317608 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="54e15401-8c4e-40c5-9634-d39a7c387073" containerName="init-config-reloader" Jun 14 15:16:24.317629 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.317617 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54e15401-8c4e-40c5-9634-d39a7c387073" containerName="kube-rbac-proxy-web" Jun 14 15:16:24.317629 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.317622 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="54e15401-8c4e-40c5-9634-d39a7c387073" containerName="kube-rbac-proxy-web" Jun 14 15:16:24.317629 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.317630 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54e15401-8c4e-40c5-9634-d39a7c387073" containerName="config-reloader" Jun 14 15:16:24.317878 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.317635 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="54e15401-8c4e-40c5-9634-d39a7c387073" containerName="config-reloader" Jun 14 15:16:24.317878 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.317646 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54e15401-8c4e-40c5-9634-d39a7c387073" containerName="alertmanager" Jun 14 15:16:24.317878 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.317651 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="54e15401-8c4e-40c5-9634-d39a7c387073" containerName="alertmanager" Jun 14 15:16:24.317878 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.317662 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54e15401-8c4e-40c5-9634-d39a7c387073" containerName="kube-rbac-proxy" Jun 14 15:16:24.317878 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.317667 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="54e15401-8c4e-40c5-9634-d39a7c387073" containerName="kube-rbac-proxy" Jun 14 15:16:24.317878 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.317673 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54e15401-8c4e-40c5-9634-d39a7c387073" containerName="kube-rbac-proxy-metric" Jun 14 15:16:24.317878 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.317678 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="54e15401-8c4e-40c5-9634-d39a7c387073" containerName="kube-rbac-proxy-metric" Jun 14 15:16:24.317878 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.317718 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="54e15401-8c4e-40c5-9634-d39a7c387073" containerName="config-reloader" Jun 14 15:16:24.317878 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.317726 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="54e15401-8c4e-40c5-9634-d39a7c387073" containerName="kube-rbac-proxy" Jun 14 15:16:24.317878 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.317732 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="54e15401-8c4e-40c5-9634-d39a7c387073" containerName="alertmanager" Jun 14 15:16:24.317878 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.317738 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="54e15401-8c4e-40c5-9634-d39a7c387073" containerName="kube-rbac-proxy-web" Jun 14 15:16:24.317878 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.317743 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="54e15401-8c4e-40c5-9634-d39a7c387073" containerName="prom-label-proxy" Jun 14 15:16:24.317878 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.317749 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="54e15401-8c4e-40c5-9634-d39a7c387073" containerName="kube-rbac-proxy-metric" Jun 14 15:16:24.317878 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.317755 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4adcc78-5391-4999-9c4e-e8760476d22d" containerName="console" Jun 14 15:16:24.321377 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.321356 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:16:24.323487 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.323465 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 14 15:16:24.323605 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.323581 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-kp98l\"" Jun 14 15:16:24.323720 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.323703 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 14 15:16:24.324139 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.324114 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 14 15:16:24.324232 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.324211 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 14 15:16:24.324294 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.324267 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 14 15:16:24.324512 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.324494 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 14 15:16:24.324606 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.324592 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 14 15:16:24.324606 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.324598 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 14 15:16:24.330127 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.330109 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 14 15:16:24.342017 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.341998 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 14 15:16:24.413782 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.413754 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7jsg\" (UniqueName: \"kubernetes.io/projected/b41b0cdd-21bd-4be8-b53e-9b7258eadaaa-kube-api-access-s7jsg\") pod \"alertmanager-main-0\" (UID: \"b41b0cdd-21bd-4be8-b53e-9b7258eadaaa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:16:24.413958 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.413788 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b41b0cdd-21bd-4be8-b53e-9b7258eadaaa-config-out\") pod \"alertmanager-main-0\" (UID: \"b41b0cdd-21bd-4be8-b53e-9b7258eadaaa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:16:24.413958 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.413810 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b41b0cdd-21bd-4be8-b53e-9b7258eadaaa-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b41b0cdd-21bd-4be8-b53e-9b7258eadaaa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:16:24.413958 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.413832 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b41b0cdd-21bd-4be8-b53e-9b7258eadaaa-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b41b0cdd-21bd-4be8-b53e-9b7258eadaaa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:16:24.413958 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.413861 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b41b0cdd-21bd-4be8-b53e-9b7258eadaaa-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b41b0cdd-21bd-4be8-b53e-9b7258eadaaa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:16:24.413958 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.413904 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b41b0cdd-21bd-4be8-b53e-9b7258eadaaa-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b41b0cdd-21bd-4be8-b53e-9b7258eadaaa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:16:24.414254 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.414017 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b41b0cdd-21bd-4be8-b53e-9b7258eadaaa-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b41b0cdd-21bd-4be8-b53e-9b7258eadaaa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:16:24.414254 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.414075 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b41b0cdd-21bd-4be8-b53e-9b7258eadaaa-config-volume\") pod \"alertmanager-main-0\" (UID: \"b41b0cdd-21bd-4be8-b53e-9b7258eadaaa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:16:24.414254 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.414116 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b41b0cdd-21bd-4be8-b53e-9b7258eadaaa-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b41b0cdd-21bd-4be8-b53e-9b7258eadaaa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:16:24.414254 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.414151 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b41b0cdd-21bd-4be8-b53e-9b7258eadaaa-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b41b0cdd-21bd-4be8-b53e-9b7258eadaaa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:16:24.414254 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.414208 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b41b0cdd-21bd-4be8-b53e-9b7258eadaaa-web-config\") pod \"alertmanager-main-0\" (UID: \"b41b0cdd-21bd-4be8-b53e-9b7258eadaaa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:16:24.414254 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.414241 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b41b0cdd-21bd-4be8-b53e-9b7258eadaaa-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b41b0cdd-21bd-4be8-b53e-9b7258eadaaa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:16:24.414451 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.414261 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b41b0cdd-21bd-4be8-b53e-9b7258eadaaa-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b41b0cdd-21bd-4be8-b53e-9b7258eadaaa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:16:24.515256 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.515214 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b41b0cdd-21bd-4be8-b53e-9b7258eadaaa-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b41b0cdd-21bd-4be8-b53e-9b7258eadaaa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:16:24.515395 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.515275 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b41b0cdd-21bd-4be8-b53e-9b7258eadaaa-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b41b0cdd-21bd-4be8-b53e-9b7258eadaaa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:16:24.515395 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.515297 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b41b0cdd-21bd-4be8-b53e-9b7258eadaaa-config-volume\") pod \"alertmanager-main-0\" (UID: \"b41b0cdd-21bd-4be8-b53e-9b7258eadaaa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:16:24.515395 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.515321 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b41b0cdd-21bd-4be8-b53e-9b7258eadaaa-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b41b0cdd-21bd-4be8-b53e-9b7258eadaaa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:16:24.515395 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.515341 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b41b0cdd-21bd-4be8-b53e-9b7258eadaaa-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b41b0cdd-21bd-4be8-b53e-9b7258eadaaa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:16:24.515395 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.515358 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b41b0cdd-21bd-4be8-b53e-9b7258eadaaa-web-config\") pod \"alertmanager-main-0\" (UID: \"b41b0cdd-21bd-4be8-b53e-9b7258eadaaa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:16:24.515395 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.515375 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b41b0cdd-21bd-4be8-b53e-9b7258eadaaa-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b41b0cdd-21bd-4be8-b53e-9b7258eadaaa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:16:24.515699 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.515399 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b41b0cdd-21bd-4be8-b53e-9b7258eadaaa-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b41b0cdd-21bd-4be8-b53e-9b7258eadaaa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:16:24.515699 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.515425 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7jsg\" (UniqueName: \"kubernetes.io/projected/b41b0cdd-21bd-4be8-b53e-9b7258eadaaa-kube-api-access-s7jsg\") pod \"alertmanager-main-0\" (UID: \"b41b0cdd-21bd-4be8-b53e-9b7258eadaaa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:16:24.515699 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.515454 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b41b0cdd-21bd-4be8-b53e-9b7258eadaaa-config-out\") pod \"alertmanager-main-0\" (UID: \"b41b0cdd-21bd-4be8-b53e-9b7258eadaaa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:16:24.515699 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.515480 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b41b0cdd-21bd-4be8-b53e-9b7258eadaaa-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b41b0cdd-21bd-4be8-b53e-9b7258eadaaa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:16:24.515699 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.515503 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b41b0cdd-21bd-4be8-b53e-9b7258eadaaa-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b41b0cdd-21bd-4be8-b53e-9b7258eadaaa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:16:24.515699 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.515531 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b41b0cdd-21bd-4be8-b53e-9b7258eadaaa-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b41b0cdd-21bd-4be8-b53e-9b7258eadaaa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:16:24.515989 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.515875 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b41b0cdd-21bd-4be8-b53e-9b7258eadaaa-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b41b0cdd-21bd-4be8-b53e-9b7258eadaaa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:16:24.517175 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.517125 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b41b0cdd-21bd-4be8-b53e-9b7258eadaaa-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b41b0cdd-21bd-4be8-b53e-9b7258eadaaa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:16:24.517500 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.517473 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b41b0cdd-21bd-4be8-b53e-9b7258eadaaa-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b41b0cdd-21bd-4be8-b53e-9b7258eadaaa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:16:24.518478 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.518450 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b41b0cdd-21bd-4be8-b53e-9b7258eadaaa-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b41b0cdd-21bd-4be8-b53e-9b7258eadaaa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:16:24.518565 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.518496 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b41b0cdd-21bd-4be8-b53e-9b7258eadaaa-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b41b0cdd-21bd-4be8-b53e-9b7258eadaaa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:16:24.518632 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.518560 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b41b0cdd-21bd-4be8-b53e-9b7258eadaaa-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b41b0cdd-21bd-4be8-b53e-9b7258eadaaa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:16:24.518707 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.518687 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b41b0cdd-21bd-4be8-b53e-9b7258eadaaa-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b41b0cdd-21bd-4be8-b53e-9b7258eadaaa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:16:24.518865 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.518841 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b41b0cdd-21bd-4be8-b53e-9b7258eadaaa-config-volume\") pod \"alertmanager-main-0\" (UID: \"b41b0cdd-21bd-4be8-b53e-9b7258eadaaa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:16:24.519076 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.519036 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b41b0cdd-21bd-4be8-b53e-9b7258eadaaa-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b41b0cdd-21bd-4be8-b53e-9b7258eadaaa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:16:24.519137 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.519120 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b41b0cdd-21bd-4be8-b53e-9b7258eadaaa-web-config\") pod \"alertmanager-main-0\" (UID: \"b41b0cdd-21bd-4be8-b53e-9b7258eadaaa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:16:24.519534 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.519513 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b41b0cdd-21bd-4be8-b53e-9b7258eadaaa-config-out\") pod \"alertmanager-main-0\" (UID: \"b41b0cdd-21bd-4be8-b53e-9b7258eadaaa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:16:24.520137 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.520119 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b41b0cdd-21bd-4be8-b53e-9b7258eadaaa-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b41b0cdd-21bd-4be8-b53e-9b7258eadaaa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:16:24.524599 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.524554 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7jsg\" (UniqueName: \"kubernetes.io/projected/b41b0cdd-21bd-4be8-b53e-9b7258eadaaa-kube-api-access-s7jsg\") pod \"alertmanager-main-0\" (UID: \"b41b0cdd-21bd-4be8-b53e-9b7258eadaaa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:16:24.631862 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.631829 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:16:24.767731 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.767703 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 14 15:16:24.771086 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:16:24.771059 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb41b0cdd_21bd_4be8_b53e_9b7258eadaaa.slice/crio-8c827d5dfac7756ac2362b3872313fc325f83e0d3cf7b6de1746a8e803100d7c WatchSource:0}: Error finding container 8c827d5dfac7756ac2362b3872313fc325f83e0d3cf7b6de1746a8e803100d7c: Status 404 returned error can't find the container with id 8c827d5dfac7756ac2362b3872313fc325f83e0d3cf7b6de1746a8e803100d7c Jun 14 15:16:24.969849 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.969817 2571 generic.go:356] "Generic (PLEG): container finished" podID="b41b0cdd-21bd-4be8-b53e-9b7258eadaaa" containerID="b4dc1381165b7c2b48035ded820e9e3805cc786808c9db28d81ead058890ab16" exitCode=0 Jun 14 15:16:24.970246 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.969863 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b41b0cdd-21bd-4be8-b53e-9b7258eadaaa","Type":"ContainerDied","Data":"b4dc1381165b7c2b48035ded820e9e3805cc786808c9db28d81ead058890ab16"} Jun 14 15:16:24.970246 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:24.969949 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b41b0cdd-21bd-4be8-b53e-9b7258eadaaa","Type":"ContainerStarted","Data":"8c827d5dfac7756ac2362b3872313fc325f83e0d3cf7b6de1746a8e803100d7c"} Jun 14 15:16:25.304423 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:25.304348 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="54e15401-8c4e-40c5-9634-d39a7c387073" path="/var/lib/kubelet/pods/54e15401-8c4e-40c5-9634-d39a7c387073/volumes" Jun 14 15:16:25.980159 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:25.980127 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b41b0cdd-21bd-4be8-b53e-9b7258eadaaa","Type":"ContainerStarted","Data":"f7fad80eb0388197d4cc3fb3e744cf4a4403972e1fb206400cc2e28050cd171e"} Jun 14 15:16:25.980546 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:25.980193 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b41b0cdd-21bd-4be8-b53e-9b7258eadaaa","Type":"ContainerStarted","Data":"ee4c36592cbe803d18ce9913fe86a6ac3d94cf99d85c79ec7977313dcae4abb4"} Jun 14 15:16:25.980546 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:25.980219 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b41b0cdd-21bd-4be8-b53e-9b7258eadaaa","Type":"ContainerStarted","Data":"af7f8985e860f70feb9a7f1b5241ddf41e96e4731e5bec4564a0b0eb61e2b5f0"} Jun 14 15:16:25.980546 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:25.980241 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b41b0cdd-21bd-4be8-b53e-9b7258eadaaa","Type":"ContainerStarted","Data":"570c643ec48c6aac1eccb1efbc090d979ef5ba83f63e8bd0ff0166b1ef447f09"} Jun 14 15:16:25.980546 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:25.980266 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b41b0cdd-21bd-4be8-b53e-9b7258eadaaa","Type":"ContainerStarted","Data":"e36e9f52fdb6f8a7120ed7d8e568fe87407c440a27ded0bf64091bf692ccd277"} Jun 14 15:16:25.980546 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:25.980290 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b41b0cdd-21bd-4be8-b53e-9b7258eadaaa","Type":"ContainerStarted","Data":"aaad324fba31c168da23bc20b674d1aebc8813a0a2323567ceeb8d89b1422e70"} Jun 14 15:16:26.008343 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:26.008222 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=1.988002871 podStartE2EDuration="2.008199586s" totalImagesPullingTime="0s" totalInitContainerRuntime="20.196715ms" isStatefulPod=false podCreationTimestamp="2026-06-14 15:16:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:16:26.006777359 +0000 UTC m=+143.188259876" watchObservedRunningTime="2026-06-14 15:16:26.008199586 +0000 UTC m=+143.189682102" Jun 14 15:16:26.986344 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:26.986309 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 14 15:16:26.986823 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:26.986619 2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="dee50442-134a-4024-81d4-c55d01e8c965" containerName="prometheus" containerID="cri-o://cbbadfe5098661c5d84f1a81df62a899bead694016bb00ab557fee7596b60f6d" gracePeriod=600 Jun 14 15:16:26.987344 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:26.986947 2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="dee50442-134a-4024-81d4-c55d01e8c965" containerName="kube-rbac-proxy-thanos" containerID="cri-o://1ad62cf1bf626f62f032e58bf1d90208cee4f00f6777db179e845489f948325d" gracePeriod=600 Jun 14 15:16:26.987344 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:26.987066 2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="dee50442-134a-4024-81d4-c55d01e8c965" containerName="kube-rbac-proxy" containerID="cri-o://678aea388aea933307537af527ff2ef6cc078112896e97f8e1ca2d2376c63360" gracePeriod=600 Jun 14 15:16:26.987344 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:26.987147 2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="dee50442-134a-4024-81d4-c55d01e8c965" containerName="kube-rbac-proxy-web" containerID="cri-o://14c74afd61e4f24d2a2cac8cc1159bd2599bd34b0122f4b42105343acc90a97e" gracePeriod=600 Jun 14 15:16:26.987344 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:26.987214 2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="dee50442-134a-4024-81d4-c55d01e8c965" containerName="thanos-sidecar" containerID="cri-o://31bdcc16778067fa775f68eb8f0492094525299a570ad9915426e1a70c4a9ec0" gracePeriod=600 Jun 14 15:16:26.987344 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:26.987279 2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="dee50442-134a-4024-81d4-c55d01e8c965" containerName="config-reloader" containerID="cri-o://74c703f30b0d934c78baa110568b79afa5fb01e2792db5942804697c0864ef83" gracePeriod=600 Jun 14 15:16:27.226231 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:27.226199 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:16:27.341661 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:27.341589 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/dee50442-134a-4024-81d4-c55d01e8c965-config\") pod \"dee50442-134a-4024-81d4-c55d01e8c965\" (UID: \"dee50442-134a-4024-81d4-c55d01e8c965\") " Jun 14 15:16:27.341661 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:27.341625 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dee50442-134a-4024-81d4-c55d01e8c965-configmap-metrics-client-ca\") pod \"dee50442-134a-4024-81d4-c55d01e8c965\" (UID: \"dee50442-134a-4024-81d4-c55d01e8c965\") " Jun 14 15:16:27.341830 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:27.341663 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dee50442-134a-4024-81d4-c55d01e8c965-prometheus-trusted-ca-bundle\") pod \"dee50442-134a-4024-81d4-c55d01e8c965\" (UID: \"dee50442-134a-4024-81d4-c55d01e8c965\") " Jun 14 15:16:27.341830 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:27.341688 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/dee50442-134a-4024-81d4-c55d01e8c965-thanos-prometheus-http-client-file\") pod \"dee50442-134a-4024-81d4-c55d01e8c965\" (UID: \"dee50442-134a-4024-81d4-c55d01e8c965\") " Jun 14 15:16:27.341830 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:27.341744 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dee50442-134a-4024-81d4-c55d01e8c965-configmap-kubelet-serving-ca-bundle\") pod \"dee50442-134a-4024-81d4-c55d01e8c965\" (UID: \"dee50442-134a-4024-81d4-c55d01e8c965\") " Jun 14 15:16:27.341830 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:27.341769 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dee50442-134a-4024-81d4-c55d01e8c965-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"dee50442-134a-4024-81d4-c55d01e8c965\" (UID: \"dee50442-134a-4024-81d4-c55d01e8c965\") " Jun 14 15:16:27.341830 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:27.341800 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/dee50442-134a-4024-81d4-c55d01e8c965-prometheus-k8s-rulefiles-1\") pod \"dee50442-134a-4024-81d4-c55d01e8c965\" (UID: \"dee50442-134a-4024-81d4-c55d01e8c965\") " Jun 14 15:16:27.342077 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:27.341841 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4wxfn\" (UniqueName: \"kubernetes.io/projected/dee50442-134a-4024-81d4-c55d01e8c965-kube-api-access-4wxfn\") pod \"dee50442-134a-4024-81d4-c55d01e8c965\" (UID: \"dee50442-134a-4024-81d4-c55d01e8c965\") " Jun 14 15:16:27.342077 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:27.341866 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/dee50442-134a-4024-81d4-c55d01e8c965-secret-metrics-client-certs\") pod \"dee50442-134a-4024-81d4-c55d01e8c965\" (UID: \"dee50442-134a-4024-81d4-c55d01e8c965\") " Jun 14 15:16:27.342077 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:27.341900 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dee50442-134a-4024-81d4-c55d01e8c965-config-out\") pod \"dee50442-134a-4024-81d4-c55d01e8c965\" (UID: \"dee50442-134a-4024-81d4-c55d01e8c965\") " Jun 14 15:16:27.342077 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:27.341923 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dee50442-134a-4024-81d4-c55d01e8c965-tls-assets\") pod \"dee50442-134a-4024-81d4-c55d01e8c965\" (UID: \"dee50442-134a-4024-81d4-c55d01e8c965\") " Jun 14 15:16:27.342077 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:27.341952 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/dee50442-134a-4024-81d4-c55d01e8c965-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"dee50442-134a-4024-81d4-c55d01e8c965\" (UID: \"dee50442-134a-4024-81d4-c55d01e8c965\") " Jun 14 15:16:27.342077 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:27.341976 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dee50442-134a-4024-81d4-c55d01e8c965-web-config\") pod \"dee50442-134a-4024-81d4-c55d01e8c965\" (UID: \"dee50442-134a-4024-81d4-c55d01e8c965\") " Jun 14 15:16:27.342077 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:27.342000 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/dee50442-134a-4024-81d4-c55d01e8c965-secret-grpc-tls\") pod \"dee50442-134a-4024-81d4-c55d01e8c965\" (UID: \"dee50442-134a-4024-81d4-c55d01e8c965\") " Jun 14 15:16:27.342077 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:27.342032 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dee50442-134a-4024-81d4-c55d01e8c965-configmap-serving-certs-ca-bundle\") pod \"dee50442-134a-4024-81d4-c55d01e8c965\" (UID: \"dee50442-134a-4024-81d4-c55d01e8c965\") " Jun 14 15:16:27.342485 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:27.342089 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/dee50442-134a-4024-81d4-c55d01e8c965-prometheus-k8s-rulefiles-0\") pod \"dee50442-134a-4024-81d4-c55d01e8c965\" (UID: \"dee50442-134a-4024-81d4-c55d01e8c965\") " Jun 14 15:16:27.342485 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:27.342086 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dee50442-134a-4024-81d4-c55d01e8c965-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "dee50442-134a-4024-81d4-c55d01e8c965" (UID: "dee50442-134a-4024-81d4-c55d01e8c965"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 15:16:27.342485 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:27.342115 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dee50442-134a-4024-81d4-c55d01e8c965-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "dee50442-134a-4024-81d4-c55d01e8c965" (UID: "dee50442-134a-4024-81d4-c55d01e8c965"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 15:16:27.342485 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:27.342124 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/dee50442-134a-4024-81d4-c55d01e8c965-secret-prometheus-k8s-tls\") pod \"dee50442-134a-4024-81d4-c55d01e8c965\" (UID: \"dee50442-134a-4024-81d4-c55d01e8c965\") " Jun 14 15:16:27.342485 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:27.342148 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/dee50442-134a-4024-81d4-c55d01e8c965-prometheus-k8s-rulefiles-2\") pod \"dee50442-134a-4024-81d4-c55d01e8c965\" (UID: \"dee50442-134a-4024-81d4-c55d01e8c965\") " Jun 14 15:16:27.342485 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:27.342176 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dee50442-134a-4024-81d4-c55d01e8c965-secret-kube-rbac-proxy\") pod \"dee50442-134a-4024-81d4-c55d01e8c965\" (UID: \"dee50442-134a-4024-81d4-c55d01e8c965\") " Jun 14 15:16:27.342485 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:27.342173 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dee50442-134a-4024-81d4-c55d01e8c965-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "dee50442-134a-4024-81d4-c55d01e8c965" (UID: "dee50442-134a-4024-81d4-c55d01e8c965"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 15:16:27.342485 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:27.342207 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/dee50442-134a-4024-81d4-c55d01e8c965-prometheus-k8s-db\") pod \"dee50442-134a-4024-81d4-c55d01e8c965\" (UID: \"dee50442-134a-4024-81d4-c55d01e8c965\") " Jun 14 15:16:27.342485 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:27.342461 2571 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dee50442-134a-4024-81d4-c55d01e8c965-configmap-metrics-client-ca\") on node \"ip-10-0-140-30.ec2.internal\" DevicePath \"\"" Jun 14 15:16:27.342485 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:27.342479 2571 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dee50442-134a-4024-81d4-c55d01e8c965-prometheus-trusted-ca-bundle\") on node \"ip-10-0-140-30.ec2.internal\" DevicePath \"\"" Jun 14 15:16:27.342978 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:27.342492 2571 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/dee50442-134a-4024-81d4-c55d01e8c965-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-140-30.ec2.internal\" DevicePath \"\"" Jun 14 15:16:27.342978 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:27.342698 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dee50442-134a-4024-81d4-c55d01e8c965-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "dee50442-134a-4024-81d4-c55d01e8c965" (UID: "dee50442-134a-4024-81d4-c55d01e8c965"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 15:16:27.342978 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:27.342959 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dee50442-134a-4024-81d4-c55d01e8c965-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "dee50442-134a-4024-81d4-c55d01e8c965" (UID: "dee50442-134a-4024-81d4-c55d01e8c965"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 15:16:27.346074 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:27.343735 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dee50442-134a-4024-81d4-c55d01e8c965-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "dee50442-134a-4024-81d4-c55d01e8c965" (UID: "dee50442-134a-4024-81d4-c55d01e8c965"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 15:16:27.346074 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:27.343953 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dee50442-134a-4024-81d4-c55d01e8c965-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "dee50442-134a-4024-81d4-c55d01e8c965" (UID: "dee50442-134a-4024-81d4-c55d01e8c965"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 15:16:27.346074 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:27.344170 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dee50442-134a-4024-81d4-c55d01e8c965-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "dee50442-134a-4024-81d4-c55d01e8c965" (UID: "dee50442-134a-4024-81d4-c55d01e8c965"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 15:16:27.346074 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:27.344332 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dee50442-134a-4024-81d4-c55d01e8c965-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "dee50442-134a-4024-81d4-c55d01e8c965" (UID: "dee50442-134a-4024-81d4-c55d01e8c965"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 15:16:27.346074 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:27.344666 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dee50442-134a-4024-81d4-c55d01e8c965-config" (OuterVolumeSpecName: "config") pod "dee50442-134a-4024-81d4-c55d01e8c965" (UID: "dee50442-134a-4024-81d4-c55d01e8c965"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 15:16:27.346074 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:27.345387 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dee50442-134a-4024-81d4-c55d01e8c965-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "dee50442-134a-4024-81d4-c55d01e8c965" (UID: "dee50442-134a-4024-81d4-c55d01e8c965"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 15:16:27.346074 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:27.345352 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dee50442-134a-4024-81d4-c55d01e8c965-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "dee50442-134a-4024-81d4-c55d01e8c965" (UID: "dee50442-134a-4024-81d4-c55d01e8c965"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 15:16:27.346074 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:27.345460 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dee50442-134a-4024-81d4-c55d01e8c965-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "dee50442-134a-4024-81d4-c55d01e8c965" (UID: "dee50442-134a-4024-81d4-c55d01e8c965"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 15:16:27.346548 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:27.346390 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dee50442-134a-4024-81d4-c55d01e8c965-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "dee50442-134a-4024-81d4-c55d01e8c965" (UID: "dee50442-134a-4024-81d4-c55d01e8c965"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 15:16:27.346548 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:27.346452 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dee50442-134a-4024-81d4-c55d01e8c965-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "dee50442-134a-4024-81d4-c55d01e8c965" (UID: "dee50442-134a-4024-81d4-c55d01e8c965"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 15:16:27.346726 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:27.346709 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dee50442-134a-4024-81d4-c55d01e8c965-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "dee50442-134a-4024-81d4-c55d01e8c965" (UID: "dee50442-134a-4024-81d4-c55d01e8c965"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 15:16:27.346987 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:27.346964 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dee50442-134a-4024-81d4-c55d01e8c965-kube-api-access-4wxfn" (OuterVolumeSpecName: "kube-api-access-4wxfn") pod "dee50442-134a-4024-81d4-c55d01e8c965" (UID: "dee50442-134a-4024-81d4-c55d01e8c965"). InnerVolumeSpecName "kube-api-access-4wxfn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 15:16:27.347114 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:27.346989 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dee50442-134a-4024-81d4-c55d01e8c965-config-out" (OuterVolumeSpecName: "config-out") pod "dee50442-134a-4024-81d4-c55d01e8c965" (UID: "dee50442-134a-4024-81d4-c55d01e8c965"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 15:16:27.347483 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:27.347464 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dee50442-134a-4024-81d4-c55d01e8c965-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "dee50442-134a-4024-81d4-c55d01e8c965" (UID: "dee50442-134a-4024-81d4-c55d01e8c965"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 15:16:27.356703 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:27.356679 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dee50442-134a-4024-81d4-c55d01e8c965-web-config" (OuterVolumeSpecName: "web-config") pod "dee50442-134a-4024-81d4-c55d01e8c965" (UID: "dee50442-134a-4024-81d4-c55d01e8c965"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 15:16:27.443395 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:27.443365 2571 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/dee50442-134a-4024-81d4-c55d01e8c965-secret-prometheus-k8s-tls\") on node \"ip-10-0-140-30.ec2.internal\" DevicePath \"\"" Jun 14 15:16:27.443395 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:27.443388 2571 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/dee50442-134a-4024-81d4-c55d01e8c965-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-140-30.ec2.internal\" DevicePath \"\"" Jun 14 15:16:27.443395 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:27.443398 2571 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dee50442-134a-4024-81d4-c55d01e8c965-secret-kube-rbac-proxy\") on node \"ip-10-0-140-30.ec2.internal\" DevicePath \"\"" Jun 14 15:16:27.443657 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:27.443406 2571 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/dee50442-134a-4024-81d4-c55d01e8c965-prometheus-k8s-db\") on node \"ip-10-0-140-30.ec2.internal\" DevicePath \"\"" Jun 14 15:16:27.443657 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:27.443415 2571 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/dee50442-134a-4024-81d4-c55d01e8c965-config\") on node \"ip-10-0-140-30.ec2.internal\" DevicePath \"\"" Jun 14 15:16:27.443657 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:27.443426 2571 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/dee50442-134a-4024-81d4-c55d01e8c965-thanos-prometheus-http-client-file\") on node \"ip-10-0-140-30.ec2.internal\" DevicePath \"\"" Jun 14 15:16:27.443657 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:27.443436 2571 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dee50442-134a-4024-81d4-c55d01e8c965-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-140-30.ec2.internal\" DevicePath \"\"" Jun 14 15:16:27.443657 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:27.443445 2571 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dee50442-134a-4024-81d4-c55d01e8c965-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-140-30.ec2.internal\" DevicePath \"\"" Jun 14 15:16:27.443657 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:27.443456 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4wxfn\" (UniqueName: \"kubernetes.io/projected/dee50442-134a-4024-81d4-c55d01e8c965-kube-api-access-4wxfn\") on node \"ip-10-0-140-30.ec2.internal\" DevicePath \"\"" Jun 14 15:16:27.443657 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:27.443465 2571 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/dee50442-134a-4024-81d4-c55d01e8c965-secret-metrics-client-certs\") on node \"ip-10-0-140-30.ec2.internal\" DevicePath \"\"" Jun 14 15:16:27.443657 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:27.443473 2571 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dee50442-134a-4024-81d4-c55d01e8c965-config-out\") on node \"ip-10-0-140-30.ec2.internal\" DevicePath \"\"" Jun 14 15:16:27.443657 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:27.443482 2571 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dee50442-134a-4024-81d4-c55d01e8c965-tls-assets\") on node \"ip-10-0-140-30.ec2.internal\" DevicePath \"\"" Jun 14 15:16:27.443657 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:27.443490 2571 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/dee50442-134a-4024-81d4-c55d01e8c965-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-140-30.ec2.internal\" DevicePath \"\"" Jun 14 15:16:27.443657 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:27.443498 2571 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dee50442-134a-4024-81d4-c55d01e8c965-web-config\") on node \"ip-10-0-140-30.ec2.internal\" DevicePath \"\"" Jun 14 15:16:27.443657 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:27.443505 2571 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/dee50442-134a-4024-81d4-c55d01e8c965-secret-grpc-tls\") on node \"ip-10-0-140-30.ec2.internal\" DevicePath \"\"" Jun 14 15:16:27.443657 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:27.443512 2571 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dee50442-134a-4024-81d4-c55d01e8c965-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-140-30.ec2.internal\" DevicePath \"\"" Jun 14 15:16:27.443657 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:27.443520 2571 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/dee50442-134a-4024-81d4-c55d01e8c965-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-140-30.ec2.internal\" DevicePath \"\"" Jun 14 15:16:27.992508 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:27.992475 2571 generic.go:356] "Generic (PLEG): container finished" podID="dee50442-134a-4024-81d4-c55d01e8c965" containerID="1ad62cf1bf626f62f032e58bf1d90208cee4f00f6777db179e845489f948325d" exitCode=0 Jun 14 15:16:27.992508 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:27.992498 2571 generic.go:356] "Generic (PLEG): container finished" podID="dee50442-134a-4024-81d4-c55d01e8c965" containerID="678aea388aea933307537af527ff2ef6cc078112896e97f8e1ca2d2376c63360" exitCode=0 Jun 14 15:16:27.992508 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:27.992507 2571 generic.go:356] "Generic (PLEG): container finished" podID="dee50442-134a-4024-81d4-c55d01e8c965" containerID="14c74afd61e4f24d2a2cac8cc1159bd2599bd34b0122f4b42105343acc90a97e" exitCode=0 Jun 14 15:16:27.992508 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:27.992513 2571 generic.go:356] "Generic (PLEG): container finished" podID="dee50442-134a-4024-81d4-c55d01e8c965" containerID="31bdcc16778067fa775f68eb8f0492094525299a570ad9915426e1a70c4a9ec0" exitCode=0 Jun 14 15:16:27.992508 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:27.992520 2571 generic.go:356] "Generic (PLEG): container finished" podID="dee50442-134a-4024-81d4-c55d01e8c965" containerID="74c703f30b0d934c78baa110568b79afa5fb01e2792db5942804697c0864ef83" exitCode=0 Jun 14 15:16:27.993171 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:27.992526 2571 generic.go:356] "Generic (PLEG): container finished" podID="dee50442-134a-4024-81d4-c55d01e8c965" containerID="cbbadfe5098661c5d84f1a81df62a899bead694016bb00ab557fee7596b60f6d" exitCode=0 Jun 14 15:16:27.993171 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:27.992550 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dee50442-134a-4024-81d4-c55d01e8c965","Type":"ContainerDied","Data":"1ad62cf1bf626f62f032e58bf1d90208cee4f00f6777db179e845489f948325d"} Jun 14 15:16:27.993171 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:27.992616 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dee50442-134a-4024-81d4-c55d01e8c965","Type":"ContainerDied","Data":"678aea388aea933307537af527ff2ef6cc078112896e97f8e1ca2d2376c63360"} Jun 14 15:16:27.993171 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:27.992557 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:16:27.993171 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:27.992647 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dee50442-134a-4024-81d4-c55d01e8c965","Type":"ContainerDied","Data":"14c74afd61e4f24d2a2cac8cc1159bd2599bd34b0122f4b42105343acc90a97e"} Jun 14 15:16:27.993171 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:27.992673 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dee50442-134a-4024-81d4-c55d01e8c965","Type":"ContainerDied","Data":"31bdcc16778067fa775f68eb8f0492094525299a570ad9915426e1a70c4a9ec0"} Jun 14 15:16:27.993171 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:27.992696 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dee50442-134a-4024-81d4-c55d01e8c965","Type":"ContainerDied","Data":"74c703f30b0d934c78baa110568b79afa5fb01e2792db5942804697c0864ef83"} Jun 14 15:16:27.993171 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:27.992720 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dee50442-134a-4024-81d4-c55d01e8c965","Type":"ContainerDied","Data":"cbbadfe5098661c5d84f1a81df62a899bead694016bb00ab557fee7596b60f6d"} Jun 14 15:16:27.993171 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:27.992723 2571 scope.go:117] "RemoveContainer" containerID="1ad62cf1bf626f62f032e58bf1d90208cee4f00f6777db179e845489f948325d" Jun 14 15:16:27.993171 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:27.992767 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dee50442-134a-4024-81d4-c55d01e8c965","Type":"ContainerDied","Data":"4a9c45f1371d21cb974eb864154f56ffbf1f0d638a5baf8a6e0b6e801c1aa546"} Jun 14 15:16:28.000909 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.000526 2571 scope.go:117] "RemoveContainer" containerID="678aea388aea933307537af527ff2ef6cc078112896e97f8e1ca2d2376c63360" Jun 14 15:16:28.016409 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.016384 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 14 15:16:28.020361 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.020340 2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 14 15:16:28.020992 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.020978 2571 scope.go:117] "RemoveContainer" containerID="14c74afd61e4f24d2a2cac8cc1159bd2599bd34b0122f4b42105343acc90a97e" Jun 14 15:16:28.027461 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.027446 2571 scope.go:117] "RemoveContainer" containerID="31bdcc16778067fa775f68eb8f0492094525299a570ad9915426e1a70c4a9ec0" Jun 14 15:16:28.033800 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.033774 2571 scope.go:117] "RemoveContainer" containerID="74c703f30b0d934c78baa110568b79afa5fb01e2792db5942804697c0864ef83" Jun 14 15:16:28.040153 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.040137 2571 scope.go:117] "RemoveContainer" containerID="cbbadfe5098661c5d84f1a81df62a899bead694016bb00ab557fee7596b60f6d" Jun 14 15:16:28.044726 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.044707 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 14 15:16:28.044974 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.044963 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dee50442-134a-4024-81d4-c55d01e8c965" containerName="kube-rbac-proxy-thanos" Jun 14 15:16:28.045013 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.044976 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="dee50442-134a-4024-81d4-c55d01e8c965" containerName="kube-rbac-proxy-thanos" Jun 14 15:16:28.045013 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.044985 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dee50442-134a-4024-81d4-c55d01e8c965" containerName="prometheus" Jun 14 15:16:28.045013 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.044990 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="dee50442-134a-4024-81d4-c55d01e8c965" containerName="prometheus" Jun 14 15:16:28.045013 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.045005 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dee50442-134a-4024-81d4-c55d01e8c965" containerName="kube-rbac-proxy" Jun 14 15:16:28.045013 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.045010 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="dee50442-134a-4024-81d4-c55d01e8c965" containerName="kube-rbac-proxy" Jun 14 15:16:28.045184 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.045021 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dee50442-134a-4024-81d4-c55d01e8c965" containerName="init-config-reloader" Jun 14 15:16:28.045184 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.045026 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="dee50442-134a-4024-81d4-c55d01e8c965" containerName="init-config-reloader" Jun 14 15:16:28.045184 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.045037 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dee50442-134a-4024-81d4-c55d01e8c965" containerName="config-reloader" Jun 14 15:16:28.045184 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.045058 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="dee50442-134a-4024-81d4-c55d01e8c965" containerName="config-reloader" Jun 14 15:16:28.045184 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.045069 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dee50442-134a-4024-81d4-c55d01e8c965" containerName="thanos-sidecar" Jun 14 15:16:28.045184 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.045075 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="dee50442-134a-4024-81d4-c55d01e8c965" containerName="thanos-sidecar" Jun 14 15:16:28.045184 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.045080 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dee50442-134a-4024-81d4-c55d01e8c965" containerName="kube-rbac-proxy-web" Jun 14 15:16:28.045184 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.045084 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="dee50442-134a-4024-81d4-c55d01e8c965" containerName="kube-rbac-proxy-web" Jun 14 15:16:28.045184 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.045142 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="dee50442-134a-4024-81d4-c55d01e8c965" containerName="kube-rbac-proxy-web" Jun 14 15:16:28.045184 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.045149 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="dee50442-134a-4024-81d4-c55d01e8c965" containerName="prometheus" Jun 14 15:16:28.045184 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.045156 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="dee50442-134a-4024-81d4-c55d01e8c965" containerName="kube-rbac-proxy-thanos" Jun 14 15:16:28.045184 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.045163 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="dee50442-134a-4024-81d4-c55d01e8c965" containerName="kube-rbac-proxy" Jun 14 15:16:28.045184 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.045170 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="dee50442-134a-4024-81d4-c55d01e8c965" containerName="config-reloader" Jun 14 15:16:28.045184 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.045175 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="dee50442-134a-4024-81d4-c55d01e8c965" containerName="thanos-sidecar" Jun 14 15:16:28.047944 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.047924 2571 scope.go:117] "RemoveContainer" containerID="56f684949369ac75afe596ab0ed4595b12c394edaa8ff6c32951861d3478675b" Jun 14 15:16:28.048892 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.048875 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:16:28.051253 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.051233 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 14 15:16:28.051357 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.051271 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 14 15:16:28.051418 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.051356 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 14 15:16:28.051587 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.051570 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-vlrxf\"" Jun 14 15:16:28.051684 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.051612 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 14 15:16:28.051684 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.051638 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 14 15:16:28.051684 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.051647 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 14 15:16:28.051843 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.051638 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 14 15:16:28.051843 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.051696 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 14 15:16:28.051971 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.051951 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 14 15:16:28.052227 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.052207 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 14 15:16:28.052227 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.052208 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 14 15:16:28.052372 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.052211 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 14 15:16:28.052372 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.052330 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 14 15:16:28.052723 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.052706 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-657mqonmbikr3\"" Jun 14 15:16:28.055396 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.055377 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 14 15:16:28.056927 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.056861 2571 scope.go:117] "RemoveContainer" containerID="1ad62cf1bf626f62f032e58bf1d90208cee4f00f6777db179e845489f948325d" Jun 14 15:16:28.057256 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:16:28.057230 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ad62cf1bf626f62f032e58bf1d90208cee4f00f6777db179e845489f948325d\": container with ID starting with 1ad62cf1bf626f62f032e58bf1d90208cee4f00f6777db179e845489f948325d not found: ID does not exist" containerID="1ad62cf1bf626f62f032e58bf1d90208cee4f00f6777db179e845489f948325d" Jun 14 15:16:28.057338 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.057265 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ad62cf1bf626f62f032e58bf1d90208cee4f00f6777db179e845489f948325d"} err="failed to get container status \"1ad62cf1bf626f62f032e58bf1d90208cee4f00f6777db179e845489f948325d\": rpc error: code = NotFound desc = could not find container \"1ad62cf1bf626f62f032e58bf1d90208cee4f00f6777db179e845489f948325d\": container with ID starting with 1ad62cf1bf626f62f032e58bf1d90208cee4f00f6777db179e845489f948325d not found: ID does not exist" Jun 14 15:16:28.057338 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.057287 2571 scope.go:117] "RemoveContainer" containerID="678aea388aea933307537af527ff2ef6cc078112896e97f8e1ca2d2376c63360" Jun 14 15:16:28.057599 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:16:28.057575 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"678aea388aea933307537af527ff2ef6cc078112896e97f8e1ca2d2376c63360\": container with ID starting with 678aea388aea933307537af527ff2ef6cc078112896e97f8e1ca2d2376c63360 not found: ID does not exist" containerID="678aea388aea933307537af527ff2ef6cc078112896e97f8e1ca2d2376c63360" Jun 14 15:16:28.057697 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.057603 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"678aea388aea933307537af527ff2ef6cc078112896e97f8e1ca2d2376c63360"} err="failed to get container status \"678aea388aea933307537af527ff2ef6cc078112896e97f8e1ca2d2376c63360\": rpc error: code = NotFound desc = could not find container \"678aea388aea933307537af527ff2ef6cc078112896e97f8e1ca2d2376c63360\": container with ID starting with 678aea388aea933307537af527ff2ef6cc078112896e97f8e1ca2d2376c63360 not found: ID does not exist" Jun 14 15:16:28.057697 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.057621 2571 scope.go:117] "RemoveContainer" containerID="14c74afd61e4f24d2a2cac8cc1159bd2599bd34b0122f4b42105343acc90a97e" Jun 14 15:16:28.057890 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:16:28.057874 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"14c74afd61e4f24d2a2cac8cc1159bd2599bd34b0122f4b42105343acc90a97e\": container with ID starting with 14c74afd61e4f24d2a2cac8cc1159bd2599bd34b0122f4b42105343acc90a97e not found: ID does not exist" containerID="14c74afd61e4f24d2a2cac8cc1159bd2599bd34b0122f4b42105343acc90a97e" Jun 14 15:16:28.057944 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.057894 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14c74afd61e4f24d2a2cac8cc1159bd2599bd34b0122f4b42105343acc90a97e"} err="failed to get container status \"14c74afd61e4f24d2a2cac8cc1159bd2599bd34b0122f4b42105343acc90a97e\": rpc error: code = NotFound desc = could not find container \"14c74afd61e4f24d2a2cac8cc1159bd2599bd34b0122f4b42105343acc90a97e\": container with ID starting with 14c74afd61e4f24d2a2cac8cc1159bd2599bd34b0122f4b42105343acc90a97e not found: ID does not exist" Jun 14 15:16:28.057944 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.057926 2571 scope.go:117] "RemoveContainer" containerID="31bdcc16778067fa775f68eb8f0492094525299a570ad9915426e1a70c4a9ec0" Jun 14 15:16:28.058245 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:16:28.058217 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"31bdcc16778067fa775f68eb8f0492094525299a570ad9915426e1a70c4a9ec0\": container with ID starting with 31bdcc16778067fa775f68eb8f0492094525299a570ad9915426e1a70c4a9ec0 not found: ID does not exist" containerID="31bdcc16778067fa775f68eb8f0492094525299a570ad9915426e1a70c4a9ec0" Jun 14 15:16:28.058333 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.058246 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 14 15:16:28.058333 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.058255 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31bdcc16778067fa775f68eb8f0492094525299a570ad9915426e1a70c4a9ec0"} err="failed to get container status \"31bdcc16778067fa775f68eb8f0492094525299a570ad9915426e1a70c4a9ec0\": rpc error: code = NotFound desc = could not find container \"31bdcc16778067fa775f68eb8f0492094525299a570ad9915426e1a70c4a9ec0\": container with ID starting with 31bdcc16778067fa775f68eb8f0492094525299a570ad9915426e1a70c4a9ec0 not found: ID does not exist" Jun 14 15:16:28.058333 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.058277 2571 scope.go:117] "RemoveContainer" containerID="74c703f30b0d934c78baa110568b79afa5fb01e2792db5942804697c0864ef83" Jun 14 15:16:28.058561 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:16:28.058542 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"74c703f30b0d934c78baa110568b79afa5fb01e2792db5942804697c0864ef83\": container with ID starting with 74c703f30b0d934c78baa110568b79afa5fb01e2792db5942804697c0864ef83 not found: ID does not exist" containerID="74c703f30b0d934c78baa110568b79afa5fb01e2792db5942804697c0864ef83" Jun 14 15:16:28.058623 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.058570 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74c703f30b0d934c78baa110568b79afa5fb01e2792db5942804697c0864ef83"} err="failed to get container status \"74c703f30b0d934c78baa110568b79afa5fb01e2792db5942804697c0864ef83\": rpc error: code = NotFound desc = could not find container \"74c703f30b0d934c78baa110568b79afa5fb01e2792db5942804697c0864ef83\": container with ID starting with 74c703f30b0d934c78baa110568b79afa5fb01e2792db5942804697c0864ef83 not found: ID does not exist" Jun 14 15:16:28.058623 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.058590 2571 scope.go:117] "RemoveContainer" containerID="cbbadfe5098661c5d84f1a81df62a899bead694016bb00ab557fee7596b60f6d" Jun 14 15:16:28.058886 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:16:28.058869 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cbbadfe5098661c5d84f1a81df62a899bead694016bb00ab557fee7596b60f6d\": container with ID starting with cbbadfe5098661c5d84f1a81df62a899bead694016bb00ab557fee7596b60f6d not found: ID does not exist" containerID="cbbadfe5098661c5d84f1a81df62a899bead694016bb00ab557fee7596b60f6d" Jun 14 15:16:28.058931 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.058891 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cbbadfe5098661c5d84f1a81df62a899bead694016bb00ab557fee7596b60f6d"} err="failed to get container status \"cbbadfe5098661c5d84f1a81df62a899bead694016bb00ab557fee7596b60f6d\": rpc error: code = NotFound desc = could not find container \"cbbadfe5098661c5d84f1a81df62a899bead694016bb00ab557fee7596b60f6d\": container with ID starting with cbbadfe5098661c5d84f1a81df62a899bead694016bb00ab557fee7596b60f6d not found: ID does not exist" Jun 14 15:16:28.058931 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.058906 2571 scope.go:117] "RemoveContainer" containerID="56f684949369ac75afe596ab0ed4595b12c394edaa8ff6c32951861d3478675b" Jun 14 15:16:28.059171 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:16:28.059150 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"56f684949369ac75afe596ab0ed4595b12c394edaa8ff6c32951861d3478675b\": container with ID starting with 56f684949369ac75afe596ab0ed4595b12c394edaa8ff6c32951861d3478675b not found: ID does not exist" containerID="56f684949369ac75afe596ab0ed4595b12c394edaa8ff6c32951861d3478675b" Jun 14 15:16:28.059249 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.059179 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56f684949369ac75afe596ab0ed4595b12c394edaa8ff6c32951861d3478675b"} err="failed to get container status \"56f684949369ac75afe596ab0ed4595b12c394edaa8ff6c32951861d3478675b\": rpc error: code = NotFound desc = could not find container \"56f684949369ac75afe596ab0ed4595b12c394edaa8ff6c32951861d3478675b\": container with ID starting with 56f684949369ac75afe596ab0ed4595b12c394edaa8ff6c32951861d3478675b not found: ID does not exist" Jun 14 15:16:28.059249 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.059200 2571 scope.go:117] "RemoveContainer" containerID="1ad62cf1bf626f62f032e58bf1d90208cee4f00f6777db179e845489f948325d" Jun 14 15:16:28.059450 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.059433 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ad62cf1bf626f62f032e58bf1d90208cee4f00f6777db179e845489f948325d"} err="failed to get container status \"1ad62cf1bf626f62f032e58bf1d90208cee4f00f6777db179e845489f948325d\": rpc error: code = NotFound desc = could not find container \"1ad62cf1bf626f62f032e58bf1d90208cee4f00f6777db179e845489f948325d\": container with ID starting with 1ad62cf1bf626f62f032e58bf1d90208cee4f00f6777db179e845489f948325d not found: ID does not exist" Jun 14 15:16:28.059512 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.059452 2571 scope.go:117] "RemoveContainer" containerID="678aea388aea933307537af527ff2ef6cc078112896e97f8e1ca2d2376c63360" Jun 14 15:16:28.059686 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.059669 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"678aea388aea933307537af527ff2ef6cc078112896e97f8e1ca2d2376c63360"} err="failed to get container status \"678aea388aea933307537af527ff2ef6cc078112896e97f8e1ca2d2376c63360\": rpc error: code = NotFound desc = could not find container \"678aea388aea933307537af527ff2ef6cc078112896e97f8e1ca2d2376c63360\": container with ID starting with 678aea388aea933307537af527ff2ef6cc078112896e97f8e1ca2d2376c63360 not found: ID does not exist" Jun 14 15:16:28.059735 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.059688 2571 scope.go:117] "RemoveContainer" containerID="14c74afd61e4f24d2a2cac8cc1159bd2599bd34b0122f4b42105343acc90a97e" Jun 14 15:16:28.059915 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.059894 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14c74afd61e4f24d2a2cac8cc1159bd2599bd34b0122f4b42105343acc90a97e"} err="failed to get container status \"14c74afd61e4f24d2a2cac8cc1159bd2599bd34b0122f4b42105343acc90a97e\": rpc error: code = NotFound desc = could not find container \"14c74afd61e4f24d2a2cac8cc1159bd2599bd34b0122f4b42105343acc90a97e\": container with ID starting with 14c74afd61e4f24d2a2cac8cc1159bd2599bd34b0122f4b42105343acc90a97e not found: ID does not exist" Jun 14 15:16:28.059981 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.059916 2571 scope.go:117] "RemoveContainer" containerID="31bdcc16778067fa775f68eb8f0492094525299a570ad9915426e1a70c4a9ec0" Jun 14 15:16:28.060150 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.060132 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31bdcc16778067fa775f68eb8f0492094525299a570ad9915426e1a70c4a9ec0"} err="failed to get container status \"31bdcc16778067fa775f68eb8f0492094525299a570ad9915426e1a70c4a9ec0\": rpc error: code = NotFound desc = could not find container \"31bdcc16778067fa775f68eb8f0492094525299a570ad9915426e1a70c4a9ec0\": container with ID starting with 31bdcc16778067fa775f68eb8f0492094525299a570ad9915426e1a70c4a9ec0 not found: ID does not exist" Jun 14 15:16:28.060212 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.060151 2571 scope.go:117] "RemoveContainer" containerID="74c703f30b0d934c78baa110568b79afa5fb01e2792db5942804697c0864ef83" Jun 14 15:16:28.060385 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.060365 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74c703f30b0d934c78baa110568b79afa5fb01e2792db5942804697c0864ef83"} err="failed to get container status \"74c703f30b0d934c78baa110568b79afa5fb01e2792db5942804697c0864ef83\": rpc error: code = NotFound desc = could not find container \"74c703f30b0d934c78baa110568b79afa5fb01e2792db5942804697c0864ef83\": container with ID starting with 74c703f30b0d934c78baa110568b79afa5fb01e2792db5942804697c0864ef83 not found: ID does not exist" Jun 14 15:16:28.060435 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.060385 2571 scope.go:117] "RemoveContainer" containerID="cbbadfe5098661c5d84f1a81df62a899bead694016bb00ab557fee7596b60f6d" Jun 14 15:16:28.060596 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.060579 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cbbadfe5098661c5d84f1a81df62a899bead694016bb00ab557fee7596b60f6d"} err="failed to get container status \"cbbadfe5098661c5d84f1a81df62a899bead694016bb00ab557fee7596b60f6d\": rpc error: code = NotFound desc = could not find container \"cbbadfe5098661c5d84f1a81df62a899bead694016bb00ab557fee7596b60f6d\": container with ID starting with cbbadfe5098661c5d84f1a81df62a899bead694016bb00ab557fee7596b60f6d not found: ID does not exist" Jun 14 15:16:28.060656 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.060598 2571 scope.go:117] "RemoveContainer" containerID="56f684949369ac75afe596ab0ed4595b12c394edaa8ff6c32951861d3478675b" Jun 14 15:16:28.060831 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.060806 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56f684949369ac75afe596ab0ed4595b12c394edaa8ff6c32951861d3478675b"} err="failed to get container status \"56f684949369ac75afe596ab0ed4595b12c394edaa8ff6c32951861d3478675b\": rpc error: code = NotFound desc = could not find container \"56f684949369ac75afe596ab0ed4595b12c394edaa8ff6c32951861d3478675b\": container with ID starting with 56f684949369ac75afe596ab0ed4595b12c394edaa8ff6c32951861d3478675b not found: ID does not exist" Jun 14 15:16:28.060831 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.060829 2571 scope.go:117] "RemoveContainer" containerID="1ad62cf1bf626f62f032e58bf1d90208cee4f00f6777db179e845489f948325d" Jun 14 15:16:28.061012 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.060995 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ad62cf1bf626f62f032e58bf1d90208cee4f00f6777db179e845489f948325d"} err="failed to get container status \"1ad62cf1bf626f62f032e58bf1d90208cee4f00f6777db179e845489f948325d\": rpc error: code = NotFound desc = could not find container \"1ad62cf1bf626f62f032e58bf1d90208cee4f00f6777db179e845489f948325d\": container with ID starting with 1ad62cf1bf626f62f032e58bf1d90208cee4f00f6777db179e845489f948325d not found: ID does not exist" Jun 14 15:16:28.061076 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.061014 2571 scope.go:117] "RemoveContainer" containerID="678aea388aea933307537af527ff2ef6cc078112896e97f8e1ca2d2376c63360" Jun 14 15:16:28.061278 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.061261 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"678aea388aea933307537af527ff2ef6cc078112896e97f8e1ca2d2376c63360"} err="failed to get container status \"678aea388aea933307537af527ff2ef6cc078112896e97f8e1ca2d2376c63360\": rpc error: code = NotFound desc = could not find container \"678aea388aea933307537af527ff2ef6cc078112896e97f8e1ca2d2376c63360\": container with ID starting with 678aea388aea933307537af527ff2ef6cc078112896e97f8e1ca2d2376c63360 not found: ID does not exist" Jun 14 15:16:28.061325 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.061278 2571 scope.go:117] "RemoveContainer" containerID="14c74afd61e4f24d2a2cac8cc1159bd2599bd34b0122f4b42105343acc90a97e" Jun 14 15:16:28.061489 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.061471 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14c74afd61e4f24d2a2cac8cc1159bd2599bd34b0122f4b42105343acc90a97e"} err="failed to get container status \"14c74afd61e4f24d2a2cac8cc1159bd2599bd34b0122f4b42105343acc90a97e\": rpc error: code = NotFound desc = could not find container \"14c74afd61e4f24d2a2cac8cc1159bd2599bd34b0122f4b42105343acc90a97e\": container with ID starting with 14c74afd61e4f24d2a2cac8cc1159bd2599bd34b0122f4b42105343acc90a97e not found: ID does not exist" Jun 14 15:16:28.061531 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.061490 2571 scope.go:117] "RemoveContainer" containerID="31bdcc16778067fa775f68eb8f0492094525299a570ad9915426e1a70c4a9ec0" Jun 14 15:16:28.061694 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.061673 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31bdcc16778067fa775f68eb8f0492094525299a570ad9915426e1a70c4a9ec0"} err="failed to get container status \"31bdcc16778067fa775f68eb8f0492094525299a570ad9915426e1a70c4a9ec0\": rpc error: code = NotFound desc = could not find container \"31bdcc16778067fa775f68eb8f0492094525299a570ad9915426e1a70c4a9ec0\": container with ID starting with 31bdcc16778067fa775f68eb8f0492094525299a570ad9915426e1a70c4a9ec0 not found: ID does not exist" Jun 14 15:16:28.061737 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.061695 2571 scope.go:117] "RemoveContainer" containerID="74c703f30b0d934c78baa110568b79afa5fb01e2792db5942804697c0864ef83" Jun 14 15:16:28.061888 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.061872 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74c703f30b0d934c78baa110568b79afa5fb01e2792db5942804697c0864ef83"} err="failed to get container status \"74c703f30b0d934c78baa110568b79afa5fb01e2792db5942804697c0864ef83\": rpc error: code = NotFound desc = could not find container \"74c703f30b0d934c78baa110568b79afa5fb01e2792db5942804697c0864ef83\": container with ID starting with 74c703f30b0d934c78baa110568b79afa5fb01e2792db5942804697c0864ef83 not found: ID does not exist" Jun 14 15:16:28.061929 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.061891 2571 scope.go:117] "RemoveContainer" containerID="cbbadfe5098661c5d84f1a81df62a899bead694016bb00ab557fee7596b60f6d" Jun 14 15:16:28.062118 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.062102 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cbbadfe5098661c5d84f1a81df62a899bead694016bb00ab557fee7596b60f6d"} err="failed to get container status \"cbbadfe5098661c5d84f1a81df62a899bead694016bb00ab557fee7596b60f6d\": rpc error: code = NotFound desc = could not find container \"cbbadfe5098661c5d84f1a81df62a899bead694016bb00ab557fee7596b60f6d\": container with ID starting with cbbadfe5098661c5d84f1a81df62a899bead694016bb00ab557fee7596b60f6d not found: ID does not exist" Jun 14 15:16:28.062165 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.062118 2571 scope.go:117] "RemoveContainer" containerID="56f684949369ac75afe596ab0ed4595b12c394edaa8ff6c32951861d3478675b" Jun 14 15:16:28.062324 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.062307 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56f684949369ac75afe596ab0ed4595b12c394edaa8ff6c32951861d3478675b"} err="failed to get container status \"56f684949369ac75afe596ab0ed4595b12c394edaa8ff6c32951861d3478675b\": rpc error: code = NotFound desc = could not find container \"56f684949369ac75afe596ab0ed4595b12c394edaa8ff6c32951861d3478675b\": container with ID starting with 56f684949369ac75afe596ab0ed4595b12c394edaa8ff6c32951861d3478675b not found: ID does not exist" Jun 14 15:16:28.062362 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.062324 2571 scope.go:117] "RemoveContainer" containerID="1ad62cf1bf626f62f032e58bf1d90208cee4f00f6777db179e845489f948325d" Jun 14 15:16:28.062549 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.062531 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ad62cf1bf626f62f032e58bf1d90208cee4f00f6777db179e845489f948325d"} err="failed to get container status \"1ad62cf1bf626f62f032e58bf1d90208cee4f00f6777db179e845489f948325d\": rpc error: code = NotFound desc = could not find container \"1ad62cf1bf626f62f032e58bf1d90208cee4f00f6777db179e845489f948325d\": container with ID starting with 1ad62cf1bf626f62f032e58bf1d90208cee4f00f6777db179e845489f948325d not found: ID does not exist" Jun 14 15:16:28.062613 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.062551 2571 scope.go:117] "RemoveContainer" containerID="678aea388aea933307537af527ff2ef6cc078112896e97f8e1ca2d2376c63360" Jun 14 15:16:28.062784 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.062767 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"678aea388aea933307537af527ff2ef6cc078112896e97f8e1ca2d2376c63360"} err="failed to get container status \"678aea388aea933307537af527ff2ef6cc078112896e97f8e1ca2d2376c63360\": rpc error: code = NotFound desc = could not find container \"678aea388aea933307537af527ff2ef6cc078112896e97f8e1ca2d2376c63360\": container with ID starting with 678aea388aea933307537af527ff2ef6cc078112896e97f8e1ca2d2376c63360 not found: ID does not exist" Jun 14 15:16:28.062874 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.062783 2571 scope.go:117] "RemoveContainer" containerID="14c74afd61e4f24d2a2cac8cc1159bd2599bd34b0122f4b42105343acc90a97e" Jun 14 15:16:28.062970 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.062956 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14c74afd61e4f24d2a2cac8cc1159bd2599bd34b0122f4b42105343acc90a97e"} err="failed to get container status \"14c74afd61e4f24d2a2cac8cc1159bd2599bd34b0122f4b42105343acc90a97e\": rpc error: code = NotFound desc = could not find container \"14c74afd61e4f24d2a2cac8cc1159bd2599bd34b0122f4b42105343acc90a97e\": container with ID starting with 14c74afd61e4f24d2a2cac8cc1159bd2599bd34b0122f4b42105343acc90a97e not found: ID does not exist" Jun 14 15:16:28.063009 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.062969 2571 scope.go:117] "RemoveContainer" containerID="31bdcc16778067fa775f68eb8f0492094525299a570ad9915426e1a70c4a9ec0" Jun 14 15:16:28.063205 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.063187 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31bdcc16778067fa775f68eb8f0492094525299a570ad9915426e1a70c4a9ec0"} err="failed to get container status \"31bdcc16778067fa775f68eb8f0492094525299a570ad9915426e1a70c4a9ec0\": rpc error: code = NotFound desc = could not find container \"31bdcc16778067fa775f68eb8f0492094525299a570ad9915426e1a70c4a9ec0\": container with ID starting with 31bdcc16778067fa775f68eb8f0492094525299a570ad9915426e1a70c4a9ec0 not found: ID does not exist" Jun 14 15:16:28.063260 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.063214 2571 scope.go:117] "RemoveContainer" containerID="74c703f30b0d934c78baa110568b79afa5fb01e2792db5942804697c0864ef83" Jun 14 15:16:28.063447 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.063421 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74c703f30b0d934c78baa110568b79afa5fb01e2792db5942804697c0864ef83"} err="failed to get container status \"74c703f30b0d934c78baa110568b79afa5fb01e2792db5942804697c0864ef83\": rpc error: code = NotFound desc = could not find container \"74c703f30b0d934c78baa110568b79afa5fb01e2792db5942804697c0864ef83\": container with ID starting with 74c703f30b0d934c78baa110568b79afa5fb01e2792db5942804697c0864ef83 not found: ID does not exist" Jun 14 15:16:28.063516 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.063448 2571 scope.go:117] "RemoveContainer" containerID="cbbadfe5098661c5d84f1a81df62a899bead694016bb00ab557fee7596b60f6d" Jun 14 15:16:28.063674 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.063658 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cbbadfe5098661c5d84f1a81df62a899bead694016bb00ab557fee7596b60f6d"} err="failed to get container status \"cbbadfe5098661c5d84f1a81df62a899bead694016bb00ab557fee7596b60f6d\": rpc error: code = NotFound desc = could not find container \"cbbadfe5098661c5d84f1a81df62a899bead694016bb00ab557fee7596b60f6d\": container with ID starting with cbbadfe5098661c5d84f1a81df62a899bead694016bb00ab557fee7596b60f6d not found: ID does not exist" Jun 14 15:16:28.063723 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.063675 2571 scope.go:117] "RemoveContainer" containerID="56f684949369ac75afe596ab0ed4595b12c394edaa8ff6c32951861d3478675b" Jun 14 15:16:28.063883 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.063868 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56f684949369ac75afe596ab0ed4595b12c394edaa8ff6c32951861d3478675b"} err="failed to get container status \"56f684949369ac75afe596ab0ed4595b12c394edaa8ff6c32951861d3478675b\": rpc error: code = NotFound desc = could not find container \"56f684949369ac75afe596ab0ed4595b12c394edaa8ff6c32951861d3478675b\": container with ID starting with 56f684949369ac75afe596ab0ed4595b12c394edaa8ff6c32951861d3478675b not found: ID does not exist" Jun 14 15:16:28.063923 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.063883 2571 scope.go:117] "RemoveContainer" containerID="1ad62cf1bf626f62f032e58bf1d90208cee4f00f6777db179e845489f948325d" Jun 14 15:16:28.064097 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.064079 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ad62cf1bf626f62f032e58bf1d90208cee4f00f6777db179e845489f948325d"} err="failed to get container status \"1ad62cf1bf626f62f032e58bf1d90208cee4f00f6777db179e845489f948325d\": rpc error: code = NotFound desc = could not find container \"1ad62cf1bf626f62f032e58bf1d90208cee4f00f6777db179e845489f948325d\": container with ID starting with 1ad62cf1bf626f62f032e58bf1d90208cee4f00f6777db179e845489f948325d not found: ID does not exist" Jun 14 15:16:28.064173 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.064100 2571 scope.go:117] "RemoveContainer" containerID="678aea388aea933307537af527ff2ef6cc078112896e97f8e1ca2d2376c63360" Jun 14 15:16:28.064371 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.064353 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"678aea388aea933307537af527ff2ef6cc078112896e97f8e1ca2d2376c63360"} err="failed to get container status \"678aea388aea933307537af527ff2ef6cc078112896e97f8e1ca2d2376c63360\": rpc error: code = NotFound desc = could not find container \"678aea388aea933307537af527ff2ef6cc078112896e97f8e1ca2d2376c63360\": container with ID starting with 678aea388aea933307537af527ff2ef6cc078112896e97f8e1ca2d2376c63360 not found: ID does not exist" Jun 14 15:16:28.064371 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.064371 2571 scope.go:117] "RemoveContainer" containerID="14c74afd61e4f24d2a2cac8cc1159bd2599bd34b0122f4b42105343acc90a97e" Jun 14 15:16:28.064618 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.064595 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14c74afd61e4f24d2a2cac8cc1159bd2599bd34b0122f4b42105343acc90a97e"} err="failed to get container status \"14c74afd61e4f24d2a2cac8cc1159bd2599bd34b0122f4b42105343acc90a97e\": rpc error: code = NotFound desc = could not find container \"14c74afd61e4f24d2a2cac8cc1159bd2599bd34b0122f4b42105343acc90a97e\": container with ID starting with 14c74afd61e4f24d2a2cac8cc1159bd2599bd34b0122f4b42105343acc90a97e not found: ID does not exist" Jun 14 15:16:28.064693 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.064620 2571 scope.go:117] "RemoveContainer" containerID="31bdcc16778067fa775f68eb8f0492094525299a570ad9915426e1a70c4a9ec0" Jun 14 15:16:28.064871 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.064847 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31bdcc16778067fa775f68eb8f0492094525299a570ad9915426e1a70c4a9ec0"} err="failed to get container status \"31bdcc16778067fa775f68eb8f0492094525299a570ad9915426e1a70c4a9ec0\": rpc error: code = NotFound desc = could not find container \"31bdcc16778067fa775f68eb8f0492094525299a570ad9915426e1a70c4a9ec0\": container with ID starting with 31bdcc16778067fa775f68eb8f0492094525299a570ad9915426e1a70c4a9ec0 not found: ID does not exist" Jun 14 15:16:28.064933 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.064873 2571 scope.go:117] "RemoveContainer" containerID="74c703f30b0d934c78baa110568b79afa5fb01e2792db5942804697c0864ef83" Jun 14 15:16:28.065144 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.065127 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74c703f30b0d934c78baa110568b79afa5fb01e2792db5942804697c0864ef83"} err="failed to get container status \"74c703f30b0d934c78baa110568b79afa5fb01e2792db5942804697c0864ef83\": rpc error: code = NotFound desc = could not find container \"74c703f30b0d934c78baa110568b79afa5fb01e2792db5942804697c0864ef83\": container with ID starting with 74c703f30b0d934c78baa110568b79afa5fb01e2792db5942804697c0864ef83 not found: ID does not exist" Jun 14 15:16:28.065212 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.065145 2571 scope.go:117] "RemoveContainer" containerID="cbbadfe5098661c5d84f1a81df62a899bead694016bb00ab557fee7596b60f6d" Jun 14 15:16:28.065356 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.065338 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cbbadfe5098661c5d84f1a81df62a899bead694016bb00ab557fee7596b60f6d"} err="failed to get container status \"cbbadfe5098661c5d84f1a81df62a899bead694016bb00ab557fee7596b60f6d\": rpc error: code = NotFound desc = could not find container \"cbbadfe5098661c5d84f1a81df62a899bead694016bb00ab557fee7596b60f6d\": container with ID starting with cbbadfe5098661c5d84f1a81df62a899bead694016bb00ab557fee7596b60f6d not found: ID does not exist" Jun 14 15:16:28.065405 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.065357 2571 scope.go:117] "RemoveContainer" containerID="56f684949369ac75afe596ab0ed4595b12c394edaa8ff6c32951861d3478675b" Jun 14 15:16:28.065593 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.065577 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56f684949369ac75afe596ab0ed4595b12c394edaa8ff6c32951861d3478675b"} err="failed to get container status \"56f684949369ac75afe596ab0ed4595b12c394edaa8ff6c32951861d3478675b\": rpc error: code = NotFound desc = could not find container \"56f684949369ac75afe596ab0ed4595b12c394edaa8ff6c32951861d3478675b\": container with ID starting with 56f684949369ac75afe596ab0ed4595b12c394edaa8ff6c32951861d3478675b not found: ID does not exist" Jun 14 15:16:28.065593 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.065592 2571 scope.go:117] "RemoveContainer" containerID="1ad62cf1bf626f62f032e58bf1d90208cee4f00f6777db179e845489f948325d" Jun 14 15:16:28.065825 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.065808 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ad62cf1bf626f62f032e58bf1d90208cee4f00f6777db179e845489f948325d"} err="failed to get container status \"1ad62cf1bf626f62f032e58bf1d90208cee4f00f6777db179e845489f948325d\": rpc error: code = NotFound desc = could not find container \"1ad62cf1bf626f62f032e58bf1d90208cee4f00f6777db179e845489f948325d\": container with ID starting with 1ad62cf1bf626f62f032e58bf1d90208cee4f00f6777db179e845489f948325d not found: ID does not exist" Jun 14 15:16:28.065886 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.065826 2571 scope.go:117] "RemoveContainer" containerID="678aea388aea933307537af527ff2ef6cc078112896e97f8e1ca2d2376c63360" Jun 14 15:16:28.066179 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.066154 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"678aea388aea933307537af527ff2ef6cc078112896e97f8e1ca2d2376c63360"} err="failed to get container status \"678aea388aea933307537af527ff2ef6cc078112896e97f8e1ca2d2376c63360\": rpc error: code = NotFound desc = could not find container \"678aea388aea933307537af527ff2ef6cc078112896e97f8e1ca2d2376c63360\": container with ID starting with 678aea388aea933307537af527ff2ef6cc078112896e97f8e1ca2d2376c63360 not found: ID does not exist" Jun 14 15:16:28.066430 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.066180 2571 scope.go:117] "RemoveContainer" containerID="14c74afd61e4f24d2a2cac8cc1159bd2599bd34b0122f4b42105343acc90a97e" Jun 14 15:16:28.066499 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.066429 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14c74afd61e4f24d2a2cac8cc1159bd2599bd34b0122f4b42105343acc90a97e"} err="failed to get container status \"14c74afd61e4f24d2a2cac8cc1159bd2599bd34b0122f4b42105343acc90a97e\": rpc error: code = NotFound desc = could not find container \"14c74afd61e4f24d2a2cac8cc1159bd2599bd34b0122f4b42105343acc90a97e\": container with ID starting with 14c74afd61e4f24d2a2cac8cc1159bd2599bd34b0122f4b42105343acc90a97e not found: ID does not exist" Jun 14 15:16:28.066499 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.066448 2571 scope.go:117] "RemoveContainer" containerID="31bdcc16778067fa775f68eb8f0492094525299a570ad9915426e1a70c4a9ec0" Jun 14 15:16:28.066825 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.066717 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31bdcc16778067fa775f68eb8f0492094525299a570ad9915426e1a70c4a9ec0"} err="failed to get container status \"31bdcc16778067fa775f68eb8f0492094525299a570ad9915426e1a70c4a9ec0\": rpc error: code = NotFound desc = could not find container \"31bdcc16778067fa775f68eb8f0492094525299a570ad9915426e1a70c4a9ec0\": container with ID starting with 31bdcc16778067fa775f68eb8f0492094525299a570ad9915426e1a70c4a9ec0 not found: ID does not exist" Jun 14 15:16:28.066825 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.066741 2571 scope.go:117] "RemoveContainer" containerID="74c703f30b0d934c78baa110568b79afa5fb01e2792db5942804697c0864ef83" Jun 14 15:16:28.067081 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.067042 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74c703f30b0d934c78baa110568b79afa5fb01e2792db5942804697c0864ef83"} err="failed to get container status \"74c703f30b0d934c78baa110568b79afa5fb01e2792db5942804697c0864ef83\": rpc error: code = NotFound desc = could not find container \"74c703f30b0d934c78baa110568b79afa5fb01e2792db5942804697c0864ef83\": container with ID starting with 74c703f30b0d934c78baa110568b79afa5fb01e2792db5942804697c0864ef83 not found: ID does not exist" Jun 14 15:16:28.067176 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.067083 2571 scope.go:117] "RemoveContainer" containerID="cbbadfe5098661c5d84f1a81df62a899bead694016bb00ab557fee7596b60f6d" Jun 14 15:16:28.067362 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.067338 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cbbadfe5098661c5d84f1a81df62a899bead694016bb00ab557fee7596b60f6d"} err="failed to get container status \"cbbadfe5098661c5d84f1a81df62a899bead694016bb00ab557fee7596b60f6d\": rpc error: code = NotFound desc = could not find container \"cbbadfe5098661c5d84f1a81df62a899bead694016bb00ab557fee7596b60f6d\": container with ID starting with cbbadfe5098661c5d84f1a81df62a899bead694016bb00ab557fee7596b60f6d not found: ID does not exist" Jun 14 15:16:28.067584 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.067363 2571 scope.go:117] "RemoveContainer" containerID="56f684949369ac75afe596ab0ed4595b12c394edaa8ff6c32951861d3478675b" Jun 14 15:16:28.067646 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.067596 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56f684949369ac75afe596ab0ed4595b12c394edaa8ff6c32951861d3478675b"} err="failed to get container status \"56f684949369ac75afe596ab0ed4595b12c394edaa8ff6c32951861d3478675b\": rpc error: code = NotFound desc = could not find container \"56f684949369ac75afe596ab0ed4595b12c394edaa8ff6c32951861d3478675b\": container with ID starting with 56f684949369ac75afe596ab0ed4595b12c394edaa8ff6c32951861d3478675b not found: ID does not exist" Jun 14 15:16:28.071190 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.071170 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 14 15:16:28.148263 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.148234 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/554ee61b-8c35-46ce-98dc-c75d431491f5-config\") pod \"prometheus-k8s-0\" (UID: \"554ee61b-8c35-46ce-98dc-c75d431491f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:16:28.148385 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.148270 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/554ee61b-8c35-46ce-98dc-c75d431491f5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"554ee61b-8c35-46ce-98dc-c75d431491f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:16:28.148385 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.148295 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/554ee61b-8c35-46ce-98dc-c75d431491f5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"554ee61b-8c35-46ce-98dc-c75d431491f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:16:28.148385 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.148355 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/554ee61b-8c35-46ce-98dc-c75d431491f5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"554ee61b-8c35-46ce-98dc-c75d431491f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:16:28.148492 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.148384 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/554ee61b-8c35-46ce-98dc-c75d431491f5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"554ee61b-8c35-46ce-98dc-c75d431491f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:16:28.148492 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.148413 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/554ee61b-8c35-46ce-98dc-c75d431491f5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"554ee61b-8c35-46ce-98dc-c75d431491f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:16:28.148492 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.148431 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/554ee61b-8c35-46ce-98dc-c75d431491f5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"554ee61b-8c35-46ce-98dc-c75d431491f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:16:28.148492 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.148453 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/554ee61b-8c35-46ce-98dc-c75d431491f5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"554ee61b-8c35-46ce-98dc-c75d431491f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:16:28.148492 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.148483 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/554ee61b-8c35-46ce-98dc-c75d431491f5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"554ee61b-8c35-46ce-98dc-c75d431491f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:16:28.148638 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.148500 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/554ee61b-8c35-46ce-98dc-c75d431491f5-web-config\") pod \"prometheus-k8s-0\" (UID: \"554ee61b-8c35-46ce-98dc-c75d431491f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:16:28.148638 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.148533 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/554ee61b-8c35-46ce-98dc-c75d431491f5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"554ee61b-8c35-46ce-98dc-c75d431491f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:16:28.148638 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.148550 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/554ee61b-8c35-46ce-98dc-c75d431491f5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"554ee61b-8c35-46ce-98dc-c75d431491f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:16:28.148638 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.148573 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/554ee61b-8c35-46ce-98dc-c75d431491f5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"554ee61b-8c35-46ce-98dc-c75d431491f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:16:28.148638 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.148591 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/554ee61b-8c35-46ce-98dc-c75d431491f5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"554ee61b-8c35-46ce-98dc-c75d431491f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:16:28.148638 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.148607 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/554ee61b-8c35-46ce-98dc-c75d431491f5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"554ee61b-8c35-46ce-98dc-c75d431491f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:16:28.148809 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.148667 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/554ee61b-8c35-46ce-98dc-c75d431491f5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"554ee61b-8c35-46ce-98dc-c75d431491f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:16:28.148809 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.148692 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlpt8\" (UniqueName: \"kubernetes.io/projected/554ee61b-8c35-46ce-98dc-c75d431491f5-kube-api-access-dlpt8\") pod \"prometheus-k8s-0\" (UID: \"554ee61b-8c35-46ce-98dc-c75d431491f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:16:28.148809 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.148743 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/554ee61b-8c35-46ce-98dc-c75d431491f5-config-out\") pod \"prometheus-k8s-0\" (UID: \"554ee61b-8c35-46ce-98dc-c75d431491f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:16:28.148809 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.148770 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/554ee61b-8c35-46ce-98dc-c75d431491f5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"554ee61b-8c35-46ce-98dc-c75d431491f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:16:28.148809 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.148786 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/554ee61b-8c35-46ce-98dc-c75d431491f5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"554ee61b-8c35-46ce-98dc-c75d431491f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:16:28.249401 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.249310 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/554ee61b-8c35-46ce-98dc-c75d431491f5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"554ee61b-8c35-46ce-98dc-c75d431491f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:16:28.249401 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.249349 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/554ee61b-8c35-46ce-98dc-c75d431491f5-web-config\") pod \"prometheus-k8s-0\" (UID: \"554ee61b-8c35-46ce-98dc-c75d431491f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:16:28.249401 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.249386 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/554ee61b-8c35-46ce-98dc-c75d431491f5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"554ee61b-8c35-46ce-98dc-c75d431491f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:16:28.249650 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.249409 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/554ee61b-8c35-46ce-98dc-c75d431491f5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"554ee61b-8c35-46ce-98dc-c75d431491f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:16:28.249650 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.249434 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/554ee61b-8c35-46ce-98dc-c75d431491f5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"554ee61b-8c35-46ce-98dc-c75d431491f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:16:28.249650 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.249459 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/554ee61b-8c35-46ce-98dc-c75d431491f5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"554ee61b-8c35-46ce-98dc-c75d431491f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:16:28.249650 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.249594 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/554ee61b-8c35-46ce-98dc-c75d431491f5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"554ee61b-8c35-46ce-98dc-c75d431491f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:16:28.249833 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.249652 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/554ee61b-8c35-46ce-98dc-c75d431491f5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"554ee61b-8c35-46ce-98dc-c75d431491f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:16:28.249833 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.249682 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlpt8\" (UniqueName: \"kubernetes.io/projected/554ee61b-8c35-46ce-98dc-c75d431491f5-kube-api-access-dlpt8\") pod \"prometheus-k8s-0\" (UID: \"554ee61b-8c35-46ce-98dc-c75d431491f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:16:28.249833 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.249719 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/554ee61b-8c35-46ce-98dc-c75d431491f5-config-out\") pod \"prometheus-k8s-0\" (UID: \"554ee61b-8c35-46ce-98dc-c75d431491f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:16:28.249833 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.249750 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/554ee61b-8c35-46ce-98dc-c75d431491f5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"554ee61b-8c35-46ce-98dc-c75d431491f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:16:28.249833 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.249775 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/554ee61b-8c35-46ce-98dc-c75d431491f5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"554ee61b-8c35-46ce-98dc-c75d431491f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:16:28.249833 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.249826 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/554ee61b-8c35-46ce-98dc-c75d431491f5-config\") pod \"prometheus-k8s-0\" (UID: \"554ee61b-8c35-46ce-98dc-c75d431491f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:16:28.250150 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.249854 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/554ee61b-8c35-46ce-98dc-c75d431491f5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"554ee61b-8c35-46ce-98dc-c75d431491f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:16:28.250150 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.249891 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/554ee61b-8c35-46ce-98dc-c75d431491f5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"554ee61b-8c35-46ce-98dc-c75d431491f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:16:28.250150 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.249930 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/554ee61b-8c35-46ce-98dc-c75d431491f5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"554ee61b-8c35-46ce-98dc-c75d431491f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:16:28.250150 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.249955 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/554ee61b-8c35-46ce-98dc-c75d431491f5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"554ee61b-8c35-46ce-98dc-c75d431491f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:16:28.250150 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.249984 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/554ee61b-8c35-46ce-98dc-c75d431491f5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"554ee61b-8c35-46ce-98dc-c75d431491f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:16:28.250150 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.250009 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/554ee61b-8c35-46ce-98dc-c75d431491f5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"554ee61b-8c35-46ce-98dc-c75d431491f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:16:28.250150 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.250036 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/554ee61b-8c35-46ce-98dc-c75d431491f5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"554ee61b-8c35-46ce-98dc-c75d431491f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:16:28.250557 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.250301 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/554ee61b-8c35-46ce-98dc-c75d431491f5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"554ee61b-8c35-46ce-98dc-c75d431491f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:16:28.251180 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.251153 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/554ee61b-8c35-46ce-98dc-c75d431491f5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"554ee61b-8c35-46ce-98dc-c75d431491f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:16:28.251754 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.251729 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/554ee61b-8c35-46ce-98dc-c75d431491f5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"554ee61b-8c35-46ce-98dc-c75d431491f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:16:28.252505 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.252469 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/554ee61b-8c35-46ce-98dc-c75d431491f5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"554ee61b-8c35-46ce-98dc-c75d431491f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:16:28.252604 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.252518 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/554ee61b-8c35-46ce-98dc-c75d431491f5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"554ee61b-8c35-46ce-98dc-c75d431491f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:16:28.252604 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.252585 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/554ee61b-8c35-46ce-98dc-c75d431491f5-web-config\") pod \"prometheus-k8s-0\" (UID: \"554ee61b-8c35-46ce-98dc-c75d431491f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:16:28.252708 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.252631 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/554ee61b-8c35-46ce-98dc-c75d431491f5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"554ee61b-8c35-46ce-98dc-c75d431491f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:16:28.252758 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.252707 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/554ee61b-8c35-46ce-98dc-c75d431491f5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"554ee61b-8c35-46ce-98dc-c75d431491f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:16:28.253110 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.253085 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/554ee61b-8c35-46ce-98dc-c75d431491f5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"554ee61b-8c35-46ce-98dc-c75d431491f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:16:28.253837 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.253808 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/554ee61b-8c35-46ce-98dc-c75d431491f5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"554ee61b-8c35-46ce-98dc-c75d431491f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:16:28.253928 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.253821 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/554ee61b-8c35-46ce-98dc-c75d431491f5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"554ee61b-8c35-46ce-98dc-c75d431491f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:16:28.254220 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.254186 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/554ee61b-8c35-46ce-98dc-c75d431491f5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"554ee61b-8c35-46ce-98dc-c75d431491f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:16:28.254347 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.254289 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/554ee61b-8c35-46ce-98dc-c75d431491f5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"554ee61b-8c35-46ce-98dc-c75d431491f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:16:28.254745 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.254723 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/554ee61b-8c35-46ce-98dc-c75d431491f5-config\") pod \"prometheus-k8s-0\" (UID: \"554ee61b-8c35-46ce-98dc-c75d431491f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:16:28.255011 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.254984 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/554ee61b-8c35-46ce-98dc-c75d431491f5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"554ee61b-8c35-46ce-98dc-c75d431491f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:16:28.255112 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.255025 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/554ee61b-8c35-46ce-98dc-c75d431491f5-config-out\") pod \"prometheus-k8s-0\" (UID: \"554ee61b-8c35-46ce-98dc-c75d431491f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:16:28.255187 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.255169 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/554ee61b-8c35-46ce-98dc-c75d431491f5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"554ee61b-8c35-46ce-98dc-c75d431491f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:16:28.255780 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.255754 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/554ee61b-8c35-46ce-98dc-c75d431491f5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"554ee61b-8c35-46ce-98dc-c75d431491f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:16:28.259483 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.259449 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/554ee61b-8c35-46ce-98dc-c75d431491f5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"554ee61b-8c35-46ce-98dc-c75d431491f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:16:28.261520 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.261500 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlpt8\" (UniqueName: \"kubernetes.io/projected/554ee61b-8c35-46ce-98dc-c75d431491f5-kube-api-access-dlpt8\") pod \"prometheus-k8s-0\" (UID: \"554ee61b-8c35-46ce-98dc-c75d431491f5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:16:28.360577 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.360543 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:16:28.496957 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.496671 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 14 15:16:28.999303 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.999267 2571 generic.go:356] "Generic (PLEG): container finished" podID="554ee61b-8c35-46ce-98dc-c75d431491f5" containerID="9e7f87b30a5e794a6eb0dfe7303f21a3f09333b8672751770e6bc3674dfac68e" exitCode=0 Jun 14 15:16:28.999650 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.999329 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"554ee61b-8c35-46ce-98dc-c75d431491f5","Type":"ContainerDied","Data":"9e7f87b30a5e794a6eb0dfe7303f21a3f09333b8672751770e6bc3674dfac68e"} Jun 14 15:16:28.999650 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:28.999383 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"554ee61b-8c35-46ce-98dc-c75d431491f5","Type":"ContainerStarted","Data":"7eda497b43db4ec42113d99c168b6a70e57b7b3d82c64e0912248ce189b07b4d"} Jun 14 15:16:29.306823 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:29.306788 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dee50442-134a-4024-81d4-c55d01e8c965" path="/var/lib/kubelet/pods/dee50442-134a-4024-81d4-c55d01e8c965/volumes" Jun 14 15:16:30.006566 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:30.006534 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"554ee61b-8c35-46ce-98dc-c75d431491f5","Type":"ContainerStarted","Data":"d8bbd22f94dce31a598dde68ffc2b90b58d805f721b893abb92d3390d8578639"} Jun 14 15:16:30.006923 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:30.006598 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"554ee61b-8c35-46ce-98dc-c75d431491f5","Type":"ContainerStarted","Data":"36f1a1433de1558850d6ca1f33f55ceaa32201fc674fd07600c3690636a812fc"} Jun 14 15:16:30.006923 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:30.006626 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"554ee61b-8c35-46ce-98dc-c75d431491f5","Type":"ContainerStarted","Data":"3d9529f033e950dd967fd9cab358001ec9356213d9ed662374d7949ced1060d2"} Jun 14 15:16:30.006923 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:30.006651 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"554ee61b-8c35-46ce-98dc-c75d431491f5","Type":"ContainerStarted","Data":"67178e1b9d08e26a20ee40c32727e2d2b1bbc681c4cb45f6e299dc4a2ed75380"} Jun 14 15:16:30.006923 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:30.006672 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"554ee61b-8c35-46ce-98dc-c75d431491f5","Type":"ContainerStarted","Data":"fbbd6445c8d7dcc5cb2e003b83b04658ac1fe4cfba5c01883f87abfcd13032fc"} Jun 14 15:16:30.006923 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:30.006695 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"554ee61b-8c35-46ce-98dc-c75d431491f5","Type":"ContainerStarted","Data":"e526a7ecb45c7a351238e54317e959101a85e7f7116e892c58d13f6644da6a3c"} Jun 14 15:16:30.042234 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:30.042174 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.024324837 podStartE2EDuration="2.042156395s" totalImagesPullingTime="0s" totalInitContainerRuntime="17.831558ms" isStatefulPod=false podCreationTimestamp="2026-06-14 15:16:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:16:30.040904231 +0000 UTC m=+147.222386759" watchObservedRunningTime="2026-06-14 15:16:30.042156395 +0000 UTC m=+147.223638910" Jun 14 15:16:31.585680 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:31.585644 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:16:31.648679 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:31.648647 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:16:33.361336 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:33.361309 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:16:42.868693 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:42.868602 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-677d66c595-bwlrh"] Jun 14 15:16:42.976317 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:42.976287 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:16:43.038287 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:43.038257 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:16:43.095444 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:16:43.095413 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:17:07.888170 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:17:07.888099 2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-677d66c595-bwlrh" podUID="66766fa4-3b87-4ccd-9c27-899d8e3ed5df" containerName="console" containerID="cri-o://da3d5a38902751e87a45b3b338c072951520b38fd6b3e4a81bb6f0ffc06dab1d" gracePeriod=15 Jun 14 15:17:08.116130 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:17:08.116107 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-677d66c595-bwlrh" Jun 14 15:17:08.148355 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:17:08.148281 2571 generic.go:356] "Generic (PLEG): container finished" podID="66766fa4-3b87-4ccd-9c27-899d8e3ed5df" containerID="da3d5a38902751e87a45b3b338c072951520b38fd6b3e4a81bb6f0ffc06dab1d" exitCode=0 Jun 14 15:17:08.148355 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:17:08.148327 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-677d66c595-bwlrh" Jun 14 15:17:08.148524 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:17:08.148363 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-677d66c595-bwlrh" event={"ID":"66766fa4-3b87-4ccd-9c27-899d8e3ed5df","Type":"ContainerDied","Data":"da3d5a38902751e87a45b3b338c072951520b38fd6b3e4a81bb6f0ffc06dab1d"} Jun 14 15:17:08.148524 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:17:08.148416 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-677d66c595-bwlrh" event={"ID":"66766fa4-3b87-4ccd-9c27-899d8e3ed5df","Type":"ContainerDied","Data":"c337866d9238b9ada16c3e615b899b3c2b6d15d36a0ce90ce0a7df16d34510c5"} Jun 14 15:17:08.148524 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:17:08.148436 2571 scope.go:117] "RemoveContainer" containerID="da3d5a38902751e87a45b3b338c072951520b38fd6b3e4a81bb6f0ffc06dab1d" Jun 14 15:17:08.156304 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:17:08.156288 2571 scope.go:117] "RemoveContainer" containerID="da3d5a38902751e87a45b3b338c072951520b38fd6b3e4a81bb6f0ffc06dab1d" Jun 14 15:17:08.156536 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:17:08.156516 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da3d5a38902751e87a45b3b338c072951520b38fd6b3e4a81bb6f0ffc06dab1d\": container with ID starting with da3d5a38902751e87a45b3b338c072951520b38fd6b3e4a81bb6f0ffc06dab1d not found: ID does not exist" containerID="da3d5a38902751e87a45b3b338c072951520b38fd6b3e4a81bb6f0ffc06dab1d" Jun 14 15:17:08.156603 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:17:08.156549 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da3d5a38902751e87a45b3b338c072951520b38fd6b3e4a81bb6f0ffc06dab1d"} err="failed to get container status \"da3d5a38902751e87a45b3b338c072951520b38fd6b3e4a81bb6f0ffc06dab1d\": rpc error: code = NotFound desc = could not find container \"da3d5a38902751e87a45b3b338c072951520b38fd6b3e4a81bb6f0ffc06dab1d\": container with ID starting with da3d5a38902751e87a45b3b338c072951520b38fd6b3e4a81bb6f0ffc06dab1d not found: ID does not exist" Jun 14 15:17:08.177991 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:17:08.177972 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66766fa4-3b87-4ccd-9c27-899d8e3ed5df-trusted-ca-bundle\") pod \"66766fa4-3b87-4ccd-9c27-899d8e3ed5df\" (UID: \"66766fa4-3b87-4ccd-9c27-899d8e3ed5df\") " Jun 14 15:17:08.178071 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:17:08.178017 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/66766fa4-3b87-4ccd-9c27-899d8e3ed5df-service-ca\") pod \"66766fa4-3b87-4ccd-9c27-899d8e3ed5df\" (UID: \"66766fa4-3b87-4ccd-9c27-899d8e3ed5df\") " Jun 14 15:17:08.178071 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:17:08.178038 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/66766fa4-3b87-4ccd-9c27-899d8e3ed5df-console-oauth-config\") pod \"66766fa4-3b87-4ccd-9c27-899d8e3ed5df\" (UID: \"66766fa4-3b87-4ccd-9c27-899d8e3ed5df\") " Jun 14 15:17:08.178146 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:17:08.178089 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/66766fa4-3b87-4ccd-9c27-899d8e3ed5df-console-config\") pod \"66766fa4-3b87-4ccd-9c27-899d8e3ed5df\" (UID: \"66766fa4-3b87-4ccd-9c27-899d8e3ed5df\") " Jun 14 15:17:08.178146 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:17:08.178110 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/66766fa4-3b87-4ccd-9c27-899d8e3ed5df-oauth-serving-cert\") pod \"66766fa4-3b87-4ccd-9c27-899d8e3ed5df\" (UID: \"66766fa4-3b87-4ccd-9c27-899d8e3ed5df\") " Jun 14 15:17:08.178248 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:17:08.178201 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/66766fa4-3b87-4ccd-9c27-899d8e3ed5df-console-serving-cert\") pod \"66766fa4-3b87-4ccd-9c27-899d8e3ed5df\" (UID: \"66766fa4-3b87-4ccd-9c27-899d8e3ed5df\") " Jun 14 15:17:08.178301 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:17:08.178261 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pphf2\" (UniqueName: \"kubernetes.io/projected/66766fa4-3b87-4ccd-9c27-899d8e3ed5df-kube-api-access-pphf2\") pod \"66766fa4-3b87-4ccd-9c27-899d8e3ed5df\" (UID: \"66766fa4-3b87-4ccd-9c27-899d8e3ed5df\") " Jun 14 15:17:08.178535 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:17:08.178485 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/66766fa4-3b87-4ccd-9c27-899d8e3ed5df-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "66766fa4-3b87-4ccd-9c27-899d8e3ed5df" (UID: "66766fa4-3b87-4ccd-9c27-899d8e3ed5df"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 15:17:08.178535 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:17:08.178500 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/66766fa4-3b87-4ccd-9c27-899d8e3ed5df-service-ca" (OuterVolumeSpecName: "service-ca") pod "66766fa4-3b87-4ccd-9c27-899d8e3ed5df" (UID: "66766fa4-3b87-4ccd-9c27-899d8e3ed5df"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 15:17:08.178535 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:17:08.178494 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/66766fa4-3b87-4ccd-9c27-899d8e3ed5df-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "66766fa4-3b87-4ccd-9c27-899d8e3ed5df" (UID: "66766fa4-3b87-4ccd-9c27-899d8e3ed5df"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 15:17:08.178699 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:17:08.178537 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/66766fa4-3b87-4ccd-9c27-899d8e3ed5df-console-config" (OuterVolumeSpecName: "console-config") pod "66766fa4-3b87-4ccd-9c27-899d8e3ed5df" (UID: "66766fa4-3b87-4ccd-9c27-899d8e3ed5df"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 15:17:08.180147 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:17:08.180121 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/66766fa4-3b87-4ccd-9c27-899d8e3ed5df-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "66766fa4-3b87-4ccd-9c27-899d8e3ed5df" (UID: "66766fa4-3b87-4ccd-9c27-899d8e3ed5df"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 15:17:08.180273 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:17:08.180252 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66766fa4-3b87-4ccd-9c27-899d8e3ed5df-kube-api-access-pphf2" (OuterVolumeSpecName: "kube-api-access-pphf2") pod "66766fa4-3b87-4ccd-9c27-899d8e3ed5df" (UID: "66766fa4-3b87-4ccd-9c27-899d8e3ed5df"). InnerVolumeSpecName "kube-api-access-pphf2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 15:17:08.180319 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:17:08.180293 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/66766fa4-3b87-4ccd-9c27-899d8e3ed5df-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "66766fa4-3b87-4ccd-9c27-899d8e3ed5df" (UID: "66766fa4-3b87-4ccd-9c27-899d8e3ed5df"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 15:17:08.279179 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:17:08.279146 2571 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/66766fa4-3b87-4ccd-9c27-899d8e3ed5df-service-ca\") on node \"ip-10-0-140-30.ec2.internal\" DevicePath \"\"" Jun 14 15:17:08.279179 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:17:08.279175 2571 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/66766fa4-3b87-4ccd-9c27-899d8e3ed5df-console-oauth-config\") on node \"ip-10-0-140-30.ec2.internal\" DevicePath \"\"" Jun 14 15:17:08.279179 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:17:08.279184 2571 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/66766fa4-3b87-4ccd-9c27-899d8e3ed5df-console-config\") on node \"ip-10-0-140-30.ec2.internal\" DevicePath \"\"" Jun 14 15:17:08.279395 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:17:08.279193 2571 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/66766fa4-3b87-4ccd-9c27-899d8e3ed5df-oauth-serving-cert\") on node \"ip-10-0-140-30.ec2.internal\" DevicePath \"\"" Jun 14 15:17:08.279395 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:17:08.279203 2571 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/66766fa4-3b87-4ccd-9c27-899d8e3ed5df-console-serving-cert\") on node \"ip-10-0-140-30.ec2.internal\" DevicePath \"\"" Jun 14 15:17:08.279395 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:17:08.279211 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pphf2\" (UniqueName: \"kubernetes.io/projected/66766fa4-3b87-4ccd-9c27-899d8e3ed5df-kube-api-access-pphf2\") on node \"ip-10-0-140-30.ec2.internal\" DevicePath \"\"" Jun 14 15:17:08.279395 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:17:08.279219 2571 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66766fa4-3b87-4ccd-9c27-899d8e3ed5df-trusted-ca-bundle\") on node \"ip-10-0-140-30.ec2.internal\" DevicePath \"\"" Jun 14 15:17:08.468714 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:17:08.468681 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-677d66c595-bwlrh"] Jun 14 15:17:08.475567 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:17:08.475541 2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-677d66c595-bwlrh"] Jun 14 15:17:09.303953 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:17:09.303919 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="66766fa4-3b87-4ccd-9c27-899d8e3ed5df" path="/var/lib/kubelet/pods/66766fa4-3b87-4ccd-9c27-899d8e3ed5df/volumes" Jun 14 15:17:28.361624 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:17:28.361593 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:17:28.376685 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:17:28.376661 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:17:29.239668 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:17:29.239643 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:17:36.835601 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:17:36.835564 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:17:36.905383 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:17:36.905353 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:17:38.753925 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:17:38.753891 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:17:38.812683 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:17:38.812652 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:17:38.900841 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:17:38.900807 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:17:38.952265 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:17:38.952234 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:17:39.494275 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:17:39.494240 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:17:39.549037 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:17:39.549007 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:17:48.657062 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:17:48.657010 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:17:48.758521 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:17:48.758489 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:17:49.201170 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:17:49.201132 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:17:49.255251 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:17:49.255226 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:17:49.318969 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:17:49.318934 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:17:54.380066 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:17:54.380020 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:17:58.501014 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:17:58.500977 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:17:58.600531 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:17:58.600500 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:18:00.760635 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:18:00.760603 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:18:00.860883 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:18:00.860844 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:18:17.895021 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:18:17.894948 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:18:17.949575 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:18:17.949543 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:18:27.677203 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:18:27.677169 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:18:27.790216 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:18:27.790182 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:18:42.179415 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:18:42.179378 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:18:42.276690 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:18:42.276657 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6df857fb5d-lx6pw"] Jun 14 15:18:42.277026 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:18:42.277010 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66766fa4-3b87-4ccd-9c27-899d8e3ed5df" containerName="console" Jun 14 15:18:42.277134 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:18:42.277029 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="66766fa4-3b87-4ccd-9c27-899d8e3ed5df" containerName="console" Jun 14 15:18:42.277134 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:18:42.277106 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="66766fa4-3b87-4ccd-9c27-899d8e3ed5df" containerName="console" Jun 14 15:18:42.280026 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:18:42.280005 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6df857fb5d-lx6pw" Jun 14 15:18:42.282919 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:18:42.282890 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 14 15:18:42.283036 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:18:42.282957 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 14 15:18:42.283439 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:18:42.283418 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 14 15:18:42.283553 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:18:42.283444 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 14 15:18:42.283553 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:18:42.283455 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 14 15:18:42.283553 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:18:42.283445 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 14 15:18:42.283553 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:18:42.283512 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 14 15:18:42.292701 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:18:42.292678 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6df857fb5d-lx6pw"] Jun 14 15:18:42.417187 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:18:42.417147 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/823ba87b-99c1-4337-bfd7-c24d238a7a1c-ca\") pod \"cluster-proxy-proxy-agent-6df857fb5d-lx6pw\" (UID: \"823ba87b-99c1-4337-bfd7-c24d238a7a1c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6df857fb5d-lx6pw" Jun 14 15:18:42.417187 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:18:42.417191 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/823ba87b-99c1-4337-bfd7-c24d238a7a1c-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6df857fb5d-lx6pw\" (UID: \"823ba87b-99c1-4337-bfd7-c24d238a7a1c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6df857fb5d-lx6pw" Jun 14 15:18:42.417402 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:18:42.417260 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/823ba87b-99c1-4337-bfd7-c24d238a7a1c-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6df857fb5d-lx6pw\" (UID: \"823ba87b-99c1-4337-bfd7-c24d238a7a1c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6df857fb5d-lx6pw" Jun 14 15:18:42.417402 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:18:42.417340 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/823ba87b-99c1-4337-bfd7-c24d238a7a1c-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6df857fb5d-lx6pw\" (UID: \"823ba87b-99c1-4337-bfd7-c24d238a7a1c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6df857fb5d-lx6pw" Jun 14 15:18:42.417402 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:18:42.417389 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/823ba87b-99c1-4337-bfd7-c24d238a7a1c-hub\") pod \"cluster-proxy-proxy-agent-6df857fb5d-lx6pw\" (UID: \"823ba87b-99c1-4337-bfd7-c24d238a7a1c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6df857fb5d-lx6pw" Jun 14 15:18:42.417504 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:18:42.417450 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wpcz\" (UniqueName: \"kubernetes.io/projected/823ba87b-99c1-4337-bfd7-c24d238a7a1c-kube-api-access-6wpcz\") pod \"cluster-proxy-proxy-agent-6df857fb5d-lx6pw\" (UID: \"823ba87b-99c1-4337-bfd7-c24d238a7a1c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6df857fb5d-lx6pw" Jun 14 15:18:42.518490 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:18:42.518440 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/823ba87b-99c1-4337-bfd7-c24d238a7a1c-ca\") pod \"cluster-proxy-proxy-agent-6df857fb5d-lx6pw\" (UID: \"823ba87b-99c1-4337-bfd7-c24d238a7a1c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6df857fb5d-lx6pw" Jun 14 15:18:42.518490 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:18:42.518495 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/823ba87b-99c1-4337-bfd7-c24d238a7a1c-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6df857fb5d-lx6pw\" (UID: \"823ba87b-99c1-4337-bfd7-c24d238a7a1c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6df857fb5d-lx6pw" Jun 14 15:18:42.518758 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:18:42.518535 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/823ba87b-99c1-4337-bfd7-c24d238a7a1c-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6df857fb5d-lx6pw\" (UID: \"823ba87b-99c1-4337-bfd7-c24d238a7a1c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6df857fb5d-lx6pw" Jun 14 15:18:42.518758 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:18:42.518560 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/823ba87b-99c1-4337-bfd7-c24d238a7a1c-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6df857fb5d-lx6pw\" (UID: \"823ba87b-99c1-4337-bfd7-c24d238a7a1c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6df857fb5d-lx6pw" Jun 14 15:18:42.518758 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:18:42.518582 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/823ba87b-99c1-4337-bfd7-c24d238a7a1c-hub\") pod \"cluster-proxy-proxy-agent-6df857fb5d-lx6pw\" (UID: \"823ba87b-99c1-4337-bfd7-c24d238a7a1c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6df857fb5d-lx6pw" Jun 14 15:18:42.518758 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:18:42.518650 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wpcz\" (UniqueName: \"kubernetes.io/projected/823ba87b-99c1-4337-bfd7-c24d238a7a1c-kube-api-access-6wpcz\") pod \"cluster-proxy-proxy-agent-6df857fb5d-lx6pw\" (UID: \"823ba87b-99c1-4337-bfd7-c24d238a7a1c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6df857fb5d-lx6pw" Jun 14 15:18:42.519330 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:18:42.519306 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/823ba87b-99c1-4337-bfd7-c24d238a7a1c-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6df857fb5d-lx6pw\" (UID: \"823ba87b-99c1-4337-bfd7-c24d238a7a1c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6df857fb5d-lx6pw" Jun 14 15:18:42.521255 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:18:42.521227 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/823ba87b-99c1-4337-bfd7-c24d238a7a1c-hub\") pod \"cluster-proxy-proxy-agent-6df857fb5d-lx6pw\" (UID: \"823ba87b-99c1-4337-bfd7-c24d238a7a1c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6df857fb5d-lx6pw" Jun 14 15:18:42.521384 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:18:42.521339 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/823ba87b-99c1-4337-bfd7-c24d238a7a1c-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6df857fb5d-lx6pw\" (UID: \"823ba87b-99c1-4337-bfd7-c24d238a7a1c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6df857fb5d-lx6pw" Jun 14 15:18:42.521384 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:18:42.521351 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/823ba87b-99c1-4337-bfd7-c24d238a7a1c-ca\") pod \"cluster-proxy-proxy-agent-6df857fb5d-lx6pw\" (UID: \"823ba87b-99c1-4337-bfd7-c24d238a7a1c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6df857fb5d-lx6pw" Jun 14 15:18:42.521520 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:18:42.521501 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/823ba87b-99c1-4337-bfd7-c24d238a7a1c-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6df857fb5d-lx6pw\" (UID: \"823ba87b-99c1-4337-bfd7-c24d238a7a1c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6df857fb5d-lx6pw" Jun 14 15:18:42.526600 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:18:42.526572 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wpcz\" (UniqueName: \"kubernetes.io/projected/823ba87b-99c1-4337-bfd7-c24d238a7a1c-kube-api-access-6wpcz\") pod \"cluster-proxy-proxy-agent-6df857fb5d-lx6pw\" (UID: \"823ba87b-99c1-4337-bfd7-c24d238a7a1c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6df857fb5d-lx6pw" Jun 14 15:18:42.599797 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:18:42.599758 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6df857fb5d-lx6pw" Jun 14 15:18:42.727556 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:18:42.727524 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6df857fb5d-lx6pw"] Jun 14 15:18:42.731073 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:18:42.731028 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod823ba87b_99c1_4337_bfd7_c24d238a7a1c.slice/crio-b620d94be48552c8ec0352b83f2ff2a977638b769fba92a85477b741625607bf WatchSource:0}: Error finding container b620d94be48552c8ec0352b83f2ff2a977638b769fba92a85477b741625607bf: Status 404 returned error can't find the container with id b620d94be48552c8ec0352b83f2ff2a977638b769fba92a85477b741625607bf Jun 14 15:18:43.131352 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:18:43.131312 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:18:43.482136 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:18:43.482084 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6df857fb5d-lx6pw" event={"ID":"823ba87b-99c1-4337-bfd7-c24d238a7a1c","Type":"ContainerStarted","Data":"b620d94be48552c8ec0352b83f2ff2a977638b769fba92a85477b741625607bf"} Jun 14 15:18:46.496855 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:18:46.496820 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6df857fb5d-lx6pw" event={"ID":"823ba87b-99c1-4337-bfd7-c24d238a7a1c","Type":"ContainerStarted","Data":"274eda38059d6516243a94e5cda152dd8764adb80b89fe076c9cb9c7e209cebe"} Jun 14 15:18:46.497296 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:18:46.496867 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6df857fb5d-lx6pw" event={"ID":"823ba87b-99c1-4337-bfd7-c24d238a7a1c","Type":"ContainerStarted","Data":"cd0522630bf9cebd171c07cd8bf3d72c4dd849c32d08e31e02aa8eb8814c9e4a"} Jun 14 15:18:46.497296 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:18:46.496885 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6df857fb5d-lx6pw" event={"ID":"823ba87b-99c1-4337-bfd7-c24d238a7a1c","Type":"ContainerStarted","Data":"ca36188d232740919ebb3939f45152c10ca99541db7e87d1d68a0f9f147c4b94"} Jun 14 15:18:46.518256 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:18:46.518199 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6df857fb5d-lx6pw" podStartSLOduration=1.062897818 podStartE2EDuration="4.518181009s" totalImagesPullingTime="3.455283191s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:18:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:18:46.516365835 +0000 UTC m=+283.697848351" watchObservedRunningTime="2026-06-14 15:18:46.518181009 +0000 UTC m=+283.699663524" Jun 14 15:18:54.646528 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:18:54.646491 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:18:56.104603 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:18:56.104570 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:18:58.548898 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:18:58.548869 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:18:58.644623 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:18:58.644588 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:19:03.250623 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:19:03.250595 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ltnnm_ee9ddc42-3dac-47b7-a02b-899fc13a7467/ovn-acl-logging/0.log" Jun 14 15:19:03.253104 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:19:03.253081 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ltnnm_ee9ddc42-3dac-47b7-a02b-899fc13a7467/ovn-acl-logging/0.log" Jun 14 15:19:03.253517 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:19:03.253492 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:19:03.258359 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:19:03.258341 2571 kubelet.go:1648] "Image garbage collection succeeded" Jun 14 15:19:03.308898 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:19:03.308774 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:19:05.802001 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:19:05.801969 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:19:05.908009 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:19:05.907979 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:19:06.056297 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:19:06.056220 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:19:06.207787 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:19:06.207757 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:19:09.303474 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:19:09.303438 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:19:09.788753 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:19:09.788715 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:19:15.181658 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:19:15.181624 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:19:15.293668 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:19:15.293637 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:19:16.526699 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:19:16.526662 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:19:16.620642 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:19:16.620613 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:19:17.519343 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:19:17.519299 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:19:20.107248 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:19:20.107199 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:19:20.234282 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:19:20.234251 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:19:21.796233 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:19:21.796206 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:19:38.481352 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:19:38.481318 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:19:38.569907 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:19:38.569875 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:19:39.352481 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:19:39.352449 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:19:39.535234 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:19:39.535203 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:19:39.633718 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:19:39.633632 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:19:39.696353 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:19:39.696322 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7f69b6c847-sjngw"] Jun 14 15:19:39.700689 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:19:39.700669 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7f69b6c847-sjngw" Jun 14 15:19:39.706071 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:19:39.703510 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-wxlgz\"" Jun 14 15:19:39.706071 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:19:39.703787 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 14 15:19:39.706071 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:19:39.703849 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 14 15:19:39.706071 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:19:39.703900 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 14 15:19:39.706071 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:19:39.704034 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 14 15:19:39.714072 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:19:39.714034 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7f69b6c847-sjngw"] Jun 14 15:19:39.799528 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:19:39.799496 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/96bf4c70-9739-491a-b200-0871b30345e4-tmp\") pod \"opendatahub-operator-controller-manager-7f69b6c847-sjngw\" (UID: \"96bf4c70-9739-491a-b200-0871b30345e4\") " pod="opendatahub/opendatahub-operator-controller-manager-7f69b6c847-sjngw" Jun 14 15:19:39.799528 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:19:39.799530 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/96bf4c70-9739-491a-b200-0871b30345e4-webhook-cert\") pod \"opendatahub-operator-controller-manager-7f69b6c847-sjngw\" (UID: \"96bf4c70-9739-491a-b200-0871b30345e4\") " pod="opendatahub/opendatahub-operator-controller-manager-7f69b6c847-sjngw" Jun 14 15:19:39.799731 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:19:39.799654 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/96bf4c70-9739-491a-b200-0871b30345e4-manifests\") pod \"opendatahub-operator-controller-manager-7f69b6c847-sjngw\" (UID: \"96bf4c70-9739-491a-b200-0871b30345e4\") " pod="opendatahub/opendatahub-operator-controller-manager-7f69b6c847-sjngw" Jun 14 15:19:39.799731 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:19:39.799685 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thhjt\" (UniqueName: \"kubernetes.io/projected/96bf4c70-9739-491a-b200-0871b30345e4-kube-api-access-thhjt\") pod \"opendatahub-operator-controller-manager-7f69b6c847-sjngw\" (UID: \"96bf4c70-9739-491a-b200-0871b30345e4\") " pod="opendatahub/opendatahub-operator-controller-manager-7f69b6c847-sjngw" Jun 14 15:19:39.799731 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:19:39.799710 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/96bf4c70-9739-491a-b200-0871b30345e4-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7f69b6c847-sjngw\" (UID: \"96bf4c70-9739-491a-b200-0871b30345e4\") " pod="opendatahub/opendatahub-operator-controller-manager-7f69b6c847-sjngw" Jun 14 15:19:39.869022 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:19:39.868972 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:19:39.900434 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:19:39.900345 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/96bf4c70-9739-491a-b200-0871b30345e4-manifests\") pod \"opendatahub-operator-controller-manager-7f69b6c847-sjngw\" (UID: \"96bf4c70-9739-491a-b200-0871b30345e4\") " pod="opendatahub/opendatahub-operator-controller-manager-7f69b6c847-sjngw" Jun 14 15:19:39.900434 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:19:39.900385 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thhjt\" (UniqueName: \"kubernetes.io/projected/96bf4c70-9739-491a-b200-0871b30345e4-kube-api-access-thhjt\") pod \"opendatahub-operator-controller-manager-7f69b6c847-sjngw\" (UID: \"96bf4c70-9739-491a-b200-0871b30345e4\") " pod="opendatahub/opendatahub-operator-controller-manager-7f69b6c847-sjngw" Jun 14 15:19:39.900434 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:19:39.900407 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/96bf4c70-9739-491a-b200-0871b30345e4-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7f69b6c847-sjngw\" (UID: \"96bf4c70-9739-491a-b200-0871b30345e4\") " pod="opendatahub/opendatahub-operator-controller-manager-7f69b6c847-sjngw" Jun 14 15:19:39.900913 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:19:39.900446 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/96bf4c70-9739-491a-b200-0871b30345e4-tmp\") pod \"opendatahub-operator-controller-manager-7f69b6c847-sjngw\" (UID: \"96bf4c70-9739-491a-b200-0871b30345e4\") " pod="opendatahub/opendatahub-operator-controller-manager-7f69b6c847-sjngw" Jun 14 15:19:39.900913 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:19:39.900564 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/96bf4c70-9739-491a-b200-0871b30345e4-webhook-cert\") pod \"opendatahub-operator-controller-manager-7f69b6c847-sjngw\" (UID: \"96bf4c70-9739-491a-b200-0871b30345e4\") " pod="opendatahub/opendatahub-operator-controller-manager-7f69b6c847-sjngw" Jun 14 15:19:39.900913 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:19:39.900817 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/96bf4c70-9739-491a-b200-0871b30345e4-manifests\") pod \"opendatahub-operator-controller-manager-7f69b6c847-sjngw\" (UID: \"96bf4c70-9739-491a-b200-0871b30345e4\") " pod="opendatahub/opendatahub-operator-controller-manager-7f69b6c847-sjngw" Jun 14 15:19:39.902885 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:19:39.902862 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/96bf4c70-9739-491a-b200-0871b30345e4-tmp\") pod \"opendatahub-operator-controller-manager-7f69b6c847-sjngw\" (UID: \"96bf4c70-9739-491a-b200-0871b30345e4\") " pod="opendatahub/opendatahub-operator-controller-manager-7f69b6c847-sjngw" Jun 14 15:19:39.903145 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:19:39.903126 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/96bf4c70-9739-491a-b200-0871b30345e4-webhook-cert\") pod \"opendatahub-operator-controller-manager-7f69b6c847-sjngw\" (UID: \"96bf4c70-9739-491a-b200-0871b30345e4\") " pod="opendatahub/opendatahub-operator-controller-manager-7f69b6c847-sjngw" Jun 14 15:19:39.903235 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:19:39.903215 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/96bf4c70-9739-491a-b200-0871b30345e4-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7f69b6c847-sjngw\" (UID: \"96bf4c70-9739-491a-b200-0871b30345e4\") " pod="opendatahub/opendatahub-operator-controller-manager-7f69b6c847-sjngw" Jun 14 15:19:39.912016 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:19:39.911991 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-thhjt\" (UniqueName: \"kubernetes.io/projected/96bf4c70-9739-491a-b200-0871b30345e4-kube-api-access-thhjt\") pod \"opendatahub-operator-controller-manager-7f69b6c847-sjngw\" (UID: \"96bf4c70-9739-491a-b200-0871b30345e4\") " pod="opendatahub/opendatahub-operator-controller-manager-7f69b6c847-sjngw" Jun 14 15:19:39.961904 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:19:39.961867 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:19:40.016175 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:19:40.016139 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7f69b6c847-sjngw" Jun 14 15:19:40.062127 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:19:40.062086 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:19:40.138987 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:19:40.138946 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:19:40.175517 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:19:40.175411 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7f69b6c847-sjngw"] Jun 14 15:19:40.178402 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:19:40.178374 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96bf4c70_9739_491a_b200_0871b30345e4.slice/crio-a78d4213ee41a15c3e00647a70193a987b18ac8683ef41fa94354d49ebb93c2e WatchSource:0}: Error finding container a78d4213ee41a15c3e00647a70193a987b18ac8683ef41fa94354d49ebb93c2e: Status 404 returned error can't find the container with id a78d4213ee41a15c3e00647a70193a987b18ac8683ef41fa94354d49ebb93c2e Jun 14 15:19:40.180169 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:19:40.180152 2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 14 15:19:40.203713 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:19:40.203681 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:19:40.304274 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:19:40.304239 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:19:40.403973 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:19:40.403927 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:19:40.695311 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:19:40.695272 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f69b6c847-sjngw" event={"ID":"96bf4c70-9739-491a-b200-0871b30345e4","Type":"ContainerStarted","Data":"a78d4213ee41a15c3e00647a70193a987b18ac8683ef41fa94354d49ebb93c2e"} Jun 14 15:19:43.711504 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:19:43.711468 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f69b6c847-sjngw" event={"ID":"96bf4c70-9739-491a-b200-0871b30345e4","Type":"ContainerStarted","Data":"2dd3002b946d227426f9bef772fa78755d6950399a6b1720987ceea2a0bc4e5b"} Jun 14 15:19:44.716770 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:19:44.716740 2571 generic.go:356] "Generic (PLEG): container finished" podID="96bf4c70-9739-491a-b200-0871b30345e4" containerID="2dd3002b946d227426f9bef772fa78755d6950399a6b1720987ceea2a0bc4e5b" exitCode=0 Jun 14 15:19:44.717174 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:19:44.716825 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f69b6c847-sjngw" event={"ID":"96bf4c70-9739-491a-b200-0871b30345e4","Type":"ContainerDied","Data":"2dd3002b946d227426f9bef772fa78755d6950399a6b1720987ceea2a0bc4e5b"} Jun 14 15:19:45.723102 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:19:45.723068 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f69b6c847-sjngw" event={"ID":"96bf4c70-9739-491a-b200-0871b30345e4","Type":"ContainerStarted","Data":"a5fad06720f248f55bc11e89abb678c4f8daf1b3274aac98f5dd1cf91ebf2924"} Jun 14 15:19:45.723507 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:19:45.723187 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7f69b6c847-sjngw" Jun 14 15:19:45.747700 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:19:45.747660 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7f69b6c847-sjngw" podStartSLOduration=2.35494954 podStartE2EDuration="6.747645401s" totalImagesPullingTime="3.350730422s" totalInitContainerRuntime="1.041965439s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:19:39 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:19:45.746479111 +0000 UTC m=+342.927961627" watchObservedRunningTime="2026-06-14 15:19:45.747645401 +0000 UTC m=+342.929127918" Jun 14 15:19:50.669356 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:19:50.669320 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:19:50.762266 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:19:50.762234 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:19:54.540507 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:19:54.540475 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:19:54.625497 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:19:54.625462 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:19:56.730088 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:19:56.730024 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7f69b6c847-sjngw" Jun 14 15:19:58.482615 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:19:58.482565 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:19:58.594223 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:19:58.594188 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:19:58.658549 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:19:58.658517 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6dfb8f76f9-7kjqj"] Jun 14 15:19:58.667967 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:19:58.667939 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6dfb8f76f9-7kjqj" Jun 14 15:19:58.670867 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:19:58.670841 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 14 15:19:58.671012 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:19:58.670848 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 14 15:19:58.671716 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:19:58.671698 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 14 15:19:58.671795 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:19:58.671742 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 14 15:19:58.671852 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:19:58.671822 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 14 15:19:58.671852 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:19:58.671830 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-7clvd\"" Jun 14 15:19:58.674471 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:19:58.674439 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6dfb8f76f9-7kjqj"] Jun 14 15:19:58.762949 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:19:58.762850 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jbhc\" (UniqueName: \"kubernetes.io/projected/dbf1b408-2e13-47dd-bb08-c49fbca3ce24-kube-api-access-7jbhc\") pod \"lws-controller-manager-6dfb8f76f9-7kjqj\" (UID: \"dbf1b408-2e13-47dd-bb08-c49fbca3ce24\") " pod="openshift-lws-operator/lws-controller-manager-6dfb8f76f9-7kjqj" Jun 14 15:19:58.762949 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:19:58.762907 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/dbf1b408-2e13-47dd-bb08-c49fbca3ce24-manager-config\") pod \"lws-controller-manager-6dfb8f76f9-7kjqj\" (UID: \"dbf1b408-2e13-47dd-bb08-c49fbca3ce24\") " pod="openshift-lws-operator/lws-controller-manager-6dfb8f76f9-7kjqj" Jun 14 15:19:58.762949 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:19:58.762929 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/dbf1b408-2e13-47dd-bb08-c49fbca3ce24-metrics-cert\") pod \"lws-controller-manager-6dfb8f76f9-7kjqj\" (UID: \"dbf1b408-2e13-47dd-bb08-c49fbca3ce24\") " pod="openshift-lws-operator/lws-controller-manager-6dfb8f76f9-7kjqj" Jun 14 15:19:58.763200 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:19:58.762974 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dbf1b408-2e13-47dd-bb08-c49fbca3ce24-cert\") pod \"lws-controller-manager-6dfb8f76f9-7kjqj\" (UID: \"dbf1b408-2e13-47dd-bb08-c49fbca3ce24\") " pod="openshift-lws-operator/lws-controller-manager-6dfb8f76f9-7kjqj" Jun 14 15:19:58.864435 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:19:58.864398 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jbhc\" (UniqueName: \"kubernetes.io/projected/dbf1b408-2e13-47dd-bb08-c49fbca3ce24-kube-api-access-7jbhc\") pod \"lws-controller-manager-6dfb8f76f9-7kjqj\" (UID: \"dbf1b408-2e13-47dd-bb08-c49fbca3ce24\") " pod="openshift-lws-operator/lws-controller-manager-6dfb8f76f9-7kjqj" Jun 14 15:19:58.864643 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:19:58.864461 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/dbf1b408-2e13-47dd-bb08-c49fbca3ce24-manager-config\") pod \"lws-controller-manager-6dfb8f76f9-7kjqj\" (UID: \"dbf1b408-2e13-47dd-bb08-c49fbca3ce24\") " pod="openshift-lws-operator/lws-controller-manager-6dfb8f76f9-7kjqj" Jun 14 15:19:58.864643 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:19:58.864490 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/dbf1b408-2e13-47dd-bb08-c49fbca3ce24-metrics-cert\") pod \"lws-controller-manager-6dfb8f76f9-7kjqj\" (UID: \"dbf1b408-2e13-47dd-bb08-c49fbca3ce24\") " pod="openshift-lws-operator/lws-controller-manager-6dfb8f76f9-7kjqj" Jun 14 15:19:58.864643 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:19:58.864521 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dbf1b408-2e13-47dd-bb08-c49fbca3ce24-cert\") pod \"lws-controller-manager-6dfb8f76f9-7kjqj\" (UID: \"dbf1b408-2e13-47dd-bb08-c49fbca3ce24\") " pod="openshift-lws-operator/lws-controller-manager-6dfb8f76f9-7kjqj" Jun 14 15:19:58.865156 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:19:58.865137 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/dbf1b408-2e13-47dd-bb08-c49fbca3ce24-manager-config\") pod \"lws-controller-manager-6dfb8f76f9-7kjqj\" (UID: \"dbf1b408-2e13-47dd-bb08-c49fbca3ce24\") " pod="openshift-lws-operator/lws-controller-manager-6dfb8f76f9-7kjqj" Jun 14 15:19:58.867014 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:19:58.866993 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dbf1b408-2e13-47dd-bb08-c49fbca3ce24-cert\") pod \"lws-controller-manager-6dfb8f76f9-7kjqj\" (UID: \"dbf1b408-2e13-47dd-bb08-c49fbca3ce24\") " pod="openshift-lws-operator/lws-controller-manager-6dfb8f76f9-7kjqj" Jun 14 15:19:58.867120 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:19:58.867039 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/dbf1b408-2e13-47dd-bb08-c49fbca3ce24-metrics-cert\") pod \"lws-controller-manager-6dfb8f76f9-7kjqj\" (UID: \"dbf1b408-2e13-47dd-bb08-c49fbca3ce24\") " pod="openshift-lws-operator/lws-controller-manager-6dfb8f76f9-7kjqj" Jun 14 15:19:58.881669 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:19:58.881642 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jbhc\" (UniqueName: \"kubernetes.io/projected/dbf1b408-2e13-47dd-bb08-c49fbca3ce24-kube-api-access-7jbhc\") pod \"lws-controller-manager-6dfb8f76f9-7kjqj\" (UID: \"dbf1b408-2e13-47dd-bb08-c49fbca3ce24\") " pod="openshift-lws-operator/lws-controller-manager-6dfb8f76f9-7kjqj" Jun 14 15:19:58.978366 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:19:58.978334 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6dfb8f76f9-7kjqj" Jun 14 15:19:59.145150 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:19:59.145116 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6dfb8f76f9-7kjqj"] Jun 14 15:19:59.148115 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:19:59.148087 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbf1b408_2e13_47dd_bb08_c49fbca3ce24.slice/crio-df6c747dd783ae3d8fc35bd397133f28b3f2d1548900f83050bf79672be1d45a WatchSource:0}: Error finding container df6c747dd783ae3d8fc35bd397133f28b3f2d1548900f83050bf79672be1d45a: Status 404 returned error can't find the container with id df6c747dd783ae3d8fc35bd397133f28b3f2d1548900f83050bf79672be1d45a Jun 14 15:19:59.179230 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:19:59.179196 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:19:59.272560 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:19:59.272532 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:19:59.429590 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:19:59.429504 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:19:59.608210 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:19:59.608179 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:19:59.712991 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:19:59.712965 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:19:59.777100 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:19:59.777061 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6dfb8f76f9-7kjqj" event={"ID":"dbf1b408-2e13-47dd-bb08-c49fbca3ce24","Type":"ContainerStarted","Data":"df6c747dd783ae3d8fc35bd397133f28b3f2d1548900f83050bf79672be1d45a"} Jun 14 15:19:59.813476 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:19:59.813438 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:20:00.403776 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:20:00.403741 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:20:00.690464 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:20:00.690441 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:20:01.791452 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:20:01.791365 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6dfb8f76f9-7kjqj" event={"ID":"dbf1b408-2e13-47dd-bb08-c49fbca3ce24","Type":"ContainerStarted","Data":"1c842c85f220084aa9f7adf0f4c7bf83e7caaa3dfa8fce2288ee04ad845d61d8"} Jun 14 15:20:01.791812 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:20:01.791458 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6dfb8f76f9-7kjqj" Jun 14 15:20:01.808987 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:20:01.808943 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6dfb8f76f9-7kjqj" podStartSLOduration=1.5157199860000001 podStartE2EDuration="3.808930531s" totalImagesPullingTime="2.293210545s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:19:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:20:01.808375445 +0000 UTC m=+358.989857961" watchObservedRunningTime="2026-06-14 15:20:01.808930531 +0000 UTC m=+358.990413091" Jun 14 15:20:11.167882 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:20:11.167823 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:20:11.358972 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:20:11.358940 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:20:11.520996 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:20:11.520951 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:20:12.657334 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:20:12.657302 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:20:12.797110 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:20:12.797085 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6dfb8f76f9-7kjqj" Jun 14 15:20:12.822249 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:20:12.822217 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:20:18.571318 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:20:18.571283 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:20:18.666290 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:20:18.666257 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:20:19.070755 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:20:19.070702 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:20:19.242354 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:20:19.242320 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:20:21.890536 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:20:21.890505 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:20:22.101465 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:20:22.101435 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:20:22.291093 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:20:22.291062 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:20:23.784795 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:20:23.784766 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:20:30.036289 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:20:30.036253 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-66c9fcbf98-9fw5w"] Jun 14 15:20:30.039404 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:20:30.039390 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-66c9fcbf98-9fw5w" Jun 14 15:20:30.055237 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:20:30.055215 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-8b57q\"" Jun 14 15:20:30.055352 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:20:30.055215 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 14 15:20:30.064135 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:20:30.064109 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-66c9fcbf98-9fw5w"] Jun 14 15:20:30.088274 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:20:30.088250 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:20:30.121167 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:20:30.121140 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnszh\" (UniqueName: \"kubernetes.io/projected/bc281542-3ec5-4f83-9a55-94fe6fb12b36-kube-api-access-pnszh\") pod \"dashboard-redirect-66c9fcbf98-9fw5w\" (UID: \"bc281542-3ec5-4f83-9a55-94fe6fb12b36\") " pod="opendatahub/dashboard-redirect-66c9fcbf98-9fw5w" Jun 14 15:20:30.121301 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:20:30.121188 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/bc281542-3ec5-4f83-9a55-94fe6fb12b36-redirect-config\") pod \"dashboard-redirect-66c9fcbf98-9fw5w\" (UID: \"bc281542-3ec5-4f83-9a55-94fe6fb12b36\") " pod="opendatahub/dashboard-redirect-66c9fcbf98-9fw5w" Jun 14 15:20:30.221816 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:20:30.221778 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/bc281542-3ec5-4f83-9a55-94fe6fb12b36-redirect-config\") pod \"dashboard-redirect-66c9fcbf98-9fw5w\" (UID: \"bc281542-3ec5-4f83-9a55-94fe6fb12b36\") " pod="opendatahub/dashboard-redirect-66c9fcbf98-9fw5w" Jun 14 15:20:30.222010 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:20:30.221876 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnszh\" (UniqueName: \"kubernetes.io/projected/bc281542-3ec5-4f83-9a55-94fe6fb12b36-kube-api-access-pnszh\") pod \"dashboard-redirect-66c9fcbf98-9fw5w\" (UID: \"bc281542-3ec5-4f83-9a55-94fe6fb12b36\") " pod="opendatahub/dashboard-redirect-66c9fcbf98-9fw5w" Jun 14 15:20:30.222487 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:20:30.222466 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/bc281542-3ec5-4f83-9a55-94fe6fb12b36-redirect-config\") pod \"dashboard-redirect-66c9fcbf98-9fw5w\" (UID: \"bc281542-3ec5-4f83-9a55-94fe6fb12b36\") " pod="opendatahub/dashboard-redirect-66c9fcbf98-9fw5w" Jun 14 15:20:30.233392 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:20:30.233370 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnszh\" (UniqueName: \"kubernetes.io/projected/bc281542-3ec5-4f83-9a55-94fe6fb12b36-kube-api-access-pnszh\") pod \"dashboard-redirect-66c9fcbf98-9fw5w\" (UID: \"bc281542-3ec5-4f83-9a55-94fe6fb12b36\") " pod="opendatahub/dashboard-redirect-66c9fcbf98-9fw5w" Jun 14 15:20:30.348956 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:20:30.348875 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-66c9fcbf98-9fw5w" Jun 14 15:20:30.490359 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:20:30.490325 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-66c9fcbf98-9fw5w"] Jun 14 15:20:30.493483 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:20:30.493454 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc281542_3ec5_4f83_9a55_94fe6fb12b36.slice/crio-edb9cdf8946f21bf6df4cb5c8473f13a8bbed3f247ee0e97a2fc4cca26c76039 WatchSource:0}: Error finding container edb9cdf8946f21bf6df4cb5c8473f13a8bbed3f247ee0e97a2fc4cca26c76039: Status 404 returned error can't find the container with id edb9cdf8946f21bf6df4cb5c8473f13a8bbed3f247ee0e97a2fc4cca26c76039 Jun 14 15:20:30.898366 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:20:30.898334 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-66c9fcbf98-9fw5w" event={"ID":"bc281542-3ec5-4f83-9a55-94fe6fb12b36","Type":"ContainerStarted","Data":"edb9cdf8946f21bf6df4cb5c8473f13a8bbed3f247ee0e97a2fc4cca26c76039"} Jun 14 15:20:32.908567 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:20:32.908471 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-66c9fcbf98-9fw5w" event={"ID":"bc281542-3ec5-4f83-9a55-94fe6fb12b36","Type":"ContainerStarted","Data":"a7c615c0f7099bf73e4c4d25b919cdc84f3ead1a0e4121a8703ec950c8cfe0c0"} Jun 14 15:20:32.925216 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:20:32.925190 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:20:32.932131 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:20:32.932091 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-66c9fcbf98-9fw5w" podStartSLOduration=1.905507084 podStartE2EDuration="3.932076478s" totalImagesPullingTime="2.026569394s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:20:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:20:32.929465075 +0000 UTC m=+390.110947598" watchObservedRunningTime="2026-06-14 15:20:32.932076478 +0000 UTC m=+390.113558994" Jun 14 15:20:33.450764 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:20:33.450730 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:20:33.612632 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:20:33.612592 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:20:45.860690 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:20:45.860654 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:20:45.956656 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:20:45.956610 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:20:46.408756 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:20:46.408718 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:20:49.214016 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:20:49.213983 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:20:49.312197 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:20:49.312163 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:20:49.478252 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:20:49.478171 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795v5sks"] Jun 14 15:20:49.481552 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:20:49.481531 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795v5sks" Jun 14 15:20:49.483945 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:20:49.483918 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 14 15:20:49.484089 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:20:49.483914 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 14 15:20:49.484089 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:20:49.484006 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 14 15:20:49.484089 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:20:49.484062 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-hvxc4\"" Jun 14 15:20:49.499698 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:20:49.499677 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795v5sks"] Jun 14 15:20:49.525120 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:20:49.525092 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:20:49.587092 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:20:49.587038 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d01de3fc-0972-441b-915d-359b698446cd-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795v5sks\" (UID: \"d01de3fc-0972-441b-915d-359b698446cd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795v5sks" Jun 14 15:20:49.587092 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:20:49.587100 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d01de3fc-0972-441b-915d-359b698446cd-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795v5sks\" (UID: \"d01de3fc-0972-441b-915d-359b698446cd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795v5sks" Jun 14 15:20:49.587315 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:20:49.587145 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d01de3fc-0972-441b-915d-359b698446cd-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795v5sks\" (UID: \"d01de3fc-0972-441b-915d-359b698446cd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795v5sks" Jun 14 15:20:49.587315 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:20:49.587165 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d01de3fc-0972-441b-915d-359b698446cd-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795v5sks\" (UID: \"d01de3fc-0972-441b-915d-359b698446cd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795v5sks" Jun 14 15:20:49.587315 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:20:49.587199 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8wmw\" (UniqueName: \"kubernetes.io/projected/d01de3fc-0972-441b-915d-359b698446cd-kube-api-access-x8wmw\") pod \"data-science-gateway-data-science-gateway-class-74759f9795v5sks\" (UID: \"d01de3fc-0972-441b-915d-359b698446cd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795v5sks" Jun 14 15:20:49.587315 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:20:49.587237 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d01de3fc-0972-441b-915d-359b698446cd-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795v5sks\" (UID: \"d01de3fc-0972-441b-915d-359b698446cd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795v5sks" Jun 14 15:20:49.587315 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:20:49.587284 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d01de3fc-0972-441b-915d-359b698446cd-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795v5sks\" (UID: \"d01de3fc-0972-441b-915d-359b698446cd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795v5sks" Jun 14 15:20:49.587315 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:20:49.587303 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d01de3fc-0972-441b-915d-359b698446cd-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795v5sks\" (UID: \"d01de3fc-0972-441b-915d-359b698446cd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795v5sks" Jun 14 15:20:49.587500 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:20:49.587355 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d01de3fc-0972-441b-915d-359b698446cd-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795v5sks\" (UID: \"d01de3fc-0972-441b-915d-359b698446cd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795v5sks" Jun 14 15:20:49.687068 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:20:49.687010 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:20:49.688114 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:20:49.688094 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d01de3fc-0972-441b-915d-359b698446cd-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795v5sks\" (UID: \"d01de3fc-0972-441b-915d-359b698446cd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795v5sks" Jun 14 15:20:49.688171 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:20:49.688126 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d01de3fc-0972-441b-915d-359b698446cd-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795v5sks\" (UID: \"d01de3fc-0972-441b-915d-359b698446cd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795v5sks" Jun 14 15:20:49.688210 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:20:49.688169 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d01de3fc-0972-441b-915d-359b698446cd-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795v5sks\" (UID: \"d01de3fc-0972-441b-915d-359b698446cd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795v5sks" Jun 14 15:20:49.688245 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:20:49.688212 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d01de3fc-0972-441b-915d-359b698446cd-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795v5sks\" (UID: \"d01de3fc-0972-441b-915d-359b698446cd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795v5sks" Jun 14 15:20:49.688245 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:20:49.688235 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d01de3fc-0972-441b-915d-359b698446cd-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795v5sks\" (UID: \"d01de3fc-0972-441b-915d-359b698446cd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795v5sks" Jun 14 15:20:49.688329 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:20:49.688262 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d01de3fc-0972-441b-915d-359b698446cd-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795v5sks\" (UID: \"d01de3fc-0972-441b-915d-359b698446cd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795v5sks" Jun 14 15:20:49.688405 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:20:49.688379 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d01de3fc-0972-441b-915d-359b698446cd-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795v5sks\" (UID: \"d01de3fc-0972-441b-915d-359b698446cd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795v5sks" Jun 14 15:20:49.688563 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:20:49.688539 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d01de3fc-0972-441b-915d-359b698446cd-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795v5sks\" (UID: \"d01de3fc-0972-441b-915d-359b698446cd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795v5sks" Jun 14 15:20:49.688563 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:20:49.688551 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d01de3fc-0972-441b-915d-359b698446cd-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795v5sks\" (UID: \"d01de3fc-0972-441b-915d-359b698446cd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795v5sks" Jun 14 15:20:49.688713 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:20:49.688694 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d01de3fc-0972-441b-915d-359b698446cd-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795v5sks\" (UID: \"d01de3fc-0972-441b-915d-359b698446cd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795v5sks" Jun 14 15:20:49.688828 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:20:49.688722 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8wmw\" (UniqueName: \"kubernetes.io/projected/d01de3fc-0972-441b-915d-359b698446cd-kube-api-access-x8wmw\") pod \"data-science-gateway-data-science-gateway-class-74759f9795v5sks\" (UID: \"d01de3fc-0972-441b-915d-359b698446cd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795v5sks" Jun 14 15:20:49.688928 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:20:49.688857 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d01de3fc-0972-441b-915d-359b698446cd-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795v5sks\" (UID: \"d01de3fc-0972-441b-915d-359b698446cd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795v5sks" Jun 14 15:20:49.689154 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:20:49.689136 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d01de3fc-0972-441b-915d-359b698446cd-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795v5sks\" (UID: \"d01de3fc-0972-441b-915d-359b698446cd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795v5sks" Jun 14 15:20:49.689222 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:20:49.689175 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d01de3fc-0972-441b-915d-359b698446cd-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795v5sks\" (UID: \"d01de3fc-0972-441b-915d-359b698446cd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795v5sks" Jun 14 15:20:49.690600 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:20:49.690579 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d01de3fc-0972-441b-915d-359b698446cd-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795v5sks\" (UID: \"d01de3fc-0972-441b-915d-359b698446cd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795v5sks" Jun 14 15:20:49.690728 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:20:49.690709 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d01de3fc-0972-441b-915d-359b698446cd-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795v5sks\" (UID: \"d01de3fc-0972-441b-915d-359b698446cd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795v5sks" Jun 14 15:20:49.698445 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:20:49.698425 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d01de3fc-0972-441b-915d-359b698446cd-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795v5sks\" (UID: \"d01de3fc-0972-441b-915d-359b698446cd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795v5sks" Jun 14 15:20:49.698544 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:20:49.698478 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8wmw\" (UniqueName: \"kubernetes.io/projected/d01de3fc-0972-441b-915d-359b698446cd-kube-api-access-x8wmw\") pod \"data-science-gateway-data-science-gateway-class-74759f9795v5sks\" (UID: \"d01de3fc-0972-441b-915d-359b698446cd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795v5sks" Jun 14 15:20:49.787127 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:20:49.787033 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:20:49.791529 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:20:49.791513 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795v5sks" Jun 14 15:20:49.922889 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:20:49.922861 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795v5sks"] Jun 14 15:20:49.925379 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:20:49.925352 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd01de3fc_0972_441b_915d_359b698446cd.slice/crio-8288331d278bc47104ac18c30d9f8715dd2f0b380ad921a8e93a9c41aa462425 WatchSource:0}: Error finding container 8288331d278bc47104ac18c30d9f8715dd2f0b380ad921a8e93a9c41aa462425: Status 404 returned error can't find the container with id 8288331d278bc47104ac18c30d9f8715dd2f0b380ad921a8e93a9c41aa462425 Jun 14 15:20:49.975660 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:20:49.975623 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795v5sks" event={"ID":"d01de3fc-0972-441b-915d-359b698446cd","Type":"ContainerStarted","Data":"8288331d278bc47104ac18c30d9f8715dd2f0b380ad921a8e93a9c41aa462425"} Jun 14 15:20:50.366789 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:20:50.366748 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:20:52.158528 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:20:52.158477 2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 14 15:20:52.158854 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:20:52.158574 2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 14 15:20:52.158854 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:20:52.158612 2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 14 15:20:52.991359 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:20:52.991320 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795v5sks" event={"ID":"d01de3fc-0972-441b-915d-359b698446cd","Type":"ContainerStarted","Data":"c2f64608af74e3ce7d0e75bd3863a8a30c1bb2c7979af19797925e6996926ddd"} Jun 14 15:20:53.013602 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:20:53.013559 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795v5sks" podStartSLOduration=1.782757906 podStartE2EDuration="4.013544108s" totalImagesPullingTime="2.230786202s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:20:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:20:53.011823148 +0000 UTC m=+410.193305664" watchObservedRunningTime="2026-06-14 15:20:53.013544108 +0000 UTC m=+410.195026690" Jun 14 15:20:53.792609 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:20:53.792573 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795v5sks" Jun 14 15:20:53.797276 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:20:53.797246 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795v5sks" Jun 14 15:20:53.995687 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:20:53.995661 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795v5sks" Jun 14 15:20:53.996705 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:20:53.996685 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795v5sks" Jun 14 15:20:59.901089 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:20:59.901032 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:20:59.997594 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:20:59.997558 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:21:00.024136 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:00.024105 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5cz5p"] Jun 14 15:21:00.027480 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:00.027458 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-5cz5p" Jun 14 15:21:00.030007 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:00.029770 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-vfxvp\"" Jun 14 15:21:00.030007 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:00.029768 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 14 15:21:00.030964 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:00.030943 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 14 15:21:00.038339 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:00.038309 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5cz5p"] Jun 14 15:21:00.112857 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:00.112802 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:21:00.186857 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:00.186743 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdgrm\" (UniqueName: \"kubernetes.io/projected/7877f7dd-fba0-4d3c-87f3-8c8062d359bb-kube-api-access-pdgrm\") pod \"kuadrant-operator-catalog-5cz5p\" (UID: \"7877f7dd-fba0-4d3c-87f3-8c8062d359bb\") " pod="kuadrant-system/kuadrant-operator-catalog-5cz5p" Jun 14 15:21:00.288280 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:00.288241 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdgrm\" (UniqueName: \"kubernetes.io/projected/7877f7dd-fba0-4d3c-87f3-8c8062d359bb-kube-api-access-pdgrm\") pod \"kuadrant-operator-catalog-5cz5p\" (UID: \"7877f7dd-fba0-4d3c-87f3-8c8062d359bb\") " pod="kuadrant-system/kuadrant-operator-catalog-5cz5p" Jun 14 15:21:00.296540 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:00.296502 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdgrm\" (UniqueName: \"kubernetes.io/projected/7877f7dd-fba0-4d3c-87f3-8c8062d359bb-kube-api-access-pdgrm\") pod \"kuadrant-operator-catalog-5cz5p\" (UID: \"7877f7dd-fba0-4d3c-87f3-8c8062d359bb\") " pod="kuadrant-system/kuadrant-operator-catalog-5cz5p" Jun 14 15:21:00.338384 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:00.338340 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-5cz5p" Jun 14 15:21:00.389097 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:00.388991 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5cz5p"] Jun 14 15:21:00.470420 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:00.470393 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5cz5p"] Jun 14 15:21:00.473230 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:21:00.473206 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7877f7dd_fba0_4d3c_87f3_8c8062d359bb.slice/crio-f2ea7116ba12efec4b142ab297527906ed248dbf55ae5347468b34b0c5652055 WatchSource:0}: Error finding container f2ea7116ba12efec4b142ab297527906ed248dbf55ae5347468b34b0c5652055: Status 404 returned error can't find the container with id f2ea7116ba12efec4b142ab297527906ed248dbf55ae5347468b34b0c5652055 Jun 14 15:21:00.596842 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:00.596804 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mdkbx"] Jun 14 15:21:00.601269 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:00.601247 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-mdkbx" Jun 14 15:21:00.608095 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:00.608072 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mdkbx"] Jun 14 15:21:00.692507 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:00.692468 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psq7b\" (UniqueName: \"kubernetes.io/projected/5ea5fe6c-18ec-4d74-bb1a-dcf9aa1e10ca-kube-api-access-psq7b\") pod \"kuadrant-operator-catalog-mdkbx\" (UID: \"5ea5fe6c-18ec-4d74-bb1a-dcf9aa1e10ca\") " pod="kuadrant-system/kuadrant-operator-catalog-mdkbx" Jun 14 15:21:00.793039 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:00.792954 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psq7b\" (UniqueName: \"kubernetes.io/projected/5ea5fe6c-18ec-4d74-bb1a-dcf9aa1e10ca-kube-api-access-psq7b\") pod \"kuadrant-operator-catalog-mdkbx\" (UID: \"5ea5fe6c-18ec-4d74-bb1a-dcf9aa1e10ca\") " pod="kuadrant-system/kuadrant-operator-catalog-mdkbx" Jun 14 15:21:00.801358 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:00.801324 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-psq7b\" (UniqueName: \"kubernetes.io/projected/5ea5fe6c-18ec-4d74-bb1a-dcf9aa1e10ca-kube-api-access-psq7b\") pod \"kuadrant-operator-catalog-mdkbx\" (UID: \"5ea5fe6c-18ec-4d74-bb1a-dcf9aa1e10ca\") " pod="kuadrant-system/kuadrant-operator-catalog-mdkbx" Jun 14 15:21:00.911206 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:00.911171 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-mdkbx" Jun 14 15:21:01.024394 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:01.024364 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-5cz5p" event={"ID":"7877f7dd-fba0-4d3c-87f3-8c8062d359bb","Type":"ContainerStarted","Data":"f2ea7116ba12efec4b142ab297527906ed248dbf55ae5347468b34b0c5652055"} Jun 14 15:21:01.039394 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:01.039363 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mdkbx"] Jun 14 15:21:01.042296 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:21:01.042268 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ea5fe6c_18ec_4d74_bb1a_dcf9aa1e10ca.slice/crio-3961bb11c2ab989b718e286548765c1145aa44449602bb066a2beba880f7b4f0 WatchSource:0}: Error finding container 3961bb11c2ab989b718e286548765c1145aa44449602bb066a2beba880f7b4f0: Status 404 returned error can't find the container with id 3961bb11c2ab989b718e286548765c1145aa44449602bb066a2beba880f7b4f0 Jun 14 15:21:02.030824 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:02.030786 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-mdkbx" event={"ID":"5ea5fe6c-18ec-4d74-bb1a-dcf9aa1e10ca","Type":"ContainerStarted","Data":"3961bb11c2ab989b718e286548765c1145aa44449602bb066a2beba880f7b4f0"} Jun 14 15:21:03.036795 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:03.036762 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-5cz5p" event={"ID":"7877f7dd-fba0-4d3c-87f3-8c8062d359bb","Type":"ContainerStarted","Data":"7293b97d3d5fde4039a4ff494d8fe7c8bf243a424d6d2c9274d9e1afe6d742c1"} Jun 14 15:21:03.037318 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:03.036829 2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-5cz5p" podUID="7877f7dd-fba0-4d3c-87f3-8c8062d359bb" containerName="registry-server" containerID="cri-o://7293b97d3d5fde4039a4ff494d8fe7c8bf243a424d6d2c9274d9e1afe6d742c1" gracePeriod=2 Jun 14 15:21:03.038434 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:03.038408 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-mdkbx" event={"ID":"5ea5fe6c-18ec-4d74-bb1a-dcf9aa1e10ca","Type":"ContainerStarted","Data":"d42b5f00a97bed17f72ec70d919e6893286268c7e97e338cd9f621d3ebb2f707"} Jun 14 15:21:03.054163 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:03.054110 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-5cz5p" podStartSLOduration=0.913067771 podStartE2EDuration="3.054027405s" totalImagesPullingTime="2.140959634s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:21:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:21:03.051883166 +0000 UTC m=+420.233365693" watchObservedRunningTime="2026-06-14 15:21:03.054027405 +0000 UTC m=+420.235509922" Jun 14 15:21:03.071984 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:03.071932 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-mdkbx" podStartSLOduration=1.471925958 podStartE2EDuration="3.071918375s" totalImagesPullingTime="1.599992417s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:21:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:21:03.070386856 +0000 UTC m=+420.251869375" watchObservedRunningTime="2026-06-14 15:21:03.071918375 +0000 UTC m=+420.253400891" Jun 14 15:21:03.284758 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:03.284726 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-5cz5p" Jun 14 15:21:03.416158 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:03.416074 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pdgrm\" (UniqueName: \"kubernetes.io/projected/7877f7dd-fba0-4d3c-87f3-8c8062d359bb-kube-api-access-pdgrm\") pod \"7877f7dd-fba0-4d3c-87f3-8c8062d359bb\" (UID: \"7877f7dd-fba0-4d3c-87f3-8c8062d359bb\") " Jun 14 15:21:03.418190 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:03.418166 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7877f7dd-fba0-4d3c-87f3-8c8062d359bb-kube-api-access-pdgrm" (OuterVolumeSpecName: "kube-api-access-pdgrm") pod "7877f7dd-fba0-4d3c-87f3-8c8062d359bb" (UID: "7877f7dd-fba0-4d3c-87f3-8c8062d359bb"). InnerVolumeSpecName "kube-api-access-pdgrm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 15:21:03.517392 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:03.517351 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pdgrm\" (UniqueName: \"kubernetes.io/projected/7877f7dd-fba0-4d3c-87f3-8c8062d359bb-kube-api-access-pdgrm\") on node \"ip-10-0-140-30.ec2.internal\" DevicePath \"\"" Jun 14 15:21:04.044260 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:04.044217 2571 generic.go:356] "Generic (PLEG): container finished" podID="7877f7dd-fba0-4d3c-87f3-8c8062d359bb" containerID="7293b97d3d5fde4039a4ff494d8fe7c8bf243a424d6d2c9274d9e1afe6d742c1" exitCode=0 Jun 14 15:21:04.044260 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:04.044264 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-5cz5p" Jun 14 15:21:04.044758 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:04.044302 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-5cz5p" event={"ID":"7877f7dd-fba0-4d3c-87f3-8c8062d359bb","Type":"ContainerDied","Data":"7293b97d3d5fde4039a4ff494d8fe7c8bf243a424d6d2c9274d9e1afe6d742c1"} Jun 14 15:21:04.044758 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:04.044351 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-5cz5p" event={"ID":"7877f7dd-fba0-4d3c-87f3-8c8062d359bb","Type":"ContainerDied","Data":"f2ea7116ba12efec4b142ab297527906ed248dbf55ae5347468b34b0c5652055"} Jun 14 15:21:04.044758 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:04.044371 2571 scope.go:117] "RemoveContainer" containerID="7293b97d3d5fde4039a4ff494d8fe7c8bf243a424d6d2c9274d9e1afe6d742c1" Jun 14 15:21:04.053449 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:04.053427 2571 scope.go:117] "RemoveContainer" containerID="7293b97d3d5fde4039a4ff494d8fe7c8bf243a424d6d2c9274d9e1afe6d742c1" Jun 14 15:21:04.053752 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:21:04.053734 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7293b97d3d5fde4039a4ff494d8fe7c8bf243a424d6d2c9274d9e1afe6d742c1\": container with ID starting with 7293b97d3d5fde4039a4ff494d8fe7c8bf243a424d6d2c9274d9e1afe6d742c1 not found: ID does not exist" containerID="7293b97d3d5fde4039a4ff494d8fe7c8bf243a424d6d2c9274d9e1afe6d742c1" Jun 14 15:21:04.053800 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:04.053764 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7293b97d3d5fde4039a4ff494d8fe7c8bf243a424d6d2c9274d9e1afe6d742c1"} err="failed to get container status \"7293b97d3d5fde4039a4ff494d8fe7c8bf243a424d6d2c9274d9e1afe6d742c1\": rpc error: code = NotFound desc = could not find container \"7293b97d3d5fde4039a4ff494d8fe7c8bf243a424d6d2c9274d9e1afe6d742c1\": container with ID starting with 7293b97d3d5fde4039a4ff494d8fe7c8bf243a424d6d2c9274d9e1afe6d742c1 not found: ID does not exist" Jun 14 15:21:04.065631 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:04.065605 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5cz5p"] Jun 14 15:21:04.068598 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:04.068573 2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5cz5p"] Jun 14 15:21:05.305673 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:05.305639 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7877f7dd-fba0-4d3c-87f3-8c8062d359bb" path="/var/lib/kubelet/pods/7877f7dd-fba0-4d3c-87f3-8c8062d359bb/volumes" Jun 14 15:21:10.911917 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:10.911876 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-mdkbx" Jun 14 15:21:10.912327 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:10.911941 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-mdkbx" Jun 14 15:21:10.934353 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:10.934322 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-mdkbx" Jun 14 15:21:11.100993 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:11.100963 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-mdkbx" Jun 14 15:21:24.011768 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:24.011631 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:21:24.609734 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:24.609685 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:21:25.858141 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:25.858103 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:21:25.959218 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:25.959172 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:21:27.896921 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:27.896887 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-p5j7t"] Jun 14 15:21:27.897310 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:27.897211 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7877f7dd-fba0-4d3c-87f3-8c8062d359bb" containerName="registry-server" Jun 14 15:21:27.897310 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:27.897223 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="7877f7dd-fba0-4d3c-87f3-8c8062d359bb" containerName="registry-server" Jun 14 15:21:27.897310 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:27.897283 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="7877f7dd-fba0-4d3c-87f3-8c8062d359bb" containerName="registry-server" Jun 14 15:21:27.905994 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:27.905978 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-p5j7t" Jun 14 15:21:27.908223 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:27.908204 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-b5w7f\"" Jun 14 15:21:27.912159 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:27.912134 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-p5j7t"] Jun 14 15:21:28.017465 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:28.017428 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nczmc\" (UniqueName: \"kubernetes.io/projected/20d4c612-8b95-457f-ab6e-f5cb101b7a02-kube-api-access-nczmc\") pod \"authorino-operator-75cc8d5cb7-p5j7t\" (UID: \"20d4c612-8b95-457f-ab6e-f5cb101b7a02\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-p5j7t" Jun 14 15:21:28.118436 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:28.118403 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nczmc\" (UniqueName: \"kubernetes.io/projected/20d4c612-8b95-457f-ab6e-f5cb101b7a02-kube-api-access-nczmc\") pod \"authorino-operator-75cc8d5cb7-p5j7t\" (UID: \"20d4c612-8b95-457f-ab6e-f5cb101b7a02\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-p5j7t" Jun 14 15:21:28.132685 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:28.132661 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nczmc\" (UniqueName: \"kubernetes.io/projected/20d4c612-8b95-457f-ab6e-f5cb101b7a02-kube-api-access-nczmc\") pod \"authorino-operator-75cc8d5cb7-p5j7t\" (UID: \"20d4c612-8b95-457f-ab6e-f5cb101b7a02\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-p5j7t" Jun 14 15:21:28.216324 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:28.216302 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-p5j7t" Jun 14 15:21:28.346718 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:28.346692 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-p5j7t"] Jun 14 15:21:28.349322 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:21:28.349289 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20d4c612_8b95_457f_ab6e_f5cb101b7a02.slice/crio-e15098f77a7aa10c4bfa070339207efd3bccb5a78445140069dc360fa3696b7b WatchSource:0}: Error finding container e15098f77a7aa10c4bfa070339207efd3bccb5a78445140069dc360fa3696b7b: Status 404 returned error can't find the container with id e15098f77a7aa10c4bfa070339207efd3bccb5a78445140069dc360fa3696b7b Jun 14 15:21:29.021822 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:29.021791 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:21:29.159688 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:29.159634 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-p5j7t" event={"ID":"20d4c612-8b95-457f-ab6e-f5cb101b7a02","Type":"ContainerStarted","Data":"e15098f77a7aa10c4bfa070339207efd3bccb5a78445140069dc360fa3696b7b"} Jun 14 15:21:31.174237 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:31.174196 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-p5j7t" event={"ID":"20d4c612-8b95-457f-ab6e-f5cb101b7a02","Type":"ContainerStarted","Data":"83184866e1b57182ad4131522153a0d3e2d558fb851c912334c3d02afbc4d6f5"} Jun 14 15:21:31.174648 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:31.174312 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-p5j7t" Jun 14 15:21:31.191824 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:31.191768 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-p5j7t" podStartSLOduration=2.032440576 podStartE2EDuration="4.191751565s" totalImagesPullingTime="2.159310989s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:21:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:21:31.190577704 +0000 UTC m=+448.372060234" watchObservedRunningTime="2026-06-14 15:21:31.191751565 +0000 UTC m=+448.373234138" Jun 14 15:21:31.626457 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:31.626428 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:21:32.278358 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:32.278318 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:21:33.426753 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:33.426723 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-2t9hz"] Jun 14 15:21:33.434645 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:33.434622 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2t9hz" Jun 14 15:21:33.440173 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:33.440148 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 14 15:21:33.441009 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:33.440988 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-99lg8\"" Jun 14 15:21:33.445174 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:33.445149 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-2t9hz"] Jun 14 15:21:33.565605 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:33.565569 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dz2c\" (UniqueName: \"kubernetes.io/projected/b978a3f4-f143-403e-b16c-a987925f21e8-kube-api-access-7dz2c\") pod \"dns-operator-controller-manager-864dd78c4c-2t9hz\" (UID: \"b978a3f4-f143-403e-b16c-a987925f21e8\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2t9hz" Jun 14 15:21:33.666986 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:33.666955 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dz2c\" (UniqueName: \"kubernetes.io/projected/b978a3f4-f143-403e-b16c-a987925f21e8-kube-api-access-7dz2c\") pod \"dns-operator-controller-manager-864dd78c4c-2t9hz\" (UID: \"b978a3f4-f143-403e-b16c-a987925f21e8\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2t9hz" Jun 14 15:21:33.679685 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:33.679621 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dz2c\" (UniqueName: \"kubernetes.io/projected/b978a3f4-f143-403e-b16c-a987925f21e8-kube-api-access-7dz2c\") pod \"dns-operator-controller-manager-864dd78c4c-2t9hz\" (UID: \"b978a3f4-f143-403e-b16c-a987925f21e8\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2t9hz" Jun 14 15:21:33.744246 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:33.744222 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2t9hz" Jun 14 15:21:33.874537 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:33.874508 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-2t9hz"] Jun 14 15:21:33.877957 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:21:33.877929 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb978a3f4_f143_403e_b16c_a987925f21e8.slice/crio-d3b60e2be29745f0a9ce4f601488de180b77726d712ca083b65c2e9c0989da1c WatchSource:0}: Error finding container d3b60e2be29745f0a9ce4f601488de180b77726d712ca083b65c2e9c0989da1c: Status 404 returned error can't find the container with id d3b60e2be29745f0a9ce4f601488de180b77726d712ca083b65c2e9c0989da1c Jun 14 15:21:34.028311 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:34.028268 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:21:34.189306 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:34.189262 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2t9hz" event={"ID":"b978a3f4-f143-403e-b16c-a987925f21e8","Type":"ContainerStarted","Data":"d3b60e2be29745f0a9ce4f601488de180b77726d712ca083b65c2e9c0989da1c"} Jun 14 15:21:34.212442 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:34.212385 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-cdb8c9959-rftb5"] Jun 14 15:21:34.217884 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:34.217841 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cdb8c9959-rftb5" Jun 14 15:21:34.224400 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:34.224364 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 14 15:21:34.224400 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:34.224396 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 14 15:21:34.225617 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:34.225585 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 14 15:21:34.226415 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:34.226384 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 14 15:21:34.226890 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:34.226862 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 14 15:21:34.227198 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:34.227160 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-mzggm\"" Jun 14 15:21:34.227356 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:34.227226 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 14 15:21:34.227602 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:34.227529 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 14 15:21:34.234594 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:34.234551 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 14 15:21:34.242751 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:34.242710 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-cdb8c9959-rftb5"] Jun 14 15:21:34.272744 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:34.272686 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5701d444-575e-411f-aa0c-37448380a05a-oauth-serving-cert\") pod \"console-cdb8c9959-rftb5\" (UID: \"5701d444-575e-411f-aa0c-37448380a05a\") " pod="openshift-console/console-cdb8c9959-rftb5" Jun 14 15:21:34.272980 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:34.272768 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2shg9\" (UniqueName: \"kubernetes.io/projected/5701d444-575e-411f-aa0c-37448380a05a-kube-api-access-2shg9\") pod \"console-cdb8c9959-rftb5\" (UID: \"5701d444-575e-411f-aa0c-37448380a05a\") " pod="openshift-console/console-cdb8c9959-rftb5" Jun 14 15:21:34.272980 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:34.272811 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5701d444-575e-411f-aa0c-37448380a05a-console-serving-cert\") pod \"console-cdb8c9959-rftb5\" (UID: \"5701d444-575e-411f-aa0c-37448380a05a\") " pod="openshift-console/console-cdb8c9959-rftb5" Jun 14 15:21:34.272980 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:34.272840 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5701d444-575e-411f-aa0c-37448380a05a-service-ca\") pod \"console-cdb8c9959-rftb5\" (UID: \"5701d444-575e-411f-aa0c-37448380a05a\") " pod="openshift-console/console-cdb8c9959-rftb5" Jun 14 15:21:34.272980 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:34.272879 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5701d444-575e-411f-aa0c-37448380a05a-console-oauth-config\") pod \"console-cdb8c9959-rftb5\" (UID: \"5701d444-575e-411f-aa0c-37448380a05a\") " pod="openshift-console/console-cdb8c9959-rftb5" Jun 14 15:21:34.272980 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:34.272907 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5701d444-575e-411f-aa0c-37448380a05a-trusted-ca-bundle\") pod \"console-cdb8c9959-rftb5\" (UID: \"5701d444-575e-411f-aa0c-37448380a05a\") " pod="openshift-console/console-cdb8c9959-rftb5" Jun 14 15:21:34.272980 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:34.272934 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5701d444-575e-411f-aa0c-37448380a05a-console-config\") pod \"console-cdb8c9959-rftb5\" (UID: \"5701d444-575e-411f-aa0c-37448380a05a\") " pod="openshift-console/console-cdb8c9959-rftb5" Jun 14 15:21:34.300029 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:34.299942 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:21:34.374068 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:34.374021 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5701d444-575e-411f-aa0c-37448380a05a-oauth-serving-cert\") pod \"console-cdb8c9959-rftb5\" (UID: \"5701d444-575e-411f-aa0c-37448380a05a\") " pod="openshift-console/console-cdb8c9959-rftb5" Jun 14 15:21:34.374235 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:34.374091 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2shg9\" (UniqueName: \"kubernetes.io/projected/5701d444-575e-411f-aa0c-37448380a05a-kube-api-access-2shg9\") pod \"console-cdb8c9959-rftb5\" (UID: \"5701d444-575e-411f-aa0c-37448380a05a\") " pod="openshift-console/console-cdb8c9959-rftb5" Jun 14 15:21:34.374235 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:34.374122 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5701d444-575e-411f-aa0c-37448380a05a-console-serving-cert\") pod \"console-cdb8c9959-rftb5\" (UID: \"5701d444-575e-411f-aa0c-37448380a05a\") " pod="openshift-console/console-cdb8c9959-rftb5" Jun 14 15:21:34.374235 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:34.374160 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5701d444-575e-411f-aa0c-37448380a05a-service-ca\") pod \"console-cdb8c9959-rftb5\" (UID: \"5701d444-575e-411f-aa0c-37448380a05a\") " pod="openshift-console/console-cdb8c9959-rftb5" Jun 14 15:21:34.374235 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:34.374216 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5701d444-575e-411f-aa0c-37448380a05a-console-oauth-config\") pod \"console-cdb8c9959-rftb5\" (UID: \"5701d444-575e-411f-aa0c-37448380a05a\") " pod="openshift-console/console-cdb8c9959-rftb5" Jun 14 15:21:34.374452 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:34.374250 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5701d444-575e-411f-aa0c-37448380a05a-trusted-ca-bundle\") pod \"console-cdb8c9959-rftb5\" (UID: \"5701d444-575e-411f-aa0c-37448380a05a\") " pod="openshift-console/console-cdb8c9959-rftb5" Jun 14 15:21:34.374452 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:34.374281 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5701d444-575e-411f-aa0c-37448380a05a-console-config\") pod \"console-cdb8c9959-rftb5\" (UID: \"5701d444-575e-411f-aa0c-37448380a05a\") " pod="openshift-console/console-cdb8c9959-rftb5" Jun 14 15:21:34.374935 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:34.374905 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5701d444-575e-411f-aa0c-37448380a05a-oauth-serving-cert\") pod \"console-cdb8c9959-rftb5\" (UID: \"5701d444-575e-411f-aa0c-37448380a05a\") " pod="openshift-console/console-cdb8c9959-rftb5" Jun 14 15:21:34.375087 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:34.374937 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5701d444-575e-411f-aa0c-37448380a05a-console-config\") pod \"console-cdb8c9959-rftb5\" (UID: \"5701d444-575e-411f-aa0c-37448380a05a\") " pod="openshift-console/console-cdb8c9959-rftb5" Jun 14 15:21:34.375087 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:34.374964 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5701d444-575e-411f-aa0c-37448380a05a-service-ca\") pod \"console-cdb8c9959-rftb5\" (UID: \"5701d444-575e-411f-aa0c-37448380a05a\") " pod="openshift-console/console-cdb8c9959-rftb5" Jun 14 15:21:34.375087 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:34.375037 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5701d444-575e-411f-aa0c-37448380a05a-trusted-ca-bundle\") pod \"console-cdb8c9959-rftb5\" (UID: \"5701d444-575e-411f-aa0c-37448380a05a\") " pod="openshift-console/console-cdb8c9959-rftb5" Jun 14 15:21:34.376662 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:34.376642 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5701d444-575e-411f-aa0c-37448380a05a-console-serving-cert\") pod \"console-cdb8c9959-rftb5\" (UID: \"5701d444-575e-411f-aa0c-37448380a05a\") " pod="openshift-console/console-cdb8c9959-rftb5" Jun 14 15:21:34.376759 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:34.376704 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5701d444-575e-411f-aa0c-37448380a05a-console-oauth-config\") pod \"console-cdb8c9959-rftb5\" (UID: \"5701d444-575e-411f-aa0c-37448380a05a\") " pod="openshift-console/console-cdb8c9959-rftb5" Jun 14 15:21:34.385807 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:34.385775 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:21:34.386491 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:34.386475 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2shg9\" (UniqueName: \"kubernetes.io/projected/5701d444-575e-411f-aa0c-37448380a05a-kube-api-access-2shg9\") pod \"console-cdb8c9959-rftb5\" (UID: \"5701d444-575e-411f-aa0c-37448380a05a\") " pod="openshift-console/console-cdb8c9959-rftb5" Jun 14 15:21:34.492573 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:34.492541 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:21:34.531802 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:34.531771 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cdb8c9959-rftb5" Jun 14 15:21:34.687659 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:34.687635 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-cdb8c9959-rftb5"] Jun 14 15:21:34.691806 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:21:34.691781 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5701d444_575e_411f_aa0c_37448380a05a.slice/crio-2507fa06289d7c028df8fbdf424a71b25043537cfc80a0ae9bd367b17532f9d4 WatchSource:0}: Error finding container 2507fa06289d7c028df8fbdf424a71b25043537cfc80a0ae9bd367b17532f9d4: Status 404 returned error can't find the container with id 2507fa06289d7c028df8fbdf424a71b25043537cfc80a0ae9bd367b17532f9d4 Jun 14 15:21:35.196999 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:35.196965 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cdb8c9959-rftb5" event={"ID":"5701d444-575e-411f-aa0c-37448380a05a","Type":"ContainerStarted","Data":"a32591d47cc63a9b05dd763bbb9368c755aa5b0e02ad9170ae5700aa1fdc81f1"} Jun 14 15:21:35.196999 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:35.197020 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cdb8c9959-rftb5" event={"ID":"5701d444-575e-411f-aa0c-37448380a05a","Type":"ContainerStarted","Data":"2507fa06289d7c028df8fbdf424a71b25043537cfc80a0ae9bd367b17532f9d4"} Jun 14 15:21:35.215929 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:35.215844 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-cdb8c9959-rftb5" podStartSLOduration=1.215826799 podStartE2EDuration="1.215826799s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:21:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:21:35.215359955 +0000 UTC m=+452.396842471" watchObservedRunningTime="2026-06-14 15:21:35.215826799 +0000 UTC m=+452.397309318" Jun 14 15:21:37.219695 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:37.219655 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2t9hz" event={"ID":"b978a3f4-f143-403e-b16c-a987925f21e8","Type":"ContainerStarted","Data":"9661af51a7a451d0f71165ce92c345ccaae1f1c0f65dfff83b1a351aec383a46"} Jun 14 15:21:37.220103 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:37.219764 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2t9hz" Jun 14 15:21:37.238957 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:37.238909 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2t9hz" podStartSLOduration=1.969989561 podStartE2EDuration="4.238892795s" totalImagesPullingTime="2.268903234s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:21:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:21:37.236806013 +0000 UTC m=+454.418288529" watchObservedRunningTime="2026-06-14 15:21:37.238892795 +0000 UTC m=+454.420375311" Jun 14 15:21:37.465288 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:37.465259 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:21:37.886502 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:37.886467 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sp6lr"] Jun 14 15:21:37.889879 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:37.889860 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sp6lr" Jun 14 15:21:37.892378 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:37.892358 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-mwrdq\"" Jun 14 15:21:37.906910 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:37.906877 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sp6lr"] Jun 14 15:21:38.022574 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:38.022537 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/afd16fc4-fcb1-4ea6-ab96-0cc82541a9a1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-sp6lr\" (UID: \"afd16fc4-fcb1-4ea6-ab96-0cc82541a9a1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sp6lr" Jun 14 15:21:38.022731 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:38.022588 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqcf4\" (UniqueName: \"kubernetes.io/projected/afd16fc4-fcb1-4ea6-ab96-0cc82541a9a1-kube-api-access-kqcf4\") pod \"kuadrant-operator-controller-manager-8684c9ff49-sp6lr\" (UID: \"afd16fc4-fcb1-4ea6-ab96-0cc82541a9a1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sp6lr" Jun 14 15:21:38.123828 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:38.123785 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/afd16fc4-fcb1-4ea6-ab96-0cc82541a9a1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-sp6lr\" (UID: \"afd16fc4-fcb1-4ea6-ab96-0cc82541a9a1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sp6lr" Jun 14 15:21:38.123973 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:38.123844 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqcf4\" (UniqueName: \"kubernetes.io/projected/afd16fc4-fcb1-4ea6-ab96-0cc82541a9a1-kube-api-access-kqcf4\") pod \"kuadrant-operator-controller-manager-8684c9ff49-sp6lr\" (UID: \"afd16fc4-fcb1-4ea6-ab96-0cc82541a9a1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sp6lr" Jun 14 15:21:38.124205 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:38.124186 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/afd16fc4-fcb1-4ea6-ab96-0cc82541a9a1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-sp6lr\" (UID: \"afd16fc4-fcb1-4ea6-ab96-0cc82541a9a1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sp6lr" Jun 14 15:21:38.131962 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:38.131938 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqcf4\" (UniqueName: \"kubernetes.io/projected/afd16fc4-fcb1-4ea6-ab96-0cc82541a9a1-kube-api-access-kqcf4\") pod \"kuadrant-operator-controller-manager-8684c9ff49-sp6lr\" (UID: \"afd16fc4-fcb1-4ea6-ab96-0cc82541a9a1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sp6lr" Jun 14 15:21:38.200105 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:38.200079 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sp6lr" Jun 14 15:21:38.334904 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:38.334778 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sp6lr"] Jun 14 15:21:38.337427 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:21:38.337395 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafd16fc4_fcb1_4ea6_ab96_0cc82541a9a1.slice/crio-ac6467a6b26b08c780067717d39ac1ba56da1a989f24f64f803b78bde59268ea WatchSource:0}: Error finding container ac6467a6b26b08c780067717d39ac1ba56da1a989f24f64f803b78bde59268ea: Status 404 returned error can't find the container with id ac6467a6b26b08c780067717d39ac1ba56da1a989f24f64f803b78bde59268ea Jun 14 15:21:39.230462 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:39.230427 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sp6lr" event={"ID":"afd16fc4-fcb1-4ea6-ab96-0cc82541a9a1","Type":"ContainerStarted","Data":"ac6467a6b26b08c780067717d39ac1ba56da1a989f24f64f803b78bde59268ea"} Jun 14 15:21:39.236804 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:39.236772 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:21:39.340491 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:39.340458 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:21:39.631445 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:39.631355 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:21:39.731446 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:39.731414 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:21:42.181665 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:42.181634 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-p5j7t" Jun 14 15:21:43.039794 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:43.039762 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:21:43.139728 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:43.139685 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:21:44.532083 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:44.532034 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-cdb8c9959-rftb5" Jun 14 15:21:44.532559 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:44.532108 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-cdb8c9959-rftb5" Jun 14 15:21:44.536828 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:44.536798 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-cdb8c9959-rftb5" Jun 14 15:21:45.264610 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:45.264581 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-cdb8c9959-rftb5" Jun 14 15:21:45.467413 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:45.467376 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:21:45.571015 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:45.570924 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:21:45.666247 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:45.666203 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:21:46.264655 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:46.264620 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sp6lr" event={"ID":"afd16fc4-fcb1-4ea6-ab96-0cc82541a9a1","Type":"ContainerStarted","Data":"81025e32e48ce0eeda497f3d1888695a60a90885902ee0b7cf174cf9da31aa38"} Jun 14 15:21:46.264862 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:46.264715 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sp6lr" Jun 14 15:21:46.291338 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:46.291291 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sp6lr" podStartSLOduration=1.7757932250000001 podStartE2EDuration="9.29127757s" totalImagesPullingTime="7.515484345s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:21:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:21:46.290937326 +0000 UTC m=+463.472419863" watchObservedRunningTime="2026-06-14 15:21:46.29127757 +0000 UTC m=+463.472760085" Jun 14 15:21:46.469155 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:46.469127 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:21:46.566084 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:46.565987 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:21:48.226410 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:48.226381 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2t9hz" Jun 14 15:21:48.420926 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:48.420887 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:21:48.671739 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:48.671656 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:21:50.424171 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:50.424139 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:21:50.518924 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:50.518893 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:21:57.271902 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:57.271867 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sp6lr" Jun 14 15:21:58.380539 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:58.380510 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-n57bw"] Jun 14 15:21:58.384022 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:58.384006 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-n57bw" Jun 14 15:21:58.402883 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:58.402855 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-n57bw"] Jun 14 15:21:58.405425 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:58.405388 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4xfg\" (UniqueName: \"kubernetes.io/projected/95f41108-8ffc-462f-b8ce-8296212b3ccc-kube-api-access-h4xfg\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-n57bw\" (UID: \"95f41108-8ffc-462f-b8ce-8296212b3ccc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-n57bw" Jun 14 15:21:58.405562 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:58.405541 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/95f41108-8ffc-462f-b8ce-8296212b3ccc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-n57bw\" (UID: \"95f41108-8ffc-462f-b8ce-8296212b3ccc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-n57bw" Jun 14 15:21:58.502593 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:58.502551 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-n57bw"] Jun 14 15:21:58.502882 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:21:58.502855 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-h4xfg], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-n57bw" podUID="95f41108-8ffc-462f-b8ce-8296212b3ccc" Jun 14 15:21:58.506097 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:58.506073 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/95f41108-8ffc-462f-b8ce-8296212b3ccc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-n57bw\" (UID: \"95f41108-8ffc-462f-b8ce-8296212b3ccc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-n57bw" Jun 14 15:21:58.506162 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:58.506123 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4xfg\" (UniqueName: \"kubernetes.io/projected/95f41108-8ffc-462f-b8ce-8296212b3ccc-kube-api-access-h4xfg\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-n57bw\" (UID: \"95f41108-8ffc-462f-b8ce-8296212b3ccc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-n57bw" Jun 14 15:21:58.506477 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:58.506460 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/95f41108-8ffc-462f-b8ce-8296212b3ccc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-n57bw\" (UID: \"95f41108-8ffc-462f-b8ce-8296212b3ccc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-n57bw" Jun 14 15:21:58.522904 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:58.522871 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:21:58.527182 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:58.527163 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4xfg\" (UniqueName: \"kubernetes.io/projected/95f41108-8ffc-462f-b8ce-8296212b3ccc-kube-api-access-h4xfg\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-n57bw\" (UID: \"95f41108-8ffc-462f-b8ce-8296212b3ccc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-n57bw" Jun 14 15:21:58.622144 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:58.622109 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:21:58.923280 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:58.923246 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-n57bw"] Jun 14 15:21:58.930690 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:58.930665 2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-n57bw"] Jun 14 15:21:58.944538 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:58.944508 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sp6lr"] Jun 14 15:21:58.944767 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:58.944738 2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sp6lr" podUID="afd16fc4-fcb1-4ea6-ab96-0cc82541a9a1" containerName="manager" containerID="cri-o://81025e32e48ce0eeda497f3d1888695a60a90885902ee0b7cf174cf9da31aa38" gracePeriod=2 Jun 14 15:21:58.951335 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:58.951293 2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sp6lr"] Jun 14 15:21:58.977935 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:58.977900 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zkqcc"] Jun 14 15:21:58.978725 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:58.978318 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="afd16fc4-fcb1-4ea6-ab96-0cc82541a9a1" containerName="manager" Jun 14 15:21:58.978725 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:58.978333 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="afd16fc4-fcb1-4ea6-ab96-0cc82541a9a1" containerName="manager" Jun 14 15:21:58.978725 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:58.978431 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="afd16fc4-fcb1-4ea6-ab96-0cc82541a9a1" containerName="manager" Jun 14 15:21:58.981603 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:58.981582 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zkqcc" Jun 14 15:21:58.983981 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:21:58.983949 2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-sp6lr\" is forbidden: User \"system:node:ip-10-0-140-30.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-30.ec2.internal' and this object" podUID="afd16fc4-fcb1-4ea6-ab96-0cc82541a9a1" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sp6lr" Jun 14 15:21:58.993468 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:58.993441 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b47mm"] Jun 14 15:21:58.997158 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:58.997138 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zkqcc"] Jun 14 15:21:58.997276 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:58.997238 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b47mm" Jun 14 15:21:58.999716 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:58.999699 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-rzgxd\"" Jun 14 15:21:59.010621 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:59.010595 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffhfn\" (UniqueName: \"kubernetes.io/projected/1bc8ab30-3f77-42f8-a40d-002d20912292-kube-api-access-ffhfn\") pod \"limitador-operator-controller-manager-859d7b78bd-b47mm\" (UID: \"1bc8ab30-3f77-42f8-a40d-002d20912292\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b47mm" Jun 14 15:21:59.010947 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:59.010669 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/46ba32f0-c05e-4268-b3d0-88f5766cd967-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-zkqcc\" (UID: \"46ba32f0-c05e-4268-b3d0-88f5766cd967\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zkqcc" Jun 14 15:21:59.010947 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:59.010754 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2499\" (UniqueName: \"kubernetes.io/projected/46ba32f0-c05e-4268-b3d0-88f5766cd967-kube-api-access-v2499\") pod \"kuadrant-operator-controller-manager-8684c9ff49-zkqcc\" (UID: \"46ba32f0-c05e-4268-b3d0-88f5766cd967\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zkqcc" Jun 14 15:21:59.012803 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:59.012779 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b47mm"] Jun 14 15:21:59.025736 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:21:59.025713 2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-sp6lr\" is forbidden: User \"system:node:ip-10-0-140-30.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-30.ec2.internal' and this object" podUID="afd16fc4-fcb1-4ea6-ab96-0cc82541a9a1" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sp6lr" Jun 14 15:21:59.111198 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:59.111168 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2499\" (UniqueName: \"kubernetes.io/projected/46ba32f0-c05e-4268-b3d0-88f5766cd967-kube-api-access-v2499\") pod \"kuadrant-operator-controller-manager-8684c9ff49-zkqcc\" (UID: \"46ba32f0-c05e-4268-b3d0-88f5766cd967\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zkqcc" Jun 14 15:21:59.111302 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:59.111227 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffhfn\" (UniqueName: \"kubernetes.io/projected/1bc8ab30-3f77-42f8-a40d-002d20912292-kube-api-access-ffhfn\") pod \"limitador-operator-controller-manager-859d7b78bd-b47mm\" (UID: \"1bc8ab30-3f77-42f8-a40d-002d20912292\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b47mm" Jun 14 15:21:59.111302 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:59.111249 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:21:59.111302 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:59.111288 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/46ba32f0-c05e-4268-b3d0-88f5766cd967-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-zkqcc\" (UID: \"46ba32f0-c05e-4268-b3d0-88f5766cd967\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zkqcc" Jun 14 15:21:59.111734 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:59.111713 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/46ba32f0-c05e-4268-b3d0-88f5766cd967-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-zkqcc\" (UID: \"46ba32f0-c05e-4268-b3d0-88f5766cd967\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zkqcc" Jun 14 15:21:59.123582 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:59.123557 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2499\" (UniqueName: \"kubernetes.io/projected/46ba32f0-c05e-4268-b3d0-88f5766cd967-kube-api-access-v2499\") pod \"kuadrant-operator-controller-manager-8684c9ff49-zkqcc\" (UID: \"46ba32f0-c05e-4268-b3d0-88f5766cd967\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zkqcc" Jun 14 15:21:59.140282 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:59.140254 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffhfn\" (UniqueName: \"kubernetes.io/projected/1bc8ab30-3f77-42f8-a40d-002d20912292-kube-api-access-ffhfn\") pod \"limitador-operator-controller-manager-859d7b78bd-b47mm\" (UID: \"1bc8ab30-3f77-42f8-a40d-002d20912292\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b47mm" Jun 14 15:21:59.173375 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:59.173320 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sp6lr" Jun 14 15:21:59.177971 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:21:59.177945 2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-sp6lr\" is forbidden: User \"system:node:ip-10-0-140-30.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-30.ec2.internal' and this object" podUID="afd16fc4-fcb1-4ea6-ab96-0cc82541a9a1" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sp6lr" Jun 14 15:21:59.211998 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:59.211970 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kqcf4\" (UniqueName: \"kubernetes.io/projected/afd16fc4-fcb1-4ea6-ab96-0cc82541a9a1-kube-api-access-kqcf4\") pod \"afd16fc4-fcb1-4ea6-ab96-0cc82541a9a1\" (UID: \"afd16fc4-fcb1-4ea6-ab96-0cc82541a9a1\") " Jun 14 15:21:59.212168 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:59.212025 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/afd16fc4-fcb1-4ea6-ab96-0cc82541a9a1-extensions-socket-volume\") pod \"afd16fc4-fcb1-4ea6-ab96-0cc82541a9a1\" (UID: \"afd16fc4-fcb1-4ea6-ab96-0cc82541a9a1\") " Jun 14 15:21:59.212532 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:59.212505 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/afd16fc4-fcb1-4ea6-ab96-0cc82541a9a1-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "afd16fc4-fcb1-4ea6-ab96-0cc82541a9a1" (UID: "afd16fc4-fcb1-4ea6-ab96-0cc82541a9a1"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 15:21:59.213975 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:59.213956 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/afd16fc4-fcb1-4ea6-ab96-0cc82541a9a1-kube-api-access-kqcf4" (OuterVolumeSpecName: "kube-api-access-kqcf4") pod "afd16fc4-fcb1-4ea6-ab96-0cc82541a9a1" (UID: "afd16fc4-fcb1-4ea6-ab96-0cc82541a9a1"). InnerVolumeSpecName "kube-api-access-kqcf4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 15:21:59.287763 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:59.287722 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:21:59.305765 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:59.305735 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="afd16fc4-fcb1-4ea6-ab96-0cc82541a9a1" path="/var/lib/kubelet/pods/afd16fc4-fcb1-4ea6-ab96-0cc82541a9a1/volumes" Jun 14 15:21:59.312625 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:59.312602 2571 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/afd16fc4-fcb1-4ea6-ab96-0cc82541a9a1-extensions-socket-volume\") on node \"ip-10-0-140-30.ec2.internal\" DevicePath \"\"" Jun 14 15:21:59.312625 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:59.312626 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kqcf4\" (UniqueName: \"kubernetes.io/projected/afd16fc4-fcb1-4ea6-ab96-0cc82541a9a1-kube-api-access-kqcf4\") on node \"ip-10-0-140-30.ec2.internal\" DevicePath \"\"" Jun 14 15:21:59.324298 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:59.324275 2571 generic.go:356] "Generic (PLEG): container finished" podID="afd16fc4-fcb1-4ea6-ab96-0cc82541a9a1" containerID="81025e32e48ce0eeda497f3d1888695a60a90885902ee0b7cf174cf9da31aa38" exitCode=0 Jun 14 15:21:59.324445 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:59.324315 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sp6lr" Jun 14 15:21:59.324445 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:59.324364 2571 scope.go:117] "RemoveContainer" containerID="81025e32e48ce0eeda497f3d1888695a60a90885902ee0b7cf174cf9da31aa38" Jun 14 15:21:59.324445 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:59.324388 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-n57bw" Jun 14 15:21:59.332292 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:59.332272 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-n57bw" Jun 14 15:21:59.333020 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:59.333002 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zkqcc" Jun 14 15:21:59.333905 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:59.333890 2571 scope.go:117] "RemoveContainer" containerID="81025e32e48ce0eeda497f3d1888695a60a90885902ee0b7cf174cf9da31aa38" Jun 14 15:21:59.334164 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:21:59.334144 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"81025e32e48ce0eeda497f3d1888695a60a90885902ee0b7cf174cf9da31aa38\": container with ID starting with 81025e32e48ce0eeda497f3d1888695a60a90885902ee0b7cf174cf9da31aa38 not found: ID does not exist" containerID="81025e32e48ce0eeda497f3d1888695a60a90885902ee0b7cf174cf9da31aa38" Jun 14 15:21:59.334252 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:59.334172 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81025e32e48ce0eeda497f3d1888695a60a90885902ee0b7cf174cf9da31aa38"} err="failed to get container status \"81025e32e48ce0eeda497f3d1888695a60a90885902ee0b7cf174cf9da31aa38\": rpc error: code = NotFound desc = could not find container \"81025e32e48ce0eeda497f3d1888695a60a90885902ee0b7cf174cf9da31aa38\": container with ID starting with 81025e32e48ce0eeda497f3d1888695a60a90885902ee0b7cf174cf9da31aa38 not found: ID does not exist" Jun 14 15:21:59.334462 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:21:59.334445 2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-n57bw\" is forbidden: User \"system:node:ip-10-0-140-30.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-30.ec2.internal' and this object" podUID="95f41108-8ffc-462f-b8ce-8296212b3ccc" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-n57bw" Jun 14 15:21:59.338618 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:59.338603 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b47mm" Jun 14 15:21:59.413457 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:59.413430 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/95f41108-8ffc-462f-b8ce-8296212b3ccc-extensions-socket-volume\") pod \"95f41108-8ffc-462f-b8ce-8296212b3ccc\" (UID: \"95f41108-8ffc-462f-b8ce-8296212b3ccc\") " Jun 14 15:21:59.413781 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:59.413527 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h4xfg\" (UniqueName: \"kubernetes.io/projected/95f41108-8ffc-462f-b8ce-8296212b3ccc-kube-api-access-h4xfg\") pod \"95f41108-8ffc-462f-b8ce-8296212b3ccc\" (UID: \"95f41108-8ffc-462f-b8ce-8296212b3ccc\") " Jun 14 15:21:59.413781 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:59.413703 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95f41108-8ffc-462f-b8ce-8296212b3ccc-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "95f41108-8ffc-462f-b8ce-8296212b3ccc" (UID: "95f41108-8ffc-462f-b8ce-8296212b3ccc"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 15:21:59.415424 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:59.415398 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95f41108-8ffc-462f-b8ce-8296212b3ccc-kube-api-access-h4xfg" (OuterVolumeSpecName: "kube-api-access-h4xfg") pod "95f41108-8ffc-462f-b8ce-8296212b3ccc" (UID: "95f41108-8ffc-462f-b8ce-8296212b3ccc"). InnerVolumeSpecName "kube-api-access-h4xfg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 15:21:59.480062 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:59.479983 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zkqcc"] Jun 14 15:21:59.482485 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:21:59.482459 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46ba32f0_c05e_4268_b3d0_88f5766cd967.slice/crio-5d50a059af18bd6c395a7d30d1985a35dff937ece72d0786be3291612f3ddfe7 WatchSource:0}: Error finding container 5d50a059af18bd6c395a7d30d1985a35dff937ece72d0786be3291612f3ddfe7: Status 404 returned error can't find the container with id 5d50a059af18bd6c395a7d30d1985a35dff937ece72d0786be3291612f3ddfe7 Jun 14 15:21:59.504747 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:59.504727 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b47mm"] Jun 14 15:21:59.507071 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:21:59.507036 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bc8ab30_3f77_42f8_a40d_002d20912292.slice/crio-fd400c7800fdae869477bf556e56531b2827e2779f079559902138c780213cf2 WatchSource:0}: Error finding container fd400c7800fdae869477bf556e56531b2827e2779f079559902138c780213cf2: Status 404 returned error can't find the container with id fd400c7800fdae869477bf556e56531b2827e2779f079559902138c780213cf2 Jun 14 15:21:59.514169 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:59.514148 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h4xfg\" (UniqueName: \"kubernetes.io/projected/95f41108-8ffc-462f-b8ce-8296212b3ccc-kube-api-access-h4xfg\") on node \"ip-10-0-140-30.ec2.internal\" DevicePath \"\"" Jun 14 15:21:59.514258 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:21:59.514172 2571 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/95f41108-8ffc-462f-b8ce-8296212b3ccc-extensions-socket-volume\") on node \"ip-10-0-140-30.ec2.internal\" DevicePath \"\"" Jun 14 15:22:00.333399 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:22:00.333360 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zkqcc" event={"ID":"46ba32f0-c05e-4268-b3d0-88f5766cd967","Type":"ContainerStarted","Data":"02400264538daa85cf34dea08848f162e80955dfa96ead376a3dca2ff4a7e7ef"} Jun 14 15:22:00.333583 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:22:00.333430 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zkqcc" event={"ID":"46ba32f0-c05e-4268-b3d0-88f5766cd967","Type":"ContainerStarted","Data":"5d50a059af18bd6c395a7d30d1985a35dff937ece72d0786be3291612f3ddfe7"} Jun 14 15:22:00.333583 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:22:00.333462 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zkqcc" Jun 14 15:22:00.334791 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:22:00.334768 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-n57bw" Jun 14 15:22:00.334791 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:22:00.334782 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b47mm" event={"ID":"1bc8ab30-3f77-42f8-a40d-002d20912292","Type":"ContainerStarted","Data":"fd400c7800fdae869477bf556e56531b2827e2779f079559902138c780213cf2"} Jun 14 15:22:00.360547 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:22:00.360481 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zkqcc" podStartSLOduration=2.360462678 podStartE2EDuration="2.360462678s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:21:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:22:00.360041991 +0000 UTC m=+477.541524535" watchObservedRunningTime="2026-06-14 15:22:00.360462678 +0000 UTC m=+477.541945194" Jun 14 15:22:00.364231 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:22:00.364198 2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-n57bw\" is forbidden: User \"system:node:ip-10-0-140-30.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-30.ec2.internal' and this object" podUID="95f41108-8ffc-462f-b8ce-8296212b3ccc" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-n57bw" Jun 14 15:22:00.366007 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:22:00.365976 2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-n57bw\" is forbidden: User \"system:node:ip-10-0-140-30.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-30.ec2.internal' and this object" podUID="95f41108-8ffc-462f-b8ce-8296212b3ccc" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-n57bw" Jun 14 15:22:01.306166 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:22:01.306134 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="95f41108-8ffc-462f-b8ce-8296212b3ccc" path="/var/lib/kubelet/pods/95f41108-8ffc-462f-b8ce-8296212b3ccc/volumes" Jun 14 15:22:01.341026 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:22:01.340994 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b47mm" event={"ID":"1bc8ab30-3f77-42f8-a40d-002d20912292","Type":"ContainerStarted","Data":"b6d8c77225681034f1c7d47fbe339dd4cadd141c7a636086d5c04a266fc82c4a"} Jun 14 15:22:01.341215 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:22:01.341071 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b47mm" Jun 14 15:22:01.363990 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:22:01.363948 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b47mm" podStartSLOduration=2.232203514 podStartE2EDuration="3.363933569s" totalImagesPullingTime="1.131730055s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:21:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:22:01.361399321 +0000 UTC m=+478.542881837" watchObservedRunningTime="2026-06-14 15:22:01.363933569 +0000 UTC m=+478.545416084" Jun 14 15:22:02.888463 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:22:02.888432 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:22:02.989618 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:22:02.989590 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:22:04.890004 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:22:04.889974 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:22:04.993090 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:22:04.993038 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:22:09.520441 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:22:09.520396 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:22:09.620943 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:22:09.620908 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:22:11.343804 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:22:11.343776 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zkqcc" Jun 14 15:22:12.354313 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:22:12.354278 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b47mm" Jun 14 15:22:14.569089 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:22:14.569038 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zkqcc"] Jun 14 15:22:14.569498 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:22:14.569313 2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zkqcc" podUID="46ba32f0-c05e-4268-b3d0-88f5766cd967" containerName="manager" containerID="cri-o://02400264538daa85cf34dea08848f162e80955dfa96ead376a3dca2ff4a7e7ef" gracePeriod=10 Jun 14 15:22:14.810003 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:22:14.809975 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zkqcc" Jun 14 15:22:14.896093 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:22:14.895999 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cwzfx"] Jun 14 15:22:14.896371 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:22:14.896359 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46ba32f0-c05e-4268-b3d0-88f5766cd967" containerName="manager" Jun 14 15:22:14.896420 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:22:14.896373 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="46ba32f0-c05e-4268-b3d0-88f5766cd967" containerName="manager" Jun 14 15:22:14.896455 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:22:14.896432 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="46ba32f0-c05e-4268-b3d0-88f5766cd967" containerName="manager" Jun 14 15:22:14.899287 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:22:14.899271 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cwzfx" Jun 14 15:22:14.926975 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:22:14.926947 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cwzfx"] Jun 14 15:22:14.949274 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:22:14.949253 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/46ba32f0-c05e-4268-b3d0-88f5766cd967-extensions-socket-volume\") pod \"46ba32f0-c05e-4268-b3d0-88f5766cd967\" (UID: \"46ba32f0-c05e-4268-b3d0-88f5766cd967\") " Jun 14 15:22:14.949394 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:22:14.949307 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v2499\" (UniqueName: \"kubernetes.io/projected/46ba32f0-c05e-4268-b3d0-88f5766cd967-kube-api-access-v2499\") pod \"46ba32f0-c05e-4268-b3d0-88f5766cd967\" (UID: \"46ba32f0-c05e-4268-b3d0-88f5766cd967\") " Jun 14 15:22:14.949447 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:22:14.949435 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plw88\" (UniqueName: \"kubernetes.io/projected/b1b2df17-7f67-457b-ac04-358c1dd262ad-kube-api-access-plw88\") pod \"kuadrant-operator-controller-manager-86878c769f-cwzfx\" (UID: \"b1b2df17-7f67-457b-ac04-358c1dd262ad\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cwzfx" Jun 14 15:22:14.949495 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:22:14.949478 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b1b2df17-7f67-457b-ac04-358c1dd262ad-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-cwzfx\" (UID: \"b1b2df17-7f67-457b-ac04-358c1dd262ad\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cwzfx" Jun 14 15:22:14.949629 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:22:14.949608 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46ba32f0-c05e-4268-b3d0-88f5766cd967-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "46ba32f0-c05e-4268-b3d0-88f5766cd967" (UID: "46ba32f0-c05e-4268-b3d0-88f5766cd967"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 15:22:14.951288 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:22:14.951267 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46ba32f0-c05e-4268-b3d0-88f5766cd967-kube-api-access-v2499" (OuterVolumeSpecName: "kube-api-access-v2499") pod "46ba32f0-c05e-4268-b3d0-88f5766cd967" (UID: "46ba32f0-c05e-4268-b3d0-88f5766cd967"). InnerVolumeSpecName "kube-api-access-v2499". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 15:22:15.050900 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:22:15.050863 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plw88\" (UniqueName: \"kubernetes.io/projected/b1b2df17-7f67-457b-ac04-358c1dd262ad-kube-api-access-plw88\") pod \"kuadrant-operator-controller-manager-86878c769f-cwzfx\" (UID: \"b1b2df17-7f67-457b-ac04-358c1dd262ad\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cwzfx" Jun 14 15:22:15.051101 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:22:15.050920 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b1b2df17-7f67-457b-ac04-358c1dd262ad-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-cwzfx\" (UID: \"b1b2df17-7f67-457b-ac04-358c1dd262ad\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cwzfx" Jun 14 15:22:15.051101 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:22:15.050985 2571 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/46ba32f0-c05e-4268-b3d0-88f5766cd967-extensions-socket-volume\") on node \"ip-10-0-140-30.ec2.internal\" DevicePath \"\"" Jun 14 15:22:15.051101 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:22:15.050995 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v2499\" (UniqueName: \"kubernetes.io/projected/46ba32f0-c05e-4268-b3d0-88f5766cd967-kube-api-access-v2499\") on node \"ip-10-0-140-30.ec2.internal\" DevicePath \"\"" Jun 14 15:22:15.051350 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:22:15.051330 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b1b2df17-7f67-457b-ac04-358c1dd262ad-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-cwzfx\" (UID: \"b1b2df17-7f67-457b-ac04-358c1dd262ad\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cwzfx" Jun 14 15:22:15.068670 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:22:15.068645 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-plw88\" (UniqueName: \"kubernetes.io/projected/b1b2df17-7f67-457b-ac04-358c1dd262ad-kube-api-access-plw88\") pod \"kuadrant-operator-controller-manager-86878c769f-cwzfx\" (UID: \"b1b2df17-7f67-457b-ac04-358c1dd262ad\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cwzfx" Jun 14 15:22:15.208936 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:22:15.208906 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cwzfx" Jun 14 15:22:15.354580 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:22:15.354558 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cwzfx"] Jun 14 15:22:15.357041 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:22:15.357016 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1b2df17_7f67_457b_ac04_358c1dd262ad.slice/crio-1e8adf97cb98c4a5292eb87f624306a398ee189285ad54dd40d9fcd4af4100c9 WatchSource:0}: Error finding container 1e8adf97cb98c4a5292eb87f624306a398ee189285ad54dd40d9fcd4af4100c9: Status 404 returned error can't find the container with id 1e8adf97cb98c4a5292eb87f624306a398ee189285ad54dd40d9fcd4af4100c9 Jun 14 15:22:15.418793 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:22:15.418761 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cwzfx" event={"ID":"b1b2df17-7f67-457b-ac04-358c1dd262ad","Type":"ContainerStarted","Data":"a0aa0038c756686ae859bdf92584bb690f4514ce0ab9b648994780858f8f82ed"} Jun 14 15:22:15.418936 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:22:15.418826 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cwzfx" Jun 14 15:22:15.418936 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:22:15.418849 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cwzfx" event={"ID":"b1b2df17-7f67-457b-ac04-358c1dd262ad","Type":"ContainerStarted","Data":"1e8adf97cb98c4a5292eb87f624306a398ee189285ad54dd40d9fcd4af4100c9"} Jun 14 15:22:15.420145 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:22:15.420109 2571 generic.go:356] "Generic (PLEG): container finished" podID="46ba32f0-c05e-4268-b3d0-88f5766cd967" containerID="02400264538daa85cf34dea08848f162e80955dfa96ead376a3dca2ff4a7e7ef" exitCode=0 Jun 14 15:22:15.420240 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:22:15.420151 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zkqcc" Jun 14 15:22:15.420240 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:22:15.420188 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zkqcc" event={"ID":"46ba32f0-c05e-4268-b3d0-88f5766cd967","Type":"ContainerDied","Data":"02400264538daa85cf34dea08848f162e80955dfa96ead376a3dca2ff4a7e7ef"} Jun 14 15:22:15.420312 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:22:15.420237 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zkqcc" event={"ID":"46ba32f0-c05e-4268-b3d0-88f5766cd967","Type":"ContainerDied","Data":"5d50a059af18bd6c395a7d30d1985a35dff937ece72d0786be3291612f3ddfe7"} Jun 14 15:22:15.420312 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:22:15.420265 2571 scope.go:117] "RemoveContainer" containerID="02400264538daa85cf34dea08848f162e80955dfa96ead376a3dca2ff4a7e7ef" Jun 14 15:22:15.428269 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:22:15.428253 2571 scope.go:117] "RemoveContainer" containerID="02400264538daa85cf34dea08848f162e80955dfa96ead376a3dca2ff4a7e7ef" Jun 14 15:22:15.428506 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:22:15.428489 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"02400264538daa85cf34dea08848f162e80955dfa96ead376a3dca2ff4a7e7ef\": container with ID starting with 02400264538daa85cf34dea08848f162e80955dfa96ead376a3dca2ff4a7e7ef not found: ID does not exist" containerID="02400264538daa85cf34dea08848f162e80955dfa96ead376a3dca2ff4a7e7ef" Jun 14 15:22:15.428551 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:22:15.428523 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02400264538daa85cf34dea08848f162e80955dfa96ead376a3dca2ff4a7e7ef"} err="failed to get container status \"02400264538daa85cf34dea08848f162e80955dfa96ead376a3dca2ff4a7e7ef\": rpc error: code = NotFound desc = could not find container \"02400264538daa85cf34dea08848f162e80955dfa96ead376a3dca2ff4a7e7ef\": container with ID starting with 02400264538daa85cf34dea08848f162e80955dfa96ead376a3dca2ff4a7e7ef not found: ID does not exist" Jun 14 15:22:15.455563 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:22:15.455510 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cwzfx" podStartSLOduration=1.455490871 podStartE2EDuration="1.455490871s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:22:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:22:15.455349717 +0000 UTC m=+492.636832233" watchObservedRunningTime="2026-06-14 15:22:15.455490871 +0000 UTC m=+492.636973389" Jun 14 15:22:15.496975 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:22:15.496914 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zkqcc"] Jun 14 15:22:15.506461 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:22:15.506437 2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zkqcc"] Jun 14 15:22:16.790956 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:22:16.790929 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:22:17.305342 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:22:17.305312 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="46ba32f0-c05e-4268-b3d0-88f5766cd967" path="/var/lib/kubelet/pods/46ba32f0-c05e-4268-b3d0-88f5766cd967/volumes" Jun 14 15:22:26.429076 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:22:26.429033 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cwzfx" Jun 14 15:22:31.121958 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:22:31.121929 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:22:31.337356 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:22:31.337305 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:22:34.094130 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:22:34.094088 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:22:34.158887 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:22:34.158846 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:22:43.378371 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:22:43.378272 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:22:45.299697 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:22:45.299666 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:22:45.410550 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:22:45.410512 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:22:45.512131 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:22:45.512097 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:22:46.235500 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:22:46.235464 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:22:46.337131 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:22:46.337092 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:23:02.027394 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:23:02.027342 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:23:11.959837 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:23:11.959805 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:23:12.051675 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:23:12.051643 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:23:12.228404 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:23:12.228309 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:23:36.386441 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:23:36.386412 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:23:36.457738 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:23:36.457704 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:24:03.282117 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:24:03.282082 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ltnnm_ee9ddc42-3dac-47b7-a02b-899fc13a7467/ovn-acl-logging/0.log" Jun 14 15:24:03.282562 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:24:03.282511 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ltnnm_ee9ddc42-3dac-47b7-a02b-899fc13a7467/ovn-acl-logging/0.log" Jun 14 15:24:05.853478 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:24:05.853443 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:24:06.760430 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:24:06.760378 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:24:07.974893 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:24:07.974856 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:24:08.049433 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:24:08.049399 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:24:11.444131 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:24:11.444016 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:24:11.542588 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:24:11.542540 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:24:11.602814 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:24:11.602775 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:24:11.637859 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:24:11.637825 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-974cc687f-lml6s"] Jun 14 15:24:11.641409 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:24:11.641391 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-974cc687f-lml6s" Jun 14 15:24:11.643498 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:24:11.643477 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 14 15:24:11.643617 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:24:11.643561 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-hq2z8\"" Jun 14 15:24:11.643617 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:24:11.643564 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 14 15:24:11.650595 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:24:11.650575 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-974cc687f-lml6s"] Jun 14 15:24:11.684472 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:24:11.684443 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9178dee5-500b-4d00-a85e-292467e1cc49-webhook-cert\") pod \"maas-controller-974cc687f-lml6s\" (UID: \"9178dee5-500b-4d00-a85e-292467e1cc49\") " pod="opendatahub/maas-controller-974cc687f-lml6s" Jun 14 15:24:11.684593 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:24:11.684479 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhdhj\" (UniqueName: \"kubernetes.io/projected/9178dee5-500b-4d00-a85e-292467e1cc49-kube-api-access-jhdhj\") pod \"maas-controller-974cc687f-lml6s\" (UID: \"9178dee5-500b-4d00-a85e-292467e1cc49\") " pod="opendatahub/maas-controller-974cc687f-lml6s" Jun 14 15:24:11.759556 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:24:11.759464 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:24:11.785812 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:24:11.785783 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9178dee5-500b-4d00-a85e-292467e1cc49-webhook-cert\") pod \"maas-controller-974cc687f-lml6s\" (UID: \"9178dee5-500b-4d00-a85e-292467e1cc49\") " pod="opendatahub/maas-controller-974cc687f-lml6s" Jun 14 15:24:11.785970 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:24:11.785823 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhdhj\" (UniqueName: \"kubernetes.io/projected/9178dee5-500b-4d00-a85e-292467e1cc49-kube-api-access-jhdhj\") pod \"maas-controller-974cc687f-lml6s\" (UID: \"9178dee5-500b-4d00-a85e-292467e1cc49\") " pod="opendatahub/maas-controller-974cc687f-lml6s" Jun 14 15:24:11.788201 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:24:11.788180 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9178dee5-500b-4d00-a85e-292467e1cc49-webhook-cert\") pod \"maas-controller-974cc687f-lml6s\" (UID: \"9178dee5-500b-4d00-a85e-292467e1cc49\") " pod="opendatahub/maas-controller-974cc687f-lml6s" Jun 14 15:24:11.793851 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:24:11.793833 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhdhj\" (UniqueName: \"kubernetes.io/projected/9178dee5-500b-4d00-a85e-292467e1cc49-kube-api-access-jhdhj\") pod \"maas-controller-974cc687f-lml6s\" (UID: \"9178dee5-500b-4d00-a85e-292467e1cc49\") " pod="opendatahub/maas-controller-974cc687f-lml6s" Jun 14 15:24:11.952800 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:24:11.952768 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-974cc687f-lml6s" Jun 14 15:24:12.088454 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:24:12.088428 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-974cc687f-lml6s"] Jun 14 15:24:12.091173 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:24:12.091150 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9178dee5_500b_4d00_a85e_292467e1cc49.slice/crio-6060a7c850dca2f78ab723407e9b797b5430135b7bdb2bbb6a8aa17a73441d69 WatchSource:0}: Error finding container 6060a7c850dca2f78ab723407e9b797b5430135b7bdb2bbb6a8aa17a73441d69: Status 404 returned error can't find the container with id 6060a7c850dca2f78ab723407e9b797b5430135b7bdb2bbb6a8aa17a73441d69 Jun 14 15:24:12.982241 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:24:12.982204 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-974cc687f-lml6s" event={"ID":"9178dee5-500b-4d00-a85e-292467e1cc49","Type":"ContainerStarted","Data":"6060a7c850dca2f78ab723407e9b797b5430135b7bdb2bbb6a8aa17a73441d69"} Jun 14 15:24:14.228808 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:24:14.228776 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:24:14.377094 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:24:14.376988 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:24:14.994862 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:24:14.994811 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-974cc687f-lml6s" event={"ID":"9178dee5-500b-4d00-a85e-292467e1cc49","Type":"ContainerStarted","Data":"1c13f2d358f08193a074a363d1bb7b3e2ccdd4a5afd49db26682c412d762b6ef"} Jun 14 15:24:14.995160 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:24:14.994963 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-974cc687f-lml6s" Jun 14 15:24:15.024305 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:24:15.024221 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-974cc687f-lml6s" podStartSLOduration=2.117529853 podStartE2EDuration="4.024197253s" totalImagesPullingTime="1.9066674s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:24:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:24:15.021562926 +0000 UTC m=+612.203045442" watchObservedRunningTime="2026-06-14 15:24:15.024197253 +0000 UTC m=+612.205679768" Jun 14 15:24:26.005515 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:24:26.005483 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-974cc687f-lml6s" Jun 14 15:24:26.148173 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:24:26.148139 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:24:26.249943 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:24:26.249895 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:24:33.063424 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:24:33.063391 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:24:33.164522 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:24:33.164493 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:24:45.181014 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:24:45.180978 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:24:45.216480 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:24:45.216445 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-856ffd5c84-qqcqg"] Jun 14 15:24:45.219801 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:24:45.219780 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-856ffd5c84-qqcqg" Jun 14 15:24:45.222127 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:24:45.222094 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 14 15:24:45.222260 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:24:45.222185 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-mnfhd\"" Jun 14 15:24:45.229035 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:24:45.229010 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-856ffd5c84-qqcqg"] Jun 14 15:24:45.387095 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:24:45.387030 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1927d9a3-84e4-4687-9801-db661a274100-maas-api-tls\") pod \"maas-api-856ffd5c84-qqcqg\" (UID: \"1927d9a3-84e4-4687-9801-db661a274100\") " pod="opendatahub/maas-api-856ffd5c84-qqcqg" Jun 14 15:24:45.387275 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:24:45.387219 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1927d9a3-84e4-4687-9801-db661a274100-openshift-service-ca\") pod \"maas-api-856ffd5c84-qqcqg\" (UID: \"1927d9a3-84e4-4687-9801-db661a274100\") " pod="opendatahub/maas-api-856ffd5c84-qqcqg" Jun 14 15:24:45.387275 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:24:45.387255 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pppc5\" (UniqueName: \"kubernetes.io/projected/1927d9a3-84e4-4687-9801-db661a274100-kube-api-access-pppc5\") pod \"maas-api-856ffd5c84-qqcqg\" (UID: \"1927d9a3-84e4-4687-9801-db661a274100\") " pod="opendatahub/maas-api-856ffd5c84-qqcqg" Jun 14 15:24:45.432590 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:24:45.432501 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:24:45.488392 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:24:45.488350 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1927d9a3-84e4-4687-9801-db661a274100-openshift-service-ca\") pod \"maas-api-856ffd5c84-qqcqg\" (UID: \"1927d9a3-84e4-4687-9801-db661a274100\") " pod="opendatahub/maas-api-856ffd5c84-qqcqg" Jun 14 15:24:45.488392 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:24:45.488395 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pppc5\" (UniqueName: \"kubernetes.io/projected/1927d9a3-84e4-4687-9801-db661a274100-kube-api-access-pppc5\") pod \"maas-api-856ffd5c84-qqcqg\" (UID: \"1927d9a3-84e4-4687-9801-db661a274100\") " pod="opendatahub/maas-api-856ffd5c84-qqcqg" Jun 14 15:24:45.488666 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:24:45.488448 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1927d9a3-84e4-4687-9801-db661a274100-maas-api-tls\") pod \"maas-api-856ffd5c84-qqcqg\" (UID: \"1927d9a3-84e4-4687-9801-db661a274100\") " pod="opendatahub/maas-api-856ffd5c84-qqcqg" Jun 14 15:24:45.489007 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:24:45.488984 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1927d9a3-84e4-4687-9801-db661a274100-openshift-service-ca\") pod \"maas-api-856ffd5c84-qqcqg\" (UID: \"1927d9a3-84e4-4687-9801-db661a274100\") " pod="opendatahub/maas-api-856ffd5c84-qqcqg" Jun 14 15:24:45.491160 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:24:45.491138 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1927d9a3-84e4-4687-9801-db661a274100-maas-api-tls\") pod \"maas-api-856ffd5c84-qqcqg\" (UID: \"1927d9a3-84e4-4687-9801-db661a274100\") " pod="opendatahub/maas-api-856ffd5c84-qqcqg" Jun 14 15:24:45.497079 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:24:45.497003 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pppc5\" (UniqueName: \"kubernetes.io/projected/1927d9a3-84e4-4687-9801-db661a274100-kube-api-access-pppc5\") pod \"maas-api-856ffd5c84-qqcqg\" (UID: \"1927d9a3-84e4-4687-9801-db661a274100\") " pod="opendatahub/maas-api-856ffd5c84-qqcqg" Jun 14 15:24:45.531469 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:24:45.531436 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-856ffd5c84-qqcqg" Jun 14 15:24:45.622906 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:24:45.622841 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:24:45.678493 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:24:45.678462 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-856ffd5c84-qqcqg"] Jun 14 15:24:45.680569 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:24:45.680540 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:24:45.681131 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:24:45.681097 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1927d9a3_84e4_4687_9801_db661a274100.slice/crio-0c567b6c68676d45f10b8c7a23d1b4692322563cc8966e7be8b5920f5feb3982 WatchSource:0}: Error finding container 0c567b6c68676d45f10b8c7a23d1b4692322563cc8966e7be8b5920f5feb3982: Status 404 returned error can't find the container with id 0c567b6c68676d45f10b8c7a23d1b4692322563cc8966e7be8b5920f5feb3982 Jun 14 15:24:45.682525 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:24:45.682509 2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 14 15:24:45.728730 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:24:45.728699 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-tfdlz"] Jun 14 15:24:45.736744 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:24:45.736713 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-tfdlz" Jun 14 15:24:45.739516 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:24:45.739491 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-wssz2\"" Jun 14 15:24:45.739668 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:24:45.739490 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 14 15:24:45.743300 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:24:45.743274 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-tfdlz"] Jun 14 15:24:45.756795 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:24:45.756768 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-j2l4f"] Jun 14 15:24:45.760732 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:24:45.760675 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-j2l4f" Jun 14 15:24:45.771557 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:24:45.771529 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-j2l4f"] Jun 14 15:24:45.892752 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:24:45.892710 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zbvc\" (UniqueName: \"kubernetes.io/projected/a7917219-c659-4886-bbc2-69fafcde54f8-kube-api-access-7zbvc\") pod \"payload-pre-processing-579785bc64-tfdlz\" (UID: \"a7917219-c659-4886-bbc2-69fafcde54f8\") " pod="openshift-ingress/payload-pre-processing-579785bc64-tfdlz" Jun 14 15:24:45.892935 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:24:45.892774 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfr2n\" (UniqueName: \"kubernetes.io/projected/64e38a91-36de-4de2-bccf-d63bd8d50352-kube-api-access-pfr2n\") pod \"payload-processing-699b6cd6c-j2l4f\" (UID: \"64e38a91-36de-4de2-bccf-d63bd8d50352\") " pod="openshift-ingress/payload-processing-699b6cd6c-j2l4f" Jun 14 15:24:45.993684 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:24:45.993641 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7zbvc\" (UniqueName: \"kubernetes.io/projected/a7917219-c659-4886-bbc2-69fafcde54f8-kube-api-access-7zbvc\") pod \"payload-pre-processing-579785bc64-tfdlz\" (UID: \"a7917219-c659-4886-bbc2-69fafcde54f8\") " pod="openshift-ingress/payload-pre-processing-579785bc64-tfdlz" Jun 14 15:24:45.993897 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:24:45.993721 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfr2n\" (UniqueName: \"kubernetes.io/projected/64e38a91-36de-4de2-bccf-d63bd8d50352-kube-api-access-pfr2n\") pod \"payload-processing-699b6cd6c-j2l4f\" (UID: \"64e38a91-36de-4de2-bccf-d63bd8d50352\") " pod="openshift-ingress/payload-processing-699b6cd6c-j2l4f" Jun 14 15:24:46.003832 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:24:46.003794 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zbvc\" (UniqueName: \"kubernetes.io/projected/a7917219-c659-4886-bbc2-69fafcde54f8-kube-api-access-7zbvc\") pod \"payload-pre-processing-579785bc64-tfdlz\" (UID: \"a7917219-c659-4886-bbc2-69fafcde54f8\") " pod="openshift-ingress/payload-pre-processing-579785bc64-tfdlz" Jun 14 15:24:46.003968 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:24:46.003850 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfr2n\" (UniqueName: \"kubernetes.io/projected/64e38a91-36de-4de2-bccf-d63bd8d50352-kube-api-access-pfr2n\") pod \"payload-processing-699b6cd6c-j2l4f\" (UID: \"64e38a91-36de-4de2-bccf-d63bd8d50352\") " pod="openshift-ingress/payload-processing-699b6cd6c-j2l4f" Jun 14 15:24:46.049520 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:24:46.049481 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-tfdlz" Jun 14 15:24:46.072611 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:24:46.072582 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-j2l4f" Jun 14 15:24:46.150285 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:24:46.150250 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-856ffd5c84-qqcqg" event={"ID":"1927d9a3-84e4-4687-9801-db661a274100","Type":"ContainerStarted","Data":"0c567b6c68676d45f10b8c7a23d1b4692322563cc8966e7be8b5920f5feb3982"} Jun 14 15:24:46.195426 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:24:46.195392 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-tfdlz"] Jun 14 15:24:46.200376 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:24:46.200338 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7917219_c659_4886_bbc2_69fafcde54f8.slice/crio-fe268d04ddafdbb28df34c02fb47c9895e6e06addcc30a479e0ad2c81dca1c72 WatchSource:0}: Error finding container fe268d04ddafdbb28df34c02fb47c9895e6e06addcc30a479e0ad2c81dca1c72: Status 404 returned error can't find the container with id fe268d04ddafdbb28df34c02fb47c9895e6e06addcc30a479e0ad2c81dca1c72 Jun 14 15:24:46.227314 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:24:46.227280 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-j2l4f"] Jun 14 15:24:46.231931 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:24:46.231890 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64e38a91_36de_4de2_bccf_d63bd8d50352.slice/crio-6eb3b340f72c97752037f1dca43ff5603f5581695489113fe8adb1c2ae189839 WatchSource:0}: Error finding container 6eb3b340f72c97752037f1dca43ff5603f5581695489113fe8adb1c2ae189839: Status 404 returned error can't find the container with id 6eb3b340f72c97752037f1dca43ff5603f5581695489113fe8adb1c2ae189839 Jun 14 15:24:47.164796 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:24:47.164677 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-856ffd5c84-qqcqg" event={"ID":"1927d9a3-84e4-4687-9801-db661a274100","Type":"ContainerStarted","Data":"93f62ccda5237a887ecbd25766a635c50d42a181631e80edf60497f9cd1b1931"} Jun 14 15:24:47.165600 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:24:47.165528 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-856ffd5c84-qqcqg" Jun 14 15:24:47.167423 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:24:47.167333 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-j2l4f" event={"ID":"64e38a91-36de-4de2-bccf-d63bd8d50352","Type":"ContainerStarted","Data":"6eb3b340f72c97752037f1dca43ff5603f5581695489113fe8adb1c2ae189839"} Jun 14 15:24:47.168808 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:24:47.168746 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-tfdlz" event={"ID":"a7917219-c659-4886-bbc2-69fafcde54f8","Type":"ContainerStarted","Data":"fe268d04ddafdbb28df34c02fb47c9895e6e06addcc30a479e0ad2c81dca1c72"} Jun 14 15:24:47.194452 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:24:47.193642 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-856ffd5c84-qqcqg" podStartSLOduration=0.853728417 podStartE2EDuration="2.193616605s" totalImagesPullingTime="1.339888188s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:24:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:24:47.191609674 +0000 UTC m=+644.373092189" watchObservedRunningTime="2026-06-14 15:24:47.193616605 +0000 UTC m=+644.375099124" Jun 14 15:24:49.183336 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:24:49.183243 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-tfdlz" event={"ID":"a7917219-c659-4886-bbc2-69fafcde54f8","Type":"ContainerStarted","Data":"a3e083949ef21e38918c593dda08f817c8b4a8c62b275a3c6d89622a7b29421f"} Jun 14 15:24:49.183336 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:24:49.183300 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-579785bc64-tfdlz" Jun 14 15:24:49.184657 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:24:49.184634 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-j2l4f" event={"ID":"64e38a91-36de-4de2-bccf-d63bd8d50352","Type":"ContainerStarted","Data":"d26a882f1ed81a9317d0c2c63f48fb107ec9f124cc8b720c16f57ea7044e1822"} Jun 14 15:24:49.200325 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:24:49.200281 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-579785bc64-tfdlz" podStartSLOduration=1.533151956 podStartE2EDuration="4.200266278s" totalImagesPullingTime="2.667114322s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:24:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:24:49.199543806 +0000 UTC m=+646.381026323" watchObservedRunningTime="2026-06-14 15:24:49.200266278 +0000 UTC m=+646.381748793" Jun 14 15:24:49.215799 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:24:49.215755 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-699b6cd6c-j2l4f" podStartSLOduration=1.572720526 podStartE2EDuration="4.215742452s" totalImagesPullingTime="2.643021926s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:24:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:24:49.215351268 +0000 UTC m=+646.396833784" watchObservedRunningTime="2026-06-14 15:24:49.215742452 +0000 UTC m=+646.397224968" Jun 14 15:24:50.190086 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:24:50.190042 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-699b6cd6c-j2l4f" Jun 14 15:24:54.190161 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:24:54.190130 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-856ffd5c84-qqcqg" Jun 14 15:25:00.192758 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:25:00.192726 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-579785bc64-tfdlz" Jun 14 15:25:01.196800 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:25:01.196772 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-699b6cd6c-j2l4f" Jun 14 15:25:45.224498 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:25:45.224427 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:26:49.231202 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:26:49.231170 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:27:13.888124 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:27:13.888024 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:27:13.943389 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:27:13.943341 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:27:37.739804 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:27:37.739763 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:27:37.839294 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:27:37.839262 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:27:50.322016 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:27:50.321982 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:27:55.874659 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:27:55.874620 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-ll76d"] Jun 14 15:27:55.878277 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:27:55.878256 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ll76d" Jun 14 15:27:55.881706 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:27:55.881682 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 14 15:27:55.881828 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:27:55.881686 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 14 15:27:55.881828 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:27:55.881687 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 14 15:27:55.881828 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:27:55.881727 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-fchjl\"" Jun 14 15:27:55.889569 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:27:55.889545 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-ll76d"] Jun 14 15:27:55.959803 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:27:55.959768 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:27:55.985934 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:27:55.985901 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/38fe2ebf-4fa0-4a1d-a40e-13ecd4993ab4-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-ll76d\" (UID: \"38fe2ebf-4fa0-4a1d-a40e-13ecd4993ab4\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ll76d" Jun 14 15:27:55.985934 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:27:55.985936 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/38fe2ebf-4fa0-4a1d-a40e-13ecd4993ab4-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-ll76d\" (UID: \"38fe2ebf-4fa0-4a1d-a40e-13ecd4993ab4\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ll76d" Jun 14 15:27:55.986222 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:27:55.985967 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/38fe2ebf-4fa0-4a1d-a40e-13ecd4993ab4-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-ll76d\" (UID: \"38fe2ebf-4fa0-4a1d-a40e-13ecd4993ab4\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ll76d" Jun 14 15:27:55.986222 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:27:55.985989 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5tzs\" (UniqueName: \"kubernetes.io/projected/38fe2ebf-4fa0-4a1d-a40e-13ecd4993ab4-kube-api-access-r5tzs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-ll76d\" (UID: \"38fe2ebf-4fa0-4a1d-a40e-13ecd4993ab4\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ll76d" Jun 14 15:27:55.986222 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:27:55.986106 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/38fe2ebf-4fa0-4a1d-a40e-13ecd4993ab4-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-ll76d\" (UID: \"38fe2ebf-4fa0-4a1d-a40e-13ecd4993ab4\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ll76d" Jun 14 15:27:55.986222 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:27:55.986146 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/38fe2ebf-4fa0-4a1d-a40e-13ecd4993ab4-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-ll76d\" (UID: \"38fe2ebf-4fa0-4a1d-a40e-13ecd4993ab4\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ll76d" Jun 14 15:27:56.087017 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:27:56.086983 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/38fe2ebf-4fa0-4a1d-a40e-13ecd4993ab4-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-ll76d\" (UID: \"38fe2ebf-4fa0-4a1d-a40e-13ecd4993ab4\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ll76d" Jun 14 15:27:56.087225 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:27:56.087021 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/38fe2ebf-4fa0-4a1d-a40e-13ecd4993ab4-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-ll76d\" (UID: \"38fe2ebf-4fa0-4a1d-a40e-13ecd4993ab4\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ll76d" Jun 14 15:27:56.087225 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:27:56.087069 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/38fe2ebf-4fa0-4a1d-a40e-13ecd4993ab4-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-ll76d\" (UID: \"38fe2ebf-4fa0-4a1d-a40e-13ecd4993ab4\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ll76d" Jun 14 15:27:56.087225 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:27:56.087084 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5tzs\" (UniqueName: \"kubernetes.io/projected/38fe2ebf-4fa0-4a1d-a40e-13ecd4993ab4-kube-api-access-r5tzs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-ll76d\" (UID: \"38fe2ebf-4fa0-4a1d-a40e-13ecd4993ab4\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ll76d" Jun 14 15:27:56.087225 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:27:56.087122 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/38fe2ebf-4fa0-4a1d-a40e-13ecd4993ab4-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-ll76d\" (UID: \"38fe2ebf-4fa0-4a1d-a40e-13ecd4993ab4\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ll76d" Jun 14 15:27:56.087225 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:27:56.087149 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/38fe2ebf-4fa0-4a1d-a40e-13ecd4993ab4-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-ll76d\" (UID: \"38fe2ebf-4fa0-4a1d-a40e-13ecd4993ab4\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ll76d" Jun 14 15:27:56.087515 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:27:56.087490 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/38fe2ebf-4fa0-4a1d-a40e-13ecd4993ab4-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-ll76d\" (UID: \"38fe2ebf-4fa0-4a1d-a40e-13ecd4993ab4\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ll76d" Jun 14 15:27:56.087574 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:27:56.087548 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/38fe2ebf-4fa0-4a1d-a40e-13ecd4993ab4-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-ll76d\" (UID: \"38fe2ebf-4fa0-4a1d-a40e-13ecd4993ab4\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ll76d" Jun 14 15:27:56.087628 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:27:56.087608 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/38fe2ebf-4fa0-4a1d-a40e-13ecd4993ab4-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-ll76d\" (UID: \"38fe2ebf-4fa0-4a1d-a40e-13ecd4993ab4\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ll76d" Jun 14 15:27:56.089298 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:27:56.089281 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/38fe2ebf-4fa0-4a1d-a40e-13ecd4993ab4-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-ll76d\" (UID: \"38fe2ebf-4fa0-4a1d-a40e-13ecd4993ab4\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ll76d" Jun 14 15:27:56.089589 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:27:56.089572 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/38fe2ebf-4fa0-4a1d-a40e-13ecd4993ab4-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-ll76d\" (UID: \"38fe2ebf-4fa0-4a1d-a40e-13ecd4993ab4\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ll76d" Jun 14 15:27:56.095060 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:27:56.095024 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5tzs\" (UniqueName: \"kubernetes.io/projected/38fe2ebf-4fa0-4a1d-a40e-13ecd4993ab4-kube-api-access-r5tzs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-ll76d\" (UID: \"38fe2ebf-4fa0-4a1d-a40e-13ecd4993ab4\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ll76d" Jun 14 15:27:56.188432 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:27:56.188328 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ll76d" Jun 14 15:27:56.337307 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:27:56.337277 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-ll76d"] Jun 14 15:27:56.339313 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:27:56.339276 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38fe2ebf_4fa0_4a1d_a40e_13ecd4993ab4.slice/crio-67110f61bb79b9ebe77f84a1d6cead4bd9f517e98b38254ebb44fa56852585df WatchSource:0}: Error finding container 67110f61bb79b9ebe77f84a1d6cead4bd9f517e98b38254ebb44fa56852585df: Status 404 returned error can't find the container with id 67110f61bb79b9ebe77f84a1d6cead4bd9f517e98b38254ebb44fa56852585df Jun 14 15:27:57.095626 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:27:57.095578 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ll76d" event={"ID":"38fe2ebf-4fa0-4a1d-a40e-13ecd4993ab4","Type":"ContainerStarted","Data":"67110f61bb79b9ebe77f84a1d6cead4bd9f517e98b38254ebb44fa56852585df"} Jun 14 15:28:00.114335 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:28:00.114245 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ll76d" event={"ID":"38fe2ebf-4fa0-4a1d-a40e-13ecd4993ab4","Type":"ContainerStarted","Data":"68783d814a9f8b57034c58e18896f20a8b3ad86ad684dc6089d2abbb0ea3dbb6"} Jun 14 15:28:03.296005 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:28:03.295974 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:28:16.731126 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:28:16.731093 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:28:38.024102 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:28:38.024067 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-tl7qt"] Jun 14 15:28:38.027950 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:28:38.027933 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-tl7qt" Jun 14 15:28:38.030456 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:28:38.030435 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 14 15:28:38.039414 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:28:38.039389 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-tl7qt"] Jun 14 15:28:38.055975 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:28:38.055838 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:28:38.086441 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:28:38.086419 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/80486bcb-2333-49d7-8c2c-2976d1f8dee2-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-tl7qt\" (UID: \"80486bcb-2333-49d7-8c2c-2976d1f8dee2\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-tl7qt" Jun 14 15:28:38.086567 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:28:38.086446 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/80486bcb-2333-49d7-8c2c-2976d1f8dee2-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-tl7qt\" (UID: \"80486bcb-2333-49d7-8c2c-2976d1f8dee2\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-tl7qt" Jun 14 15:28:38.086567 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:28:38.086466 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5k9jf\" (UniqueName: \"kubernetes.io/projected/80486bcb-2333-49d7-8c2c-2976d1f8dee2-kube-api-access-5k9jf\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-tl7qt\" (UID: \"80486bcb-2333-49d7-8c2c-2976d1f8dee2\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-tl7qt" Jun 14 15:28:38.086567 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:28:38.086500 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/80486bcb-2333-49d7-8c2c-2976d1f8dee2-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-tl7qt\" (UID: \"80486bcb-2333-49d7-8c2c-2976d1f8dee2\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-tl7qt" Jun 14 15:28:38.086721 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:28:38.086625 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/80486bcb-2333-49d7-8c2c-2976d1f8dee2-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-tl7qt\" (UID: \"80486bcb-2333-49d7-8c2c-2976d1f8dee2\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-tl7qt" Jun 14 15:28:38.086760 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:28:38.086733 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/80486bcb-2333-49d7-8c2c-2976d1f8dee2-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-tl7qt\" (UID: \"80486bcb-2333-49d7-8c2c-2976d1f8dee2\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-tl7qt" Jun 14 15:28:38.187723 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:28:38.187691 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/80486bcb-2333-49d7-8c2c-2976d1f8dee2-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-tl7qt\" (UID: \"80486bcb-2333-49d7-8c2c-2976d1f8dee2\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-tl7qt" Jun 14 15:28:38.187914 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:28:38.187734 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/80486bcb-2333-49d7-8c2c-2976d1f8dee2-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-tl7qt\" (UID: \"80486bcb-2333-49d7-8c2c-2976d1f8dee2\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-tl7qt" Jun 14 15:28:38.187914 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:28:38.187749 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/80486bcb-2333-49d7-8c2c-2976d1f8dee2-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-tl7qt\" (UID: \"80486bcb-2333-49d7-8c2c-2976d1f8dee2\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-tl7qt" Jun 14 15:28:38.187914 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:28:38.187766 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5k9jf\" (UniqueName: \"kubernetes.io/projected/80486bcb-2333-49d7-8c2c-2976d1f8dee2-kube-api-access-5k9jf\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-tl7qt\" (UID: \"80486bcb-2333-49d7-8c2c-2976d1f8dee2\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-tl7qt" Jun 14 15:28:38.187914 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:28:38.187792 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/80486bcb-2333-49d7-8c2c-2976d1f8dee2-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-tl7qt\" (UID: \"80486bcb-2333-49d7-8c2c-2976d1f8dee2\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-tl7qt" Jun 14 15:28:38.187914 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:28:38.187815 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/80486bcb-2333-49d7-8c2c-2976d1f8dee2-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-tl7qt\" (UID: \"80486bcb-2333-49d7-8c2c-2976d1f8dee2\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-tl7qt" Jun 14 15:28:38.188237 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:28:38.188195 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/80486bcb-2333-49d7-8c2c-2976d1f8dee2-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-tl7qt\" (UID: \"80486bcb-2333-49d7-8c2c-2976d1f8dee2\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-tl7qt" Jun 14 15:28:38.188294 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:28:38.188269 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/80486bcb-2333-49d7-8c2c-2976d1f8dee2-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-tl7qt\" (UID: \"80486bcb-2333-49d7-8c2c-2976d1f8dee2\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-tl7qt" Jun 14 15:28:38.188343 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:28:38.188289 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/80486bcb-2333-49d7-8c2c-2976d1f8dee2-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-tl7qt\" (UID: \"80486bcb-2333-49d7-8c2c-2976d1f8dee2\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-tl7qt" Jun 14 15:28:38.190093 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:28:38.190071 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/80486bcb-2333-49d7-8c2c-2976d1f8dee2-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-tl7qt\" (UID: \"80486bcb-2333-49d7-8c2c-2976d1f8dee2\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-tl7qt" Jun 14 15:28:38.190266 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:28:38.190250 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/80486bcb-2333-49d7-8c2c-2976d1f8dee2-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-tl7qt\" (UID: \"80486bcb-2333-49d7-8c2c-2976d1f8dee2\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-tl7qt" Jun 14 15:28:38.195545 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:28:38.195523 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5k9jf\" (UniqueName: \"kubernetes.io/projected/80486bcb-2333-49d7-8c2c-2976d1f8dee2-kube-api-access-5k9jf\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-tl7qt\" (UID: \"80486bcb-2333-49d7-8c2c-2976d1f8dee2\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-tl7qt" Jun 14 15:28:38.368962 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:28:38.368878 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-tl7qt" Jun 14 15:28:38.503416 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:28:38.503393 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-tl7qt"] Jun 14 15:28:38.505651 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:28:38.505626 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80486bcb_2333_49d7_8c2c_2976d1f8dee2.slice/crio-ba369bb194da1c08863c1d1e6188d7d28d064bea683ed63c8ae4cbfdb8e458b1 WatchSource:0}: Error finding container ba369bb194da1c08863c1d1e6188d7d28d064bea683ed63c8ae4cbfdb8e458b1: Status 404 returned error can't find the container with id ba369bb194da1c08863c1d1e6188d7d28d064bea683ed63c8ae4cbfdb8e458b1 Jun 14 15:28:39.305492 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:28:39.305455 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-tl7qt" event={"ID":"80486bcb-2333-49d7-8c2c-2976d1f8dee2","Type":"ContainerStarted","Data":"2f6fc56dacca7e14c3bf64f16bf94b7d9dad358f9a4e06a5397ccbd5b0757749"} Jun 14 15:28:39.305872 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:28:39.305511 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-tl7qt" event={"ID":"80486bcb-2333-49d7-8c2c-2976d1f8dee2","Type":"ContainerStarted","Data":"ba369bb194da1c08863c1d1e6188d7d28d064bea683ed63c8ae4cbfdb8e458b1"} Jun 14 15:28:40.310333 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:28:40.310296 2571 generic.go:356] "Generic (PLEG): container finished" podID="80486bcb-2333-49d7-8c2c-2976d1f8dee2" containerID="2f6fc56dacca7e14c3bf64f16bf94b7d9dad358f9a4e06a5397ccbd5b0757749" exitCode=0 Jun 14 15:28:40.310719 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:28:40.310372 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-tl7qt" event={"ID":"80486bcb-2333-49d7-8c2c-2976d1f8dee2","Type":"ContainerDied","Data":"2f6fc56dacca7e14c3bf64f16bf94b7d9dad358f9a4e06a5397ccbd5b0757749"} Jun 14 15:28:42.322814 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:28:42.322775 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-tl7qt" event={"ID":"80486bcb-2333-49d7-8c2c-2976d1f8dee2","Type":"ContainerStarted","Data":"b62799af6b2471b1fc82ab6e7064685e155261c5eb7d8ed7d4c5fd92d6d19f04"} Jun 14 15:28:42.344294 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:28:42.344243 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-tl7qt" podStartSLOduration=2.9782149430000002 podStartE2EDuration="5.344228781s" totalImagesPullingTime="1.007066292s" totalInitContainerRuntime="1.358947546s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:28:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:28:42.343533097 +0000 UTC m=+879.525015615" watchObservedRunningTime="2026-06-14 15:28:42.344228781 +0000 UTC m=+879.525711310" Jun 14 15:28:48.369612 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:28:48.369580 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-tl7qt" Jun 14 15:28:48.370105 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:28:48.369641 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-tl7qt" Jun 14 15:28:48.382476 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:28:48.382453 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-tl7qt" Jun 14 15:28:49.376005 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:28:49.375979 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-tl7qt" Jun 14 15:28:52.380087 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:28:52.379996 2571 generic.go:356] "Generic (PLEG): container finished" podID="38fe2ebf-4fa0-4a1d-a40e-13ecd4993ab4" containerID="68783d814a9f8b57034c58e18896f20a8b3ad86ad684dc6089d2abbb0ea3dbb6" exitCode=0 Jun 14 15:28:52.380087 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:28:52.380069 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ll76d" event={"ID":"38fe2ebf-4fa0-4a1d-a40e-13ecd4993ab4","Type":"ContainerDied","Data":"68783d814a9f8b57034c58e18896f20a8b3ad86ad684dc6089d2abbb0ea3dbb6"} Jun 14 15:28:53.386580 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:28:53.386544 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ll76d" event={"ID":"38fe2ebf-4fa0-4a1d-a40e-13ecd4993ab4","Type":"ContainerStarted","Data":"4dd7453e07211288036a520da9d947c2f1b38b0efe564dacbb25ac5f42761a66"} Jun 14 15:28:53.405166 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:28:53.405116 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ll76d" podStartSLOduration=2.690874026 podStartE2EDuration="58.405099072s" totalImagesPullingTime="3.638622369s" totalInitContainerRuntime="52.075602677s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:27:55 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:28:53.404410939 +0000 UTC m=+890.585893457" watchObservedRunningTime="2026-06-14 15:28:53.405099072 +0000 UTC m=+890.586581589" Jun 14 15:28:54.451181 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:28:54.451144 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-vrckx"] Jun 14 15:28:54.455579 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:28:54.455549 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-vrckx" Jun 14 15:28:54.457817 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:28:54.457799 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 14 15:28:54.465131 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:28:54.465105 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-vrckx"] Jun 14 15:28:54.485246 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:28:54.485225 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:28:54.533267 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:28:54.533245 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2b2c0442-0ce0-4d7e-9852-ee9463eefc70-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-vrckx\" (UID: \"2b2c0442-0ce0-4d7e-9852-ee9463eefc70\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-vrckx" Jun 14 15:28:54.533393 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:28:54.533280 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b2c0442-0ce0-4d7e-9852-ee9463eefc70-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-vrckx\" (UID: \"2b2c0442-0ce0-4d7e-9852-ee9463eefc70\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-vrckx" Jun 14 15:28:54.533393 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:28:54.533300 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b2c0442-0ce0-4d7e-9852-ee9463eefc70-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-vrckx\" (UID: \"2b2c0442-0ce0-4d7e-9852-ee9463eefc70\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-vrckx" Jun 14 15:28:54.533486 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:28:54.533453 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b2c0442-0ce0-4d7e-9852-ee9463eefc70-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-vrckx\" (UID: \"2b2c0442-0ce0-4d7e-9852-ee9463eefc70\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-vrckx" Jun 14 15:28:54.533523 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:28:54.533499 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xm2fv\" (UniqueName: \"kubernetes.io/projected/2b2c0442-0ce0-4d7e-9852-ee9463eefc70-kube-api-access-xm2fv\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-vrckx\" (UID: \"2b2c0442-0ce0-4d7e-9852-ee9463eefc70\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-vrckx" Jun 14 15:28:54.533565 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:28:54.533526 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b2c0442-0ce0-4d7e-9852-ee9463eefc70-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-vrckx\" (UID: \"2b2c0442-0ce0-4d7e-9852-ee9463eefc70\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-vrckx" Jun 14 15:28:54.634663 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:28:54.634631 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b2c0442-0ce0-4d7e-9852-ee9463eefc70-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-vrckx\" (UID: \"2b2c0442-0ce0-4d7e-9852-ee9463eefc70\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-vrckx" Jun 14 15:28:54.634819 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:28:54.634681 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xm2fv\" (UniqueName: \"kubernetes.io/projected/2b2c0442-0ce0-4d7e-9852-ee9463eefc70-kube-api-access-xm2fv\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-vrckx\" (UID: \"2b2c0442-0ce0-4d7e-9852-ee9463eefc70\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-vrckx" Jun 14 15:28:54.634819 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:28:54.634702 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b2c0442-0ce0-4d7e-9852-ee9463eefc70-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-vrckx\" (UID: \"2b2c0442-0ce0-4d7e-9852-ee9463eefc70\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-vrckx" Jun 14 15:28:54.634819 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:28:54.634738 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2b2c0442-0ce0-4d7e-9852-ee9463eefc70-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-vrckx\" (UID: \"2b2c0442-0ce0-4d7e-9852-ee9463eefc70\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-vrckx" Jun 14 15:28:54.634819 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:28:54.634755 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b2c0442-0ce0-4d7e-9852-ee9463eefc70-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-vrckx\" (UID: \"2b2c0442-0ce0-4d7e-9852-ee9463eefc70\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-vrckx" Jun 14 15:28:54.634819 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:28:54.634770 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b2c0442-0ce0-4d7e-9852-ee9463eefc70-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-vrckx\" (UID: \"2b2c0442-0ce0-4d7e-9852-ee9463eefc70\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-vrckx" Jun 14 15:28:54.635137 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:28:54.635102 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b2c0442-0ce0-4d7e-9852-ee9463eefc70-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-vrckx\" (UID: \"2b2c0442-0ce0-4d7e-9852-ee9463eefc70\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-vrckx" Jun 14 15:28:54.635196 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:28:54.635149 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b2c0442-0ce0-4d7e-9852-ee9463eefc70-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-vrckx\" (UID: \"2b2c0442-0ce0-4d7e-9852-ee9463eefc70\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-vrckx" Jun 14 15:28:54.635269 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:28:54.635251 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2b2c0442-0ce0-4d7e-9852-ee9463eefc70-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-vrckx\" (UID: \"2b2c0442-0ce0-4d7e-9852-ee9463eefc70\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-vrckx" Jun 14 15:28:54.636935 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:28:54.636916 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b2c0442-0ce0-4d7e-9852-ee9463eefc70-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-vrckx\" (UID: \"2b2c0442-0ce0-4d7e-9852-ee9463eefc70\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-vrckx" Jun 14 15:28:54.637253 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:28:54.637234 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b2c0442-0ce0-4d7e-9852-ee9463eefc70-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-vrckx\" (UID: \"2b2c0442-0ce0-4d7e-9852-ee9463eefc70\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-vrckx" Jun 14 15:28:54.643375 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:28:54.643354 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xm2fv\" (UniqueName: \"kubernetes.io/projected/2b2c0442-0ce0-4d7e-9852-ee9463eefc70-kube-api-access-xm2fv\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-vrckx\" (UID: \"2b2c0442-0ce0-4d7e-9852-ee9463eefc70\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-vrckx" Jun 14 15:28:54.766030 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:28:54.765939 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-vrckx" Jun 14 15:28:54.897992 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:28:54.897966 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-vrckx"] Jun 14 15:28:54.900484 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:28:54.900455 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b2c0442_0ce0_4d7e_9852_ee9463eefc70.slice/crio-d109c2e85c8c601cf850db882388377d9941f32889e86f006c5e89e04ba7a822 WatchSource:0}: Error finding container d109c2e85c8c601cf850db882388377d9941f32889e86f006c5e89e04ba7a822: Status 404 returned error can't find the container with id d109c2e85c8c601cf850db882388377d9941f32889e86f006c5e89e04ba7a822 Jun 14 15:28:55.396739 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:28:55.396707 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-vrckx" event={"ID":"2b2c0442-0ce0-4d7e-9852-ee9463eefc70","Type":"ContainerStarted","Data":"e6a9292ed97e77e91f122308c0336892fd3b1598741b8e0f859ab5ffc8125a55"} Jun 14 15:28:55.396739 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:28:55.396747 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-vrckx" event={"ID":"2b2c0442-0ce0-4d7e-9852-ee9463eefc70","Type":"ContainerStarted","Data":"d109c2e85c8c601cf850db882388377d9941f32889e86f006c5e89e04ba7a822"} Jun 14 15:28:56.188650 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:28:56.188617 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ll76d" Jun 14 15:28:56.188998 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:28:56.188669 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ll76d" Jun 14 15:28:56.207488 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:28:56.207460 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ll76d" Jun 14 15:28:56.402981 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:28:56.402940 2571 generic.go:356] "Generic (PLEG): container finished" podID="2b2c0442-0ce0-4d7e-9852-ee9463eefc70" containerID="e6a9292ed97e77e91f122308c0336892fd3b1598741b8e0f859ab5ffc8125a55" exitCode=0 Jun 14 15:28:56.403185 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:28:56.403030 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-vrckx" event={"ID":"2b2c0442-0ce0-4d7e-9852-ee9463eefc70","Type":"ContainerDied","Data":"e6a9292ed97e77e91f122308c0336892fd3b1598741b8e0f859ab5ffc8125a55"} Jun 14 15:28:56.415136 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:28:56.415106 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ll76d" Jun 14 15:28:57.410447 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:28:57.410421 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-vrckx" event={"ID":"2b2c0442-0ce0-4d7e-9852-ee9463eefc70","Type":"ContainerStarted","Data":"93edb80fba97b67ae1d382ebfda21422358ad1af41af907f786f26208283137b"} Jun 14 15:28:57.431395 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:28:57.431340 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-vrckx" podStartSLOduration=1.880412344 podStartE2EDuration="3.431322633s" totalImagesPullingTime="174.047409ms" totalInitContainerRuntime="1.37686288s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:28:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:28:57.430280103 +0000 UTC m=+894.611762623" watchObservedRunningTime="2026-06-14 15:28:57.431322633 +0000 UTC m=+894.612805148" Jun 14 15:29:03.314626 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:29:03.314601 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ltnnm_ee9ddc42-3dac-47b7-a02b-899fc13a7467/ovn-acl-logging/0.log" Jun 14 15:29:03.315027 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:29:03.314988 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ltnnm_ee9ddc42-3dac-47b7-a02b-899fc13a7467/ovn-acl-logging/0.log" Jun 14 15:29:04.766282 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:29:04.766249 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-vrckx" Jun 14 15:29:04.766282 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:29:04.766293 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-vrckx" Jun 14 15:29:04.778547 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:29:04.778522 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-vrckx" Jun 14 15:29:05.462342 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:29:05.462306 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-vrckx" Jun 14 15:29:54.341810 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:29:54.341742 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:29:55.266041 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:29:55.266002 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:29:55.452737 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:29:55.452680 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:29:55.613692 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:29:55.613610 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:30:31.400655 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:30:31.400623 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:31:23.081376 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:31:23.081320 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:31:23.174753 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:31:23.174714 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-974cc687f-lml6s"] Jun 14 15:31:23.175037 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:31:23.175009 2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-974cc687f-lml6s" podUID="9178dee5-500b-4d00-a85e-292467e1cc49" containerName="manager" containerID="cri-o://1c13f2d358f08193a074a363d1bb7b3e2ccdd4a5afd49db26682c412d762b6ef" gracePeriod=30 Jun 14 15:31:23.426314 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:31:23.426284 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-974cc687f-lml6s" Jun 14 15:31:23.500860 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:31:23.500825 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jhdhj\" (UniqueName: \"kubernetes.io/projected/9178dee5-500b-4d00-a85e-292467e1cc49-kube-api-access-jhdhj\") pod \"9178dee5-500b-4d00-a85e-292467e1cc49\" (UID: \"9178dee5-500b-4d00-a85e-292467e1cc49\") " Jun 14 15:31:23.501042 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:31:23.500883 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9178dee5-500b-4d00-a85e-292467e1cc49-webhook-cert\") pod \"9178dee5-500b-4d00-a85e-292467e1cc49\" (UID: \"9178dee5-500b-4d00-a85e-292467e1cc49\") " Jun 14 15:31:23.503007 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:31:23.502972 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9178dee5-500b-4d00-a85e-292467e1cc49-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "9178dee5-500b-4d00-a85e-292467e1cc49" (UID: "9178dee5-500b-4d00-a85e-292467e1cc49"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 15:31:23.503137 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:31:23.503010 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9178dee5-500b-4d00-a85e-292467e1cc49-kube-api-access-jhdhj" (OuterVolumeSpecName: "kube-api-access-jhdhj") pod "9178dee5-500b-4d00-a85e-292467e1cc49" (UID: "9178dee5-500b-4d00-a85e-292467e1cc49"). InnerVolumeSpecName "kube-api-access-jhdhj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 15:31:23.601980 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:31:23.601879 2571 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9178dee5-500b-4d00-a85e-292467e1cc49-webhook-cert\") on node \"ip-10-0-140-30.ec2.internal\" DevicePath \"\"" Jun 14 15:31:23.601980 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:31:23.601911 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jhdhj\" (UniqueName: \"kubernetes.io/projected/9178dee5-500b-4d00-a85e-292467e1cc49-kube-api-access-jhdhj\") on node \"ip-10-0-140-30.ec2.internal\" DevicePath \"\"" Jun 14 15:31:24.148175 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:31:24.148140 2571 generic.go:356] "Generic (PLEG): container finished" podID="9178dee5-500b-4d00-a85e-292467e1cc49" containerID="1c13f2d358f08193a074a363d1bb7b3e2ccdd4a5afd49db26682c412d762b6ef" exitCode=0 Jun 14 15:31:24.148604 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:31:24.148179 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-974cc687f-lml6s" Jun 14 15:31:24.148604 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:31:24.148233 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-974cc687f-lml6s" event={"ID":"9178dee5-500b-4d00-a85e-292467e1cc49","Type":"ContainerDied","Data":"1c13f2d358f08193a074a363d1bb7b3e2ccdd4a5afd49db26682c412d762b6ef"} Jun 14 15:31:24.148604 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:31:24.148287 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-974cc687f-lml6s" event={"ID":"9178dee5-500b-4d00-a85e-292467e1cc49","Type":"ContainerDied","Data":"6060a7c850dca2f78ab723407e9b797b5430135b7bdb2bbb6a8aa17a73441d69"} Jun 14 15:31:24.148604 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:31:24.148308 2571 scope.go:117] "RemoveContainer" containerID="1c13f2d358f08193a074a363d1bb7b3e2ccdd4a5afd49db26682c412d762b6ef" Jun 14 15:31:24.157738 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:31:24.157721 2571 scope.go:117] "RemoveContainer" containerID="1c13f2d358f08193a074a363d1bb7b3e2ccdd4a5afd49db26682c412d762b6ef" Jun 14 15:31:24.157998 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:31:24.157981 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c13f2d358f08193a074a363d1bb7b3e2ccdd4a5afd49db26682c412d762b6ef\": container with ID starting with 1c13f2d358f08193a074a363d1bb7b3e2ccdd4a5afd49db26682c412d762b6ef not found: ID does not exist" containerID="1c13f2d358f08193a074a363d1bb7b3e2ccdd4a5afd49db26682c412d762b6ef" Jun 14 15:31:24.158089 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:31:24.158006 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c13f2d358f08193a074a363d1bb7b3e2ccdd4a5afd49db26682c412d762b6ef"} err="failed to get container status \"1c13f2d358f08193a074a363d1bb7b3e2ccdd4a5afd49db26682c412d762b6ef\": rpc error: code = NotFound desc = could not find container \"1c13f2d358f08193a074a363d1bb7b3e2ccdd4a5afd49db26682c412d762b6ef\": container with ID starting with 1c13f2d358f08193a074a363d1bb7b3e2ccdd4a5afd49db26682c412d762b6ef not found: ID does not exist" Jun 14 15:31:24.169501 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:31:24.169479 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-974cc687f-lml6s"] Jun 14 15:31:24.172640 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:31:24.172622 2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-974cc687f-lml6s"] Jun 14 15:31:24.828485 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:31:24.828454 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:31:25.305819 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:31:25.305782 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9178dee5-500b-4d00-a85e-292467e1cc49" path="/var/lib/kubelet/pods/9178dee5-500b-4d00-a85e-292467e1cc49/volumes" Jun 14 15:32:02.541830 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:32:02.541790 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:32:04.930271 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:32:04.930241 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:32:05.039370 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:32:05.039337 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:32:13.395093 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:32:13.395040 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:32:19.513965 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:32:19.513930 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:32:19.595482 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:32:19.595446 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:32:51.732504 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:32:51.732465 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:32:51.826155 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:32:51.826109 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:33:15.690430 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:33:15.690349 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:33:22.029435 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:33:22.029403 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:33:22.139567 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:33:22.139532 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:33:22.231077 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:33:22.231029 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:33:22.409029 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:33:22.408943 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:33:22.500567 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:33:22.500536 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:33:39.018913 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:33:39.018883 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:33:39.147672 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:33:39.147638 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:33:39.281562 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:33:39.281482 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:33:45.476525 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:33:45.476486 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:33:45.577467 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:33:45.577428 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:33:53.626978 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:33:53.626886 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:33:53.718316 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:33:53.718285 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:33:53.830243 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:33:53.830206 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:33:53.958941 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:33:53.958904 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:34:03.353572 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:34:03.353544 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ltnnm_ee9ddc42-3dac-47b7-a02b-899fc13a7467/ovn-acl-logging/0.log" Jun 14 15:34:03.356316 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:34:03.356296 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ltnnm_ee9ddc42-3dac-47b7-a02b-899fc13a7467/ovn-acl-logging/0.log" Jun 14 15:34:10.375585 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:34:10.375551 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:34:10.495304 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:34:10.495270 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:34:10.594502 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:34:10.594465 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:34:16.953765 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:34:16.953712 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:34:17.055644 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:34:17.055614 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:34:33.173257 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:34:33.173214 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:34:33.262875 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:34:33.262844 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:34:33.384609 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:34:33.384575 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:34:39.703128 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:34:39.703094 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:34:39.807385 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:34:39.807354 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:34:39.902554 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:34:39.902526 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:34:40.043103 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:34:40.042978 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:34:42.387028 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:34:42.386931 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:34:42.486758 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:34:42.486719 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:34:46.287373 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:34:46.287343 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:34:46.390469 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:34:46.390435 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:35:02.182542 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:35:02.182510 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:35:17.192590 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:35:17.192550 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:35:17.284887 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:35:17.284841 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:36:28.106675 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:36:28.106593 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:39:03.384701 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:39:03.384675 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ltnnm_ee9ddc42-3dac-47b7-a02b-899fc13a7467/ovn-acl-logging/0.log" Jun 14 15:39:03.389255 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:39:03.389232 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ltnnm_ee9ddc42-3dac-47b7-a02b-899fc13a7467/ovn-acl-logging/0.log" Jun 14 15:40:50.842210 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:40:50.842126 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:41:42.797866 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:41:42.797830 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:42:56.393327 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:42:56.393290 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cwzfx"] Jun 14 15:42:56.393904 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:42:56.393547 2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cwzfx" podUID="b1b2df17-7f67-457b-ac04-358c1dd262ad" containerName="manager" containerID="cri-o://a0aa0038c756686ae859bdf92584bb690f4514ce0ab9b648994780858f8f82ed" gracePeriod=10 Jun 14 15:42:56.426680 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:42:56.426646 2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cwzfx" podUID="b1b2df17-7f67-457b-ac04-358c1dd262ad" containerName="manager" probeResult="failure" output="Get \"http://10.134.0.32:8081/readyz\": dial tcp 10.134.0.32:8081: connect: connection refused" Jun 14 15:42:56.580648 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:42:56.580588 2571 generic.go:356] "Generic (PLEG): container finished" podID="b1b2df17-7f67-457b-ac04-358c1dd262ad" containerID="a0aa0038c756686ae859bdf92584bb690f4514ce0ab9b648994780858f8f82ed" exitCode=0 Jun 14 15:42:56.580821 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:42:56.580668 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cwzfx" event={"ID":"b1b2df17-7f67-457b-ac04-358c1dd262ad","Type":"ContainerDied","Data":"a0aa0038c756686ae859bdf92584bb690f4514ce0ab9b648994780858f8f82ed"} Jun 14 15:42:56.649622 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:42:56.649570 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cwzfx" Jun 14 15:42:56.760300 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:42:56.760275 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b1b2df17-7f67-457b-ac04-358c1dd262ad-extensions-socket-volume\") pod \"b1b2df17-7f67-457b-ac04-358c1dd262ad\" (UID: \"b1b2df17-7f67-457b-ac04-358c1dd262ad\") " Jun 14 15:42:56.760471 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:42:56.760332 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-plw88\" (UniqueName: \"kubernetes.io/projected/b1b2df17-7f67-457b-ac04-358c1dd262ad-kube-api-access-plw88\") pod \"b1b2df17-7f67-457b-ac04-358c1dd262ad\" (UID: \"b1b2df17-7f67-457b-ac04-358c1dd262ad\") " Jun 14 15:42:56.760714 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:42:56.760691 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1b2df17-7f67-457b-ac04-358c1dd262ad-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "b1b2df17-7f67-457b-ac04-358c1dd262ad" (UID: "b1b2df17-7f67-457b-ac04-358c1dd262ad"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 15:42:56.762452 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:42:56.762429 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1b2df17-7f67-457b-ac04-358c1dd262ad-kube-api-access-plw88" (OuterVolumeSpecName: "kube-api-access-plw88") pod "b1b2df17-7f67-457b-ac04-358c1dd262ad" (UID: "b1b2df17-7f67-457b-ac04-358c1dd262ad"). InnerVolumeSpecName "kube-api-access-plw88". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 15:42:56.861660 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:42:56.861620 2571 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b1b2df17-7f67-457b-ac04-358c1dd262ad-extensions-socket-volume\") on node \"ip-10-0-140-30.ec2.internal\" DevicePath \"\"" Jun 14 15:42:56.861660 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:42:56.861652 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-plw88\" (UniqueName: \"kubernetes.io/projected/b1b2df17-7f67-457b-ac04-358c1dd262ad-kube-api-access-plw88\") on node \"ip-10-0-140-30.ec2.internal\" DevicePath \"\"" Jun 14 15:42:57.586787 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:42:57.586704 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cwzfx" Jun 14 15:42:57.587254 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:42:57.586707 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cwzfx" event={"ID":"b1b2df17-7f67-457b-ac04-358c1dd262ad","Type":"ContainerDied","Data":"1e8adf97cb98c4a5292eb87f624306a398ee189285ad54dd40d9fcd4af4100c9"} Jun 14 15:42:57.587254 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:42:57.586841 2571 scope.go:117] "RemoveContainer" containerID="a0aa0038c756686ae859bdf92584bb690f4514ce0ab9b648994780858f8f82ed" Jun 14 15:42:57.607535 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:42:57.607507 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cwzfx"] Jun 14 15:42:57.611490 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:42:57.611470 2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cwzfx"] Jun 14 15:42:59.305802 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:42:59.305766 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b1b2df17-7f67-457b-ac04-358c1dd262ad" path="/var/lib/kubelet/pods/b1b2df17-7f67-457b-ac04-358c1dd262ad/volumes" Jun 14 15:44:03.415147 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:44:03.415121 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ltnnm_ee9ddc42-3dac-47b7-a02b-899fc13a7467/ovn-acl-logging/0.log" Jun 14 15:44:03.421063 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:44:03.421022 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ltnnm_ee9ddc42-3dac-47b7-a02b-899fc13a7467/ovn-acl-logging/0.log" Jun 14 15:44:33.394030 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:44:33.393994 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:47:37.000331 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:47:37.000294 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:47:37.994684 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:47:37.994646 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:48:46.985661 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:48:46.985628 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:48:47.144603 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:48:47.144576 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:49:03.447115 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:49:03.447083 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ltnnm_ee9ddc42-3dac-47b7-a02b-899fc13a7467/ovn-acl-logging/0.log" Jun 14 15:49:03.456784 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:49:03.456759 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ltnnm_ee9ddc42-3dac-47b7-a02b-899fc13a7467/ovn-acl-logging/0.log" Jun 14 15:50:45.685977 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:50:45.685943 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:51:20.899548 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:51:20.899467 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:52:50.405551 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:52:50.405480 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:52:53.691917 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:52:53.691885 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:53:17.929697 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:17.929668 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:53:30.976253 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:30.976203 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:53:32.616738 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:32.616700 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-d9eebf53-openshift-default-6986659944-vpgwr"] Jun 14 15:53:32.617219 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:32.617121 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9178dee5-500b-4d00-a85e-292467e1cc49" containerName="manager" Jun 14 15:53:32.617219 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:32.617134 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="9178dee5-500b-4d00-a85e-292467e1cc49" containerName="manager" Jun 14 15:53:32.617219 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:32.617143 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1b2df17-7f67-457b-ac04-358c1dd262ad" containerName="manager" Jun 14 15:53:32.617219 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:32.617148 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1b2df17-7f67-457b-ac04-358c1dd262ad" containerName="manager" Jun 14 15:53:32.617219 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:32.617210 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1b2df17-7f67-457b-ac04-358c1dd262ad" containerName="manager" Jun 14 15:53:32.617219 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:32.617218 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="9178dee5-500b-4d00-a85e-292467e1cc49" containerName="manager" Jun 14 15:53:32.620454 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:32.620432 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d9eebf53-openshift-default-6986659944-vpgwr" Jun 14 15:53:32.622577 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:32.622554 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-d9eebf53-openshift-default-dockercfg-7vdc4\"" Jun 14 15:53:32.653866 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:32.653829 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-d9eebf53-openshift-default-6986659944-vpgwr"] Jun 14 15:53:32.657683 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:32.657647 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:53:32.751446 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:32.751413 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:53:32.787688 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:32.787656 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07afbf9f-0089-46ed-ae02-b0ba3682e828-credential-socket\") pod \"e2e-ait-d9eebf53-openshift-default-6986659944-vpgwr\" (UID: \"07afbf9f-0089-46ed-ae02-b0ba3682e828\") " pod="openshift-ingress/e2e-ait-d9eebf53-openshift-default-6986659944-vpgwr" Jun 14 15:53:32.787861 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:32.787694 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cshcj\" (UniqueName: \"kubernetes.io/projected/07afbf9f-0089-46ed-ae02-b0ba3682e828-kube-api-access-cshcj\") pod \"e2e-ait-d9eebf53-openshift-default-6986659944-vpgwr\" (UID: \"07afbf9f-0089-46ed-ae02-b0ba3682e828\") " pod="openshift-ingress/e2e-ait-d9eebf53-openshift-default-6986659944-vpgwr" Jun 14 15:53:32.787861 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:32.787714 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07afbf9f-0089-46ed-ae02-b0ba3682e828-istiod-ca-cert\") pod \"e2e-ait-d9eebf53-openshift-default-6986659944-vpgwr\" (UID: \"07afbf9f-0089-46ed-ae02-b0ba3682e828\") " pod="openshift-ingress/e2e-ait-d9eebf53-openshift-default-6986659944-vpgwr" Jun 14 15:53:32.787861 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:32.787804 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07afbf9f-0089-46ed-ae02-b0ba3682e828-istio-token\") pod \"e2e-ait-d9eebf53-openshift-default-6986659944-vpgwr\" (UID: \"07afbf9f-0089-46ed-ae02-b0ba3682e828\") " pod="openshift-ingress/e2e-ait-d9eebf53-openshift-default-6986659944-vpgwr" Jun 14 15:53:32.788038 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:32.787863 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07afbf9f-0089-46ed-ae02-b0ba3682e828-istio-data\") pod \"e2e-ait-d9eebf53-openshift-default-6986659944-vpgwr\" (UID: \"07afbf9f-0089-46ed-ae02-b0ba3682e828\") " pod="openshift-ingress/e2e-ait-d9eebf53-openshift-default-6986659944-vpgwr" Jun 14 15:53:32.788038 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:32.787880 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07afbf9f-0089-46ed-ae02-b0ba3682e828-istio-podinfo\") pod \"e2e-ait-d9eebf53-openshift-default-6986659944-vpgwr\" (UID: \"07afbf9f-0089-46ed-ae02-b0ba3682e828\") " pod="openshift-ingress/e2e-ait-d9eebf53-openshift-default-6986659944-vpgwr" Jun 14 15:53:32.788038 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:32.787903 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07afbf9f-0089-46ed-ae02-b0ba3682e828-workload-socket\") pod \"e2e-ait-d9eebf53-openshift-default-6986659944-vpgwr\" (UID: \"07afbf9f-0089-46ed-ae02-b0ba3682e828\") " pod="openshift-ingress/e2e-ait-d9eebf53-openshift-default-6986659944-vpgwr" Jun 14 15:53:32.788038 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:32.787922 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07afbf9f-0089-46ed-ae02-b0ba3682e828-workload-certs\") pod \"e2e-ait-d9eebf53-openshift-default-6986659944-vpgwr\" (UID: \"07afbf9f-0089-46ed-ae02-b0ba3682e828\") " pod="openshift-ingress/e2e-ait-d9eebf53-openshift-default-6986659944-vpgwr" Jun 14 15:53:32.788038 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:32.788004 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07afbf9f-0089-46ed-ae02-b0ba3682e828-istio-envoy\") pod \"e2e-ait-d9eebf53-openshift-default-6986659944-vpgwr\" (UID: \"07afbf9f-0089-46ed-ae02-b0ba3682e828\") " pod="openshift-ingress/e2e-ait-d9eebf53-openshift-default-6986659944-vpgwr" Jun 14 15:53:32.854703 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:32.854641 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:53:32.888567 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:32.888487 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cshcj\" (UniqueName: \"kubernetes.io/projected/07afbf9f-0089-46ed-ae02-b0ba3682e828-kube-api-access-cshcj\") pod \"e2e-ait-d9eebf53-openshift-default-6986659944-vpgwr\" (UID: \"07afbf9f-0089-46ed-ae02-b0ba3682e828\") " pod="openshift-ingress/e2e-ait-d9eebf53-openshift-default-6986659944-vpgwr" Jun 14 15:53:32.888567 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:32.888523 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07afbf9f-0089-46ed-ae02-b0ba3682e828-istiod-ca-cert\") pod \"e2e-ait-d9eebf53-openshift-default-6986659944-vpgwr\" (UID: \"07afbf9f-0089-46ed-ae02-b0ba3682e828\") " pod="openshift-ingress/e2e-ait-d9eebf53-openshift-default-6986659944-vpgwr" Jun 14 15:53:32.888764 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:32.888628 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07afbf9f-0089-46ed-ae02-b0ba3682e828-istio-token\") pod \"e2e-ait-d9eebf53-openshift-default-6986659944-vpgwr\" (UID: \"07afbf9f-0089-46ed-ae02-b0ba3682e828\") " pod="openshift-ingress/e2e-ait-d9eebf53-openshift-default-6986659944-vpgwr" Jun 14 15:53:32.888764 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:32.888671 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07afbf9f-0089-46ed-ae02-b0ba3682e828-istio-data\") pod \"e2e-ait-d9eebf53-openshift-default-6986659944-vpgwr\" (UID: \"07afbf9f-0089-46ed-ae02-b0ba3682e828\") " pod="openshift-ingress/e2e-ait-d9eebf53-openshift-default-6986659944-vpgwr" Jun 14 15:53:32.888764 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:32.888687 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07afbf9f-0089-46ed-ae02-b0ba3682e828-istio-podinfo\") pod \"e2e-ait-d9eebf53-openshift-default-6986659944-vpgwr\" (UID: \"07afbf9f-0089-46ed-ae02-b0ba3682e828\") " pod="openshift-ingress/e2e-ait-d9eebf53-openshift-default-6986659944-vpgwr" Jun 14 15:53:32.888764 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:32.888710 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07afbf9f-0089-46ed-ae02-b0ba3682e828-workload-socket\") pod \"e2e-ait-d9eebf53-openshift-default-6986659944-vpgwr\" (UID: \"07afbf9f-0089-46ed-ae02-b0ba3682e828\") " pod="openshift-ingress/e2e-ait-d9eebf53-openshift-default-6986659944-vpgwr" Jun 14 15:53:32.888764 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:32.888727 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07afbf9f-0089-46ed-ae02-b0ba3682e828-workload-certs\") pod \"e2e-ait-d9eebf53-openshift-default-6986659944-vpgwr\" (UID: \"07afbf9f-0089-46ed-ae02-b0ba3682e828\") " pod="openshift-ingress/e2e-ait-d9eebf53-openshift-default-6986659944-vpgwr" Jun 14 15:53:32.888764 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:32.888763 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07afbf9f-0089-46ed-ae02-b0ba3682e828-istio-envoy\") pod \"e2e-ait-d9eebf53-openshift-default-6986659944-vpgwr\" (UID: \"07afbf9f-0089-46ed-ae02-b0ba3682e828\") " pod="openshift-ingress/e2e-ait-d9eebf53-openshift-default-6986659944-vpgwr" Jun 14 15:53:32.889097 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:32.888817 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07afbf9f-0089-46ed-ae02-b0ba3682e828-credential-socket\") pod \"e2e-ait-d9eebf53-openshift-default-6986659944-vpgwr\" (UID: \"07afbf9f-0089-46ed-ae02-b0ba3682e828\") " pod="openshift-ingress/e2e-ait-d9eebf53-openshift-default-6986659944-vpgwr" Jun 14 15:53:32.889168 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:32.889102 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07afbf9f-0089-46ed-ae02-b0ba3682e828-workload-certs\") pod \"e2e-ait-d9eebf53-openshift-default-6986659944-vpgwr\" (UID: \"07afbf9f-0089-46ed-ae02-b0ba3682e828\") " pod="openshift-ingress/e2e-ait-d9eebf53-openshift-default-6986659944-vpgwr" Jun 14 15:53:32.889224 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:32.889180 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07afbf9f-0089-46ed-ae02-b0ba3682e828-credential-socket\") pod \"e2e-ait-d9eebf53-openshift-default-6986659944-vpgwr\" (UID: \"07afbf9f-0089-46ed-ae02-b0ba3682e828\") " pod="openshift-ingress/e2e-ait-d9eebf53-openshift-default-6986659944-vpgwr" Jun 14 15:53:32.889274 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:32.889227 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07afbf9f-0089-46ed-ae02-b0ba3682e828-workload-socket\") pod \"e2e-ait-d9eebf53-openshift-default-6986659944-vpgwr\" (UID: \"07afbf9f-0089-46ed-ae02-b0ba3682e828\") " pod="openshift-ingress/e2e-ait-d9eebf53-openshift-default-6986659944-vpgwr" Jun 14 15:53:32.889382 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:32.889357 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07afbf9f-0089-46ed-ae02-b0ba3682e828-istiod-ca-cert\") pod \"e2e-ait-d9eebf53-openshift-default-6986659944-vpgwr\" (UID: \"07afbf9f-0089-46ed-ae02-b0ba3682e828\") " pod="openshift-ingress/e2e-ait-d9eebf53-openshift-default-6986659944-vpgwr" Jun 14 15:53:32.889493 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:32.889408 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07afbf9f-0089-46ed-ae02-b0ba3682e828-istio-data\") pod \"e2e-ait-d9eebf53-openshift-default-6986659944-vpgwr\" (UID: \"07afbf9f-0089-46ed-ae02-b0ba3682e828\") " pod="openshift-ingress/e2e-ait-d9eebf53-openshift-default-6986659944-vpgwr" Jun 14 15:53:32.891171 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:32.891143 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07afbf9f-0089-46ed-ae02-b0ba3682e828-istio-envoy\") pod \"e2e-ait-d9eebf53-openshift-default-6986659944-vpgwr\" (UID: \"07afbf9f-0089-46ed-ae02-b0ba3682e828\") " pod="openshift-ingress/e2e-ait-d9eebf53-openshift-default-6986659944-vpgwr" Jun 14 15:53:32.891325 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:32.891303 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07afbf9f-0089-46ed-ae02-b0ba3682e828-istio-podinfo\") pod \"e2e-ait-d9eebf53-openshift-default-6986659944-vpgwr\" (UID: \"07afbf9f-0089-46ed-ae02-b0ba3682e828\") " pod="openshift-ingress/e2e-ait-d9eebf53-openshift-default-6986659944-vpgwr" Jun 14 15:53:32.898219 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:32.898198 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cshcj\" (UniqueName: \"kubernetes.io/projected/07afbf9f-0089-46ed-ae02-b0ba3682e828-kube-api-access-cshcj\") pod \"e2e-ait-d9eebf53-openshift-default-6986659944-vpgwr\" (UID: \"07afbf9f-0089-46ed-ae02-b0ba3682e828\") " pod="openshift-ingress/e2e-ait-d9eebf53-openshift-default-6986659944-vpgwr" Jun 14 15:53:32.898308 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:32.898265 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07afbf9f-0089-46ed-ae02-b0ba3682e828-istio-token\") pod \"e2e-ait-d9eebf53-openshift-default-6986659944-vpgwr\" (UID: \"07afbf9f-0089-46ed-ae02-b0ba3682e828\") " pod="openshift-ingress/e2e-ait-d9eebf53-openshift-default-6986659944-vpgwr" Jun 14 15:53:32.931399 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:32.931374 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d9eebf53-openshift-default-6986659944-vpgwr" Jun 14 15:53:32.952005 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:32.951972 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:53:33.074850 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:33.074821 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-d9eebf53-openshift-default-6986659944-vpgwr"] Jun 14 15:53:33.077001 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:53:33.076966 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07afbf9f_0089_46ed_ae02_b0ba3682e828.slice/crio-2198f6938fdd9dacbf931c593c79646a0e83d9b2f6420d4de7567b9bf9ba2abd WatchSource:0}: Error finding container 2198f6938fdd9dacbf931c593c79646a0e83d9b2f6420d4de7567b9bf9ba2abd: Status 404 returned error can't find the container with id 2198f6938fdd9dacbf931c593c79646a0e83d9b2f6420d4de7567b9bf9ba2abd Jun 14 15:53:33.079386 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:33.079346 2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 14 15:53:33.079471 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:33.079439 2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 14 15:53:33.079510 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:33.079484 2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 14 15:53:33.649399 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:33.649369 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d9eebf53-openshift-default-6986659944-vpgwr" event={"ID":"07afbf9f-0089-46ed-ae02-b0ba3682e828","Type":"ContainerStarted","Data":"e0fa1c08b8efbfb0d8a2027d7c21c4fe7457e4b817085bafa3b49ac70b5905d6"} Jun 14 15:53:33.649922 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:33.649425 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d9eebf53-openshift-default-6986659944-vpgwr" event={"ID":"07afbf9f-0089-46ed-ae02-b0ba3682e828","Type":"ContainerStarted","Data":"2198f6938fdd9dacbf931c593c79646a0e83d9b2f6420d4de7567b9bf9ba2abd"} Jun 14 15:53:33.668412 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:33.668361 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-d9eebf53-openshift-default-6986659944-vpgwr" podStartSLOduration=1.668346278 podStartE2EDuration="1.668346278s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:53:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:53:33.667530767 +0000 UTC m=+2370.849013283" watchObservedRunningTime="2026-06-14 15:53:33.668346278 +0000 UTC m=+2370.849828795" Jun 14 15:53:33.932474 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:33.932398 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-d9eebf53-openshift-default-6986659944-vpgwr" Jun 14 15:53:34.936292 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:34.936264 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-d9eebf53-openshift-default-6986659944-vpgwr" Jun 14 15:53:35.660441 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:35.660403 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-d9eebf53-openshift-default-6986659944-vpgwr" Jun 14 15:53:35.661238 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:35.661221 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-d9eebf53-openshift-default-6986659944-vpgwr" Jun 14 15:53:36.489856 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:36.489825 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:53:38.918520 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:38.918482 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:53:39.087727 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:39.087689 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-d9eebf53-openshift-default-6986659944-vpgwr"] Jun 14 15:53:39.087890 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:39.087872 2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-d9eebf53-openshift-default-6986659944-vpgwr" podUID="07afbf9f-0089-46ed-ae02-b0ba3682e828" containerName="istio-proxy" containerID="cri-o://e0fa1c08b8efbfb0d8a2027d7c21c4fe7457e4b817085bafa3b49ac70b5905d6" gracePeriod=30 Jun 14 15:53:39.104682 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:39.104652 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:53:39.204841 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:39.204814 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:53:40.874888 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:40.874855 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:53:44.343956 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:44.343928 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d9eebf53-openshift-default-6986659944-vpgwr" Jun 14 15:53:44.394819 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:44.394745 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07afbf9f-0089-46ed-ae02-b0ba3682e828-istio-podinfo\") pod \"07afbf9f-0089-46ed-ae02-b0ba3682e828\" (UID: \"07afbf9f-0089-46ed-ae02-b0ba3682e828\") " Jun 14 15:53:44.394819 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:44.394795 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07afbf9f-0089-46ed-ae02-b0ba3682e828-istiod-ca-cert\") pod \"07afbf9f-0089-46ed-ae02-b0ba3682e828\" (UID: \"07afbf9f-0089-46ed-ae02-b0ba3682e828\") " Jun 14 15:53:44.394998 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:44.394832 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cshcj\" (UniqueName: \"kubernetes.io/projected/07afbf9f-0089-46ed-ae02-b0ba3682e828-kube-api-access-cshcj\") pod \"07afbf9f-0089-46ed-ae02-b0ba3682e828\" (UID: \"07afbf9f-0089-46ed-ae02-b0ba3682e828\") " Jun 14 15:53:44.394998 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:44.394968 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07afbf9f-0089-46ed-ae02-b0ba3682e828-credential-socket\") pod \"07afbf9f-0089-46ed-ae02-b0ba3682e828\" (UID: \"07afbf9f-0089-46ed-ae02-b0ba3682e828\") " Jun 14 15:53:44.395168 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:44.395020 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07afbf9f-0089-46ed-ae02-b0ba3682e828-workload-socket\") pod \"07afbf9f-0089-46ed-ae02-b0ba3682e828\" (UID: \"07afbf9f-0089-46ed-ae02-b0ba3682e828\") " Jun 14 15:53:44.395168 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:44.395074 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07afbf9f-0089-46ed-ae02-b0ba3682e828-istio-token\") pod \"07afbf9f-0089-46ed-ae02-b0ba3682e828\" (UID: \"07afbf9f-0089-46ed-ae02-b0ba3682e828\") " Jun 14 15:53:44.395168 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:44.395140 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07afbf9f-0089-46ed-ae02-b0ba3682e828-workload-certs\") pod \"07afbf9f-0089-46ed-ae02-b0ba3682e828\" (UID: \"07afbf9f-0089-46ed-ae02-b0ba3682e828\") " Jun 14 15:53:44.395326 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:44.395163 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07afbf9f-0089-46ed-ae02-b0ba3682e828-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "07afbf9f-0089-46ed-ae02-b0ba3682e828" (UID: "07afbf9f-0089-46ed-ae02-b0ba3682e828"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 15:53:44.395326 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:44.395220 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07afbf9f-0089-46ed-ae02-b0ba3682e828-istio-envoy\") pod \"07afbf9f-0089-46ed-ae02-b0ba3682e828\" (UID: \"07afbf9f-0089-46ed-ae02-b0ba3682e828\") " Jun 14 15:53:44.395326 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:44.395258 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07afbf9f-0089-46ed-ae02-b0ba3682e828-istio-data\") pod \"07afbf9f-0089-46ed-ae02-b0ba3682e828\" (UID: \"07afbf9f-0089-46ed-ae02-b0ba3682e828\") " Jun 14 15:53:44.395465 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:44.395248 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/07afbf9f-0089-46ed-ae02-b0ba3682e828-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "07afbf9f-0089-46ed-ae02-b0ba3682e828" (UID: "07afbf9f-0089-46ed-ae02-b0ba3682e828"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 15:53:44.395465 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:44.395330 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07afbf9f-0089-46ed-ae02-b0ba3682e828-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "07afbf9f-0089-46ed-ae02-b0ba3682e828" (UID: "07afbf9f-0089-46ed-ae02-b0ba3682e828"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 15:53:44.395465 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:44.395417 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07afbf9f-0089-46ed-ae02-b0ba3682e828-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "07afbf9f-0089-46ed-ae02-b0ba3682e828" (UID: "07afbf9f-0089-46ed-ae02-b0ba3682e828"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 15:53:44.395595 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:44.395559 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07afbf9f-0089-46ed-ae02-b0ba3682e828-istio-data" (OuterVolumeSpecName: "istio-data") pod "07afbf9f-0089-46ed-ae02-b0ba3682e828" (UID: "07afbf9f-0089-46ed-ae02-b0ba3682e828"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 15:53:44.395650 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:44.395639 2571 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07afbf9f-0089-46ed-ae02-b0ba3682e828-istio-data\") on node \"ip-10-0-140-30.ec2.internal\" DevicePath \"\"" Jun 14 15:53:44.395703 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:44.395657 2571 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07afbf9f-0089-46ed-ae02-b0ba3682e828-istiod-ca-cert\") on node \"ip-10-0-140-30.ec2.internal\" DevicePath \"\"" Jun 14 15:53:44.395703 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:44.395671 2571 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07afbf9f-0089-46ed-ae02-b0ba3682e828-credential-socket\") on node \"ip-10-0-140-30.ec2.internal\" DevicePath \"\"" Jun 14 15:53:44.395703 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:44.395685 2571 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07afbf9f-0089-46ed-ae02-b0ba3682e828-workload-socket\") on node \"ip-10-0-140-30.ec2.internal\" DevicePath \"\"" Jun 14 15:53:44.395703 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:44.395699 2571 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07afbf9f-0089-46ed-ae02-b0ba3682e828-workload-certs\") on node \"ip-10-0-140-30.ec2.internal\" DevicePath \"\"" Jun 14 15:53:44.397141 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:44.397105 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/07afbf9f-0089-46ed-ae02-b0ba3682e828-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "07afbf9f-0089-46ed-ae02-b0ba3682e828" (UID: "07afbf9f-0089-46ed-ae02-b0ba3682e828"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 14 15:53:44.397259 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:44.397234 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07afbf9f-0089-46ed-ae02-b0ba3682e828-istio-token" (OuterVolumeSpecName: "istio-token") pod "07afbf9f-0089-46ed-ae02-b0ba3682e828" (UID: "07afbf9f-0089-46ed-ae02-b0ba3682e828"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 15:53:44.397307 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:44.397270 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07afbf9f-0089-46ed-ae02-b0ba3682e828-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "07afbf9f-0089-46ed-ae02-b0ba3682e828" (UID: "07afbf9f-0089-46ed-ae02-b0ba3682e828"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 15:53:44.397307 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:44.397290 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07afbf9f-0089-46ed-ae02-b0ba3682e828-kube-api-access-cshcj" (OuterVolumeSpecName: "kube-api-access-cshcj") pod "07afbf9f-0089-46ed-ae02-b0ba3682e828" (UID: "07afbf9f-0089-46ed-ae02-b0ba3682e828"). InnerVolumeSpecName "kube-api-access-cshcj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 15:53:44.496493 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:44.496462 2571 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07afbf9f-0089-46ed-ae02-b0ba3682e828-istio-token\") on node \"ip-10-0-140-30.ec2.internal\" DevicePath \"\"" Jun 14 15:53:44.496493 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:44.496486 2571 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07afbf9f-0089-46ed-ae02-b0ba3682e828-istio-envoy\") on node \"ip-10-0-140-30.ec2.internal\" DevicePath \"\"" Jun 14 15:53:44.496493 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:44.496495 2571 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07afbf9f-0089-46ed-ae02-b0ba3682e828-istio-podinfo\") on node \"ip-10-0-140-30.ec2.internal\" DevicePath \"\"" Jun 14 15:53:44.496709 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:44.496503 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cshcj\" (UniqueName: \"kubernetes.io/projected/07afbf9f-0089-46ed-ae02-b0ba3682e828-kube-api-access-cshcj\") on node \"ip-10-0-140-30.ec2.internal\" DevicePath \"\"" Jun 14 15:53:44.705501 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:44.705469 2571 generic.go:356] "Generic (PLEG): container finished" podID="07afbf9f-0089-46ed-ae02-b0ba3682e828" containerID="e0fa1c08b8efbfb0d8a2027d7c21c4fe7457e4b817085bafa3b49ac70b5905d6" exitCode=0 Jun 14 15:53:44.705671 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:44.705515 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d9eebf53-openshift-default-6986659944-vpgwr" Jun 14 15:53:44.705671 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:44.705543 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d9eebf53-openshift-default-6986659944-vpgwr" event={"ID":"07afbf9f-0089-46ed-ae02-b0ba3682e828","Type":"ContainerDied","Data":"e0fa1c08b8efbfb0d8a2027d7c21c4fe7457e4b817085bafa3b49ac70b5905d6"} Jun 14 15:53:44.705671 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:44.705583 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d9eebf53-openshift-default-6986659944-vpgwr" event={"ID":"07afbf9f-0089-46ed-ae02-b0ba3682e828","Type":"ContainerDied","Data":"2198f6938fdd9dacbf931c593c79646a0e83d9b2f6420d4de7567b9bf9ba2abd"} Jun 14 15:53:44.705671 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:44.705604 2571 scope.go:117] "RemoveContainer" containerID="e0fa1c08b8efbfb0d8a2027d7c21c4fe7457e4b817085bafa3b49ac70b5905d6" Jun 14 15:53:44.715569 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:44.715553 2571 scope.go:117] "RemoveContainer" containerID="e0fa1c08b8efbfb0d8a2027d7c21c4fe7457e4b817085bafa3b49ac70b5905d6" Jun 14 15:53:44.715812 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:53:44.715797 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e0fa1c08b8efbfb0d8a2027d7c21c4fe7457e4b817085bafa3b49ac70b5905d6\": container with ID starting with e0fa1c08b8efbfb0d8a2027d7c21c4fe7457e4b817085bafa3b49ac70b5905d6 not found: ID does not exist" containerID="e0fa1c08b8efbfb0d8a2027d7c21c4fe7457e4b817085bafa3b49ac70b5905d6" Jun 14 15:53:44.715904 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:44.715819 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0fa1c08b8efbfb0d8a2027d7c21c4fe7457e4b817085bafa3b49ac70b5905d6"} err="failed to get container status \"e0fa1c08b8efbfb0d8a2027d7c21c4fe7457e4b817085bafa3b49ac70b5905d6\": rpc error: code = NotFound desc = could not find container \"e0fa1c08b8efbfb0d8a2027d7c21c4fe7457e4b817085bafa3b49ac70b5905d6\": container with ID starting with e0fa1c08b8efbfb0d8a2027d7c21c4fe7457e4b817085bafa3b49ac70b5905d6 not found: ID does not exist" Jun 14 15:53:44.727270 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:44.727244 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-d9eebf53-openshift-default-6986659944-vpgwr"] Jun 14 15:53:44.732784 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:44.732764 2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-d9eebf53-openshift-default-6986659944-vpgwr"] Jun 14 15:53:45.305737 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:45.305705 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="07afbf9f-0089-46ed-ae02-b0ba3682e828" path="/var/lib/kubelet/pods/07afbf9f-0089-46ed-ae02-b0ba3682e828/volumes" Jun 14 15:53:45.473765 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:45.473738 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:53:45.578466 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:45.578393 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:53:45.637665 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:45.637637 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-efe8f615-openshift-default-76bf6f9c9d-kp9tt"] Jun 14 15:53:45.638024 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:45.638012 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07afbf9f-0089-46ed-ae02-b0ba3682e828" containerName="istio-proxy" Jun 14 15:53:45.638093 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:45.638025 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="07afbf9f-0089-46ed-ae02-b0ba3682e828" containerName="istio-proxy" Jun 14 15:53:45.638141 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:45.638129 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="07afbf9f-0089-46ed-ae02-b0ba3682e828" containerName="istio-proxy" Jun 14 15:53:45.642765 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:45.642743 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-efe8f615-openshift-default-76bf6f9c9d-kp9tt" Jun 14 15:53:45.646491 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:45.646450 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-efe8f615-openshift-default-dockercfg-gbckt\"" Jun 14 15:53:45.658713 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:45.658687 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-efe8f615-openshift-default-76bf6f9c9d-kp9tt"] Jun 14 15:53:45.678610 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:45.678576 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:53:45.706016 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:45.705978 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be2541d1-764d-44f2-8187-45205da1eb99-workload-socket\") pod \"e2e-ait-efe8f615-openshift-default-76bf6f9c9d-kp9tt\" (UID: \"be2541d1-764d-44f2-8187-45205da1eb99\") " pod="openshift-ingress/e2e-ait-efe8f615-openshift-default-76bf6f9c9d-kp9tt" Jun 14 15:53:45.706179 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:45.706033 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be2541d1-764d-44f2-8187-45205da1eb99-workload-certs\") pod \"e2e-ait-efe8f615-openshift-default-76bf6f9c9d-kp9tt\" (UID: \"be2541d1-764d-44f2-8187-45205da1eb99\") " pod="openshift-ingress/e2e-ait-efe8f615-openshift-default-76bf6f9c9d-kp9tt" Jun 14 15:53:45.706224 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:45.706184 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzkrz\" (UniqueName: \"kubernetes.io/projected/be2541d1-764d-44f2-8187-45205da1eb99-kube-api-access-tzkrz\") pod \"e2e-ait-efe8f615-openshift-default-76bf6f9c9d-kp9tt\" (UID: \"be2541d1-764d-44f2-8187-45205da1eb99\") " pod="openshift-ingress/e2e-ait-efe8f615-openshift-default-76bf6f9c9d-kp9tt" Jun 14 15:53:45.706266 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:45.706243 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be2541d1-764d-44f2-8187-45205da1eb99-istiod-ca-cert\") pod \"e2e-ait-efe8f615-openshift-default-76bf6f9c9d-kp9tt\" (UID: \"be2541d1-764d-44f2-8187-45205da1eb99\") " pod="openshift-ingress/e2e-ait-efe8f615-openshift-default-76bf6f9c9d-kp9tt" Jun 14 15:53:45.706337 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:45.706318 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be2541d1-764d-44f2-8187-45205da1eb99-istio-data\") pod \"e2e-ait-efe8f615-openshift-default-76bf6f9c9d-kp9tt\" (UID: \"be2541d1-764d-44f2-8187-45205da1eb99\") " pod="openshift-ingress/e2e-ait-efe8f615-openshift-default-76bf6f9c9d-kp9tt" Jun 14 15:53:45.706381 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:45.706361 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be2541d1-764d-44f2-8187-45205da1eb99-istio-envoy\") pod \"e2e-ait-efe8f615-openshift-default-76bf6f9c9d-kp9tt\" (UID: \"be2541d1-764d-44f2-8187-45205da1eb99\") " pod="openshift-ingress/e2e-ait-efe8f615-openshift-default-76bf6f9c9d-kp9tt" Jun 14 15:53:45.706422 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:45.706392 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be2541d1-764d-44f2-8187-45205da1eb99-istio-token\") pod \"e2e-ait-efe8f615-openshift-default-76bf6f9c9d-kp9tt\" (UID: \"be2541d1-764d-44f2-8187-45205da1eb99\") " pod="openshift-ingress/e2e-ait-efe8f615-openshift-default-76bf6f9c9d-kp9tt" Jun 14 15:53:45.706466 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:45.706443 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be2541d1-764d-44f2-8187-45205da1eb99-credential-socket\") pod \"e2e-ait-efe8f615-openshift-default-76bf6f9c9d-kp9tt\" (UID: \"be2541d1-764d-44f2-8187-45205da1eb99\") " pod="openshift-ingress/e2e-ait-efe8f615-openshift-default-76bf6f9c9d-kp9tt" Jun 14 15:53:45.706532 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:45.706509 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be2541d1-764d-44f2-8187-45205da1eb99-istio-podinfo\") pod \"e2e-ait-efe8f615-openshift-default-76bf6f9c9d-kp9tt\" (UID: \"be2541d1-764d-44f2-8187-45205da1eb99\") " pod="openshift-ingress/e2e-ait-efe8f615-openshift-default-76bf6f9c9d-kp9tt" Jun 14 15:53:45.777733 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:45.777707 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:53:45.807260 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:45.807233 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be2541d1-764d-44f2-8187-45205da1eb99-workload-socket\") pod \"e2e-ait-efe8f615-openshift-default-76bf6f9c9d-kp9tt\" (UID: \"be2541d1-764d-44f2-8187-45205da1eb99\") " pod="openshift-ingress/e2e-ait-efe8f615-openshift-default-76bf6f9c9d-kp9tt" Jun 14 15:53:45.807414 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:45.807284 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be2541d1-764d-44f2-8187-45205da1eb99-workload-certs\") pod \"e2e-ait-efe8f615-openshift-default-76bf6f9c9d-kp9tt\" (UID: \"be2541d1-764d-44f2-8187-45205da1eb99\") " pod="openshift-ingress/e2e-ait-efe8f615-openshift-default-76bf6f9c9d-kp9tt" Jun 14 15:53:45.807414 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:45.807322 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzkrz\" (UniqueName: \"kubernetes.io/projected/be2541d1-764d-44f2-8187-45205da1eb99-kube-api-access-tzkrz\") pod \"e2e-ait-efe8f615-openshift-default-76bf6f9c9d-kp9tt\" (UID: \"be2541d1-764d-44f2-8187-45205da1eb99\") " pod="openshift-ingress/e2e-ait-efe8f615-openshift-default-76bf6f9c9d-kp9tt" Jun 14 15:53:45.807414 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:45.807385 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be2541d1-764d-44f2-8187-45205da1eb99-istiod-ca-cert\") pod \"e2e-ait-efe8f615-openshift-default-76bf6f9c9d-kp9tt\" (UID: \"be2541d1-764d-44f2-8187-45205da1eb99\") " pod="openshift-ingress/e2e-ait-efe8f615-openshift-default-76bf6f9c9d-kp9tt" Jun 14 15:53:45.807592 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:45.807418 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be2541d1-764d-44f2-8187-45205da1eb99-istio-data\") pod \"e2e-ait-efe8f615-openshift-default-76bf6f9c9d-kp9tt\" (UID: \"be2541d1-764d-44f2-8187-45205da1eb99\") " pod="openshift-ingress/e2e-ait-efe8f615-openshift-default-76bf6f9c9d-kp9tt" Jun 14 15:53:45.807592 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:45.807450 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be2541d1-764d-44f2-8187-45205da1eb99-istio-envoy\") pod \"e2e-ait-efe8f615-openshift-default-76bf6f9c9d-kp9tt\" (UID: \"be2541d1-764d-44f2-8187-45205da1eb99\") " pod="openshift-ingress/e2e-ait-efe8f615-openshift-default-76bf6f9c9d-kp9tt" Jun 14 15:53:45.807592 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:45.807485 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be2541d1-764d-44f2-8187-45205da1eb99-istio-token\") pod \"e2e-ait-efe8f615-openshift-default-76bf6f9c9d-kp9tt\" (UID: \"be2541d1-764d-44f2-8187-45205da1eb99\") " pod="openshift-ingress/e2e-ait-efe8f615-openshift-default-76bf6f9c9d-kp9tt" Jun 14 15:53:45.807592 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:45.807540 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be2541d1-764d-44f2-8187-45205da1eb99-credential-socket\") pod \"e2e-ait-efe8f615-openshift-default-76bf6f9c9d-kp9tt\" (UID: \"be2541d1-764d-44f2-8187-45205da1eb99\") " pod="openshift-ingress/e2e-ait-efe8f615-openshift-default-76bf6f9c9d-kp9tt" Jun 14 15:53:45.807592 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:45.807582 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be2541d1-764d-44f2-8187-45205da1eb99-istio-podinfo\") pod \"e2e-ait-efe8f615-openshift-default-76bf6f9c9d-kp9tt\" (UID: \"be2541d1-764d-44f2-8187-45205da1eb99\") " pod="openshift-ingress/e2e-ait-efe8f615-openshift-default-76bf6f9c9d-kp9tt" Jun 14 15:53:45.807836 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:45.807737 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be2541d1-764d-44f2-8187-45205da1eb99-workload-socket\") pod \"e2e-ait-efe8f615-openshift-default-76bf6f9c9d-kp9tt\" (UID: \"be2541d1-764d-44f2-8187-45205da1eb99\") " pod="openshift-ingress/e2e-ait-efe8f615-openshift-default-76bf6f9c9d-kp9tt" Jun 14 15:53:45.807836 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:45.807823 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be2541d1-764d-44f2-8187-45205da1eb99-istio-data\") pod \"e2e-ait-efe8f615-openshift-default-76bf6f9c9d-kp9tt\" (UID: \"be2541d1-764d-44f2-8187-45205da1eb99\") " pod="openshift-ingress/e2e-ait-efe8f615-openshift-default-76bf6f9c9d-kp9tt" Jun 14 15:53:45.808022 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:45.807998 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be2541d1-764d-44f2-8187-45205da1eb99-credential-socket\") pod \"e2e-ait-efe8f615-openshift-default-76bf6f9c9d-kp9tt\" (UID: \"be2541d1-764d-44f2-8187-45205da1eb99\") " pod="openshift-ingress/e2e-ait-efe8f615-openshift-default-76bf6f9c9d-kp9tt" Jun 14 15:53:45.808152 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:45.808121 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be2541d1-764d-44f2-8187-45205da1eb99-workload-certs\") pod \"e2e-ait-efe8f615-openshift-default-76bf6f9c9d-kp9tt\" (UID: \"be2541d1-764d-44f2-8187-45205da1eb99\") " pod="openshift-ingress/e2e-ait-efe8f615-openshift-default-76bf6f9c9d-kp9tt" Jun 14 15:53:45.808152 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:45.808132 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be2541d1-764d-44f2-8187-45205da1eb99-istiod-ca-cert\") pod \"e2e-ait-efe8f615-openshift-default-76bf6f9c9d-kp9tt\" (UID: \"be2541d1-764d-44f2-8187-45205da1eb99\") " pod="openshift-ingress/e2e-ait-efe8f615-openshift-default-76bf6f9c9d-kp9tt" Jun 14 15:53:45.809983 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:45.809963 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be2541d1-764d-44f2-8187-45205da1eb99-istio-envoy\") pod \"e2e-ait-efe8f615-openshift-default-76bf6f9c9d-kp9tt\" (UID: \"be2541d1-764d-44f2-8187-45205da1eb99\") " pod="openshift-ingress/e2e-ait-efe8f615-openshift-default-76bf6f9c9d-kp9tt" Jun 14 15:53:45.810205 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:45.810188 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be2541d1-764d-44f2-8187-45205da1eb99-istio-podinfo\") pod \"e2e-ait-efe8f615-openshift-default-76bf6f9c9d-kp9tt\" (UID: \"be2541d1-764d-44f2-8187-45205da1eb99\") " pod="openshift-ingress/e2e-ait-efe8f615-openshift-default-76bf6f9c9d-kp9tt" Jun 14 15:53:45.816966 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:45.816945 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be2541d1-764d-44f2-8187-45205da1eb99-istio-token\") pod \"e2e-ait-efe8f615-openshift-default-76bf6f9c9d-kp9tt\" (UID: \"be2541d1-764d-44f2-8187-45205da1eb99\") " pod="openshift-ingress/e2e-ait-efe8f615-openshift-default-76bf6f9c9d-kp9tt" Jun 14 15:53:45.817167 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:45.817147 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzkrz\" (UniqueName: \"kubernetes.io/projected/be2541d1-764d-44f2-8187-45205da1eb99-kube-api-access-tzkrz\") pod \"e2e-ait-efe8f615-openshift-default-76bf6f9c9d-kp9tt\" (UID: \"be2541d1-764d-44f2-8187-45205da1eb99\") " pod="openshift-ingress/e2e-ait-efe8f615-openshift-default-76bf6f9c9d-kp9tt" Jun 14 15:53:45.875358 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:45.875300 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:53:45.954550 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:45.954526 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-efe8f615-openshift-default-76bf6f9c9d-kp9tt" Jun 14 15:53:45.975727 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:45.975703 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:53:46.094014 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:46.093991 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-efe8f615-openshift-default-76bf6f9c9d-kp9tt"] Jun 14 15:53:46.096128 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:53:46.096098 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe2541d1_764d_44f2_8187_45205da1eb99.slice/crio-ebf057dec1acd124f20717c6f0ed00002053e2577d4dab3e2ac38150f8c0f82c WatchSource:0}: Error finding container ebf057dec1acd124f20717c6f0ed00002053e2577d4dab3e2ac38150f8c0f82c: Status 404 returned error can't find the container with id ebf057dec1acd124f20717c6f0ed00002053e2577d4dab3e2ac38150f8c0f82c Jun 14 15:53:46.098147 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:46.098117 2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 14 15:53:46.098214 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:46.098177 2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 14 15:53:46.098214 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:46.098206 2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 14 15:53:46.717304 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:46.717268 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-efe8f615-openshift-default-76bf6f9c9d-kp9tt" event={"ID":"be2541d1-764d-44f2-8187-45205da1eb99","Type":"ContainerStarted","Data":"8ccbf2061a5adf31139ebdfa741f071b572b9f47836c809f3683896ba1ec26b9"} Jun 14 15:53:46.717681 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:46.717325 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-efe8f615-openshift-default-76bf6f9c9d-kp9tt" event={"ID":"be2541d1-764d-44f2-8187-45205da1eb99","Type":"ContainerStarted","Data":"ebf057dec1acd124f20717c6f0ed00002053e2577d4dab3e2ac38150f8c0f82c"} Jun 14 15:53:46.741769 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:46.741726 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-efe8f615-openshift-default-76bf6f9c9d-kp9tt" podStartSLOduration=1.7417110660000001 podStartE2EDuration="1.741711066s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:53:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:53:46.739199656 +0000 UTC m=+2383.920682193" watchObservedRunningTime="2026-06-14 15:53:46.741711066 +0000 UTC m=+2383.923193581" Jun 14 15:53:46.955661 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:46.955634 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-efe8f615-openshift-default-76bf6f9c9d-kp9tt" Jun 14 15:53:47.960604 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:47.960577 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-efe8f615-openshift-default-76bf6f9c9d-kp9tt" Jun 14 15:53:48.728681 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:48.728645 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-efe8f615-openshift-default-76bf6f9c9d-kp9tt" Jun 14 15:53:48.729540 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:48.729523 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-efe8f615-openshift-default-76bf6f9c9d-kp9tt" Jun 14 15:53:49.212117 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:49.212094 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:53:51.967540 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:51.967513 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:53:53.123287 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:53.123248 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-efe8f615-openshift-default-76bf6f9c9d-kp9tt"] Jun 14 15:53:53.123786 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:53.123466 2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-efe8f615-openshift-default-76bf6f9c9d-kp9tt" podUID="be2541d1-764d-44f2-8187-45205da1eb99" containerName="istio-proxy" containerID="cri-o://8ccbf2061a5adf31139ebdfa741f071b572b9f47836c809f3683896ba1ec26b9" gracePeriod=30 Jun 14 15:53:53.148399 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:53.148368 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:53:53.247417 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:53.247383 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:53:56.124923 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:56.124891 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:53:58.364864 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:58.364841 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-efe8f615-openshift-default-76bf6f9c9d-kp9tt" Jun 14 15:53:58.425590 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:58.425515 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be2541d1-764d-44f2-8187-45205da1eb99-istiod-ca-cert\") pod \"be2541d1-764d-44f2-8187-45205da1eb99\" (UID: \"be2541d1-764d-44f2-8187-45205da1eb99\") " Jun 14 15:53:58.425590 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:58.425549 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be2541d1-764d-44f2-8187-45205da1eb99-istio-token\") pod \"be2541d1-764d-44f2-8187-45205da1eb99\" (UID: \"be2541d1-764d-44f2-8187-45205da1eb99\") " Jun 14 15:53:58.425590 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:58.425568 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be2541d1-764d-44f2-8187-45205da1eb99-credential-socket\") pod \"be2541d1-764d-44f2-8187-45205da1eb99\" (UID: \"be2541d1-764d-44f2-8187-45205da1eb99\") " Jun 14 15:53:58.425828 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:58.425611 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be2541d1-764d-44f2-8187-45205da1eb99-istio-envoy\") pod \"be2541d1-764d-44f2-8187-45205da1eb99\" (UID: \"be2541d1-764d-44f2-8187-45205da1eb99\") " Jun 14 15:53:58.425828 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:58.425651 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be2541d1-764d-44f2-8187-45205da1eb99-workload-socket\") pod \"be2541d1-764d-44f2-8187-45205da1eb99\" (UID: \"be2541d1-764d-44f2-8187-45205da1eb99\") " Jun 14 15:53:58.425828 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:58.425668 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be2541d1-764d-44f2-8187-45205da1eb99-workload-certs\") pod \"be2541d1-764d-44f2-8187-45205da1eb99\" (UID: \"be2541d1-764d-44f2-8187-45205da1eb99\") " Jun 14 15:53:58.425828 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:58.425708 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tzkrz\" (UniqueName: \"kubernetes.io/projected/be2541d1-764d-44f2-8187-45205da1eb99-kube-api-access-tzkrz\") pod \"be2541d1-764d-44f2-8187-45205da1eb99\" (UID: \"be2541d1-764d-44f2-8187-45205da1eb99\") " Jun 14 15:53:58.425828 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:58.425735 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be2541d1-764d-44f2-8187-45205da1eb99-istio-data\") pod \"be2541d1-764d-44f2-8187-45205da1eb99\" (UID: \"be2541d1-764d-44f2-8187-45205da1eb99\") " Jun 14 15:53:58.425828 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:58.425784 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be2541d1-764d-44f2-8187-45205da1eb99-istio-podinfo\") pod \"be2541d1-764d-44f2-8187-45205da1eb99\" (UID: \"be2541d1-764d-44f2-8187-45205da1eb99\") " Jun 14 15:53:58.426150 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:58.425884 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be2541d1-764d-44f2-8187-45205da1eb99-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "be2541d1-764d-44f2-8187-45205da1eb99" (UID: "be2541d1-764d-44f2-8187-45205da1eb99"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 15:53:58.426150 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:58.425919 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be2541d1-764d-44f2-8187-45205da1eb99-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "be2541d1-764d-44f2-8187-45205da1eb99" (UID: "be2541d1-764d-44f2-8187-45205da1eb99"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 15:53:58.426150 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:58.426006 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be2541d1-764d-44f2-8187-45205da1eb99-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "be2541d1-764d-44f2-8187-45205da1eb99" (UID: "be2541d1-764d-44f2-8187-45205da1eb99"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 15:53:58.426150 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:58.426137 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be2541d1-764d-44f2-8187-45205da1eb99-istio-data" (OuterVolumeSpecName: "istio-data") pod "be2541d1-764d-44f2-8187-45205da1eb99" (UID: "be2541d1-764d-44f2-8187-45205da1eb99"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 15:53:58.426353 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:58.426324 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be2541d1-764d-44f2-8187-45205da1eb99-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "be2541d1-764d-44f2-8187-45205da1eb99" (UID: "be2541d1-764d-44f2-8187-45205da1eb99"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 15:53:58.426514 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:58.426483 2571 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be2541d1-764d-44f2-8187-45205da1eb99-istiod-ca-cert\") on node \"ip-10-0-140-30.ec2.internal\" DevicePath \"\"" Jun 14 15:53:58.426514 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:58.426507 2571 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be2541d1-764d-44f2-8187-45205da1eb99-credential-socket\") on node \"ip-10-0-140-30.ec2.internal\" DevicePath \"\"" Jun 14 15:53:58.426635 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:58.426521 2571 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be2541d1-764d-44f2-8187-45205da1eb99-workload-socket\") on node \"ip-10-0-140-30.ec2.internal\" DevicePath \"\"" Jun 14 15:53:58.426635 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:58.426534 2571 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be2541d1-764d-44f2-8187-45205da1eb99-workload-certs\") on node \"ip-10-0-140-30.ec2.internal\" DevicePath \"\"" Jun 14 15:53:58.426635 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:58.426547 2571 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be2541d1-764d-44f2-8187-45205da1eb99-istio-data\") on node \"ip-10-0-140-30.ec2.internal\" DevicePath \"\"" Jun 14 15:53:58.427956 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:58.427932 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be2541d1-764d-44f2-8187-45205da1eb99-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "be2541d1-764d-44f2-8187-45205da1eb99" (UID: "be2541d1-764d-44f2-8187-45205da1eb99"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 15:53:58.428090 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:58.428028 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be2541d1-764d-44f2-8187-45205da1eb99-kube-api-access-tzkrz" (OuterVolumeSpecName: "kube-api-access-tzkrz") pod "be2541d1-764d-44f2-8187-45205da1eb99" (UID: "be2541d1-764d-44f2-8187-45205da1eb99"). InnerVolumeSpecName "kube-api-access-tzkrz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 15:53:58.428314 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:58.428289 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/be2541d1-764d-44f2-8187-45205da1eb99-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "be2541d1-764d-44f2-8187-45205da1eb99" (UID: "be2541d1-764d-44f2-8187-45205da1eb99"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 14 15:53:58.428314 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:58.428306 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be2541d1-764d-44f2-8187-45205da1eb99-istio-token" (OuterVolumeSpecName: "istio-token") pod "be2541d1-764d-44f2-8187-45205da1eb99" (UID: "be2541d1-764d-44f2-8187-45205da1eb99"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 15:53:58.527525 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:58.527495 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tzkrz\" (UniqueName: \"kubernetes.io/projected/be2541d1-764d-44f2-8187-45205da1eb99-kube-api-access-tzkrz\") on node \"ip-10-0-140-30.ec2.internal\" DevicePath \"\"" Jun 14 15:53:58.527525 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:58.527518 2571 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be2541d1-764d-44f2-8187-45205da1eb99-istio-podinfo\") on node \"ip-10-0-140-30.ec2.internal\" DevicePath \"\"" Jun 14 15:53:58.527525 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:58.527529 2571 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be2541d1-764d-44f2-8187-45205da1eb99-istio-token\") on node \"ip-10-0-140-30.ec2.internal\" DevicePath \"\"" Jun 14 15:53:58.527725 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:58.527536 2571 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be2541d1-764d-44f2-8187-45205da1eb99-istio-envoy\") on node \"ip-10-0-140-30.ec2.internal\" DevicePath \"\"" Jun 14 15:53:58.776975 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:58.776940 2571 generic.go:356] "Generic (PLEG): container finished" podID="be2541d1-764d-44f2-8187-45205da1eb99" containerID="8ccbf2061a5adf31139ebdfa741f071b572b9f47836c809f3683896ba1ec26b9" exitCode=0 Jun 14 15:53:58.777170 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:58.776983 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-efe8f615-openshift-default-76bf6f9c9d-kp9tt" event={"ID":"be2541d1-764d-44f2-8187-45205da1eb99","Type":"ContainerDied","Data":"8ccbf2061a5adf31139ebdfa741f071b572b9f47836c809f3683896ba1ec26b9"} Jun 14 15:53:58.777170 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:58.776990 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-efe8f615-openshift-default-76bf6f9c9d-kp9tt" Jun 14 15:53:58.777170 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:58.777022 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-efe8f615-openshift-default-76bf6f9c9d-kp9tt" event={"ID":"be2541d1-764d-44f2-8187-45205da1eb99","Type":"ContainerDied","Data":"ebf057dec1acd124f20717c6f0ed00002053e2577d4dab3e2ac38150f8c0f82c"} Jun 14 15:53:58.777170 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:58.777062 2571 scope.go:117] "RemoveContainer" containerID="8ccbf2061a5adf31139ebdfa741f071b572b9f47836c809f3683896ba1ec26b9" Jun 14 15:53:58.786077 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:58.786062 2571 scope.go:117] "RemoveContainer" containerID="8ccbf2061a5adf31139ebdfa741f071b572b9f47836c809f3683896ba1ec26b9" Jun 14 15:53:58.786324 ip-10-0-140-30 kubenswrapper[2571]: E0614 15:53:58.786308 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ccbf2061a5adf31139ebdfa741f071b572b9f47836c809f3683896ba1ec26b9\": container with ID starting with 8ccbf2061a5adf31139ebdfa741f071b572b9f47836c809f3683896ba1ec26b9 not found: ID does not exist" containerID="8ccbf2061a5adf31139ebdfa741f071b572b9f47836c809f3683896ba1ec26b9" Jun 14 15:53:58.786366 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:58.786331 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ccbf2061a5adf31139ebdfa741f071b572b9f47836c809f3683896ba1ec26b9"} err="failed to get container status \"8ccbf2061a5adf31139ebdfa741f071b572b9f47836c809f3683896ba1ec26b9\": rpc error: code = NotFound desc = could not find container \"8ccbf2061a5adf31139ebdfa741f071b572b9f47836c809f3683896ba1ec26b9\": container with ID starting with 8ccbf2061a5adf31139ebdfa741f071b572b9f47836c809f3683896ba1ec26b9 not found: ID does not exist" Jun 14 15:53:58.798996 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:58.798972 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-efe8f615-openshift-default-76bf6f9c9d-kp9tt"] Jun 14 15:53:58.803316 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:58.803296 2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-efe8f615-openshift-default-76bf6f9c9d-kp9tt"] Jun 14 15:53:59.305744 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:59.305707 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="be2541d1-764d-44f2-8187-45205da1eb99" path="/var/lib/kubelet/pods/be2541d1-764d-44f2-8187-45205da1eb99/volumes" Jun 14 15:53:59.447845 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:59.447817 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:53:59.547984 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:53:59.547960 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:54:03.481763 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:03.481735 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ltnnm_ee9ddc42-3dac-47b7-a02b-899fc13a7467/ovn-acl-logging/0.log" Jun 14 15:54:03.490069 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:03.490036 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ltnnm_ee9ddc42-3dac-47b7-a02b-899fc13a7467/ovn-acl-logging/0.log" Jun 14 15:54:10.185912 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:10.185885 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-66c9fcbf98-9fw5w_bc281542-3ec5-4f83-9a55-94fe6fb12b36/nginx/0.log" Jun 14 15:54:10.644691 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:10.644634 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-856ffd5c84-qqcqg_1927d9a3-84e4-4687-9801-db661a274100/maas-api/0.log" Jun 14 15:54:11.449955 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:11.449875 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7f69b6c847-sjngw_96bf4c70-9739-491a-b200-0871b30345e4/copy-manifests/0.log" Jun 14 15:54:11.456131 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:11.456105 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7f69b6c847-sjngw_96bf4c70-9739-491a-b200-0871b30345e4/manager/0.log" Jun 14 15:54:13.064972 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:13.064938 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-p5j7t_20d4c612-8b95-457f-ab6e-f5cb101b7a02/manager/0.log" Jun 14 15:54:13.170686 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:13.170644 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-2t9hz_b978a3f4-f143-403e-b16c-a987925f21e8/manager/0.log" Jun 14 15:54:13.396887 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:13.396814 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-mdkbx_5ea5fe6c-18ec-4d74-bb1a-dcf9aa1e10ca/registry-server/0.log" Jun 14 15:54:13.765174 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:13.765145 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-b47mm_1bc8ab30-3f77-42f8-a40d-002d20912292/manager/0.log" Jun 14 15:54:14.126160 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:14.126077 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795v5sks_d01de3fc-0972-441b-915d-359b698446cd/istio-proxy/0.log" Jun 14 15:54:14.675761 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:14.675729 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-tfdlz_a7917219-c659-4886-bbc2-69fafcde54f8/payload-pre-processing/0.log" Jun 14 15:54:14.787578 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:14.787551 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-j2l4f_64e38a91-36de-4de2-bccf-d63bd8d50352/payload-processing/0.log" Jun 14 15:54:15.346361 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:15.346337 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-ll76d_38fe2ebf-4fa0-4a1d-a40e-13ecd4993ab4/main/0.log" Jun 14 15:54:15.353001 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:15.352959 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-ll76d_38fe2ebf-4fa0-4a1d-a40e-13ecd4993ab4/storage-initializer/0.log" Jun 14 15:54:15.696248 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:15.696221 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-tl7qt_80486bcb-2333-49d7-8c2c-2976d1f8dee2/storage-initializer/0.log" Jun 14 15:54:15.703902 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:15.703878 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-tl7qt_80486bcb-2333-49d7-8c2c-2976d1f8dee2/main/0.log" Jun 14 15:54:15.819103 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:15.819062 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-vrckx_2b2c0442-0ce0-4d7e-9852-ee9463eefc70/storage-initializer/0.log" Jun 14 15:54:15.826213 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:15.826194 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-vrckx_2b2c0442-0ce0-4d7e-9852-ee9463eefc70/main/0.log" Jun 14 15:54:19.860430 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:19.860396 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-b6lvg/must-gather-sbxzc"] Jun 14 15:54:19.860868 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:19.860768 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be2541d1-764d-44f2-8187-45205da1eb99" containerName="istio-proxy" Jun 14 15:54:19.860868 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:19.860779 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="be2541d1-764d-44f2-8187-45205da1eb99" containerName="istio-proxy" Jun 14 15:54:19.860868 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:19.860846 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="be2541d1-764d-44f2-8187-45205da1eb99" containerName="istio-proxy" Jun 14 15:54:19.865597 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:19.865576 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-b6lvg/must-gather-sbxzc" Jun 14 15:54:19.868109 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:19.868089 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-b6lvg\"/\"kube-root-ca.crt\"" Jun 14 15:54:19.868840 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:19.868823 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-b6lvg\"/\"default-dockercfg-fcbwv\"" Jun 14 15:54:19.868931 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:19.868824 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-b6lvg\"/\"openshift-service-ca.crt\"" Jun 14 15:54:19.875636 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:19.875609 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-b6lvg/must-gather-sbxzc"] Jun 14 15:54:19.879003 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:19.878979 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:54:19.943651 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:19.943622 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:54:20.023614 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:20.023588 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdpdw\" (UniqueName: \"kubernetes.io/projected/9314c74f-2ca2-44d6-954c-4a5d0b1833d5-kube-api-access-jdpdw\") pod \"must-gather-sbxzc\" (UID: \"9314c74f-2ca2-44d6-954c-4a5d0b1833d5\") " pod="openshift-must-gather-b6lvg/must-gather-sbxzc" Jun 14 15:54:20.023766 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:20.023641 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9314c74f-2ca2-44d6-954c-4a5d0b1833d5-must-gather-output\") pod \"must-gather-sbxzc\" (UID: \"9314c74f-2ca2-44d6-954c-4a5d0b1833d5\") " pod="openshift-must-gather-b6lvg/must-gather-sbxzc" Jun 14 15:54:20.124756 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:20.124678 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdpdw\" (UniqueName: \"kubernetes.io/projected/9314c74f-2ca2-44d6-954c-4a5d0b1833d5-kube-api-access-jdpdw\") pod \"must-gather-sbxzc\" (UID: \"9314c74f-2ca2-44d6-954c-4a5d0b1833d5\") " pod="openshift-must-gather-b6lvg/must-gather-sbxzc" Jun 14 15:54:20.124756 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:20.124726 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9314c74f-2ca2-44d6-954c-4a5d0b1833d5-must-gather-output\") pod \"must-gather-sbxzc\" (UID: \"9314c74f-2ca2-44d6-954c-4a5d0b1833d5\") " pod="openshift-must-gather-b6lvg/must-gather-sbxzc" Jun 14 15:54:20.125021 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:20.125007 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9314c74f-2ca2-44d6-954c-4a5d0b1833d5-must-gather-output\") pod \"must-gather-sbxzc\" (UID: \"9314c74f-2ca2-44d6-954c-4a5d0b1833d5\") " pod="openshift-must-gather-b6lvg/must-gather-sbxzc" Jun 14 15:54:20.132927 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:20.132905 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdpdw\" (UniqueName: \"kubernetes.io/projected/9314c74f-2ca2-44d6-954c-4a5d0b1833d5-kube-api-access-jdpdw\") pod \"must-gather-sbxzc\" (UID: \"9314c74f-2ca2-44d6-954c-4a5d0b1833d5\") " pod="openshift-must-gather-b6lvg/must-gather-sbxzc" Jun 14 15:54:20.177180 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:20.177155 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-b6lvg/must-gather-sbxzc" Jun 14 15:54:20.308387 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:20.308360 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-b6lvg/must-gather-sbxzc"] Jun 14 15:54:20.310875 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:54:20.310853 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9314c74f_2ca2_44d6_954c_4a5d0b1833d5.slice/crio-3d77d492cca6dab7c1fa6f4020ddb2b30f74a34c8a1b597a17d8d9921a1ac9f1 WatchSource:0}: Error finding container 3d77d492cca6dab7c1fa6f4020ddb2b30f74a34c8a1b597a17d8d9921a1ac9f1: Status 404 returned error can't find the container with id 3d77d492cca6dab7c1fa6f4020ddb2b30f74a34c8a1b597a17d8d9921a1ac9f1 Jun 14 15:54:20.312830 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:20.312816 2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 14 15:54:20.886774 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:20.886725 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-b6lvg/must-gather-sbxzc" event={"ID":"9314c74f-2ca2-44d6-954c-4a5d0b1833d5","Type":"ContainerStarted","Data":"3d77d492cca6dab7c1fa6f4020ddb2b30f74a34c8a1b597a17d8d9921a1ac9f1"} Jun 14 15:54:21.895433 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:21.895391 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-b6lvg/must-gather-sbxzc" event={"ID":"9314c74f-2ca2-44d6-954c-4a5d0b1833d5","Type":"ContainerStarted","Data":"c613cc1d138d3d9d86c9760d121abedf953275471cf4b50ddc8bed94b569e5aa"} Jun 14 15:54:21.895878 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:21.895451 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-b6lvg/must-gather-sbxzc" event={"ID":"9314c74f-2ca2-44d6-954c-4a5d0b1833d5","Type":"ContainerStarted","Data":"06faf400f1269f6e3d5599759fd60f89fe914b4104a5cafcbd609a5f6ef983cc"} Jun 14 15:54:21.915925 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:21.915867 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-b6lvg/must-gather-sbxzc" podStartSLOduration=2.273987639 podStartE2EDuration="2.915845584s" totalImagesPullingTime="641.857945ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:54:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:54:21.913293984 +0000 UTC m=+2419.094776501" watchObservedRunningTime="2026-06-14 15:54:21.915845584 +0000 UTC m=+2419.097328105" Jun 14 15:54:22.854577 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:22.854548 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-lfxgl_15bccd1f-7f51-4c8b-8b76-75481887049f/global-pull-secret-syncer/0.log" Jun 14 15:54:22.905161 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:22.905133 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" Jun 14 15:54:23.038288 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:23.038252 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-30.ec2.internal_50126b156a8d7ec40dc0a7da700bcb71/haproxy/0.log" Jun 14 15:54:25.051328 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:25.051291 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:54:25.152768 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:25.152729 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59js7_0c99e6cb-ee5c-45c5-9635-839d2f237c0b/konnectivity-agent/0.log" limit=1024 Jun 14 15:54:28.256731 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:28.256696 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-p5j7t_20d4c612-8b95-457f-ab6e-f5cb101b7a02/manager/0.log" Jun 14 15:54:28.295088 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:28.295008 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-2t9hz_b978a3f4-f143-403e-b16c-a987925f21e8/manager/0.log" Jun 14 15:54:28.383068 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:28.372484 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-mdkbx_5ea5fe6c-18ec-4d74-bb1a-dcf9aa1e10ca/registry-server/0.log" Jun 14 15:54:28.573020 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:28.572693 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-b47mm_1bc8ab30-3f77-42f8-a40d-002d20912292/manager/0.log" Jun 14 15:54:29.987018 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:29.986930 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b41b0cdd-21bd-4be8-b53e-9b7258eadaaa/alertmanager/0.log" Jun 14 15:54:30.010476 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:30.010418 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b41b0cdd-21bd-4be8-b53e-9b7258eadaaa/config-reloader/0.log" Jun 14 15:54:30.038418 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:30.038390 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b41b0cdd-21bd-4be8-b53e-9b7258eadaaa/kube-rbac-proxy-web/0.log" Jun 14 15:54:30.061676 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:30.061651 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b41b0cdd-21bd-4be8-b53e-9b7258eadaaa/kube-rbac-proxy/0.log" Jun 14 15:54:30.088143 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:30.088039 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b41b0cdd-21bd-4be8-b53e-9b7258eadaaa/kube-rbac-proxy-metric/0.log" Jun 14 15:54:30.117421 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:30.117386 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b41b0cdd-21bd-4be8-b53e-9b7258eadaaa/prom-label-proxy/0.log" Jun 14 15:54:30.154565 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:30.154536 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b41b0cdd-21bd-4be8-b53e-9b7258eadaaa/init-config-reloader/0.log" Jun 14 15:54:30.309272 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:30.309195 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-589576dfc7-8xxdz_c127cc7e-7761-45e9-96ab-64ce18e83b21/monitoring-plugin/0.log" Jun 14 15:54:30.343147 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:30.343101 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-d2tck_c371278d-8f71-4604-9fe4-26a12d97fbb8/node-exporter/0.log" Jun 14 15:54:30.365882 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:30.365859 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-d2tck_c371278d-8f71-4604-9fe4-26a12d97fbb8/kube-rbac-proxy/0.log" Jun 14 15:54:30.388182 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:30.388159 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-d2tck_c371278d-8f71-4604-9fe4-26a12d97fbb8/init-textfile/0.log" Jun 14 15:54:30.666884 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:30.666852 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_554ee61b-8c35-46ce-98dc-c75d431491f5/prometheus/0.log" Jun 14 15:54:30.702775 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:30.701260 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_554ee61b-8c35-46ce-98dc-c75d431491f5/config-reloader/0.log" Jun 14 15:54:30.733849 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:30.733817 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_554ee61b-8c35-46ce-98dc-c75d431491f5/thanos-sidecar/0.log" Jun 14 15:54:30.759151 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:30.759100 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_554ee61b-8c35-46ce-98dc-c75d431491f5/kube-rbac-proxy-web/0.log" Jun 14 15:54:30.788220 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:30.788169 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_554ee61b-8c35-46ce-98dc-c75d431491f5/kube-rbac-proxy/0.log" Jun 14 15:54:30.815141 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:30.815106 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_554ee61b-8c35-46ce-98dc-c75d431491f5/kube-rbac-proxy-thanos/0.log" Jun 14 15:54:30.842765 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:30.842728 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_554ee61b-8c35-46ce-98dc-c75d431491f5/init-config-reloader/0.log" Jun 14 15:54:30.876907 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:30.876880 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-864fcfc6f9-jxj67_8cdf0eed-1609-41e4-b2d9-ead3616e5dff/prometheus-operator/0.log" Jun 14 15:54:30.897813 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:30.897784 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-864fcfc6f9-jxj67_8cdf0eed-1609-41e4-b2d9-ead3616e5dff/kube-rbac-proxy/0.log" Jun 14 15:54:31.053721 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:31.053689 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5b985bcb8d-n7p54_0395b7ba-7aa2-4729-9706-5b2550c71e8a/thanos-query/0.log" Jun 14 15:54:31.077315 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:31.077274 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5b985bcb8d-n7p54_0395b7ba-7aa2-4729-9706-5b2550c71e8a/kube-rbac-proxy-web/0.log" Jun 14 15:54:31.101294 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:31.101181 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5b985bcb8d-n7p54_0395b7ba-7aa2-4729-9706-5b2550c71e8a/kube-rbac-proxy/0.log" Jun 14 15:54:31.126974 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:31.126887 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5b985bcb8d-n7p54_0395b7ba-7aa2-4729-9706-5b2550c71e8a/prom-label-proxy/0.log" Jun 14 15:54:31.150474 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:31.150448 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5b985bcb8d-n7p54_0395b7ba-7aa2-4729-9706-5b2550c71e8a/kube-rbac-proxy-rules/0.log" Jun 14 15:54:31.176494 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:31.176450 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5b985bcb8d-n7p54_0395b7ba-7aa2-4729-9706-5b2550c71e8a/kube-rbac-proxy-metrics/0.log" Jun 14 15:54:33.829816 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:33.829787 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-cdb8c9959-rftb5_5701d444-575e-411f-aa0c-37448380a05a/console/0.log" Jun 14 15:54:34.666890 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:34.666852 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-b6lvg/perf-node-gather-daemonset-rrjjb"] Jun 14 15:54:34.671653 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:34.671622 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-b6lvg/perf-node-gather-daemonset-rrjjb" Jun 14 15:54:34.681981 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:34.681950 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-b6lvg/perf-node-gather-daemonset-rrjjb"] Jun 14 15:54:34.788174 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:34.788145 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/51b86588-98d8-4542-b688-9363216b88ed-proc\") pod \"perf-node-gather-daemonset-rrjjb\" (UID: \"51b86588-98d8-4542-b688-9363216b88ed\") " pod="openshift-must-gather-b6lvg/perf-node-gather-daemonset-rrjjb" Jun 14 15:54:34.788357 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:34.788290 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jj5ds\" (UniqueName: \"kubernetes.io/projected/51b86588-98d8-4542-b688-9363216b88ed-kube-api-access-jj5ds\") pod \"perf-node-gather-daemonset-rrjjb\" (UID: \"51b86588-98d8-4542-b688-9363216b88ed\") " pod="openshift-must-gather-b6lvg/perf-node-gather-daemonset-rrjjb" Jun 14 15:54:34.788430 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:34.788372 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/51b86588-98d8-4542-b688-9363216b88ed-podres\") pod \"perf-node-gather-daemonset-rrjjb\" (UID: \"51b86588-98d8-4542-b688-9363216b88ed\") " pod="openshift-must-gather-b6lvg/perf-node-gather-daemonset-rrjjb" Jun 14 15:54:34.788485 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:34.788468 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/51b86588-98d8-4542-b688-9363216b88ed-sys\") pod \"perf-node-gather-daemonset-rrjjb\" (UID: \"51b86588-98d8-4542-b688-9363216b88ed\") " pod="openshift-must-gather-b6lvg/perf-node-gather-daemonset-rrjjb" Jun 14 15:54:34.788537 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:34.788520 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/51b86588-98d8-4542-b688-9363216b88ed-lib-modules\") pod \"perf-node-gather-daemonset-rrjjb\" (UID: \"51b86588-98d8-4542-b688-9363216b88ed\") " pod="openshift-must-gather-b6lvg/perf-node-gather-daemonset-rrjjb" Jun 14 15:54:34.890085 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:34.890026 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/51b86588-98d8-4542-b688-9363216b88ed-proc\") pod \"perf-node-gather-daemonset-rrjjb\" (UID: \"51b86588-98d8-4542-b688-9363216b88ed\") " pod="openshift-must-gather-b6lvg/perf-node-gather-daemonset-rrjjb" Jun 14 15:54:34.890576 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:34.890105 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jj5ds\" (UniqueName: \"kubernetes.io/projected/51b86588-98d8-4542-b688-9363216b88ed-kube-api-access-jj5ds\") pod \"perf-node-gather-daemonset-rrjjb\" (UID: \"51b86588-98d8-4542-b688-9363216b88ed\") " pod="openshift-must-gather-b6lvg/perf-node-gather-daemonset-rrjjb" Jun 14 15:54:34.890576 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:34.890165 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/51b86588-98d8-4542-b688-9363216b88ed-podres\") pod \"perf-node-gather-daemonset-rrjjb\" (UID: \"51b86588-98d8-4542-b688-9363216b88ed\") " pod="openshift-must-gather-b6lvg/perf-node-gather-daemonset-rrjjb" Jun 14 15:54:34.890576 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:34.890259 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/51b86588-98d8-4542-b688-9363216b88ed-sys\") pod \"perf-node-gather-daemonset-rrjjb\" (UID: \"51b86588-98d8-4542-b688-9363216b88ed\") " pod="openshift-must-gather-b6lvg/perf-node-gather-daemonset-rrjjb" Jun 14 15:54:34.890576 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:34.890303 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/51b86588-98d8-4542-b688-9363216b88ed-lib-modules\") pod \"perf-node-gather-daemonset-rrjjb\" (UID: \"51b86588-98d8-4542-b688-9363216b88ed\") " pod="openshift-must-gather-b6lvg/perf-node-gather-daemonset-rrjjb" Jun 14 15:54:34.890576 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:34.890499 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/51b86588-98d8-4542-b688-9363216b88ed-lib-modules\") pod \"perf-node-gather-daemonset-rrjjb\" (UID: \"51b86588-98d8-4542-b688-9363216b88ed\") " pod="openshift-must-gather-b6lvg/perf-node-gather-daemonset-rrjjb" Jun 14 15:54:34.890576 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:34.890567 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/51b86588-98d8-4542-b688-9363216b88ed-proc\") pod \"perf-node-gather-daemonset-rrjjb\" (UID: \"51b86588-98d8-4542-b688-9363216b88ed\") " pod="openshift-must-gather-b6lvg/perf-node-gather-daemonset-rrjjb" Jun 14 15:54:34.891023 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:34.890996 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/51b86588-98d8-4542-b688-9363216b88ed-podres\") pod \"perf-node-gather-daemonset-rrjjb\" (UID: \"51b86588-98d8-4542-b688-9363216b88ed\") " pod="openshift-must-gather-b6lvg/perf-node-gather-daemonset-rrjjb" Jun 14 15:54:34.891193 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:34.891087 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/51b86588-98d8-4542-b688-9363216b88ed-sys\") pod \"perf-node-gather-daemonset-rrjjb\" (UID: \"51b86588-98d8-4542-b688-9363216b88ed\") " pod="openshift-must-gather-b6lvg/perf-node-gather-daemonset-rrjjb" Jun 14 15:54:34.899244 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:34.899216 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jj5ds\" (UniqueName: \"kubernetes.io/projected/51b86588-98d8-4542-b688-9363216b88ed-kube-api-access-jj5ds\") pod \"perf-node-gather-daemonset-rrjjb\" (UID: \"51b86588-98d8-4542-b688-9363216b88ed\") " pod="openshift-must-gather-b6lvg/perf-node-gather-daemonset-rrjjb" Jun 14 15:54:34.987907 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:34.987871 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-b6lvg/perf-node-gather-daemonset-rrjjb" Jun 14 15:54:35.185984 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:35.185888 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-b6lvg/perf-node-gather-daemonset-rrjjb"] Jun 14 15:54:35.191197 ip-10-0-140-30 kubenswrapper[2571]: W0614 15:54:35.191159 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod51b86588_98d8_4542_b688_9363216b88ed.slice/crio-309faf91606018ae2ca93029f63ca49f9ebb9b8c3fe07fdbc247c864b5dcc079 WatchSource:0}: Error finding container 309faf91606018ae2ca93029f63ca49f9ebb9b8c3fe07fdbc247c864b5dcc079: Status 404 returned error can't find the container with id 309faf91606018ae2ca93029f63ca49f9ebb9b8c3fe07fdbc247c864b5dcc079 Jun 14 15:54:35.946574 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:35.946542 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kqsrl_194b5b96-5a7b-4760-874c-903e5e9dce48/dns/0.log" Jun 14 15:54:35.968441 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:35.968418 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kqsrl_194b5b96-5a7b-4760-874c-903e5e9dce48/kube-rbac-proxy/0.log" Jun 14 15:54:36.029237 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:36.029206 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-b6lvg/perf-node-gather-daemonset-rrjjb" event={"ID":"51b86588-98d8-4542-b688-9363216b88ed","Type":"ContainerStarted","Data":"7cce64530c225baea0d7daca2cda12c755aed2f1c20c266345602a2d8a36a63e"} Jun 14 15:54:36.029415 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:36.029254 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-b6lvg/perf-node-gather-daemonset-rrjjb" event={"ID":"51b86588-98d8-4542-b688-9363216b88ed","Type":"ContainerStarted","Data":"309faf91606018ae2ca93029f63ca49f9ebb9b8c3fe07fdbc247c864b5dcc079"} Jun 14 15:54:36.029415 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:36.029314 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-b6lvg/perf-node-gather-daemonset-rrjjb" Jun 14 15:54:36.042635 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:36.042565 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8w5cg_61fac2bb-36e8-4862-82b0-39169b4fa9cd/dns-node-resolver/0.log" Jun 14 15:54:36.046782 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:36.046728 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-b6lvg/perf-node-gather-daemonset-rrjjb" podStartSLOduration=2.04670702 podStartE2EDuration="2.04670702s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 15:54:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:54:36.045964946 +0000 UTC m=+2433.227447463" watchObservedRunningTime="2026-06-14 15:54:36.04670702 +0000 UTC m=+2433.228189537" Jun 14 15:54:36.640007 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:36.639956 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5fg9d_5ffbcb60-2145-4431-b8e8-0f7528cb4851/node-ca/0.log" Jun 14 15:54:37.644699 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:37.644659 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795v5sks_d01de3fc-0972-441b-915d-359b698446cd/istio-proxy/0.log" Jun 14 15:54:37.852648 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:37.852620 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-tfdlz_a7917219-c659-4886-bbc2-69fafcde54f8/payload-pre-processing/0.log" Jun 14 15:54:37.934774 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:37.934694 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-j2l4f_64e38a91-36de-4de2-bccf-d63bd8d50352/payload-processing/0.log" Jun 14 15:54:38.596726 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:38.596701 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-j62hw_8aa56d5d-e118-4630-a660-9f86ab228a8b/serve-healthcheck-canary/0.log" Jun 14 15:54:39.147461 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:39.147421 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mx6n9_b19af6b9-4b2a-44ea-b9b1-e01f23b73630/kube-rbac-proxy/0.log" Jun 14 15:54:39.170867 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:39.170839 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mx6n9_b19af6b9-4b2a-44ea-b9b1-e01f23b73630/exporter/0.log" Jun 14 15:54:39.194763 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:39.194736 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mx6n9_b19af6b9-4b2a-44ea-b9b1-e01f23b73630/extractor/0.log" Jun 14 15:54:41.552714 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:41.552680 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-66c9fcbf98-9fw5w_bc281542-3ec5-4f83-9a55-94fe6fb12b36/nginx/0.log" Jun 14 15:54:41.725325 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:41.725293 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-856ffd5c84-qqcqg_1927d9a3-84e4-4687-9801-db661a274100/maas-api/0.log" Jun 14 15:54:42.047323 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:42.047295 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-b6lvg/perf-node-gather-daemonset-rrjjb" Jun 14 15:54:42.055222 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:42.055196 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7f69b6c847-sjngw_96bf4c70-9739-491a-b200-0871b30345e4/manager/0.log" Jun 14 15:54:42.078551 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:42.078519 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7f69b6c847-sjngw_96bf4c70-9739-491a-b200-0871b30345e4/copy-manifests/0.log" Jun 14 15:54:43.843192 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:43.843165 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6dfb8f76f9-7kjqj_dbf1b408-2e13-47dd-bb08-c49fbca3ce24/manager/0.log" Jun 14 15:54:47.974154 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:47.974122 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795v5sks_d01de3fc-0972-441b-915d-359b698446cd/istio-proxy/0.log" Jun 14 15:54:48.149716 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:48.149687 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-tfdlz_a7917219-c659-4886-bbc2-69fafcde54f8/payload-pre-processing/0.log" Jun 14 15:54:48.205462 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:48.205434 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-j2l4f_64e38a91-36de-4de2-bccf-d63bd8d50352/payload-processing/0.log" Jun 14 15:54:49.318702 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:49.318668 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795v5sks_d01de3fc-0972-441b-915d-359b698446cd/istio-proxy/0.log" Jun 14 15:54:49.482891 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:49.482866 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-tfdlz_a7917219-c659-4886-bbc2-69fafcde54f8/payload-pre-processing/0.log" Jun 14 15:54:49.554765 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:49.554733 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-j2l4f_64e38a91-36de-4de2-bccf-d63bd8d50352/payload-processing/0.log" Jun 14 15:54:51.190500 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:51.190471 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795v5sks_d01de3fc-0972-441b-915d-359b698446cd/istio-proxy/0.log" Jun 14 15:54:51.243748 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:51.243721 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kn9qq_73a47e15-a8cc-45e8-8138-d62372b4b753/kube-multus-additional-cni-plugins/0.log" Jun 14 15:54:51.265968 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:51.265947 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kn9qq_73a47e15-a8cc-45e8-8138-d62372b4b753/egress-router-binary-copy/0.log" Jun 14 15:54:51.288172 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:51.288144 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kn9qq_73a47e15-a8cc-45e8-8138-d62372b4b753/cni-plugins/0.log" Jun 14 15:54:51.311286 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:51.311261 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kn9qq_73a47e15-a8cc-45e8-8138-d62372b4b753/bond-cni-plugin/0.log" Jun 14 15:54:51.332919 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:51.332881 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kn9qq_73a47e15-a8cc-45e8-8138-d62372b4b753/routeoverride-cni/0.log" Jun 14 15:54:51.341123 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:51.341099 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-tfdlz_a7917219-c659-4886-bbc2-69fafcde54f8/payload-pre-processing/0.log" Jun 14 15:54:51.354529 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:51.354508 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kn9qq_73a47e15-a8cc-45e8-8138-d62372b4b753/whereabouts-cni-bincopy/0.log" Jun 14 15:54:51.378950 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:51.378926 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kn9qq_73a47e15-a8cc-45e8-8138-d62372b4b753/whereabouts-cni/0.log" Jun 14 15:54:51.405595 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:51.405569 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-j2l4f_64e38a91-36de-4de2-bccf-d63bd8d50352/payload-processing/0.log" Jun 14 15:54:51.613751 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:51.613722 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-nlqnj_87a9a729-3c3f-451a-bcd6-c8726159c1c0/kube-multus/0.log" Jun 14 15:54:51.725195 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:51.725156 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-nb6vz_d0df8c3a-2915-4563-8f78-1bf2e8d5a27f/network-metrics-daemon/0.log" Jun 14 15:54:51.746503 ip-10-0-140-30 kubenswrapper[2571]: I0614 15:54:51.746432 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-nb6vz_d0df8c3a-2915-4563-8f78-1bf2e8d5a27f/kube-rbac-proxy/0.log"