Jun 11 15:00:09.159241 ip-10-0-128-147 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 11 15:00:09.159254 ip-10-0-128-147 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 11 15:00:09.159263 ip-10-0-128-147 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 11 15:00:09.159461 ip-10-0-128-147 systemd[1]: Failed to start Kubernetes Kubelet. Jun 11 15:00:19.408597 ip-10-0-128-147 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 11 15:00:19.408616 ip-10-0-128-147 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot af6e155a3a38442096059075d1f6d91d -- Jun 11 15:02:44.943116 ip-10-0-128-147 systemd[1]: Starting Kubernetes Kubelet... Jun 11 15:02:45.315961 ip-10-0-128-147 kubenswrapper[2569]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 15:02:45.315961 ip-10-0-128-147 kubenswrapper[2569]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 11 15:02:45.315961 ip-10-0-128-147 kubenswrapper[2569]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 15:02:45.315961 ip-10-0-128-147 kubenswrapper[2569]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 11 15:02:45.315961 ip-10-0-128-147 kubenswrapper[2569]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 15:02:45.317675 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.317588 2569 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 11 15:02:45.322901 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.322882 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 15:02:45.322901 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.322901 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 15:02:45.322901 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.322906 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 15:02:45.323105 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.322911 2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 15:02:45.323105 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.322915 2569 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 15:02:45.323105 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.322919 2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 15:02:45.323105 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.322923 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 15:02:45.323105 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.322927 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 15:02:45.323105 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.322931 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 15:02:45.323105 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.322935 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 15:02:45.323105 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.322939 2569 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 15:02:45.323105 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.322943 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 15:02:45.323105 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.322947 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 15:02:45.323105 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.322951 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 15:02:45.323105 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.322955 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 15:02:45.323105 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.322959 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 15:02:45.323105 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.322963 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 15:02:45.323105 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.322967 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 15:02:45.323105 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.322971 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 15:02:45.323105 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.322977 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 15:02:45.323105 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.322981 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 15:02:45.323105 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.322985 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 15:02:45.323105 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.322989 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 15:02:45.323105 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.322993 2569 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 15:02:45.323807 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.322997 2569 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 15:02:45.323807 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.323001 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 15:02:45.323807 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.323005 2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 15:02:45.323807 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.323009 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 15:02:45.323807 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.323014 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 15:02:45.323807 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.323019 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 15:02:45.323807 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.323023 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 15:02:45.323807 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.323028 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 15:02:45.323807 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.323033 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 15:02:45.323807 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.323037 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 15:02:45.323807 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.323042 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 15:02:45.323807 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.323047 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 15:02:45.323807 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.323052 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 15:02:45.323807 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.323056 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 15:02:45.323807 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.323062 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 15:02:45.323807 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.323066 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 15:02:45.323807 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.323071 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 15:02:45.323807 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.323077 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 15:02:45.323807 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.323081 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 15:02:45.323807 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.323086 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 15:02:45.324596 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.323090 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 15:02:45.324596 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.323094 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 15:02:45.324596 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.323099 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 15:02:45.324596 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.323103 2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 15:02:45.324596 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.323107 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 15:02:45.324596 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.323111 2569 feature_gate.go:328] unrecognized feature gate: Example Jun 11 15:02:45.324596 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.323116 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 15:02:45.324596 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.323120 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 15:02:45.324596 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.323126 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 15:02:45.324596 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.323130 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 15:02:45.324596 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.323135 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 15:02:45.324596 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.323139 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 15:02:45.324596 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.323144 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 15:02:45.324596 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.323148 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 15:02:45.324596 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.323153 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 15:02:45.324596 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.323157 2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 15:02:45.324596 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.323162 2569 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 15:02:45.324596 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.323166 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 15:02:45.324596 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.323171 2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 15:02:45.325460 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.323175 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 15:02:45.325460 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.323180 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 15:02:45.325460 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.323187 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 15:02:45.325460 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.323193 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 15:02:45.325460 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.323198 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 15:02:45.325460 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.323204 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 15:02:45.325460 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.323209 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 15:02:45.325460 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.323214 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 15:02:45.325460 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.323222 2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 15:02:45.325460 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.323228 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 15:02:45.325460 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.323235 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 15:02:45.325460 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.323240 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 15:02:45.325460 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.323244 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 15:02:45.325460 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.323249 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 15:02:45.325460 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.323253 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 15:02:45.325460 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.323257 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 15:02:45.325460 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.323262 2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 15:02:45.325460 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.323266 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 15:02:45.325460 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.323271 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 15:02:45.326314 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.323275 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 15:02:45.326314 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.323280 2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 15:02:45.326314 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.323284 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 15:02:45.326314 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.323288 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 15:02:45.326314 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.323292 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 15:02:45.326314 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.323296 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 15:02:45.326314 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.323303 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 15:02:45.326314 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.323310 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 15:02:45.326314 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.323315 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 15:02:45.326314 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.323321 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 15:02:45.326314 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.323325 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 15:02:45.326314 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.323330 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 15:02:45.326314 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.323334 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 15:02:45.326314 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.323339 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 15:02:45.326314 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.323343 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 15:02:45.326314 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.323347 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 15:02:45.326314 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.323352 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 15:02:45.326314 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.325144 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 15:02:45.326314 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.325155 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 15:02:45.327190 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.325161 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 15:02:45.327190 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.325165 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 15:02:45.327190 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.325170 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 15:02:45.327190 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.325176 2569 feature_gate.go:328] unrecognized feature gate: Example Jun 11 15:02:45.327190 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.325181 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 15:02:45.327190 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.325185 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 15:02:45.327190 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.325189 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 15:02:45.327190 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.325194 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 15:02:45.327190 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.325198 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 15:02:45.327190 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.325203 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 15:02:45.327190 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.325207 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 15:02:45.327190 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.325211 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 15:02:45.327190 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.325216 2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 15:02:45.327190 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.325220 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 15:02:45.327190 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.325225 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 15:02:45.327190 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.325229 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 15:02:45.327190 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.325233 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 15:02:45.327190 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.325238 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 15:02:45.327190 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.325242 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 15:02:45.327190 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.325247 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 15:02:45.328106 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.325251 2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 15:02:45.328106 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.325255 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 15:02:45.328106 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.325260 2569 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 15:02:45.328106 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.325264 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 15:02:45.328106 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.325269 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 15:02:45.328106 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.325273 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 15:02:45.328106 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.325277 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 15:02:45.328106 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.325282 2569 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 15:02:45.328106 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.325287 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 15:02:45.328106 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.325291 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 15:02:45.328106 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.325296 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 15:02:45.328106 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.325300 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 15:02:45.328106 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.325304 2569 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 15:02:45.328106 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.325309 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 15:02:45.328106 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.325313 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 15:02:45.328106 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.325319 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 15:02:45.328106 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.325324 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 15:02:45.328106 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.325329 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 15:02:45.328106 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.325333 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 15:02:45.328106 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.325338 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 15:02:45.328778 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.325342 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 15:02:45.328778 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.325347 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 15:02:45.328778 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.325351 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 15:02:45.328778 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.325355 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 15:02:45.328778 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.325360 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 15:02:45.328778 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.325364 2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 15:02:45.328778 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.325368 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 15:02:45.328778 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.325373 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 15:02:45.328778 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.325377 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 15:02:45.328778 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.325382 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 15:02:45.328778 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.325386 2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 15:02:45.328778 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.325392 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 15:02:45.328778 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.325399 2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 15:02:45.328778 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.325404 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 15:02:45.328778 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.325409 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 15:02:45.328778 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.325413 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 15:02:45.328778 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.325418 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 15:02:45.328778 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.325422 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 15:02:45.328778 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.325427 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 15:02:45.328778 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.325432 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 15:02:45.329391 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.325436 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 15:02:45.329391 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.325441 2569 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 15:02:45.329391 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.325448 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 15:02:45.329391 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.325452 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 15:02:45.329391 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.325456 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 15:02:45.329391 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.325461 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 15:02:45.329391 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.325465 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 15:02:45.329391 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.325469 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 15:02:45.329391 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.325473 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 15:02:45.329391 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.325477 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 15:02:45.329391 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.325482 2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 15:02:45.329391 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.325486 2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 15:02:45.329391 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.325490 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 15:02:45.329391 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.325495 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 15:02:45.329391 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.325502 2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 15:02:45.329391 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.325507 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 15:02:45.329391 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.325512 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 15:02:45.329391 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.325517 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 15:02:45.329391 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.325522 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 15:02:45.330074 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.325527 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 15:02:45.330074 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.325531 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 15:02:45.330074 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.325536 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 15:02:45.330074 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.325542 2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 15:02:45.330074 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.325547 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 15:02:45.330074 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.325551 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 15:02:45.330074 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.325555 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 15:02:45.330074 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.325562 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 15:02:45.330074 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.325572 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 15:02:45.330074 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.325578 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 15:02:45.330074 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.325583 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 15:02:45.330074 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.325587 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 15:02:45.330074 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.325592 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 15:02:45.330074 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.325596 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 15:02:45.330074 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.325600 2569 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 15:02:45.330074 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.325604 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 15:02:45.330074 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.325609 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 15:02:45.330074 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.325614 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 15:02:45.330074 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.326227 2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 15:02:45.330707 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.326238 2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 15:02:45.330707 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.326243 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 15:02:45.330707 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.326248 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 15:02:45.330707 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.326254 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 15:02:45.330707 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.326259 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 15:02:45.330707 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.326263 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 15:02:45.330707 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.326268 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 15:02:45.330707 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.326273 2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 15:02:45.330707 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.326278 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 15:02:45.330707 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.326283 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 15:02:45.330707 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.326288 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 15:02:45.330707 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.326292 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 15:02:45.330707 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.326296 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 15:02:45.330707 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.326303 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 15:02:45.330707 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.326308 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 15:02:45.330707 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.326312 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 15:02:45.330707 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.326316 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 15:02:45.330707 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.326321 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 15:02:45.330707 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.326325 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 15:02:45.330707 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.326329 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 15:02:45.331304 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.326333 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 15:02:45.331304 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.326338 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 15:02:45.331304 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.326342 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 15:02:45.331304 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.326346 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 15:02:45.331304 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.326351 2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 15:02:45.331304 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.326355 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 15:02:45.331304 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.326360 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 15:02:45.331304 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.326364 2569 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 15:02:45.331304 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.326368 2569 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 15:02:45.331304 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.326372 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 15:02:45.331304 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.326377 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 15:02:45.331304 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.326381 2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 15:02:45.331304 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.326385 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 15:02:45.331304 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.326389 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 15:02:45.331304 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.326394 2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 15:02:45.331304 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.326398 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 15:02:45.331304 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.326404 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 15:02:45.331304 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.326410 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 15:02:45.331304 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.326414 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 15:02:45.331304 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.326419 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 15:02:45.331858 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.326423 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 15:02:45.331858 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.326427 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 15:02:45.331858 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.326431 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 15:02:45.331858 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.326436 2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 15:02:45.331858 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.326440 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 15:02:45.331858 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.326445 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 15:02:45.331858 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.326451 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 15:02:45.331858 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.326455 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 15:02:45.331858 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.326460 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 15:02:45.331858 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.326464 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 15:02:45.331858 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.326468 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 15:02:45.331858 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.326473 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 15:02:45.331858 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.326477 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 15:02:45.331858 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.326482 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 15:02:45.331858 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.326487 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 15:02:45.331858 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.326491 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 15:02:45.331858 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.326496 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 15:02:45.331858 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.326503 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 15:02:45.331858 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.326508 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 15:02:45.332364 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.326513 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 15:02:45.332364 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.326517 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 15:02:45.332364 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.326521 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 15:02:45.332364 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.326526 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 15:02:45.332364 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.326530 2569 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 15:02:45.332364 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.326535 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 15:02:45.332364 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.326539 2569 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 15:02:45.332364 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.326544 2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 15:02:45.332364 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.326548 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 15:02:45.332364 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.326552 2569 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 15:02:45.332364 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.326557 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 15:02:45.332364 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.326561 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 15:02:45.332364 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.326566 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 15:02:45.332364 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.326570 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 15:02:45.332364 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.326574 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 15:02:45.332364 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.326578 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 15:02:45.332364 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.326583 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 15:02:45.332364 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.326587 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 15:02:45.332364 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.326592 2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 15:02:45.332364 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.326596 2569 feature_gate.go:328] unrecognized feature gate: Example Jun 11 15:02:45.332894 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.326601 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 15:02:45.332894 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.326605 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 15:02:45.332894 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.326610 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 15:02:45.332894 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.326615 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 15:02:45.332894 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.326619 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 15:02:45.332894 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.326623 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 15:02:45.332894 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.326628 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 15:02:45.332894 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.326632 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 15:02:45.332894 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.326637 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 15:02:45.332894 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.326641 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 15:02:45.332894 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.326646 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 15:02:45.332894 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.326650 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 15:02:45.332894 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.326654 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 15:02:45.332894 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.326659 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 15:02:45.332894 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.326663 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 15:02:45.332894 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.326667 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 15:02:45.332894 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.326672 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 15:02:45.332894 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.326676 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 15:02:45.332894 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.326680 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 15:02:45.332894 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.326777 2569 flags.go:64] FLAG: --address="0.0.0.0" Jun 11 15:02:45.333393 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.326815 2569 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 11 15:02:45.333393 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.326824 2569 flags.go:64] FLAG: --anonymous-auth="true" Jun 11 15:02:45.333393 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.326832 2569 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 11 15:02:45.333393 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.326839 2569 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 11 15:02:45.333393 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.326844 2569 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 11 15:02:45.333393 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.326851 2569 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 11 15:02:45.333393 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.326857 2569 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 11 15:02:45.333393 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.326863 2569 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 11 15:02:45.333393 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.326867 2569 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 11 15:02:45.333393 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.326874 2569 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 11 15:02:45.333393 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.326880 2569 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 11 15:02:45.333393 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.326886 2569 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 11 15:02:45.333393 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.326891 2569 flags.go:64] FLAG: --cgroup-root="" Jun 11 15:02:45.333393 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.326895 2569 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 11 15:02:45.333393 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.326900 2569 flags.go:64] FLAG: --client-ca-file="" Jun 11 15:02:45.333393 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.326905 2569 flags.go:64] FLAG: --cloud-provider="external" Jun 11 15:02:45.333393 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.326910 2569 flags.go:64] FLAG: --cluster-dns="[]" Jun 11 15:02:45.333393 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.326918 2569 flags.go:64] FLAG: --cluster-domain="" Jun 11 15:02:45.333393 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.326923 2569 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 11 15:02:45.333393 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.326928 2569 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 11 15:02:45.333393 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.326934 2569 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 11 15:02:45.333393 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.326939 2569 flags.go:64] FLAG: --container-log-max-files="5" Jun 11 15:02:45.333393 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.326945 2569 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 11 15:02:45.333393 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.326950 2569 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 11 15:02:45.334004 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.326956 2569 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 11 15:02:45.334004 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.326962 2569 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 11 15:02:45.334004 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.326967 2569 flags.go:64] FLAG: --contention-profiling="false" Jun 11 15:02:45.334004 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.326971 2569 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 11 15:02:45.334004 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.326976 2569 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 11 15:02:45.334004 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.326981 2569 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 11 15:02:45.334004 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.326986 2569 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 11 15:02:45.334004 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.326993 2569 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 11 15:02:45.334004 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.326997 2569 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 11 15:02:45.334004 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327003 2569 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 11 15:02:45.334004 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327008 2569 flags.go:64] FLAG: --enable-load-reader="false" Jun 11 15:02:45.334004 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327013 2569 flags.go:64] FLAG: --enable-server="true" Jun 11 15:02:45.334004 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327019 2569 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 11 15:02:45.334004 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327026 2569 flags.go:64] FLAG: --event-burst="100" Jun 11 15:02:45.334004 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327031 2569 flags.go:64] FLAG: --event-qps="50" Jun 11 15:02:45.334004 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327036 2569 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 11 15:02:45.334004 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327041 2569 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 11 15:02:45.334004 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327046 2569 flags.go:64] FLAG: --eviction-hard="" Jun 11 15:02:45.334004 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327052 2569 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 11 15:02:45.334004 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327057 2569 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 11 15:02:45.334004 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327062 2569 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 11 15:02:45.334004 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327067 2569 flags.go:64] FLAG: --eviction-soft="" Jun 11 15:02:45.334004 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327072 2569 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 11 15:02:45.334004 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327077 2569 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 11 15:02:45.334004 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327082 2569 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 11 15:02:45.335049 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327087 2569 flags.go:64] FLAG: --experimental-mounter-path="" Jun 11 15:02:45.335049 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327094 2569 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 11 15:02:45.335049 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327099 2569 flags.go:64] FLAG: --fail-swap-on="true" Jun 11 15:02:45.335049 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327104 2569 flags.go:64] FLAG: --feature-gates="" Jun 11 15:02:45.335049 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327110 2569 flags.go:64] FLAG: --file-check-frequency="20s" Jun 11 15:02:45.335049 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327116 2569 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 11 15:02:45.335049 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327121 2569 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 11 15:02:45.335049 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327126 2569 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 11 15:02:45.335049 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327132 2569 flags.go:64] FLAG: --healthz-port="10248" Jun 11 15:02:45.335049 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327137 2569 flags.go:64] FLAG: --help="false" Jun 11 15:02:45.335049 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327141 2569 flags.go:64] FLAG: --hostname-override="ip-10-0-128-147.ec2.internal" Jun 11 15:02:45.335049 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327146 2569 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 11 15:02:45.335049 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327151 2569 flags.go:64] FLAG: --http-check-frequency="20s" Jun 11 15:02:45.335049 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327156 2569 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 11 15:02:45.335049 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327162 2569 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 11 15:02:45.335049 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327168 2569 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 11 15:02:45.335049 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327178 2569 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 11 15:02:45.335049 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327183 2569 flags.go:64] FLAG: --image-service-endpoint="" Jun 11 15:02:45.335049 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327188 2569 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 11 15:02:45.335049 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327193 2569 flags.go:64] FLAG: --kube-api-burst="100" Jun 11 15:02:45.335049 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327198 2569 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 11 15:02:45.335049 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327203 2569 flags.go:64] FLAG: --kube-api-qps="50" Jun 11 15:02:45.335049 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327207 2569 flags.go:64] FLAG: --kube-reserved="" Jun 11 15:02:45.335049 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327212 2569 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 11 15:02:45.336145 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327217 2569 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 11 15:02:45.336145 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327222 2569 flags.go:64] FLAG: --kubelet-cgroups="" Jun 11 15:02:45.336145 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327227 2569 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 11 15:02:45.336145 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327232 2569 flags.go:64] FLAG: --lock-file="" Jun 11 15:02:45.336145 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327237 2569 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 11 15:02:45.336145 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327242 2569 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 11 15:02:45.336145 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327247 2569 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 11 15:02:45.336145 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327256 2569 flags.go:64] FLAG: --log-json-split-stream="false" Jun 11 15:02:45.336145 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327261 2569 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 11 15:02:45.336145 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327268 2569 flags.go:64] FLAG: --log-text-split-stream="false" Jun 11 15:02:45.336145 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327273 2569 flags.go:64] FLAG: --logging-format="text" Jun 11 15:02:45.336145 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327278 2569 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 11 15:02:45.336145 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327284 2569 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 11 15:02:45.336145 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327288 2569 flags.go:64] FLAG: --manifest-url="" Jun 11 15:02:45.336145 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327293 2569 flags.go:64] FLAG: --manifest-url-header="" Jun 11 15:02:45.336145 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327300 2569 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 11 15:02:45.336145 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327305 2569 flags.go:64] FLAG: --max-open-files="1000000" Jun 11 15:02:45.336145 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327312 2569 flags.go:64] FLAG: --max-pods="110" Jun 11 15:02:45.336145 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327317 2569 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 11 15:02:45.336145 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327321 2569 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 11 15:02:45.336145 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327326 2569 flags.go:64] FLAG: --memory-manager-policy="None" Jun 11 15:02:45.336145 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327331 2569 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 11 15:02:45.336145 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327336 2569 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 11 15:02:45.336145 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327341 2569 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 11 15:02:45.336145 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327347 2569 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 11 15:02:45.337268 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327359 2569 flags.go:64] FLAG: --node-status-max-images="50" Jun 11 15:02:45.337268 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327364 2569 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 11 15:02:45.337268 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327370 2569 flags.go:64] FLAG: --oom-score-adj="-999" Jun 11 15:02:45.337268 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327375 2569 flags.go:64] FLAG: --pod-cidr="" Jun 11 15:02:45.337268 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327382 2569 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 11 15:02:45.337268 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327396 2569 flags.go:64] FLAG: --pod-manifest-path="" Jun 11 15:02:45.337268 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327401 2569 flags.go:64] FLAG: --pod-max-pids="-1" Jun 11 15:02:45.337268 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327406 2569 flags.go:64] FLAG: --pods-per-core="0" Jun 11 15:02:45.337268 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327410 2569 flags.go:64] FLAG: --port="10250" Jun 11 15:02:45.337268 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327415 2569 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 11 15:02:45.337268 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327420 2569 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0f49ca5e9dde9d966" Jun 11 15:02:45.337268 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327425 2569 flags.go:64] FLAG: --qos-reserved="" Jun 11 15:02:45.337268 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327430 2569 flags.go:64] FLAG: --read-only-port="10255" Jun 11 15:02:45.337268 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327435 2569 flags.go:64] FLAG: --register-node="true" Jun 11 15:02:45.337268 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327440 2569 flags.go:64] FLAG: --register-with-taints="" Jun 11 15:02:45.337268 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327447 2569 flags.go:64] FLAG: --registry-burst="10" Jun 11 15:02:45.337268 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327452 2569 flags.go:64] FLAG: --registry-qps="5" Jun 11 15:02:45.337268 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327458 2569 flags.go:64] FLAG: --reserved-cpus="" Jun 11 15:02:45.337268 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327463 2569 flags.go:64] FLAG: --reserved-memory="" Jun 11 15:02:45.337268 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327469 2569 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 11 15:02:45.337268 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327474 2569 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 11 15:02:45.337268 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327480 2569 flags.go:64] FLAG: --rotate-certificates="false" Jun 11 15:02:45.337268 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327484 2569 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 11 15:02:45.337268 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327489 2569 flags.go:64] FLAG: --runonce="false" Jun 11 15:02:45.337268 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327494 2569 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 11 15:02:45.338096 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327499 2569 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 11 15:02:45.338096 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327505 2569 flags.go:64] FLAG: --seccomp-default="false" Jun 11 15:02:45.338096 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327510 2569 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 11 15:02:45.338096 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327514 2569 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 11 15:02:45.338096 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327520 2569 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 11 15:02:45.338096 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327525 2569 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 11 15:02:45.338096 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327532 2569 flags.go:64] FLAG: --storage-driver-password="root" Jun 11 15:02:45.338096 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327537 2569 flags.go:64] FLAG: --storage-driver-secure="false" Jun 11 15:02:45.338096 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327542 2569 flags.go:64] FLAG: --storage-driver-table="stats" Jun 11 15:02:45.338096 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327546 2569 flags.go:64] FLAG: --storage-driver-user="root" Jun 11 15:02:45.338096 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327551 2569 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 11 15:02:45.338096 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327556 2569 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 11 15:02:45.338096 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327562 2569 flags.go:64] FLAG: --system-cgroups="" Jun 11 15:02:45.338096 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327567 2569 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 11 15:02:45.338096 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327576 2569 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 11 15:02:45.338096 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327581 2569 flags.go:64] FLAG: --tls-cert-file="" Jun 11 15:02:45.338096 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327586 2569 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 11 15:02:45.338096 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327593 2569 flags.go:64] FLAG: --tls-min-version="" Jun 11 15:02:45.338096 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327598 2569 flags.go:64] FLAG: --tls-private-key-file="" Jun 11 15:02:45.338096 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327603 2569 flags.go:64] FLAG: --topology-manager-policy="none" Jun 11 15:02:45.338096 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327608 2569 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 11 15:02:45.338096 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327613 2569 flags.go:64] FLAG: --topology-manager-scope="container" Jun 11 15:02:45.338096 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327618 2569 flags.go:64] FLAG: --v="2" Jun 11 15:02:45.338096 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327624 2569 flags.go:64] FLAG: --version="false" Jun 11 15:02:45.338096 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327632 2569 flags.go:64] FLAG: --vmodule="" Jun 11 15:02:45.339027 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327638 2569 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 11 15:02:45.339027 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.327643 2569 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 11 15:02:45.339027 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.327884 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 15:02:45.339027 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.327892 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 15:02:45.339027 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.327897 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 15:02:45.339027 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.327901 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 15:02:45.339027 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.327906 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 15:02:45.339027 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.327910 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 15:02:45.339027 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.327915 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 15:02:45.339027 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.327919 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 15:02:45.339027 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.327924 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 15:02:45.339027 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.327928 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 15:02:45.339027 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.327933 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 15:02:45.339027 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.327940 2569 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 15:02:45.339027 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.327944 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 15:02:45.339027 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.327949 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 15:02:45.339027 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.327953 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 15:02:45.339027 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.327958 2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 15:02:45.339027 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.327962 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 15:02:45.339027 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.327966 2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 15:02:45.339955 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.327972 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 15:02:45.339955 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.327976 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 15:02:45.339955 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.327981 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 15:02:45.339955 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.327985 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 15:02:45.339955 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.327989 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 15:02:45.339955 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.327994 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 15:02:45.339955 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.327998 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 15:02:45.339955 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.328002 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 15:02:45.339955 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.328007 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 15:02:45.339955 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.328011 2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 15:02:45.339955 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.328015 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 15:02:45.339955 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.328023 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 15:02:45.339955 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.328028 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 15:02:45.339955 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.328033 2569 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 15:02:45.339955 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.328037 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 15:02:45.339955 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.328041 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 15:02:45.339955 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.328046 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 15:02:45.339955 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.328050 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 15:02:45.339955 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.328054 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 15:02:45.339955 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.328059 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 15:02:45.340583 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.328065 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 15:02:45.340583 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.328071 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 15:02:45.340583 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.328076 2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 15:02:45.340583 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.328081 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 15:02:45.340583 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.328085 2569 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 15:02:45.340583 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.328091 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 15:02:45.340583 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.328096 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 15:02:45.340583 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.328101 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 15:02:45.340583 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.328105 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 15:02:45.340583 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.328109 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 15:02:45.340583 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.328113 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 15:02:45.340583 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.328117 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 15:02:45.340583 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.328122 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 15:02:45.340583 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.328126 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 15:02:45.340583 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.328132 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 15:02:45.340583 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.328136 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 15:02:45.340583 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.328141 2569 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 15:02:45.340583 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.328145 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 15:02:45.340583 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.328150 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 15:02:45.341354 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.328154 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 15:02:45.341354 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.328159 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 15:02:45.341354 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.328163 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 15:02:45.341354 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.328167 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 15:02:45.341354 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.328173 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 15:02:45.341354 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.328177 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 15:02:45.341354 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.328182 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 15:02:45.341354 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.328186 2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 15:02:45.341354 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.328190 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 15:02:45.341354 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.328195 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 15:02:45.341354 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.328199 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 15:02:45.341354 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.328204 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 15:02:45.341354 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.328208 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 15:02:45.341354 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.328213 2569 feature_gate.go:328] unrecognized feature gate: Example Jun 11 15:02:45.341354 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.328217 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 15:02:45.341354 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.328222 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 15:02:45.341354 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.328226 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 15:02:45.341354 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.328230 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 15:02:45.341354 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.328239 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 15:02:45.342193 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.328245 2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 15:02:45.342193 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.328250 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 15:02:45.342193 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.328255 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 15:02:45.342193 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.328260 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 15:02:45.342193 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.328264 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 15:02:45.342193 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.328269 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 15:02:45.342193 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.328274 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 15:02:45.342193 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.328279 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 15:02:45.342193 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.328285 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 15:02:45.342193 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.328292 2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 15:02:45.342193 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.328297 2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 15:02:45.342193 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.328302 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 15:02:45.342193 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.328307 2569 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 15:02:45.342193 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.328312 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 15:02:45.342193 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.328316 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 15:02:45.342193 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.328321 2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 15:02:45.342193 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.328326 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 15:02:45.342193 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.328332 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 15:02:45.342193 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.328337 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 15:02:45.342706 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.328342 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 15:02:45.342706 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.328346 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 15:02:45.342706 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.328351 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 15:02:45.342706 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.328355 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 15:02:45.342706 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.329042 2569 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 15:02:45.342706 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.337578 2569 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 11 15:02:45.342706 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.337594 2569 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 11 15:02:45.342706 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.338528 2569 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 11 15:02:45.342706 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.338541 2569 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 11 15:02:45.342706 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.338650 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 15:02:45.342706 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.338659 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 15:02:45.342706 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.338665 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 15:02:45.342706 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.338671 2569 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 15:02:45.342706 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.338677 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 15:02:45.342706 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.338682 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 15:02:45.343127 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.338687 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 15:02:45.343127 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.338691 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 15:02:45.343127 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.338696 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 15:02:45.343127 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.338701 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 15:02:45.343127 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.338705 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 15:02:45.343127 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.338709 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 15:02:45.343127 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.338724 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 15:02:45.343127 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.338730 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 15:02:45.343127 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.338734 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 15:02:45.343127 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.338738 2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 15:02:45.343127 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.338743 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 15:02:45.343127 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.338747 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 15:02:45.343127 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.338752 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 15:02:45.343127 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.338756 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 15:02:45.343127 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.338760 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 15:02:45.343127 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.338765 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 15:02:45.343127 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.338770 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 15:02:45.343127 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.338775 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 15:02:45.343127 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.338779 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 15:02:45.343619 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.338783 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 15:02:45.343619 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.338808 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 15:02:45.343619 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.338813 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 15:02:45.343619 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.338817 2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 15:02:45.343619 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.338821 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 15:02:45.343619 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.338824 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 15:02:45.343619 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.338831 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 15:02:45.343619 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.338835 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 15:02:45.343619 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.338840 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 15:02:45.343619 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.338844 2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 15:02:45.343619 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.338849 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 15:02:45.343619 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.338855 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 15:02:45.343619 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.338861 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 15:02:45.343619 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.338865 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 15:02:45.343619 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.338869 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 15:02:45.343619 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.338874 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 15:02:45.343619 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.338878 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 15:02:45.343619 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.338882 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 15:02:45.343619 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.338886 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 15:02:45.344192 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.338890 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 15:02:45.344192 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.338906 2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 15:02:45.344192 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.338912 2569 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 15:02:45.344192 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.338918 2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 15:02:45.344192 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.338923 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 15:02:45.344192 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.338927 2569 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 15:02:45.344192 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.338932 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 15:02:45.344192 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.338937 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 15:02:45.344192 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.338941 2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 15:02:45.344192 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.338945 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 15:02:45.344192 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.338949 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 15:02:45.344192 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.338954 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 15:02:45.344192 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.338958 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 15:02:45.344192 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.338962 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 15:02:45.344192 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.338966 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 15:02:45.344192 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.338971 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 15:02:45.344192 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.338975 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 15:02:45.344192 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.338979 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 15:02:45.344192 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.338984 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 15:02:45.344680 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.338988 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 15:02:45.344680 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.338993 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 15:02:45.344680 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.338997 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 15:02:45.344680 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339001 2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 15:02:45.344680 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339006 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 15:02:45.344680 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339011 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 15:02:45.344680 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339015 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 15:02:45.344680 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339019 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 15:02:45.344680 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339023 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 15:02:45.344680 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339027 2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 15:02:45.344680 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339031 2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 15:02:45.344680 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339035 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 15:02:45.344680 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339039 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 15:02:45.344680 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339043 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 15:02:45.344680 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339047 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 15:02:45.344680 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339059 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 15:02:45.344680 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339065 2569 feature_gate.go:328] unrecognized feature gate: Example Jun 11 15:02:45.344680 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339069 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 15:02:45.344680 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339074 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 15:02:45.345179 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339078 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 15:02:45.345179 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339083 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 15:02:45.345179 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339087 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 15:02:45.345179 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339091 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 15:02:45.345179 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339095 2569 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 15:02:45.345179 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339100 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 15:02:45.345179 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339104 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 15:02:45.345179 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339108 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 15:02:45.345179 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339113 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 15:02:45.345179 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339117 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 15:02:45.345179 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339121 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 15:02:45.345179 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339125 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 15:02:45.345179 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339130 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 15:02:45.345179 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339134 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 15:02:45.345179 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339139 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 15:02:45.345179 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339143 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 15:02:45.345179 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339147 2569 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 15:02:45.345615 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.339156 2569 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 15:02:45.345615 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339412 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 15:02:45.345615 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339420 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 15:02:45.345615 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339425 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 15:02:45.345615 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339430 2569 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 15:02:45.345615 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339436 2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 15:02:45.345615 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339441 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 15:02:45.345615 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339445 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 15:02:45.345615 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339450 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 15:02:45.345615 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339455 2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 15:02:45.345615 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339460 2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 15:02:45.345615 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339464 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 15:02:45.345615 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339476 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 15:02:45.345615 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339481 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 15:02:45.345615 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339485 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 15:02:45.346019 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339490 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 15:02:45.346019 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339494 2569 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 15:02:45.346019 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339499 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 15:02:45.346019 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339503 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 15:02:45.346019 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339508 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 15:02:45.346019 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339512 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 15:02:45.346019 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339517 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 15:02:45.346019 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339521 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 15:02:45.346019 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339525 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 15:02:45.346019 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339529 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 15:02:45.346019 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339534 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 15:02:45.346019 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339541 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 15:02:45.346019 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339547 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 15:02:45.346019 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339552 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 15:02:45.346019 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339557 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 15:02:45.346019 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339562 2569 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 15:02:45.346019 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339567 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 15:02:45.346019 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339571 2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 15:02:45.346019 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339576 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 15:02:45.346019 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339580 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 15:02:45.346520 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339584 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 15:02:45.346520 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339588 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 15:02:45.346520 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339593 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 15:02:45.346520 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339597 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 15:02:45.346520 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339602 2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 15:02:45.346520 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339606 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 15:02:45.346520 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339610 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 15:02:45.346520 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339615 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 15:02:45.346520 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339619 2569 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 15:02:45.346520 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339623 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 15:02:45.346520 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339645 2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 15:02:45.346520 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339651 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 15:02:45.346520 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339663 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 15:02:45.346520 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339668 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 15:02:45.346520 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339673 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 15:02:45.346520 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339678 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 15:02:45.346520 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339683 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 15:02:45.346520 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339687 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 15:02:45.346520 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339691 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 15:02:45.347071 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339695 2569 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 15:02:45.347071 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339700 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 15:02:45.347071 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339704 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 15:02:45.347071 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339708 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 15:02:45.347071 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339712 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 15:02:45.347071 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339717 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 15:02:45.347071 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339721 2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 15:02:45.347071 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339726 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 15:02:45.347071 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339730 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 15:02:45.347071 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339734 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 15:02:45.347071 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339738 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 15:02:45.347071 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339743 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 15:02:45.347071 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339747 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 15:02:45.347071 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339751 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 15:02:45.347071 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339756 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 15:02:45.347071 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339760 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 15:02:45.347071 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339765 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 15:02:45.347071 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339769 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 15:02:45.347071 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339774 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 15:02:45.347071 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339779 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 15:02:45.347559 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339783 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 15:02:45.347559 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339804 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 15:02:45.347559 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339812 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 15:02:45.347559 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339817 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 15:02:45.347559 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339829 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 15:02:45.347559 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339833 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 15:02:45.347559 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339838 2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 15:02:45.347559 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339843 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 15:02:45.347559 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339847 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 15:02:45.347559 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339851 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 15:02:45.347559 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339855 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 15:02:45.347559 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339860 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 15:02:45.347559 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339864 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 15:02:45.347559 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339868 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 15:02:45.347559 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339873 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 15:02:45.347559 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339877 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 15:02:45.347559 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339881 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 15:02:45.347559 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339886 2569 feature_gate.go:328] unrecognized feature gate: Example Jun 11 15:02:45.347559 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339892 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 15:02:45.347559 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339899 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 15:02:45.348138 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339904 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 15:02:45.348138 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339908 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 15:02:45.348138 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339912 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 15:02:45.348138 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339916 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 15:02:45.348138 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339921 2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 15:02:45.348138 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:45.339925 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 15:02:45.348138 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.339934 2569 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 15:02:45.348138 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.340080 2569 server.go:962] "Client rotation is on, will bootstrap in background" Jun 11 15:02:45.348138 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.343672 2569 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 11 15:02:45.348138 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.345025 2569 server.go:1019] "Starting client certificate rotation" Jun 11 15:02:45.348138 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.345129 2569 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 15:02:45.348138 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.345163 2569 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 15:02:45.348138 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.347890 2569 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 15:02:45.349347 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.349331 2569 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 15:02:45.358693 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.358674 2569 log.go:25] "Validated CRI v1 runtime API" Jun 11 15:02:45.363299 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.363282 2569 log.go:25] "Validated CRI v1 image API" Jun 11 15:02:45.364140 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.364122 2569 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 11 15:02:45.366534 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.366516 2569 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 8718dbd8-8061-45de-a0ce-6ce8b17cbdcb:/dev/nvme0n1p4 9eaac253-b721-496d-8705-c3563efe4b65:/dev/nvme0n1p3] Jun 11 15:02:45.366587 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.366534 2569 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 11 15:02:45.372151 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.372047 2569 manager.go:216] Machine: {Timestamp:2026-06-11 15:02:45.370819398 +0000 UTC m=+0.319443652 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100615 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2fe91d12199f9500637e3fb8db29c7 SystemUUID:ec2fe91d-1219-9f95-0063-7e3fb8db29c7 BootID:af6e155a-3a38-4420-9605-9075d1f6d91d Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ed:0f:51:42:2d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ed:0f:51:42:2d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:0e:23:21:7a:81:0a Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 11 15:02:45.372151 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.372150 2569 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 11 15:02:45.372269 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.372228 2569 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 11 15:02:45.375091 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.375061 2569 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 11 15:02:45.375238 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.375095 2569 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-147.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 11 15:02:45.375710 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.375700 2569 topology_manager.go:138] "Creating topology manager with none policy" Jun 11 15:02:45.375746 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.375713 2569 container_manager_linux.go:309] "Creating device plugin manager" Jun 11 15:02:45.375746 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.375722 2569 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 15:02:45.377150 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.377138 2569 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 15:02:45.377958 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.377946 2569 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 11 15:02:45.380597 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.380583 2569 state_mem.go:36] "Initialized new in-memory state store" Jun 11 15:02:45.380743 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.380731 2569 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 11 15:02:45.380817 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.380807 2569 kubelet.go:486] "Attempting to sync node with API server" Jun 11 15:02:45.380855 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.380832 2569 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 15:02:45.380855 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.380837 2569 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 11 15:02:45.380915 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.380889 2569 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 11 15:02:45.380980 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.380971 2569 kubelet.go:398] "Adding apiserver pod source" Jun 11 15:02:45.381014 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.380987 2569 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 11 15:02:45.381614 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.381598 2569 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 15:02:45.381677 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.381623 2569 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 15:02:45.386207 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.386180 2569 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 11 15:02:45.388594 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.388581 2569 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 11 15:02:45.388660 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.388612 2569 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 11 15:02:45.389684 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.389673 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 11 15:02:45.389722 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.389689 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 11 15:02:45.389722 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.389697 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 11 15:02:45.389722 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.389703 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 11 15:02:45.389722 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.389712 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 11 15:02:45.389722 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.389718 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 11 15:02:45.389880 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.389747 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 11 15:02:45.389880 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.389754 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 11 15:02:45.389880 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.389761 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 11 15:02:45.389880 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.389767 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 11 15:02:45.389880 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.389775 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 11 15:02:45.389880 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.389781 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 11 15:02:45.391258 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.391246 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 11 15:02:45.391258 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.391257 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 11 15:02:45.394392 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.394378 2569 server.go:1268] "Started kubelet" Jun 11 15:02:45.394502 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.394471 2569 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 11 15:02:45.394677 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.394620 2569 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 11 15:02:45.394821 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.394804 2569 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 11 15:02:45.395310 ip-10-0-128-147 systemd[1]: Started Kubernetes Kubelet. Jun 11 15:02:45.395927 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.395913 2569 server.go:310] "Adding debug handlers to kubelet server" Jun 11 15:02:45.396453 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.396436 2569 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 11 15:02:45.397417 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.397394 2569 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-147.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 11 15:02:45.397905 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:02:45.397856 2569 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 11 15:02:45.397962 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:02:45.397860 2569 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-147.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 11 15:02:45.401085 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:02:45.401065 2569 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 11 15:02:45.401423 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.401410 2569 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 11 15:02:45.401505 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:02:45.401484 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-147.ec2.internal\" not found" Jun 11 15:02:45.401561 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.401545 2569 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 11 15:02:45.402065 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.402003 2569 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 11 15:02:45.402065 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.402024 2569 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 11 15:02:45.402187 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.402159 2569 reconstruct.go:97] "Volume reconstruction finished" Jun 11 15:02:45.402187 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.402169 2569 reconciler.go:29] "Reconciler: start to sync state" Jun 11 15:02:45.402275 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.402194 2569 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 11 15:02:45.402346 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.402332 2569 factory.go:55] Registering systemd factory Jun 11 15:02:45.402396 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.402347 2569 factory.go:223] Registration of the systemd container factory successfully Jun 11 15:02:45.402576 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.402562 2569 factory.go:153] Registering CRI-O factory Jun 11 15:02:45.402576 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.402580 2569 factory.go:223] Registration of the crio container factory successfully Jun 11 15:02:45.402688 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.402648 2569 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 11 15:02:45.402688 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.402672 2569 factory.go:103] Registering Raw factory Jun 11 15:02:45.402688 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.402687 2569 manager.go:1196] Started watching for new ooms in manager Jun 11 15:02:45.403338 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.403324 2569 manager.go:349] Starting recovery of all containers Jun 11 15:02:45.405772 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:02:45.405733 2569 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 11 15:02:45.406411 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:02:45.406384 2569 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-147.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 11 15:02:45.406706 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:02:45.405733 2569 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-147.ec2.internal.18b80f04adbfe3fd default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-147.ec2.internal,UID:ip-10-0-128-147.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-147.ec2.internal,},FirstTimestamp:2026-06-11 15:02:45.394351101 +0000 UTC m=+0.342975356,LastTimestamp:2026-06-11 15:02:45.394351101 +0000 UTC m=+0.342975356,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-147.ec2.internal,}" Jun 11 15:02:45.415688 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.415557 2569 manager.go:354] Recovery completed Jun 11 15:02:45.419881 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.419869 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 15:02:45.421607 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.421578 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-147.ec2.internal" event="NodeHasSufficientMemory" Jun 11 15:02:45.421677 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.421623 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-147.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 15:02:45.421677 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.421637 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-147.ec2.internal" event="NodeHasSufficientPID" Jun 11 15:02:45.422186 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.422174 2569 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 11 15:02:45.422186 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.422185 2569 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 11 15:02:45.422267 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.422201 2569 state_mem.go:36] "Initialized new in-memory state store" Jun 11 15:02:45.422267 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.422236 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 15:02:45.422929 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.422906 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-147.ec2.internal" event="NodeHasSufficientMemory" Jun 11 15:02:45.422995 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.422934 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-147.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 15:02:45.422995 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.422944 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-147.ec2.internal" event="NodeHasSufficientPID" Jun 11 15:02:45.423404 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.423393 2569 policy_none.go:49] "None policy: Start" Jun 11 15:02:45.423434 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.423409 2569 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 11 15:02:45.423434 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.423419 2569 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 11 15:02:45.424115 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:02:45.424048 2569 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-147.ec2.internal.18b80f04af5fc58f default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-147.ec2.internal,UID:ip-10-0-128-147.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-147.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-147.ec2.internal,},FirstTimestamp:2026-06-11 15:02:45.421606287 +0000 UTC m=+0.370230547,LastTimestamp:2026-06-11 15:02:45.421606287 +0000 UTC m=+0.370230547,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-147.ec2.internal,}" Jun 11 15:02:45.424225 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.424209 2569 policy_none.go:47] "Start" Jun 11 15:02:45.432186 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.432169 2569 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-c22tv" Jun 11 15:02:45.434112 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:02:45.434036 2569 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-147.ec2.internal.18b80f04af602126 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-147.ec2.internal,UID:ip-10-0-128-147.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-128-147.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-128-147.ec2.internal,},FirstTimestamp:2026-06-11 15:02:45.421629734 +0000 UTC m=+0.370253989,LastTimestamp:2026-06-11 15:02:45.421629734 +0000 UTC m=+0.370253989,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-147.ec2.internal,}" Jun 11 15:02:45.437879 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:02:45.437817 2569 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-147.ec2.internal.18b80f04af6055ba default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-147.ec2.internal,UID:ip-10-0-128-147.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-128-147.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-128-147.ec2.internal,},FirstTimestamp:2026-06-11 15:02:45.421643194 +0000 UTC m=+0.370267451,LastTimestamp:2026-06-11 15:02:45.421643194 +0000 UTC m=+0.370267451,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-147.ec2.internal,}" Jun 11 15:02:45.445492 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.445470 2569 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-c22tv" Jun 11 15:02:45.464353 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.464337 2569 manager.go:337] "Starting Device Plugin manager" Jun 11 15:02:45.471790 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:02:45.464370 2569 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 11 15:02:45.471790 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.464384 2569 server.go:87] "Starting device plugin registration server" Jun 11 15:02:45.471790 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.464614 2569 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 11 15:02:45.471790 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.464626 2569 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 11 15:02:45.471790 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.464724 2569 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 11 15:02:45.471790 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.464835 2569 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 11 15:02:45.471790 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.464843 2569 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 11 15:02:45.471790 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:02:45.465370 2569 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 11 15:02:45.471790 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:02:45.465424 2569 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-147.ec2.internal\" not found" Jun 11 15:02:45.472294 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.472271 2569 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 11 15:02:45.473485 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.473468 2569 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 11 15:02:45.473583 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.473505 2569 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 11 15:02:45.473583 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.473524 2569 kubelet.go:2448] "Starting kubelet main sync loop" Jun 11 15:02:45.473583 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:02:45.473566 2569 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 11 15:02:45.476071 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.476053 2569 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 15:02:45.565154 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.565120 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 15:02:45.568567 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.568525 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-147.ec2.internal" event="NodeHasSufficientMemory" Jun 11 15:02:45.568567 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.568554 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-147.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 15:02:45.568675 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.568574 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-147.ec2.internal" event="NodeHasSufficientPID" Jun 11 15:02:45.568675 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.568597 2569 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-147.ec2.internal" Jun 11 15:02:45.574092 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.574075 2569 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-147.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-147.ec2.internal"] Jun 11 15:02:45.574163 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.574131 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 15:02:45.574987 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.574966 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-147.ec2.internal" event="NodeHasSufficientMemory" Jun 11 15:02:45.575083 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.574999 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-147.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 15:02:45.575083 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.575011 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-147.ec2.internal" event="NodeHasSufficientPID" Jun 11 15:02:45.576120 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.576107 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 15:02:45.576247 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.576227 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-147.ec2.internal" Jun 11 15:02:45.576793 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.576771 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 15:02:45.577076 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.577057 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-147.ec2.internal" event="NodeHasSufficientMemory" Jun 11 15:02:45.577132 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.577082 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-147.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 15:02:45.577132 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.577091 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-147.ec2.internal" event="NodeHasSufficientPID" Jun 11 15:02:45.577725 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.577708 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-147.ec2.internal" event="NodeHasSufficientMemory" Jun 11 15:02:45.577835 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.577733 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-147.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 15:02:45.577835 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.577742 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-147.ec2.internal" event="NodeHasSufficientPID" Jun 11 15:02:45.577835 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.577717 2569 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-147.ec2.internal" Jun 11 15:02:45.577835 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:02:45.577799 2569 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-147.ec2.internal\": node \"ip-10-0-128-147.ec2.internal\" not found" Jun 11 15:02:45.578107 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.578092 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-147.ec2.internal" Jun 11 15:02:45.578174 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.578131 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 15:02:45.578856 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.578840 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-147.ec2.internal" event="NodeHasSufficientMemory" Jun 11 15:02:45.578917 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.578872 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-147.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 15:02:45.578917 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.578891 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-147.ec2.internal" event="NodeHasSufficientPID" Jun 11 15:02:45.598069 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:02:45.598053 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-147.ec2.internal\" not found" Jun 11 15:02:45.599284 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:02:45.599270 2569 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-147.ec2.internal\" not found" node="ip-10-0-128-147.ec2.internal" Jun 11 15:02:45.602707 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:02:45.602694 2569 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-147.ec2.internal\" not found" node="ip-10-0-128-147.ec2.internal" Jun 11 15:02:45.603788 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.603774 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/759a219e0bec71c2eaeea66fcc1c48b7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-147.ec2.internal\" (UID: \"759a219e0bec71c2eaeea66fcc1c48b7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-147.ec2.internal" Jun 11 15:02:45.603834 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.603797 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/759a219e0bec71c2eaeea66fcc1c48b7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-147.ec2.internal\" (UID: \"759a219e0bec71c2eaeea66fcc1c48b7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-147.ec2.internal" Jun 11 15:02:45.603834 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.603814 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/40e5bb6ad17f9c3a0001225289b11e90-config\") pod \"kube-apiserver-proxy-ip-10-0-128-147.ec2.internal\" (UID: \"40e5bb6ad17f9c3a0001225289b11e90\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-147.ec2.internal" Jun 11 15:02:45.698278 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:02:45.698257 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-147.ec2.internal\" not found" Jun 11 15:02:45.704660 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.704627 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/759a219e0bec71c2eaeea66fcc1c48b7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-147.ec2.internal\" (UID: \"759a219e0bec71c2eaeea66fcc1c48b7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-147.ec2.internal" Jun 11 15:02:45.704777 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.704670 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/759a219e0bec71c2eaeea66fcc1c48b7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-147.ec2.internal\" (UID: \"759a219e0bec71c2eaeea66fcc1c48b7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-147.ec2.internal" Jun 11 15:02:45.704777 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.704694 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/40e5bb6ad17f9c3a0001225289b11e90-config\") pod \"kube-apiserver-proxy-ip-10-0-128-147.ec2.internal\" (UID: \"40e5bb6ad17f9c3a0001225289b11e90\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-147.ec2.internal" Jun 11 15:02:45.704777 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.704718 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/759a219e0bec71c2eaeea66fcc1c48b7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-147.ec2.internal\" (UID: \"759a219e0bec71c2eaeea66fcc1c48b7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-147.ec2.internal" Jun 11 15:02:45.704777 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.704729 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/759a219e0bec71c2eaeea66fcc1c48b7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-147.ec2.internal\" (UID: \"759a219e0bec71c2eaeea66fcc1c48b7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-147.ec2.internal" Jun 11 15:02:45.704777 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.704728 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/40e5bb6ad17f9c3a0001225289b11e90-config\") pod \"kube-apiserver-proxy-ip-10-0-128-147.ec2.internal\" (UID: \"40e5bb6ad17f9c3a0001225289b11e90\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-147.ec2.internal" Jun 11 15:02:45.798763 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:02:45.798738 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-147.ec2.internal\" not found" Jun 11 15:02:45.899128 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:02:45.899065 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-147.ec2.internal\" not found" Jun 11 15:02:45.902226 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.902213 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-147.ec2.internal" Jun 11 15:02:45.907671 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:45.907657 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-147.ec2.internal" Jun 11 15:02:46.000208 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:02:46.000177 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-147.ec2.internal\" not found" Jun 11 15:02:46.100693 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:02:46.100669 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-147.ec2.internal\" not found" Jun 11 15:02:46.201253 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:02:46.201181 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-147.ec2.internal\" not found" Jun 11 15:02:46.301636 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:02:46.301612 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-147.ec2.internal\" not found" Jun 11 15:02:46.345009 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:46.344983 2569 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 11 15:02:46.345575 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:46.345123 2569 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 15:02:46.378726 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:46.378697 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40e5bb6ad17f9c3a0001225289b11e90.slice/crio-1794edc87af51e51ab0055adbbda590bd4fe117d79eea543c9819b3e44cfd443 WatchSource:0}: Error finding container 1794edc87af51e51ab0055adbbda590bd4fe117d79eea543c9819b3e44cfd443: Status 404 returned error can't find the container with id 1794edc87af51e51ab0055adbbda590bd4fe117d79eea543c9819b3e44cfd443 Jun 11 15:02:46.378964 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:46.378948 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod759a219e0bec71c2eaeea66fcc1c48b7.slice/crio-4d41ad60cc2a8da07d0971804b23b5e385e9e0fec4fa4f296b0bd3d0a58627bb WatchSource:0}: Error finding container 4d41ad60cc2a8da07d0971804b23b5e385e9e0fec4fa4f296b0bd3d0a58627bb: Status 404 returned error can't find the container with id 4d41ad60cc2a8da07d0971804b23b5e385e9e0fec4fa4f296b0bd3d0a58627bb Jun 11 15:02:46.383862 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:46.383847 2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 15:02:46.401725 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:02:46.401703 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-147.ec2.internal\" not found" Jun 11 15:02:46.449941 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:46.449906 2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-10 14:57:45 +0000 UTC" deadline="2027-12-18 02:19:57.667110999 +0000 UTC" Jun 11 15:02:46.450038 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:46.449938 2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13307h17m11.217177663s" Jun 11 15:02:46.464457 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:46.464409 2569 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 15:02:46.470462 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:46.470446 2569 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 15:02:46.476378 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:46.476337 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-147.ec2.internal" event={"ID":"759a219e0bec71c2eaeea66fcc1c48b7","Type":"ContainerStarted","Data":"4d41ad60cc2a8da07d0971804b23b5e385e9e0fec4fa4f296b0bd3d0a58627bb"} Jun 11 15:02:46.477247 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:46.477230 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-147.ec2.internal" event={"ID":"40e5bb6ad17f9c3a0001225289b11e90","Type":"ContainerStarted","Data":"1794edc87af51e51ab0055adbbda590bd4fe117d79eea543c9819b3e44cfd443"} Jun 11 15:02:46.502096 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:46.502072 2569 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-147.ec2.internal" Jun 11 15:02:46.517660 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:46.517640 2569 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 15:02:46.518830 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:46.518818 2569 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-147.ec2.internal" Jun 11 15:02:46.519219 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:46.519203 2569 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 15:02:46.532122 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:46.532105 2569 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 15:02:47.382301 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.382273 2569 apiserver.go:52] "Watching apiserver" Jun 11 15:02:47.393180 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.393159 2569 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 11 15:02:47.393596 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.393563 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-6779b","openshift-network-operator/iptables-alerter-lqrrd","kube-system/global-pull-secret-syncer-9xq6t","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pl4zp","openshift-cluster-node-tuning-operator/tuned-nshvv","openshift-image-registry/node-ca-9fgfz","openshift-multus/multus-additional-cni-plugins-pqqnp","openshift-multus/network-metrics-daemon-6zlq9","openshift-network-diagnostics/network-check-target-786s7","openshift-ovn-kubernetes/ovnkube-node-5lcln","kube-system/konnectivity-agent-gjwn5","kube-system/kube-apiserver-proxy-ip-10-0-128-147.ec2.internal","openshift-dns/node-resolver-fzhq9","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-147.ec2.internal"] Jun 11 15:02:47.395278 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.395258 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pqqnp" Jun 11 15:02:47.396555 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.396535 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fzhq9" Jun 11 15:02:47.397512 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.397493 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9xq6t" Jun 11 15:02:47.397607 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:02:47.397560 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9xq6t" podUID="f5813fd7-de59-42f7-b4ee-de396547742d" Jun 11 15:02:47.398742 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.398723 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pl4zp" Jun 11 15:02:47.399605 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.399584 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 11 15:02:47.399722 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.399702 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 11 15:02:47.399809 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.399708 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 11 15:02:47.399809 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.399802 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-4ft2k\"" Jun 11 15:02:47.400346 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.400326 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-nshvv" Jun 11 15:02:47.401451 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.401435 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9fgfz" Jun 11 15:02:47.401773 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.401737 2569 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 11 15:02:47.403222 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.403203 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-786s7" Jun 11 15:02:47.403313 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:02:47.403263 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-786s7" podUID="5f5aa8b6-caed-490f-818a-9a245c7bba82" Jun 11 15:02:47.403736 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.403719 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 11 15:02:47.403966 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.403947 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 11 15:02:47.404093 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.404017 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 11 15:02:47.404459 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.404151 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 11 15:02:47.404459 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.404215 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 11 15:02:47.404459 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.404419 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 11 15:02:47.404459 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.404457 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-zqgqm\"" Jun 11 15:02:47.404697 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.404679 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 11 15:02:47.404697 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.404688 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 11 15:02:47.404697 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.404693 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 11 15:02:47.404875 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.404700 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6779b" Jun 11 15:02:47.404875 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.404708 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-7vdl7\"" Jun 11 15:02:47.405276 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.405258 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lqrrd" Jun 11 15:02:47.407628 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.407102 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5lcln" Jun 11 15:02:47.409521 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.408667 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gjwn5" Jun 11 15:02:47.409970 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.409950 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6zlq9" Jun 11 15:02:47.410058 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:02:47.410017 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6zlq9" podUID="a79c1c7a-ce77-499f-8f15-ea44cd93aeb2" Jun 11 15:02:47.412021 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.412001 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-bjw9c\"" Jun 11 15:02:47.414363 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.414310 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f5813fd7-de59-42f7-b4ee-de396547742d-dbus\") pod \"global-pull-secret-syncer-9xq6t\" (UID: \"f5813fd7-de59-42f7-b4ee-de396547742d\") " pod="kube-system/global-pull-secret-syncer-9xq6t" Jun 11 15:02:47.414464 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.414394 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 11 15:02:47.414464 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.414400 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/702ed42e-bdb8-4845-bc4d-cfa514fa6dff-device-dir\") pod \"aws-ebs-csi-driver-node-pl4zp\" (UID: \"702ed42e-bdb8-4845-bc4d-cfa514fa6dff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pl4zp" Jun 11 15:02:47.414464 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.414447 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/702ed42e-bdb8-4845-bc4d-cfa514fa6dff-sys-fs\") pod \"aws-ebs-csi-driver-node-pl4zp\" (UID: \"702ed42e-bdb8-4845-bc4d-cfa514fa6dff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pl4zp" Jun 11 15:02:47.414646 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.414481 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dw8nz\" (UniqueName: \"kubernetes.io/projected/702ed42e-bdb8-4845-bc4d-cfa514fa6dff-kube-api-access-dw8nz\") pod \"aws-ebs-csi-driver-node-pl4zp\" (UID: \"702ed42e-bdb8-4845-bc4d-cfa514fa6dff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pl4zp" Jun 11 15:02:47.414646 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.414522 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a10fef5-133c-4a0b-85d5-2af4705ce4e2-var-lib-kubelet\") pod \"tuned-nshvv\" (UID: \"6a10fef5-133c-4a0b-85d5-2af4705ce4e2\") " pod="openshift-cluster-node-tuning-operator/tuned-nshvv" Jun 11 15:02:47.414646 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.414567 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f5813fd7-de59-42f7-b4ee-de396547742d-kubelet-config\") pod \"global-pull-secret-syncer-9xq6t\" (UID: \"f5813fd7-de59-42f7-b4ee-de396547742d\") " pod="kube-system/global-pull-secret-syncer-9xq6t" Jun 11 15:02:47.414646 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.414602 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/702ed42e-bdb8-4845-bc4d-cfa514fa6dff-etc-selinux\") pod \"aws-ebs-csi-driver-node-pl4zp\" (UID: \"702ed42e-bdb8-4845-bc4d-cfa514fa6dff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pl4zp" Jun 11 15:02:47.414646 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.414634 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9329cd7d-8d39-4a1a-b7da-d6604e6274bb-serviceca\") pod \"node-ca-9fgfz\" (UID: \"9329cd7d-8d39-4a1a-b7da-d6604e6274bb\") " pod="openshift-image-registry/node-ca-9fgfz" Jun 11 15:02:47.414945 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.414663 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/702ed42e-bdb8-4845-bc4d-cfa514fa6dff-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pl4zp\" (UID: \"702ed42e-bdb8-4845-bc4d-cfa514fa6dff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pl4zp" Jun 11 15:02:47.414945 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.414686 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6a10fef5-133c-4a0b-85d5-2af4705ce4e2-run\") pod \"tuned-nshvv\" (UID: \"6a10fef5-133c-4a0b-85d5-2af4705ce4e2\") " pod="openshift-cluster-node-tuning-operator/tuned-nshvv" Jun 11 15:02:47.414945 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.414730 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6a10fef5-133c-4a0b-85d5-2af4705ce4e2-lib-modules\") pod \"tuned-nshvv\" (UID: \"6a10fef5-133c-4a0b-85d5-2af4705ce4e2\") " pod="openshift-cluster-node-tuning-operator/tuned-nshvv" Jun 11 15:02:47.414945 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.414746 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 11 15:02:47.414945 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.414793 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 11 15:02:47.414945 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.414813 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6a10fef5-133c-4a0b-85d5-2af4705ce4e2-tmp\") pod \"tuned-nshvv\" (UID: \"6a10fef5-133c-4a0b-85d5-2af4705ce4e2\") " pod="openshift-cluster-node-tuning-operator/tuned-nshvv" Jun 11 15:02:47.414945 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.414856 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6a10fef5-133c-4a0b-85d5-2af4705ce4e2-etc-modprobe-d\") pod \"tuned-nshvv\" (UID: \"6a10fef5-133c-4a0b-85d5-2af4705ce4e2\") " pod="openshift-cluster-node-tuning-operator/tuned-nshvv" Jun 11 15:02:47.415557 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.414896 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4dca31c7-6860-4b5c-8631-a8e7d5a09d72-os-release\") pod \"multus-additional-cni-plugins-pqqnp\" (UID: \"4dca31c7-6860-4b5c-8631-a8e7d5a09d72\") " pod="openshift-multus/multus-additional-cni-plugins-pqqnp" Jun 11 15:02:47.415557 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.415425 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4dca31c7-6860-4b5c-8631-a8e7d5a09d72-cni-binary-copy\") pod \"multus-additional-cni-plugins-pqqnp\" (UID: \"4dca31c7-6860-4b5c-8631-a8e7d5a09d72\") " pod="openshift-multus/multus-additional-cni-plugins-pqqnp" Jun 11 15:02:47.415557 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.415454 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4dca31c7-6860-4b5c-8631-a8e7d5a09d72-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pqqnp\" (UID: \"4dca31c7-6860-4b5c-8631-a8e7d5a09d72\") " pod="openshift-multus/multus-additional-cni-plugins-pqqnp" Jun 11 15:02:47.415557 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.415476 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9329cd7d-8d39-4a1a-b7da-d6604e6274bb-host\") pod \"node-ca-9fgfz\" (UID: \"9329cd7d-8d39-4a1a-b7da-d6604e6274bb\") " pod="openshift-image-registry/node-ca-9fgfz" Jun 11 15:02:47.415557 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.415498 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6a10fef5-133c-4a0b-85d5-2af4705ce4e2-etc-sysconfig\") pod \"tuned-nshvv\" (UID: \"6a10fef5-133c-4a0b-85d5-2af4705ce4e2\") " pod="openshift-cluster-node-tuning-operator/tuned-nshvv" Jun 11 15:02:47.415557 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.415523 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6a10fef5-133c-4a0b-85d5-2af4705ce4e2-etc-sysctl-conf\") pod \"tuned-nshvv\" (UID: \"6a10fef5-133c-4a0b-85d5-2af4705ce4e2\") " pod="openshift-cluster-node-tuning-operator/tuned-nshvv" Jun 11 15:02:47.415557 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.415546 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9zg5\" (UniqueName: \"kubernetes.io/projected/5f5aa8b6-caed-490f-818a-9a245c7bba82-kube-api-access-w9zg5\") pod \"network-check-target-786s7\" (UID: \"5f5aa8b6-caed-490f-818a-9a245c7bba82\") " pod="openshift-network-diagnostics/network-check-target-786s7" Jun 11 15:02:47.415914 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.415570 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c98bn\" (UniqueName: \"kubernetes.io/projected/c1a1d2ac-69d9-4fd9-a430-4392613b148f-kube-api-access-c98bn\") pod \"node-resolver-fzhq9\" (UID: \"c1a1d2ac-69d9-4fd9-a430-4392613b148f\") " pod="openshift-dns/node-resolver-fzhq9" Jun 11 15:02:47.415914 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.415594 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f5813fd7-de59-42f7-b4ee-de396547742d-original-pull-secret\") pod \"global-pull-secret-syncer-9xq6t\" (UID: \"f5813fd7-de59-42f7-b4ee-de396547742d\") " pod="kube-system/global-pull-secret-syncer-9xq6t" Jun 11 15:02:47.415914 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.415602 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 11 15:02:47.415914 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.415611 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 11 15:02:47.415914 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.415616 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6a10fef5-133c-4a0b-85d5-2af4705ce4e2-etc-sysctl-d\") pod \"tuned-nshvv\" (UID: \"6a10fef5-133c-4a0b-85d5-2af4705ce4e2\") " pod="openshift-cluster-node-tuning-operator/tuned-nshvv" Jun 11 15:02:47.415914 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.415739 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4dca31c7-6860-4b5c-8631-a8e7d5a09d72-system-cni-dir\") pod \"multus-additional-cni-plugins-pqqnp\" (UID: \"4dca31c7-6860-4b5c-8631-a8e7d5a09d72\") " pod="openshift-multus/multus-additional-cni-plugins-pqqnp" Jun 11 15:02:47.415914 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.415788 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4dca31c7-6860-4b5c-8631-a8e7d5a09d72-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pqqnp\" (UID: \"4dca31c7-6860-4b5c-8631-a8e7d5a09d72\") " pod="openshift-multus/multus-additional-cni-plugins-pqqnp" Jun 11 15:02:47.415914 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.415814 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c1a1d2ac-69d9-4fd9-a430-4392613b148f-tmp-dir\") pod \"node-resolver-fzhq9\" (UID: \"c1a1d2ac-69d9-4fd9-a430-4392613b148f\") " pod="openshift-dns/node-resolver-fzhq9" Jun 11 15:02:47.415914 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.415838 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6a10fef5-133c-4a0b-85d5-2af4705ce4e2-host\") pod \"tuned-nshvv\" (UID: \"6a10fef5-133c-4a0b-85d5-2af4705ce4e2\") " pod="openshift-cluster-node-tuning-operator/tuned-nshvv" Jun 11 15:02:47.415914 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.415858 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 11 15:02:47.415914 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.415863 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6a10fef5-133c-4a0b-85d5-2af4705ce4e2-etc-tuned\") pod \"tuned-nshvv\" (UID: \"6a10fef5-133c-4a0b-85d5-2af4705ce4e2\") " pod="openshift-cluster-node-tuning-operator/tuned-nshvv" Jun 11 15:02:47.415914 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.415889 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqr47\" (UniqueName: \"kubernetes.io/projected/6a10fef5-133c-4a0b-85d5-2af4705ce4e2-kube-api-access-fqr47\") pod \"tuned-nshvv\" (UID: \"6a10fef5-133c-4a0b-85d5-2af4705ce4e2\") " pod="openshift-cluster-node-tuning-operator/tuned-nshvv" Jun 11 15:02:47.415914 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.415914 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4dca31c7-6860-4b5c-8631-a8e7d5a09d72-cnibin\") pod \"multus-additional-cni-plugins-pqqnp\" (UID: \"4dca31c7-6860-4b5c-8631-a8e7d5a09d72\") " pod="openshift-multus/multus-additional-cni-plugins-pqqnp" Jun 11 15:02:47.416491 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.415941 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4dca31c7-6860-4b5c-8631-a8e7d5a09d72-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pqqnp\" (UID: \"4dca31c7-6860-4b5c-8631-a8e7d5a09d72\") " pod="openshift-multus/multus-additional-cni-plugins-pqqnp" Jun 11 15:02:47.416491 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.415966 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5plb\" (UniqueName: \"kubernetes.io/projected/4dca31c7-6860-4b5c-8631-a8e7d5a09d72-kube-api-access-b5plb\") pod \"multus-additional-cni-plugins-pqqnp\" (UID: \"4dca31c7-6860-4b5c-8631-a8e7d5a09d72\") " pod="openshift-multus/multus-additional-cni-plugins-pqqnp" Jun 11 15:02:47.416491 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.415988 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/702ed42e-bdb8-4845-bc4d-cfa514fa6dff-socket-dir\") pod \"aws-ebs-csi-driver-node-pl4zp\" (UID: \"702ed42e-bdb8-4845-bc4d-cfa514fa6dff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pl4zp" Jun 11 15:02:47.416491 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.416010 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 11 15:02:47.416491 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.416026 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/702ed42e-bdb8-4845-bc4d-cfa514fa6dff-registration-dir\") pod \"aws-ebs-csi-driver-node-pl4zp\" (UID: \"702ed42e-bdb8-4845-bc4d-cfa514fa6dff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pl4zp" Jun 11 15:02:47.416491 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.416049 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6a10fef5-133c-4a0b-85d5-2af4705ce4e2-etc-kubernetes\") pod \"tuned-nshvv\" (UID: \"6a10fef5-133c-4a0b-85d5-2af4705ce4e2\") " pod="openshift-cluster-node-tuning-operator/tuned-nshvv" Jun 11 15:02:47.416491 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.416072 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6a10fef5-133c-4a0b-85d5-2af4705ce4e2-etc-systemd\") pod \"tuned-nshvv\" (UID: \"6a10fef5-133c-4a0b-85d5-2af4705ce4e2\") " pod="openshift-cluster-node-tuning-operator/tuned-nshvv" Jun 11 15:02:47.416491 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.415916 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 11 15:02:47.416491 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.416107 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 11 15:02:47.416491 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.416112 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 11 15:02:47.416491 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.416143 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-cjgbk\"" Jun 11 15:02:47.416491 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.416027 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 11 15:02:47.416491 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.416279 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6a10fef5-133c-4a0b-85d5-2af4705ce4e2-sys\") pod \"tuned-nshvv\" (UID: \"6a10fef5-133c-4a0b-85d5-2af4705ce4e2\") " pod="openshift-cluster-node-tuning-operator/tuned-nshvv" Jun 11 15:02:47.416491 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.416309 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7s9t\" (UniqueName: \"kubernetes.io/projected/9329cd7d-8d39-4a1a-b7da-d6604e6274bb-kube-api-access-f7s9t\") pod \"node-ca-9fgfz\" (UID: \"9329cd7d-8d39-4a1a-b7da-d6604e6274bb\") " pod="openshift-image-registry/node-ca-9fgfz" Jun 11 15:02:47.416491 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.416334 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c1a1d2ac-69d9-4fd9-a430-4392613b148f-hosts-file\") pod \"node-resolver-fzhq9\" (UID: \"c1a1d2ac-69d9-4fd9-a430-4392613b148f\") " pod="openshift-dns/node-resolver-fzhq9" Jun 11 15:02:47.416491 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.416427 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-svrpv\"" Jun 11 15:02:47.416491 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.416467 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 11 15:02:47.416491 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.416427 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 11 15:02:47.417323 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.416634 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-w4jm2\"" Jun 11 15:02:47.417323 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.416661 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 11 15:02:47.417323 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.416732 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-6w7w7\"" Jun 11 15:02:47.417323 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.416901 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-lcfdp\"" Jun 11 15:02:47.417323 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.416997 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 11 15:02:47.433215 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.433077 2569 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 15:02:47.473842 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.473816 2569 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-59sb8" Jun 11 15:02:47.488831 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.488807 2569 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-59sb8" Jun 11 15:02:47.503378 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.503354 2569 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 11 15:02:47.511186 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.511163 2569 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 15:02:47.516979 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.516958 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/702ed42e-bdb8-4845-bc4d-cfa514fa6dff-socket-dir\") pod \"aws-ebs-csi-driver-node-pl4zp\" (UID: \"702ed42e-bdb8-4845-bc4d-cfa514fa6dff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pl4zp" Jun 11 15:02:47.517068 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.516985 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/702ed42e-bdb8-4845-bc4d-cfa514fa6dff-registration-dir\") pod \"aws-ebs-csi-driver-node-pl4zp\" (UID: \"702ed42e-bdb8-4845-bc4d-cfa514fa6dff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pl4zp" Jun 11 15:02:47.517068 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.517004 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7s9t\" (UniqueName: \"kubernetes.io/projected/9329cd7d-8d39-4a1a-b7da-d6604e6274bb-kube-api-access-f7s9t\") pod \"node-ca-9fgfz\" (UID: \"9329cd7d-8d39-4a1a-b7da-d6604e6274bb\") " pod="openshift-image-registry/node-ca-9fgfz" Jun 11 15:02:47.517068 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.517029 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c1a1d2ac-69d9-4fd9-a430-4392613b148f-hosts-file\") pod \"node-resolver-fzhq9\" (UID: \"c1a1d2ac-69d9-4fd9-a430-4392613b148f\") " pod="openshift-dns/node-resolver-fzhq9" Jun 11 15:02:47.517068 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.517052 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f5813fd7-de59-42f7-b4ee-de396547742d-dbus\") pod \"global-pull-secret-syncer-9xq6t\" (UID: \"f5813fd7-de59-42f7-b4ee-de396547742d\") " pod="kube-system/global-pull-secret-syncer-9xq6t" Jun 11 15:02:47.517275 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.517089 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dw8nz\" (UniqueName: \"kubernetes.io/projected/702ed42e-bdb8-4845-bc4d-cfa514fa6dff-kube-api-access-dw8nz\") pod \"aws-ebs-csi-driver-node-pl4zp\" (UID: \"702ed42e-bdb8-4845-bc4d-cfa514fa6dff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pl4zp" Jun 11 15:02:47.517275 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.517096 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/702ed42e-bdb8-4845-bc4d-cfa514fa6dff-registration-dir\") pod \"aws-ebs-csi-driver-node-pl4zp\" (UID: \"702ed42e-bdb8-4845-bc4d-cfa514fa6dff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pl4zp" Jun 11 15:02:47.517275 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.517117 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/77786904-9829-4966-9657-c97854cb6555-run-openvswitch\") pod \"ovnkube-node-5lcln\" (UID: \"77786904-9829-4966-9657-c97854cb6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lcln" Jun 11 15:02:47.517275 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.517140 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/702ed42e-bdb8-4845-bc4d-cfa514fa6dff-socket-dir\") pod \"aws-ebs-csi-driver-node-pl4zp\" (UID: \"702ed42e-bdb8-4845-bc4d-cfa514fa6dff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pl4zp" Jun 11 15:02:47.517275 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.517151 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e8d0e901-1b06-4e8a-b6af-a2b11c8ad7b4-host-slash\") pod \"iptables-alerter-lqrrd\" (UID: \"e8d0e901-1b06-4e8a-b6af-a2b11c8ad7b4\") " pod="openshift-network-operator/iptables-alerter-lqrrd" Jun 11 15:02:47.517275 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.517173 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c1a1d2ac-69d9-4fd9-a430-4392613b148f-hosts-file\") pod \"node-resolver-fzhq9\" (UID: \"c1a1d2ac-69d9-4fd9-a430-4392613b148f\") " pod="openshift-dns/node-resolver-fzhq9" Jun 11 15:02:47.517275 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.517176 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f5813fd7-de59-42f7-b4ee-de396547742d-kubelet-config\") pod \"global-pull-secret-syncer-9xq6t\" (UID: \"f5813fd7-de59-42f7-b4ee-de396547742d\") " pod="kube-system/global-pull-secret-syncer-9xq6t" Jun 11 15:02:47.517275 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.517217 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/702ed42e-bdb8-4845-bc4d-cfa514fa6dff-etc-selinux\") pod \"aws-ebs-csi-driver-node-pl4zp\" (UID: \"702ed42e-bdb8-4845-bc4d-cfa514fa6dff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pl4zp" Jun 11 15:02:47.517275 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.517222 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f5813fd7-de59-42f7-b4ee-de396547742d-kubelet-config\") pod \"global-pull-secret-syncer-9xq6t\" (UID: \"f5813fd7-de59-42f7-b4ee-de396547742d\") " pod="kube-system/global-pull-secret-syncer-9xq6t" Jun 11 15:02:47.517275 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.517244 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5b430c4f-2679-47e4-bf04-6037fbd86c34-host-run-multus-certs\") pod \"multus-6779b\" (UID: \"5b430c4f-2679-47e4-bf04-6037fbd86c34\") " pod="openshift-multus/multus-6779b" Jun 11 15:02:47.517275 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.517268 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/77786904-9829-4966-9657-c97854cb6555-ovnkube-script-lib\") pod \"ovnkube-node-5lcln\" (UID: \"77786904-9829-4966-9657-c97854cb6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lcln" Jun 11 15:02:47.517817 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.517291 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6a10fef5-133c-4a0b-85d5-2af4705ce4e2-run\") pod \"tuned-nshvv\" (UID: \"6a10fef5-133c-4a0b-85d5-2af4705ce4e2\") " pod="openshift-cluster-node-tuning-operator/tuned-nshvv" Jun 11 15:02:47.517817 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.517312 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6a10fef5-133c-4a0b-85d5-2af4705ce4e2-lib-modules\") pod \"tuned-nshvv\" (UID: \"6a10fef5-133c-4a0b-85d5-2af4705ce4e2\") " pod="openshift-cluster-node-tuning-operator/tuned-nshvv" Jun 11 15:02:47.517817 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.517333 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6a10fef5-133c-4a0b-85d5-2af4705ce4e2-tmp\") pod \"tuned-nshvv\" (UID: \"6a10fef5-133c-4a0b-85d5-2af4705ce4e2\") " pod="openshift-cluster-node-tuning-operator/tuned-nshvv" Jun 11 15:02:47.517817 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.517375 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/77786904-9829-4966-9657-c97854cb6555-env-overrides\") pod \"ovnkube-node-5lcln\" (UID: \"77786904-9829-4966-9657-c97854cb6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lcln" Jun 11 15:02:47.517817 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.517401 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5x2sg\" (UniqueName: \"kubernetes.io/projected/77786904-9829-4966-9657-c97854cb6555-kube-api-access-5x2sg\") pod \"ovnkube-node-5lcln\" (UID: \"77786904-9829-4966-9657-c97854cb6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lcln" Jun 11 15:02:47.517817 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.517376 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f5813fd7-de59-42f7-b4ee-de396547742d-dbus\") pod \"global-pull-secret-syncer-9xq6t\" (UID: \"f5813fd7-de59-42f7-b4ee-de396547742d\") " pod="kube-system/global-pull-secret-syncer-9xq6t" Jun 11 15:02:47.517817 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.517424 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e8d0e901-1b06-4e8a-b6af-a2b11c8ad7b4-iptables-alerter-script\") pod \"iptables-alerter-lqrrd\" (UID: \"e8d0e901-1b06-4e8a-b6af-a2b11c8ad7b4\") " pod="openshift-network-operator/iptables-alerter-lqrrd" Jun 11 15:02:47.517817 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.517423 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6a10fef5-133c-4a0b-85d5-2af4705ce4e2-run\") pod \"tuned-nshvv\" (UID: \"6a10fef5-133c-4a0b-85d5-2af4705ce4e2\") " pod="openshift-cluster-node-tuning-operator/tuned-nshvv" Jun 11 15:02:47.517817 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.517437 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/702ed42e-bdb8-4845-bc4d-cfa514fa6dff-etc-selinux\") pod \"aws-ebs-csi-driver-node-pl4zp\" (UID: \"702ed42e-bdb8-4845-bc4d-cfa514fa6dff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pl4zp" Jun 11 15:02:47.517817 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.517463 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5b430c4f-2679-47e4-bf04-6037fbd86c34-os-release\") pod \"multus-6779b\" (UID: \"5b430c4f-2679-47e4-bf04-6037fbd86c34\") " pod="openshift-multus/multus-6779b" Jun 11 15:02:47.517817 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.517486 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/77786904-9829-4966-9657-c97854cb6555-etc-openvswitch\") pod \"ovnkube-node-5lcln\" (UID: \"77786904-9829-4966-9657-c97854cb6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lcln" Jun 11 15:02:47.517817 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.517520 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4dca31c7-6860-4b5c-8631-a8e7d5a09d72-os-release\") pod \"multus-additional-cni-plugins-pqqnp\" (UID: \"4dca31c7-6860-4b5c-8631-a8e7d5a09d72\") " pod="openshift-multus/multus-additional-cni-plugins-pqqnp" Jun 11 15:02:47.517817 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.517548 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6a10fef5-133c-4a0b-85d5-2af4705ce4e2-etc-sysconfig\") pod \"tuned-nshvv\" (UID: \"6a10fef5-133c-4a0b-85d5-2af4705ce4e2\") " pod="openshift-cluster-node-tuning-operator/tuned-nshvv" Jun 11 15:02:47.517817 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.517569 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6a10fef5-133c-4a0b-85d5-2af4705ce4e2-lib-modules\") pod \"tuned-nshvv\" (UID: \"6a10fef5-133c-4a0b-85d5-2af4705ce4e2\") " pod="openshift-cluster-node-tuning-operator/tuned-nshvv" Jun 11 15:02:47.517817 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.517602 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4dca31c7-6860-4b5c-8631-a8e7d5a09d72-os-release\") pod \"multus-additional-cni-plugins-pqqnp\" (UID: \"4dca31c7-6860-4b5c-8631-a8e7d5a09d72\") " pod="openshift-multus/multus-additional-cni-plugins-pqqnp" Jun 11 15:02:47.517817 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.517572 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6a10fef5-133c-4a0b-85d5-2af4705ce4e2-etc-sysctl-conf\") pod \"tuned-nshvv\" (UID: \"6a10fef5-133c-4a0b-85d5-2af4705ce4e2\") " pod="openshift-cluster-node-tuning-operator/tuned-nshvv" Jun 11 15:02:47.517817 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.517629 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6a10fef5-133c-4a0b-85d5-2af4705ce4e2-etc-sysconfig\") pod \"tuned-nshvv\" (UID: \"6a10fef5-133c-4a0b-85d5-2af4705ce4e2\") " pod="openshift-cluster-node-tuning-operator/tuned-nshvv" Jun 11 15:02:47.518578 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.517640 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5b430c4f-2679-47e4-bf04-6037fbd86c34-host-run-k8s-cni-cncf-io\") pod \"multus-6779b\" (UID: \"5b430c4f-2679-47e4-bf04-6037fbd86c34\") " pod="openshift-multus/multus-6779b" Jun 11 15:02:47.518578 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.517669 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/77786904-9829-4966-9657-c97854cb6555-systemd-units\") pod \"ovnkube-node-5lcln\" (UID: \"77786904-9829-4966-9657-c97854cb6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lcln" Jun 11 15:02:47.518578 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.517700 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f5813fd7-de59-42f7-b4ee-de396547742d-original-pull-secret\") pod \"global-pull-secret-syncer-9xq6t\" (UID: \"f5813fd7-de59-42f7-b4ee-de396547742d\") " pod="kube-system/global-pull-secret-syncer-9xq6t" Jun 11 15:02:47.518578 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.517695 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6a10fef5-133c-4a0b-85d5-2af4705ce4e2-etc-sysctl-conf\") pod \"tuned-nshvv\" (UID: \"6a10fef5-133c-4a0b-85d5-2af4705ce4e2\") " pod="openshift-cluster-node-tuning-operator/tuned-nshvv" Jun 11 15:02:47.518578 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.517731 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5b430c4f-2679-47e4-bf04-6037fbd86c34-host-var-lib-cni-bin\") pod \"multus-6779b\" (UID: \"5b430c4f-2679-47e4-bf04-6037fbd86c34\") " pod="openshift-multus/multus-6779b" Jun 11 15:02:47.518578 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.517800 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/77786904-9829-4966-9657-c97854cb6555-run-systemd\") pod \"ovnkube-node-5lcln\" (UID: \"77786904-9829-4966-9657-c97854cb6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lcln" Jun 11 15:02:47.518578 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.517809 2569 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 11 15:02:47.518578 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:02:47.517838 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 15:02:47.518578 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.517854 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/77786904-9829-4966-9657-c97854cb6555-var-lib-openvswitch\") pod \"ovnkube-node-5lcln\" (UID: \"77786904-9829-4966-9657-c97854cb6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lcln" Jun 11 15:02:47.518578 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:02:47.517898 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5813fd7-de59-42f7-b4ee-de396547742d-original-pull-secret podName:f5813fd7-de59-42f7-b4ee-de396547742d nodeName:}" failed. No retries permitted until 2026-06-11 15:02:48.017880191 +0000 UTC m=+2.966504460 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f5813fd7-de59-42f7-b4ee-de396547742d-original-pull-secret") pod "global-pull-secret-syncer-9xq6t" (UID: "f5813fd7-de59-42f7-b4ee-de396547742d") : object "kube-system"/"original-pull-secret" not registered Jun 11 15:02:47.518578 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.517914 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/77786904-9829-4966-9657-c97854cb6555-host-cni-bin\") pod \"ovnkube-node-5lcln\" (UID: \"77786904-9829-4966-9657-c97854cb6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lcln" Jun 11 15:02:47.518578 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.517952 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4dca31c7-6860-4b5c-8631-a8e7d5a09d72-system-cni-dir\") pod \"multus-additional-cni-plugins-pqqnp\" (UID: \"4dca31c7-6860-4b5c-8631-a8e7d5a09d72\") " pod="openshift-multus/multus-additional-cni-plugins-pqqnp" Jun 11 15:02:47.518578 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.517975 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c1a1d2ac-69d9-4fd9-a430-4392613b148f-tmp-dir\") pod \"node-resolver-fzhq9\" (UID: \"c1a1d2ac-69d9-4fd9-a430-4392613b148f\") " pod="openshift-dns/node-resolver-fzhq9" Jun 11 15:02:47.518578 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.517982 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4dca31c7-6860-4b5c-8631-a8e7d5a09d72-system-cni-dir\") pod \"multus-additional-cni-plugins-pqqnp\" (UID: \"4dca31c7-6860-4b5c-8631-a8e7d5a09d72\") " pod="openshift-multus/multus-additional-cni-plugins-pqqnp" Jun 11 15:02:47.518578 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.517998 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6a10fef5-133c-4a0b-85d5-2af4705ce4e2-etc-tuned\") pod \"tuned-nshvv\" (UID: \"6a10fef5-133c-4a0b-85d5-2af4705ce4e2\") " pod="openshift-cluster-node-tuning-operator/tuned-nshvv" Jun 11 15:02:47.518578 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.518022 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqr47\" (UniqueName: \"kubernetes.io/projected/6a10fef5-133c-4a0b-85d5-2af4705ce4e2-kube-api-access-fqr47\") pod \"tuned-nshvv\" (UID: \"6a10fef5-133c-4a0b-85d5-2af4705ce4e2\") " pod="openshift-cluster-node-tuning-operator/tuned-nshvv" Jun 11 15:02:47.518578 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.518045 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/77786904-9829-4966-9657-c97854cb6555-host-kubelet\") pod \"ovnkube-node-5lcln\" (UID: \"77786904-9829-4966-9657-c97854cb6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lcln" Jun 11 15:02:47.519366 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.518070 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/77786904-9829-4966-9657-c97854cb6555-host-run-netns\") pod \"ovnkube-node-5lcln\" (UID: \"77786904-9829-4966-9657-c97854cb6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lcln" Jun 11 15:02:47.519366 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.518092 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/77786904-9829-4966-9657-c97854cb6555-node-log\") pod \"ovnkube-node-5lcln\" (UID: \"77786904-9829-4966-9657-c97854cb6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lcln" Jun 11 15:02:47.519366 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.518115 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5b430c4f-2679-47e4-bf04-6037fbd86c34-host-run-netns\") pod \"multus-6779b\" (UID: \"5b430c4f-2679-47e4-bf04-6037fbd86c34\") " pod="openshift-multus/multus-6779b" Jun 11 15:02:47.519366 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.518139 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4dca31c7-6860-4b5c-8631-a8e7d5a09d72-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pqqnp\" (UID: \"4dca31c7-6860-4b5c-8631-a8e7d5a09d72\") " pod="openshift-multus/multus-additional-cni-plugins-pqqnp" Jun 11 15:02:47.519366 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.518174 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5plb\" (UniqueName: \"kubernetes.io/projected/4dca31c7-6860-4b5c-8631-a8e7d5a09d72-kube-api-access-b5plb\") pod \"multus-additional-cni-plugins-pqqnp\" (UID: \"4dca31c7-6860-4b5c-8631-a8e7d5a09d72\") " pod="openshift-multus/multus-additional-cni-plugins-pqqnp" Jun 11 15:02:47.519366 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.518204 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6a10fef5-133c-4a0b-85d5-2af4705ce4e2-etc-kubernetes\") pod \"tuned-nshvv\" (UID: \"6a10fef5-133c-4a0b-85d5-2af4705ce4e2\") " pod="openshift-cluster-node-tuning-operator/tuned-nshvv" Jun 11 15:02:47.519366 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.518232 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6a10fef5-133c-4a0b-85d5-2af4705ce4e2-etc-systemd\") pod \"tuned-nshvv\" (UID: \"6a10fef5-133c-4a0b-85d5-2af4705ce4e2\") " pod="openshift-cluster-node-tuning-operator/tuned-nshvv" Jun 11 15:02:47.519366 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.518255 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6a10fef5-133c-4a0b-85d5-2af4705ce4e2-sys\") pod \"tuned-nshvv\" (UID: \"6a10fef5-133c-4a0b-85d5-2af4705ce4e2\") " pod="openshift-cluster-node-tuning-operator/tuned-nshvv" Jun 11 15:02:47.519366 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.518265 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c1a1d2ac-69d9-4fd9-a430-4392613b148f-tmp-dir\") pod \"node-resolver-fzhq9\" (UID: \"c1a1d2ac-69d9-4fd9-a430-4392613b148f\") " pod="openshift-dns/node-resolver-fzhq9" Jun 11 15:02:47.519366 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.518280 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/77786904-9829-4966-9657-c97854cb6555-run-ovn\") pod \"ovnkube-node-5lcln\" (UID: \"77786904-9829-4966-9657-c97854cb6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lcln" Jun 11 15:02:47.519366 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.518331 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6a10fef5-133c-4a0b-85d5-2af4705ce4e2-etc-systemd\") pod \"tuned-nshvv\" (UID: \"6a10fef5-133c-4a0b-85d5-2af4705ce4e2\") " pod="openshift-cluster-node-tuning-operator/tuned-nshvv" Jun 11 15:02:47.519366 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.518334 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6a10fef5-133c-4a0b-85d5-2af4705ce4e2-sys\") pod \"tuned-nshvv\" (UID: \"6a10fef5-133c-4a0b-85d5-2af4705ce4e2\") " pod="openshift-cluster-node-tuning-operator/tuned-nshvv" Jun 11 15:02:47.519366 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.518365 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/77786904-9829-4966-9657-c97854cb6555-host-cni-netd\") pod \"ovnkube-node-5lcln\" (UID: \"77786904-9829-4966-9657-c97854cb6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lcln" Jun 11 15:02:47.519366 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.518430 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/702ed42e-bdb8-4845-bc4d-cfa514fa6dff-device-dir\") pod \"aws-ebs-csi-driver-node-pl4zp\" (UID: \"702ed42e-bdb8-4845-bc4d-cfa514fa6dff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pl4zp" Jun 11 15:02:47.519366 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.518432 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6a10fef5-133c-4a0b-85d5-2af4705ce4e2-etc-kubernetes\") pod \"tuned-nshvv\" (UID: \"6a10fef5-133c-4a0b-85d5-2af4705ce4e2\") " pod="openshift-cluster-node-tuning-operator/tuned-nshvv" Jun 11 15:02:47.519366 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.518461 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/702ed42e-bdb8-4845-bc4d-cfa514fa6dff-sys-fs\") pod \"aws-ebs-csi-driver-node-pl4zp\" (UID: \"702ed42e-bdb8-4845-bc4d-cfa514fa6dff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pl4zp" Jun 11 15:02:47.519366 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.518476 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/702ed42e-bdb8-4845-bc4d-cfa514fa6dff-device-dir\") pod \"aws-ebs-csi-driver-node-pl4zp\" (UID: \"702ed42e-bdb8-4845-bc4d-cfa514fa6dff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pl4zp" Jun 11 15:02:47.520089 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.518486 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5b430c4f-2679-47e4-bf04-6037fbd86c34-system-cni-dir\") pod \"multus-6779b\" (UID: \"5b430c4f-2679-47e4-bf04-6037fbd86c34\") " pod="openshift-multus/multus-6779b" Jun 11 15:02:47.520089 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.518534 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/702ed42e-bdb8-4845-bc4d-cfa514fa6dff-sys-fs\") pod \"aws-ebs-csi-driver-node-pl4zp\" (UID: \"702ed42e-bdb8-4845-bc4d-cfa514fa6dff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pl4zp" Jun 11 15:02:47.520089 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.518566 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5b430c4f-2679-47e4-bf04-6037fbd86c34-cni-binary-copy\") pod \"multus-6779b\" (UID: \"5b430c4f-2679-47e4-bf04-6037fbd86c34\") " pod="openshift-multus/multus-6779b" Jun 11 15:02:47.520089 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.518590 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5b430c4f-2679-47e4-bf04-6037fbd86c34-host-var-lib-kubelet\") pod \"multus-6779b\" (UID: \"5b430c4f-2679-47e4-bf04-6037fbd86c34\") " pod="openshift-multus/multus-6779b" Jun 11 15:02:47.520089 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.518616 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/77786904-9829-4966-9657-c97854cb6555-host-run-ovn-kubernetes\") pod \"ovnkube-node-5lcln\" (UID: \"77786904-9829-4966-9657-c97854cb6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lcln" Jun 11 15:02:47.520089 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.518642 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/77786904-9829-4966-9657-c97854cb6555-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5lcln\" (UID: \"77786904-9829-4966-9657-c97854cb6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lcln" Jun 11 15:02:47.520089 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.518684 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a5ddf0c9-e1fc-49b7-9adb-80504c04c71b-agent-certs\") pod \"konnectivity-agent-gjwn5\" (UID: \"a5ddf0c9-e1fc-49b7-9adb-80504c04c71b\") " pod="kube-system/konnectivity-agent-gjwn5" Jun 11 15:02:47.520089 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.518689 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4dca31c7-6860-4b5c-8631-a8e7d5a09d72-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pqqnp\" (UID: \"4dca31c7-6860-4b5c-8631-a8e7d5a09d72\") " pod="openshift-multus/multus-additional-cni-plugins-pqqnp" Jun 11 15:02:47.520089 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.518722 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/77786904-9829-4966-9657-c97854cb6555-host-slash\") pod \"ovnkube-node-5lcln\" (UID: \"77786904-9829-4966-9657-c97854cb6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lcln" Jun 11 15:02:47.520089 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.518743 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/77786904-9829-4966-9657-c97854cb6555-ovn-node-metrics-cert\") pod \"ovnkube-node-5lcln\" (UID: \"77786904-9829-4966-9657-c97854cb6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lcln" Jun 11 15:02:47.520089 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.518778 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2psc5\" (UniqueName: \"kubernetes.io/projected/e8d0e901-1b06-4e8a-b6af-a2b11c8ad7b4-kube-api-access-2psc5\") pod \"iptables-alerter-lqrrd\" (UID: \"e8d0e901-1b06-4e8a-b6af-a2b11c8ad7b4\") " pod="openshift-network-operator/iptables-alerter-lqrrd" Jun 11 15:02:47.520089 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.518800 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a5ddf0c9-e1fc-49b7-9adb-80504c04c71b-konnectivity-ca\") pod \"konnectivity-agent-gjwn5\" (UID: \"a5ddf0c9-e1fc-49b7-9adb-80504c04c71b\") " pod="kube-system/konnectivity-agent-gjwn5" Jun 11 15:02:47.520089 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.518820 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hf72t\" (UniqueName: \"kubernetes.io/projected/a79c1c7a-ce77-499f-8f15-ea44cd93aeb2-kube-api-access-hf72t\") pod \"network-metrics-daemon-6zlq9\" (UID: \"a79c1c7a-ce77-499f-8f15-ea44cd93aeb2\") " pod="openshift-multus/network-metrics-daemon-6zlq9" Jun 11 15:02:47.520089 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.518856 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9329cd7d-8d39-4a1a-b7da-d6604e6274bb-serviceca\") pod \"node-ca-9fgfz\" (UID: \"9329cd7d-8d39-4a1a-b7da-d6604e6274bb\") " pod="openshift-image-registry/node-ca-9fgfz" Jun 11 15:02:47.520089 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.518887 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/702ed42e-bdb8-4845-bc4d-cfa514fa6dff-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pl4zp\" (UID: \"702ed42e-bdb8-4845-bc4d-cfa514fa6dff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pl4zp" Jun 11 15:02:47.520089 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.518912 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a79c1c7a-ce77-499f-8f15-ea44cd93aeb2-metrics-certs\") pod \"network-metrics-daemon-6zlq9\" (UID: \"a79c1c7a-ce77-499f-8f15-ea44cd93aeb2\") " pod="openshift-multus/network-metrics-daemon-6zlq9" Jun 11 15:02:47.520775 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.518935 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6a10fef5-133c-4a0b-85d5-2af4705ce4e2-etc-modprobe-d\") pod \"tuned-nshvv\" (UID: \"6a10fef5-133c-4a0b-85d5-2af4705ce4e2\") " pod="openshift-cluster-node-tuning-operator/tuned-nshvv" Jun 11 15:02:47.520775 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.518944 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/702ed42e-bdb8-4845-bc4d-cfa514fa6dff-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pl4zp\" (UID: \"702ed42e-bdb8-4845-bc4d-cfa514fa6dff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pl4zp" Jun 11 15:02:47.520775 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.518958 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4dca31c7-6860-4b5c-8631-a8e7d5a09d72-cni-binary-copy\") pod \"multus-additional-cni-plugins-pqqnp\" (UID: \"4dca31c7-6860-4b5c-8631-a8e7d5a09d72\") " pod="openshift-multus/multus-additional-cni-plugins-pqqnp" Jun 11 15:02:47.520775 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.518988 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4dca31c7-6860-4b5c-8631-a8e7d5a09d72-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pqqnp\" (UID: \"4dca31c7-6860-4b5c-8631-a8e7d5a09d72\") " pod="openshift-multus/multus-additional-cni-plugins-pqqnp" Jun 11 15:02:47.520775 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.519015 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9329cd7d-8d39-4a1a-b7da-d6604e6274bb-host\") pod \"node-ca-9fgfz\" (UID: \"9329cd7d-8d39-4a1a-b7da-d6604e6274bb\") " pod="openshift-image-registry/node-ca-9fgfz" Jun 11 15:02:47.520775 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.519035 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9zg5\" (UniqueName: \"kubernetes.io/projected/5f5aa8b6-caed-490f-818a-9a245c7bba82-kube-api-access-w9zg5\") pod \"network-check-target-786s7\" (UID: \"5f5aa8b6-caed-490f-818a-9a245c7bba82\") " pod="openshift-network-diagnostics/network-check-target-786s7" Jun 11 15:02:47.520775 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.519071 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6a10fef5-133c-4a0b-85d5-2af4705ce4e2-etc-modprobe-d\") pod \"tuned-nshvv\" (UID: \"6a10fef5-133c-4a0b-85d5-2af4705ce4e2\") " pod="openshift-cluster-node-tuning-operator/tuned-nshvv" Jun 11 15:02:47.520775 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.519137 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5b430c4f-2679-47e4-bf04-6037fbd86c34-multus-cni-dir\") pod \"multus-6779b\" (UID: \"5b430c4f-2679-47e4-bf04-6037fbd86c34\") " pod="openshift-multus/multus-6779b" Jun 11 15:02:47.520775 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.519170 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/77786904-9829-4966-9657-c97854cb6555-ovnkube-config\") pod \"ovnkube-node-5lcln\" (UID: \"77786904-9829-4966-9657-c97854cb6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lcln" Jun 11 15:02:47.520775 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.519179 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9329cd7d-8d39-4a1a-b7da-d6604e6274bb-host\") pod \"node-ca-9fgfz\" (UID: \"9329cd7d-8d39-4a1a-b7da-d6604e6274bb\") " pod="openshift-image-registry/node-ca-9fgfz" Jun 11 15:02:47.520775 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.519201 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c98bn\" (UniqueName: \"kubernetes.io/projected/c1a1d2ac-69d9-4fd9-a430-4392613b148f-kube-api-access-c98bn\") pod \"node-resolver-fzhq9\" (UID: \"c1a1d2ac-69d9-4fd9-a430-4392613b148f\") " pod="openshift-dns/node-resolver-fzhq9" Jun 11 15:02:47.520775 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.519228 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6a10fef5-133c-4a0b-85d5-2af4705ce4e2-etc-sysctl-d\") pod \"tuned-nshvv\" (UID: \"6a10fef5-133c-4a0b-85d5-2af4705ce4e2\") " pod="openshift-cluster-node-tuning-operator/tuned-nshvv" Jun 11 15:02:47.520775 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.519252 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5b430c4f-2679-47e4-bf04-6037fbd86c34-hostroot\") pod \"multus-6779b\" (UID: \"5b430c4f-2679-47e4-bf04-6037fbd86c34\") " pod="openshift-multus/multus-6779b" Jun 11 15:02:47.520775 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.519277 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5b430c4f-2679-47e4-bf04-6037fbd86c34-etc-kubernetes\") pod \"multus-6779b\" (UID: \"5b430c4f-2679-47e4-bf04-6037fbd86c34\") " pod="openshift-multus/multus-6779b" Jun 11 15:02:47.520775 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.519302 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4j9tx\" (UniqueName: \"kubernetes.io/projected/5b430c4f-2679-47e4-bf04-6037fbd86c34-kube-api-access-4j9tx\") pod \"multus-6779b\" (UID: \"5b430c4f-2679-47e4-bf04-6037fbd86c34\") " pod="openshift-multus/multus-6779b" Jun 11 15:02:47.520775 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.519342 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9329cd7d-8d39-4a1a-b7da-d6604e6274bb-serviceca\") pod \"node-ca-9fgfz\" (UID: \"9329cd7d-8d39-4a1a-b7da-d6604e6274bb\") " pod="openshift-image-registry/node-ca-9fgfz" Jun 11 15:02:47.520775 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.519353 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4dca31c7-6860-4b5c-8631-a8e7d5a09d72-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pqqnp\" (UID: \"4dca31c7-6860-4b5c-8631-a8e7d5a09d72\") " pod="openshift-multus/multus-additional-cni-plugins-pqqnp" Jun 11 15:02:47.521511 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.519368 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6a10fef5-133c-4a0b-85d5-2af4705ce4e2-etc-sysctl-d\") pod \"tuned-nshvv\" (UID: \"6a10fef5-133c-4a0b-85d5-2af4705ce4e2\") " pod="openshift-cluster-node-tuning-operator/tuned-nshvv" Jun 11 15:02:47.521511 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.519383 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6a10fef5-133c-4a0b-85d5-2af4705ce4e2-host\") pod \"tuned-nshvv\" (UID: \"6a10fef5-133c-4a0b-85d5-2af4705ce4e2\") " pod="openshift-cluster-node-tuning-operator/tuned-nshvv" Jun 11 15:02:47.521511 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.519407 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5b430c4f-2679-47e4-bf04-6037fbd86c34-cnibin\") pod \"multus-6779b\" (UID: \"5b430c4f-2679-47e4-bf04-6037fbd86c34\") " pod="openshift-multus/multus-6779b" Jun 11 15:02:47.521511 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.519429 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5b430c4f-2679-47e4-bf04-6037fbd86c34-multus-daemon-config\") pod \"multus-6779b\" (UID: \"5b430c4f-2679-47e4-bf04-6037fbd86c34\") " pod="openshift-multus/multus-6779b" Jun 11 15:02:47.521511 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.519472 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/77786904-9829-4966-9657-c97854cb6555-log-socket\") pod \"ovnkube-node-5lcln\" (UID: \"77786904-9829-4966-9657-c97854cb6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lcln" Jun 11 15:02:47.521511 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.519506 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6a10fef5-133c-4a0b-85d5-2af4705ce4e2-host\") pod \"tuned-nshvv\" (UID: \"6a10fef5-133c-4a0b-85d5-2af4705ce4e2\") " pod="openshift-cluster-node-tuning-operator/tuned-nshvv" Jun 11 15:02:47.521511 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.519515 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4dca31c7-6860-4b5c-8631-a8e7d5a09d72-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pqqnp\" (UID: \"4dca31c7-6860-4b5c-8631-a8e7d5a09d72\") " pod="openshift-multus/multus-additional-cni-plugins-pqqnp" Jun 11 15:02:47.521511 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.519519 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a10fef5-133c-4a0b-85d5-2af4705ce4e2-var-lib-kubelet\") pod \"tuned-nshvv\" (UID: \"6a10fef5-133c-4a0b-85d5-2af4705ce4e2\") " pod="openshift-cluster-node-tuning-operator/tuned-nshvv" Jun 11 15:02:47.521511 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.519540 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4dca31c7-6860-4b5c-8631-a8e7d5a09d72-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pqqnp\" (UID: \"4dca31c7-6860-4b5c-8631-a8e7d5a09d72\") " pod="openshift-multus/multus-additional-cni-plugins-pqqnp" Jun 11 15:02:47.521511 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.519556 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5b430c4f-2679-47e4-bf04-6037fbd86c34-multus-socket-dir-parent\") pod \"multus-6779b\" (UID: \"5b430c4f-2679-47e4-bf04-6037fbd86c34\") " pod="openshift-multus/multus-6779b" Jun 11 15:02:47.521511 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.519571 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4dca31c7-6860-4b5c-8631-a8e7d5a09d72-cni-binary-copy\") pod \"multus-additional-cni-plugins-pqqnp\" (UID: \"4dca31c7-6860-4b5c-8631-a8e7d5a09d72\") " pod="openshift-multus/multus-additional-cni-plugins-pqqnp" Jun 11 15:02:47.521511 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.519579 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a10fef5-133c-4a0b-85d5-2af4705ce4e2-var-lib-kubelet\") pod \"tuned-nshvv\" (UID: \"6a10fef5-133c-4a0b-85d5-2af4705ce4e2\") " pod="openshift-cluster-node-tuning-operator/tuned-nshvv" Jun 11 15:02:47.521511 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.519620 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5b430c4f-2679-47e4-bf04-6037fbd86c34-host-var-lib-cni-multus\") pod \"multus-6779b\" (UID: \"5b430c4f-2679-47e4-bf04-6037fbd86c34\") " pod="openshift-multus/multus-6779b" Jun 11 15:02:47.521511 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.519647 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5b430c4f-2679-47e4-bf04-6037fbd86c34-multus-conf-dir\") pod \"multus-6779b\" (UID: \"5b430c4f-2679-47e4-bf04-6037fbd86c34\") " pod="openshift-multus/multus-6779b" Jun 11 15:02:47.521511 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.519700 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4dca31c7-6860-4b5c-8631-a8e7d5a09d72-cnibin\") pod \"multus-additional-cni-plugins-pqqnp\" (UID: \"4dca31c7-6860-4b5c-8631-a8e7d5a09d72\") " pod="openshift-multus/multus-additional-cni-plugins-pqqnp" Jun 11 15:02:47.521511 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.519795 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4dca31c7-6860-4b5c-8631-a8e7d5a09d72-cnibin\") pod \"multus-additional-cni-plugins-pqqnp\" (UID: \"4dca31c7-6860-4b5c-8631-a8e7d5a09d72\") " pod="openshift-multus/multus-additional-cni-plugins-pqqnp" Jun 11 15:02:47.522209 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.521660 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6a10fef5-133c-4a0b-85d5-2af4705ce4e2-etc-tuned\") pod \"tuned-nshvv\" (UID: \"6a10fef5-133c-4a0b-85d5-2af4705ce4e2\") " pod="openshift-cluster-node-tuning-operator/tuned-nshvv" Jun 11 15:02:47.522209 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.521902 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6a10fef5-133c-4a0b-85d5-2af4705ce4e2-tmp\") pod \"tuned-nshvv\" (UID: \"6a10fef5-133c-4a0b-85d5-2af4705ce4e2\") " pod="openshift-cluster-node-tuning-operator/tuned-nshvv" Jun 11 15:02:47.537913 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.537885 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqr47\" (UniqueName: \"kubernetes.io/projected/6a10fef5-133c-4a0b-85d5-2af4705ce4e2-kube-api-access-fqr47\") pod \"tuned-nshvv\" (UID: \"6a10fef5-133c-4a0b-85d5-2af4705ce4e2\") " pod="openshift-cluster-node-tuning-operator/tuned-nshvv" Jun 11 15:02:47.538013 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:02:47.537991 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 15:02:47.538013 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:02:47.538012 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 15:02:47.538122 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:02:47.538025 2569 projected.go:196] Error preparing data for projected volume kube-api-access-w9zg5 for pod openshift-network-diagnostics/network-check-target-786s7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 15:02:47.538122 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:02:47.538099 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5f5aa8b6-caed-490f-818a-9a245c7bba82-kube-api-access-w9zg5 podName:5f5aa8b6-caed-490f-818a-9a245c7bba82 nodeName:}" failed. No retries permitted until 2026-06-11 15:02:48.038080732 +0000 UTC m=+2.986704971 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-w9zg5" (UniqueName: "kubernetes.io/projected/5f5aa8b6-caed-490f-818a-9a245c7bba82-kube-api-access-w9zg5") pod "network-check-target-786s7" (UID: "5f5aa8b6-caed-490f-818a-9a245c7bba82") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 15:02:47.539066 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.539040 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5plb\" (UniqueName: \"kubernetes.io/projected/4dca31c7-6860-4b5c-8631-a8e7d5a09d72-kube-api-access-b5plb\") pod \"multus-additional-cni-plugins-pqqnp\" (UID: \"4dca31c7-6860-4b5c-8631-a8e7d5a09d72\") " pod="openshift-multus/multus-additional-cni-plugins-pqqnp" Jun 11 15:02:47.540931 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.540906 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7s9t\" (UniqueName: \"kubernetes.io/projected/9329cd7d-8d39-4a1a-b7da-d6604e6274bb-kube-api-access-f7s9t\") pod \"node-ca-9fgfz\" (UID: \"9329cd7d-8d39-4a1a-b7da-d6604e6274bb\") " pod="openshift-image-registry/node-ca-9fgfz" Jun 11 15:02:47.542623 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.542598 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c98bn\" (UniqueName: \"kubernetes.io/projected/c1a1d2ac-69d9-4fd9-a430-4392613b148f-kube-api-access-c98bn\") pod \"node-resolver-fzhq9\" (UID: \"c1a1d2ac-69d9-4fd9-a430-4392613b148f\") " pod="openshift-dns/node-resolver-fzhq9" Jun 11 15:02:47.543983 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.543960 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dw8nz\" (UniqueName: \"kubernetes.io/projected/702ed42e-bdb8-4845-bc4d-cfa514fa6dff-kube-api-access-dw8nz\") pod \"aws-ebs-csi-driver-node-pl4zp\" (UID: \"702ed42e-bdb8-4845-bc4d-cfa514fa6dff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pl4zp" Jun 11 15:02:47.620007 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.619976 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/77786904-9829-4966-9657-c97854cb6555-run-ovn\") pod \"ovnkube-node-5lcln\" (UID: \"77786904-9829-4966-9657-c97854cb6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lcln" Jun 11 15:02:47.620158 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.620012 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/77786904-9829-4966-9657-c97854cb6555-host-cni-netd\") pod \"ovnkube-node-5lcln\" (UID: \"77786904-9829-4966-9657-c97854cb6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lcln" Jun 11 15:02:47.620158 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.620035 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5b430c4f-2679-47e4-bf04-6037fbd86c34-system-cni-dir\") pod \"multus-6779b\" (UID: \"5b430c4f-2679-47e4-bf04-6037fbd86c34\") " pod="openshift-multus/multus-6779b" Jun 11 15:02:47.620158 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.620104 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/77786904-9829-4966-9657-c97854cb6555-run-ovn\") pod \"ovnkube-node-5lcln\" (UID: \"77786904-9829-4966-9657-c97854cb6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lcln" Jun 11 15:02:47.620278 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.620163 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/77786904-9829-4966-9657-c97854cb6555-host-cni-netd\") pod \"ovnkube-node-5lcln\" (UID: \"77786904-9829-4966-9657-c97854cb6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lcln" Jun 11 15:02:47.620278 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.620224 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5b430c4f-2679-47e4-bf04-6037fbd86c34-cni-binary-copy\") pod \"multus-6779b\" (UID: \"5b430c4f-2679-47e4-bf04-6037fbd86c34\") " pod="openshift-multus/multus-6779b" Jun 11 15:02:47.620278 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.620233 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5b430c4f-2679-47e4-bf04-6037fbd86c34-system-cni-dir\") pod \"multus-6779b\" (UID: \"5b430c4f-2679-47e4-bf04-6037fbd86c34\") " pod="openshift-multus/multus-6779b" Jun 11 15:02:47.620278 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.620257 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5b430c4f-2679-47e4-bf04-6037fbd86c34-host-var-lib-kubelet\") pod \"multus-6779b\" (UID: \"5b430c4f-2679-47e4-bf04-6037fbd86c34\") " pod="openshift-multus/multus-6779b" Jun 11 15:02:47.620470 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.620280 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/77786904-9829-4966-9657-c97854cb6555-host-run-ovn-kubernetes\") pod \"ovnkube-node-5lcln\" (UID: \"77786904-9829-4966-9657-c97854cb6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lcln" Jun 11 15:02:47.620470 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.620309 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/77786904-9829-4966-9657-c97854cb6555-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5lcln\" (UID: \"77786904-9829-4966-9657-c97854cb6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lcln" Jun 11 15:02:47.620470 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.620334 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a5ddf0c9-e1fc-49b7-9adb-80504c04c71b-agent-certs\") pod \"konnectivity-agent-gjwn5\" (UID: \"a5ddf0c9-e1fc-49b7-9adb-80504c04c71b\") " pod="kube-system/konnectivity-agent-gjwn5" Jun 11 15:02:47.620470 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.620357 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/77786904-9829-4966-9657-c97854cb6555-host-slash\") pod \"ovnkube-node-5lcln\" (UID: \"77786904-9829-4966-9657-c97854cb6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lcln" Jun 11 15:02:47.620470 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.620370 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5b430c4f-2679-47e4-bf04-6037fbd86c34-host-var-lib-kubelet\") pod \"multus-6779b\" (UID: \"5b430c4f-2679-47e4-bf04-6037fbd86c34\") " pod="openshift-multus/multus-6779b" Jun 11 15:02:47.620470 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.620379 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/77786904-9829-4966-9657-c97854cb6555-ovn-node-metrics-cert\") pod \"ovnkube-node-5lcln\" (UID: \"77786904-9829-4966-9657-c97854cb6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lcln" Jun 11 15:02:47.620470 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.620430 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2psc5\" (UniqueName: \"kubernetes.io/projected/e8d0e901-1b06-4e8a-b6af-a2b11c8ad7b4-kube-api-access-2psc5\") pod \"iptables-alerter-lqrrd\" (UID: \"e8d0e901-1b06-4e8a-b6af-a2b11c8ad7b4\") " pod="openshift-network-operator/iptables-alerter-lqrrd" Jun 11 15:02:47.620470 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.620456 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a5ddf0c9-e1fc-49b7-9adb-80504c04c71b-konnectivity-ca\") pod \"konnectivity-agent-gjwn5\" (UID: \"a5ddf0c9-e1fc-49b7-9adb-80504c04c71b\") " pod="kube-system/konnectivity-agent-gjwn5" Jun 11 15:02:47.620879 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.620481 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hf72t\" (UniqueName: \"kubernetes.io/projected/a79c1c7a-ce77-499f-8f15-ea44cd93aeb2-kube-api-access-hf72t\") pod \"network-metrics-daemon-6zlq9\" (UID: \"a79c1c7a-ce77-499f-8f15-ea44cd93aeb2\") " pod="openshift-multus/network-metrics-daemon-6zlq9" Jun 11 15:02:47.620879 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.620507 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a79c1c7a-ce77-499f-8f15-ea44cd93aeb2-metrics-certs\") pod \"network-metrics-daemon-6zlq9\" (UID: \"a79c1c7a-ce77-499f-8f15-ea44cd93aeb2\") " pod="openshift-multus/network-metrics-daemon-6zlq9" Jun 11 15:02:47.620879 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.620561 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/77786904-9829-4966-9657-c97854cb6555-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5lcln\" (UID: \"77786904-9829-4966-9657-c97854cb6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lcln" Jun 11 15:02:47.620879 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:02:47.620592 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 15:02:47.620879 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.620612 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5b430c4f-2679-47e4-bf04-6037fbd86c34-multus-cni-dir\") pod \"multus-6779b\" (UID: \"5b430c4f-2679-47e4-bf04-6037fbd86c34\") " pod="openshift-multus/multus-6779b" Jun 11 15:02:47.620879 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:02:47.620644 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a79c1c7a-ce77-499f-8f15-ea44cd93aeb2-metrics-certs podName:a79c1c7a-ce77-499f-8f15-ea44cd93aeb2 nodeName:}" failed. No retries permitted until 2026-06-11 15:02:48.120628658 +0000 UTC m=+3.069252899 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a79c1c7a-ce77-499f-8f15-ea44cd93aeb2-metrics-certs") pod "network-metrics-daemon-6zlq9" (UID: "a79c1c7a-ce77-499f-8f15-ea44cd93aeb2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 15:02:47.620879 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.620661 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/77786904-9829-4966-9657-c97854cb6555-ovnkube-config\") pod \"ovnkube-node-5lcln\" (UID: \"77786904-9829-4966-9657-c97854cb6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lcln" Jun 11 15:02:47.620879 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.620678 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5b430c4f-2679-47e4-bf04-6037fbd86c34-multus-cni-dir\") pod \"multus-6779b\" (UID: \"5b430c4f-2679-47e4-bf04-6037fbd86c34\") " pod="openshift-multus/multus-6779b" Jun 11 15:02:47.620879 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.620688 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5b430c4f-2679-47e4-bf04-6037fbd86c34-hostroot\") pod \"multus-6779b\" (UID: \"5b430c4f-2679-47e4-bf04-6037fbd86c34\") " pod="openshift-multus/multus-6779b" Jun 11 15:02:47.620879 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.620711 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5b430c4f-2679-47e4-bf04-6037fbd86c34-etc-kubernetes\") pod \"multus-6779b\" (UID: \"5b430c4f-2679-47e4-bf04-6037fbd86c34\") " pod="openshift-multus/multus-6779b" Jun 11 15:02:47.620879 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.620718 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/77786904-9829-4966-9657-c97854cb6555-host-run-ovn-kubernetes\") pod \"ovnkube-node-5lcln\" (UID: \"77786904-9829-4966-9657-c97854cb6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lcln" Jun 11 15:02:47.620879 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.620743 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4j9tx\" (UniqueName: \"kubernetes.io/projected/5b430c4f-2679-47e4-bf04-6037fbd86c34-kube-api-access-4j9tx\") pod \"multus-6779b\" (UID: \"5b430c4f-2679-47e4-bf04-6037fbd86c34\") " pod="openshift-multus/multus-6779b" Jun 11 15:02:47.620879 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.620795 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5b430c4f-2679-47e4-bf04-6037fbd86c34-cnibin\") pod \"multus-6779b\" (UID: \"5b430c4f-2679-47e4-bf04-6037fbd86c34\") " pod="openshift-multus/multus-6779b" Jun 11 15:02:47.620879 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.620797 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5b430c4f-2679-47e4-bf04-6037fbd86c34-cni-binary-copy\") pod \"multus-6779b\" (UID: \"5b430c4f-2679-47e4-bf04-6037fbd86c34\") " pod="openshift-multus/multus-6779b" Jun 11 15:02:47.620879 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.620817 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5b430c4f-2679-47e4-bf04-6037fbd86c34-multus-daemon-config\") pod \"multus-6779b\" (UID: \"5b430c4f-2679-47e4-bf04-6037fbd86c34\") " pod="openshift-multus/multus-6779b" Jun 11 15:02:47.620879 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.620842 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/77786904-9829-4966-9657-c97854cb6555-log-socket\") pod \"ovnkube-node-5lcln\" (UID: \"77786904-9829-4966-9657-c97854cb6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lcln" Jun 11 15:02:47.620879 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.620865 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5b430c4f-2679-47e4-bf04-6037fbd86c34-multus-socket-dir-parent\") pod \"multus-6779b\" (UID: \"5b430c4f-2679-47e4-bf04-6037fbd86c34\") " pod="openshift-multus/multus-6779b" Jun 11 15:02:47.621660 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.620888 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5b430c4f-2679-47e4-bf04-6037fbd86c34-host-var-lib-cni-multus\") pod \"multus-6779b\" (UID: \"5b430c4f-2679-47e4-bf04-6037fbd86c34\") " pod="openshift-multus/multus-6779b" Jun 11 15:02:47.621660 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.620919 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5b430c4f-2679-47e4-bf04-6037fbd86c34-multus-conf-dir\") pod \"multus-6779b\" (UID: \"5b430c4f-2679-47e4-bf04-6037fbd86c34\") " pod="openshift-multus/multus-6779b" Jun 11 15:02:47.621660 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.620951 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/77786904-9829-4966-9657-c97854cb6555-run-openvswitch\") pod \"ovnkube-node-5lcln\" (UID: \"77786904-9829-4966-9657-c97854cb6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lcln" Jun 11 15:02:47.621660 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.620974 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5b430c4f-2679-47e4-bf04-6037fbd86c34-etc-kubernetes\") pod \"multus-6779b\" (UID: \"5b430c4f-2679-47e4-bf04-6037fbd86c34\") " pod="openshift-multus/multus-6779b" Jun 11 15:02:47.621660 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.620990 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e8d0e901-1b06-4e8a-b6af-a2b11c8ad7b4-host-slash\") pod \"iptables-alerter-lqrrd\" (UID: \"e8d0e901-1b06-4e8a-b6af-a2b11c8ad7b4\") " pod="openshift-network-operator/iptables-alerter-lqrrd" Jun 11 15:02:47.621660 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.621014 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5b430c4f-2679-47e4-bf04-6037fbd86c34-host-run-multus-certs\") pod \"multus-6779b\" (UID: \"5b430c4f-2679-47e4-bf04-6037fbd86c34\") " pod="openshift-multus/multus-6779b" Jun 11 15:02:47.621660 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.621050 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/77786904-9829-4966-9657-c97854cb6555-ovnkube-script-lib\") pod \"ovnkube-node-5lcln\" (UID: \"77786904-9829-4966-9657-c97854cb6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lcln" Jun 11 15:02:47.621660 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.621079 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/77786904-9829-4966-9657-c97854cb6555-env-overrides\") pod \"ovnkube-node-5lcln\" (UID: \"77786904-9829-4966-9657-c97854cb6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lcln" Jun 11 15:02:47.621660 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.621107 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5x2sg\" (UniqueName: \"kubernetes.io/projected/77786904-9829-4966-9657-c97854cb6555-kube-api-access-5x2sg\") pod \"ovnkube-node-5lcln\" (UID: \"77786904-9829-4966-9657-c97854cb6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lcln" Jun 11 15:02:47.621660 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.621132 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e8d0e901-1b06-4e8a-b6af-a2b11c8ad7b4-iptables-alerter-script\") pod \"iptables-alerter-lqrrd\" (UID: \"e8d0e901-1b06-4e8a-b6af-a2b11c8ad7b4\") " pod="openshift-network-operator/iptables-alerter-lqrrd" Jun 11 15:02:47.621660 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.621163 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5b430c4f-2679-47e4-bf04-6037fbd86c34-os-release\") pod \"multus-6779b\" (UID: \"5b430c4f-2679-47e4-bf04-6037fbd86c34\") " pod="openshift-multus/multus-6779b" Jun 11 15:02:47.621660 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.621209 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/77786904-9829-4966-9657-c97854cb6555-run-openvswitch\") pod \"ovnkube-node-5lcln\" (UID: \"77786904-9829-4966-9657-c97854cb6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lcln" Jun 11 15:02:47.621660 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.621241 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5b430c4f-2679-47e4-bf04-6037fbd86c34-os-release\") pod \"multus-6779b\" (UID: \"5b430c4f-2679-47e4-bf04-6037fbd86c34\") " pod="openshift-multus/multus-6779b" Jun 11 15:02:47.621660 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.621245 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/77786904-9829-4966-9657-c97854cb6555-etc-openvswitch\") pod \"ovnkube-node-5lcln\" (UID: \"77786904-9829-4966-9657-c97854cb6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lcln" Jun 11 15:02:47.621660 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.621282 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/77786904-9829-4966-9657-c97854cb6555-etc-openvswitch\") pod \"ovnkube-node-5lcln\" (UID: \"77786904-9829-4966-9657-c97854cb6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lcln" Jun 11 15:02:47.621660 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.621285 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5b430c4f-2679-47e4-bf04-6037fbd86c34-host-run-k8s-cni-cncf-io\") pod \"multus-6779b\" (UID: \"5b430c4f-2679-47e4-bf04-6037fbd86c34\") " pod="openshift-multus/multus-6779b" Jun 11 15:02:47.621660 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.621312 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/77786904-9829-4966-9657-c97854cb6555-systemd-units\") pod \"ovnkube-node-5lcln\" (UID: \"77786904-9829-4966-9657-c97854cb6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lcln" Jun 11 15:02:47.621660 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.621331 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5b430c4f-2679-47e4-bf04-6037fbd86c34-cnibin\") pod \"multus-6779b\" (UID: \"5b430c4f-2679-47e4-bf04-6037fbd86c34\") " pod="openshift-multus/multus-6779b" Jun 11 15:02:47.622428 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.621357 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5b430c4f-2679-47e4-bf04-6037fbd86c34-host-var-lib-cni-bin\") pod \"multus-6779b\" (UID: \"5b430c4f-2679-47e4-bf04-6037fbd86c34\") " pod="openshift-multus/multus-6779b" Jun 11 15:02:47.622428 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.621370 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/77786904-9829-4966-9657-c97854cb6555-systemd-units\") pod \"ovnkube-node-5lcln\" (UID: \"77786904-9829-4966-9657-c97854cb6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lcln" Jun 11 15:02:47.622428 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.621384 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/77786904-9829-4966-9657-c97854cb6555-run-systemd\") pod \"ovnkube-node-5lcln\" (UID: \"77786904-9829-4966-9657-c97854cb6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lcln" Jun 11 15:02:47.622428 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.621408 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/77786904-9829-4966-9657-c97854cb6555-var-lib-openvswitch\") pod \"ovnkube-node-5lcln\" (UID: \"77786904-9829-4966-9657-c97854cb6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lcln" Jun 11 15:02:47.622428 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.621415 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e8d0e901-1b06-4e8a-b6af-a2b11c8ad7b4-host-slash\") pod \"iptables-alerter-lqrrd\" (UID: \"e8d0e901-1b06-4e8a-b6af-a2b11c8ad7b4\") " pod="openshift-network-operator/iptables-alerter-lqrrd" Jun 11 15:02:47.622428 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.621424 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/77786904-9829-4966-9657-c97854cb6555-ovnkube-config\") pod \"ovnkube-node-5lcln\" (UID: \"77786904-9829-4966-9657-c97854cb6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lcln" Jun 11 15:02:47.622428 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.621433 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/77786904-9829-4966-9657-c97854cb6555-host-cni-bin\") pod \"ovnkube-node-5lcln\" (UID: \"77786904-9829-4966-9657-c97854cb6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lcln" Jun 11 15:02:47.622428 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.621457 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5b430c4f-2679-47e4-bf04-6037fbd86c34-host-run-multus-certs\") pod \"multus-6779b\" (UID: \"5b430c4f-2679-47e4-bf04-6037fbd86c34\") " pod="openshift-multus/multus-6779b" Jun 11 15:02:47.622428 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.621462 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/77786904-9829-4966-9657-c97854cb6555-host-kubelet\") pod \"ovnkube-node-5lcln\" (UID: \"77786904-9829-4966-9657-c97854cb6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lcln" Jun 11 15:02:47.622428 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.621487 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/77786904-9829-4966-9657-c97854cb6555-host-run-netns\") pod \"ovnkube-node-5lcln\" (UID: \"77786904-9829-4966-9657-c97854cb6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lcln" Jun 11 15:02:47.622428 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.621498 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a5ddf0c9-e1fc-49b7-9adb-80504c04c71b-konnectivity-ca\") pod \"konnectivity-agent-gjwn5\" (UID: \"a5ddf0c9-e1fc-49b7-9adb-80504c04c71b\") " pod="kube-system/konnectivity-agent-gjwn5" Jun 11 15:02:47.622428 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.621520 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/77786904-9829-4966-9657-c97854cb6555-node-log\") pod \"ovnkube-node-5lcln\" (UID: \"77786904-9829-4966-9657-c97854cb6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lcln" Jun 11 15:02:47.622428 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.621546 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5b430c4f-2679-47e4-bf04-6037fbd86c34-host-run-netns\") pod \"multus-6779b\" (UID: \"5b430c4f-2679-47e4-bf04-6037fbd86c34\") " pod="openshift-multus/multus-6779b" Jun 11 15:02:47.622428 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.621560 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5b430c4f-2679-47e4-bf04-6037fbd86c34-multus-socket-dir-parent\") pod \"multus-6779b\" (UID: \"5b430c4f-2679-47e4-bf04-6037fbd86c34\") " pod="openshift-multus/multus-6779b" Jun 11 15:02:47.622428 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.621562 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/77786904-9829-4966-9657-c97854cb6555-log-socket\") pod \"ovnkube-node-5lcln\" (UID: \"77786904-9829-4966-9657-c97854cb6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lcln" Jun 11 15:02:47.622428 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.621504 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5b430c4f-2679-47e4-bf04-6037fbd86c34-multus-conf-dir\") pod \"multus-6779b\" (UID: \"5b430c4f-2679-47e4-bf04-6037fbd86c34\") " pod="openshift-multus/multus-6779b" Jun 11 15:02:47.622428 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.621464 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5b430c4f-2679-47e4-bf04-6037fbd86c34-hostroot\") pod \"multus-6779b\" (UID: \"5b430c4f-2679-47e4-bf04-6037fbd86c34\") " pod="openshift-multus/multus-6779b" Jun 11 15:02:47.622428 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.621623 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5b430c4f-2679-47e4-bf04-6037fbd86c34-host-var-lib-cni-bin\") pod \"multus-6779b\" (UID: \"5b430c4f-2679-47e4-bf04-6037fbd86c34\") " pod="openshift-multus/multus-6779b" Jun 11 15:02:47.623128 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.621662 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5b430c4f-2679-47e4-bf04-6037fbd86c34-host-run-netns\") pod \"multus-6779b\" (UID: \"5b430c4f-2679-47e4-bf04-6037fbd86c34\") " pod="openshift-multus/multus-6779b" Jun 11 15:02:47.623128 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.621693 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/77786904-9829-4966-9657-c97854cb6555-host-run-netns\") pod \"ovnkube-node-5lcln\" (UID: \"77786904-9829-4966-9657-c97854cb6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lcln" Jun 11 15:02:47.623128 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.621727 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/77786904-9829-4966-9657-c97854cb6555-run-systemd\") pod \"ovnkube-node-5lcln\" (UID: \"77786904-9829-4966-9657-c97854cb6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lcln" Jun 11 15:02:47.623128 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.621777 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/77786904-9829-4966-9657-c97854cb6555-var-lib-openvswitch\") pod \"ovnkube-node-5lcln\" (UID: \"77786904-9829-4966-9657-c97854cb6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lcln" Jun 11 15:02:47.623128 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.621810 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/77786904-9829-4966-9657-c97854cb6555-host-cni-bin\") pod \"ovnkube-node-5lcln\" (UID: \"77786904-9829-4966-9657-c97854cb6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lcln" Jun 11 15:02:47.623128 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.621844 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/77786904-9829-4966-9657-c97854cb6555-host-kubelet\") pod \"ovnkube-node-5lcln\" (UID: \"77786904-9829-4966-9657-c97854cb6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lcln" Jun 11 15:02:47.623128 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.621845 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/77786904-9829-4966-9657-c97854cb6555-env-overrides\") pod \"ovnkube-node-5lcln\" (UID: \"77786904-9829-4966-9657-c97854cb6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lcln" Jun 11 15:02:47.623128 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.621664 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5b430c4f-2679-47e4-bf04-6037fbd86c34-host-var-lib-cni-multus\") pod \"multus-6779b\" (UID: \"5b430c4f-2679-47e4-bf04-6037fbd86c34\") " pod="openshift-multus/multus-6779b" Jun 11 15:02:47.623128 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.621898 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5b430c4f-2679-47e4-bf04-6037fbd86c34-host-run-k8s-cni-cncf-io\") pod \"multus-6779b\" (UID: \"5b430c4f-2679-47e4-bf04-6037fbd86c34\") " pod="openshift-multus/multus-6779b" Jun 11 15:02:47.623128 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.621957 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/77786904-9829-4966-9657-c97854cb6555-node-log\") pod \"ovnkube-node-5lcln\" (UID: \"77786904-9829-4966-9657-c97854cb6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lcln" Jun 11 15:02:47.623128 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.621999 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/77786904-9829-4966-9657-c97854cb6555-host-slash\") pod \"ovnkube-node-5lcln\" (UID: \"77786904-9829-4966-9657-c97854cb6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lcln" Jun 11 15:02:47.623128 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.622203 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5b430c4f-2679-47e4-bf04-6037fbd86c34-multus-daemon-config\") pod \"multus-6779b\" (UID: \"5b430c4f-2679-47e4-bf04-6037fbd86c34\") " pod="openshift-multus/multus-6779b" Jun 11 15:02:47.623128 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.622457 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/77786904-9829-4966-9657-c97854cb6555-ovnkube-script-lib\") pod \"ovnkube-node-5lcln\" (UID: \"77786904-9829-4966-9657-c97854cb6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lcln" Jun 11 15:02:47.623128 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.622692 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e8d0e901-1b06-4e8a-b6af-a2b11c8ad7b4-iptables-alerter-script\") pod \"iptables-alerter-lqrrd\" (UID: \"e8d0e901-1b06-4e8a-b6af-a2b11c8ad7b4\") " pod="openshift-network-operator/iptables-alerter-lqrrd" Jun 11 15:02:47.623128 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.623134 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/77786904-9829-4966-9657-c97854cb6555-ovn-node-metrics-cert\") pod \"ovnkube-node-5lcln\" (UID: \"77786904-9829-4966-9657-c97854cb6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lcln" Jun 11 15:02:47.624206 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.624185 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a5ddf0c9-e1fc-49b7-9adb-80504c04c71b-agent-certs\") pod \"konnectivity-agent-gjwn5\" (UID: \"a5ddf0c9-e1fc-49b7-9adb-80504c04c71b\") " pod="kube-system/konnectivity-agent-gjwn5" Jun 11 15:02:47.639772 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.639630 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4j9tx\" (UniqueName: \"kubernetes.io/projected/5b430c4f-2679-47e4-bf04-6037fbd86c34-kube-api-access-4j9tx\") pod \"multus-6779b\" (UID: \"5b430c4f-2679-47e4-bf04-6037fbd86c34\") " pod="openshift-multus/multus-6779b" Jun 11 15:02:47.641907 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.641889 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2psc5\" (UniqueName: \"kubernetes.io/projected/e8d0e901-1b06-4e8a-b6af-a2b11c8ad7b4-kube-api-access-2psc5\") pod \"iptables-alerter-lqrrd\" (UID: \"e8d0e901-1b06-4e8a-b6af-a2b11c8ad7b4\") " pod="openshift-network-operator/iptables-alerter-lqrrd" Jun 11 15:02:47.642349 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.642332 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5x2sg\" (UniqueName: \"kubernetes.io/projected/77786904-9829-4966-9657-c97854cb6555-kube-api-access-5x2sg\") pod \"ovnkube-node-5lcln\" (UID: \"77786904-9829-4966-9657-c97854cb6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-5lcln" Jun 11 15:02:47.645616 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.645530 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hf72t\" (UniqueName: \"kubernetes.io/projected/a79c1c7a-ce77-499f-8f15-ea44cd93aeb2-kube-api-access-hf72t\") pod \"network-metrics-daemon-6zlq9\" (UID: \"a79c1c7a-ce77-499f-8f15-ea44cd93aeb2\") " pod="openshift-multus/network-metrics-daemon-6zlq9" Jun 11 15:02:47.707885 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.707858 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pqqnp" Jun 11 15:02:47.716053 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.716030 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fzhq9" Jun 11 15:02:47.725276 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.725256 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pl4zp" Jun 11 15:02:47.731078 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.731053 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-nshvv" Jun 11 15:02:47.739398 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.739366 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9fgfz" Jun 11 15:02:47.747975 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.747953 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6779b" Jun 11 15:02:47.754452 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.754428 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lqrrd" Jun 11 15:02:47.761302 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.761285 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5lcln" Jun 11 15:02:47.768312 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:47.768294 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gjwn5" Jun 11 15:02:48.024643 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:48.024612 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f5813fd7-de59-42f7-b4ee-de396547742d-original-pull-secret\") pod \"global-pull-secret-syncer-9xq6t\" (UID: \"f5813fd7-de59-42f7-b4ee-de396547742d\") " pod="kube-system/global-pull-secret-syncer-9xq6t" Jun 11 15:02:48.024833 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:02:48.024807 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 15:02:48.024881 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:02:48.024876 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5813fd7-de59-42f7-b4ee-de396547742d-original-pull-secret podName:f5813fd7-de59-42f7-b4ee-de396547742d nodeName:}" failed. No retries permitted until 2026-06-11 15:02:49.024855474 +0000 UTC m=+3.973479714 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f5813fd7-de59-42f7-b4ee-de396547742d-original-pull-secret") pod "global-pull-secret-syncer-9xq6t" (UID: "f5813fd7-de59-42f7-b4ee-de396547742d") : object "kube-system"/"original-pull-secret" not registered Jun 11 15:02:48.125403 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:48.125375 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9zg5\" (UniqueName: \"kubernetes.io/projected/5f5aa8b6-caed-490f-818a-9a245c7bba82-kube-api-access-w9zg5\") pod \"network-check-target-786s7\" (UID: \"5f5aa8b6-caed-490f-818a-9a245c7bba82\") " pod="openshift-network-diagnostics/network-check-target-786s7" Jun 11 15:02:48.125554 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:48.125441 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a79c1c7a-ce77-499f-8f15-ea44cd93aeb2-metrics-certs\") pod \"network-metrics-daemon-6zlq9\" (UID: \"a79c1c7a-ce77-499f-8f15-ea44cd93aeb2\") " pod="openshift-multus/network-metrics-daemon-6zlq9" Jun 11 15:02:48.125554 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:02:48.125518 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 15:02:48.125554 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:02:48.125543 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 15:02:48.125692 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:02:48.125566 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 15:02:48.125692 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:02:48.125570 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a79c1c7a-ce77-499f-8f15-ea44cd93aeb2-metrics-certs podName:a79c1c7a-ce77-499f-8f15-ea44cd93aeb2 nodeName:}" failed. No retries permitted until 2026-06-11 15:02:49.12555807 +0000 UTC m=+4.074182310 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a79c1c7a-ce77-499f-8f15-ea44cd93aeb2-metrics-certs") pod "network-metrics-daemon-6zlq9" (UID: "a79c1c7a-ce77-499f-8f15-ea44cd93aeb2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 15:02:48.125692 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:02:48.125577 2569 projected.go:196] Error preparing data for projected volume kube-api-access-w9zg5 for pod openshift-network-diagnostics/network-check-target-786s7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 15:02:48.125692 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:02:48.125618 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5f5aa8b6-caed-490f-818a-9a245c7bba82-kube-api-access-w9zg5 podName:5f5aa8b6-caed-490f-818a-9a245c7bba82 nodeName:}" failed. No retries permitted until 2026-06-11 15:02:49.125604923 +0000 UTC m=+4.074229163 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-w9zg5" (UniqueName: "kubernetes.io/projected/5f5aa8b6-caed-490f-818a-9a245c7bba82-kube-api-access-w9zg5") pod "network-check-target-786s7" (UID: "5f5aa8b6-caed-490f-818a-9a245c7bba82") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 15:02:48.346031 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:48.346001 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4dca31c7_6860_4b5c_8631_a8e7d5a09d72.slice/crio-e3e38ee7cc41e03970506e2b47e869e22c3c32314f1010faf89b2e7097be3eb5 WatchSource:0}: Error finding container e3e38ee7cc41e03970506e2b47e869e22c3c32314f1010faf89b2e7097be3eb5: Status 404 returned error can't find the container with id e3e38ee7cc41e03970506e2b47e869e22c3c32314f1010faf89b2e7097be3eb5 Jun 11 15:02:48.348102 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:48.347955 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b430c4f_2679_47e4_bf04_6037fbd86c34.slice/crio-65e403187bb8f90bf044073d45ce92fe24756053c555e3ea937de6d3655fd1d7 WatchSource:0}: Error finding container 65e403187bb8f90bf044073d45ce92fe24756053c555e3ea937de6d3655fd1d7: Status 404 returned error can't find the container with id 65e403187bb8f90bf044073d45ce92fe24756053c555e3ea937de6d3655fd1d7 Jun 11 15:02:48.351076 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:48.351053 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a10fef5_133c_4a0b_85d5_2af4705ce4e2.slice/crio-5181b71b0bea1e1127118371fa3cfa05baaa03c06dc4b19837f205328d50cb16 WatchSource:0}: Error finding container 5181b71b0bea1e1127118371fa3cfa05baaa03c06dc4b19837f205328d50cb16: Status 404 returned error can't find the container with id 5181b71b0bea1e1127118371fa3cfa05baaa03c06dc4b19837f205328d50cb16 Jun 11 15:02:48.352504 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:48.352345 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5ddf0c9_e1fc_49b7_9adb_80504c04c71b.slice/crio-e725c84cbf7d7e58ccd6177e481f740004ace4054a0ebbaea7b4df8dcf07eff6 WatchSource:0}: Error finding container e725c84cbf7d7e58ccd6177e481f740004ace4054a0ebbaea7b4df8dcf07eff6: Status 404 returned error can't find the container with id e725c84cbf7d7e58ccd6177e481f740004ace4054a0ebbaea7b4df8dcf07eff6 Jun 11 15:02:48.353275 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:48.353254 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8d0e901_1b06_4e8a_b6af_a2b11c8ad7b4.slice/crio-7da559d2625eb67c68cdd89acc3adf9e35973c9e341645d8cacae7c5894aaae4 WatchSource:0}: Error finding container 7da559d2625eb67c68cdd89acc3adf9e35973c9e341645d8cacae7c5894aaae4: Status 404 returned error can't find the container with id 7da559d2625eb67c68cdd89acc3adf9e35973c9e341645d8cacae7c5894aaae4 Jun 11 15:02:48.354072 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:48.354049 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod702ed42e_bdb8_4845_bc4d_cfa514fa6dff.slice/crio-31fd8ab557d2c2ddaf0e5d140c12f027145a9bcbfd655fb9a999fe52224412e7 WatchSource:0}: Error finding container 31fd8ab557d2c2ddaf0e5d140c12f027145a9bcbfd655fb9a999fe52224412e7: Status 404 returned error can't find the container with id 31fd8ab557d2c2ddaf0e5d140c12f027145a9bcbfd655fb9a999fe52224412e7 Jun 11 15:02:48.355743 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:48.355428 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1a1d2ac_69d9_4fd9_a430_4392613b148f.slice/crio-65fc72efba3473e8c607a3d6365ea6cb9bb18de19cb2735d02bbc4e4d6cec2c0 WatchSource:0}: Error finding container 65fc72efba3473e8c607a3d6365ea6cb9bb18de19cb2735d02bbc4e4d6cec2c0: Status 404 returned error can't find the container with id 65fc72efba3473e8c607a3d6365ea6cb9bb18de19cb2735d02bbc4e4d6cec2c0 Jun 11 15:02:48.356319 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:48.356292 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9329cd7d_8d39_4a1a_b7da_d6604e6274bb.slice/crio-6749795b84215f42e0ce2d49453bf8eecf1798addd9924f94de0378d8b981982 WatchSource:0}: Error finding container 6749795b84215f42e0ce2d49453bf8eecf1798addd9924f94de0378d8b981982: Status 404 returned error can't find the container with id 6749795b84215f42e0ce2d49453bf8eecf1798addd9924f94de0378d8b981982 Jun 11 15:02:48.357518 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:02:48.357497 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77786904_9829_4966_9657_c97854cb6555.slice/crio-9730d68c353022e8ce0f39c14e92da63c9ea688a6748128f2e17191391fbdc54 WatchSource:0}: Error finding container 9730d68c353022e8ce0f39c14e92da63c9ea688a6748128f2e17191391fbdc54: Status 404 returned error can't find the container with id 9730d68c353022e8ce0f39c14e92da63c9ea688a6748128f2e17191391fbdc54 Jun 11 15:02:48.484734 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:48.484702 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-147.ec2.internal" event={"ID":"40e5bb6ad17f9c3a0001225289b11e90","Type":"ContainerStarted","Data":"2dae5430a18f9dfdd82bd0cd1be5e2fb8361d92de6031396ecc92632e33090cb"} Jun 11 15:02:48.486000 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:48.485969 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5lcln" event={"ID":"77786904-9829-4966-9657-c97854cb6555","Type":"ContainerStarted","Data":"9730d68c353022e8ce0f39c14e92da63c9ea688a6748128f2e17191391fbdc54"} Jun 11 15:02:48.486962 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:48.486939 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fzhq9" event={"ID":"c1a1d2ac-69d9-4fd9-a430-4392613b148f","Type":"ContainerStarted","Data":"65fc72efba3473e8c607a3d6365ea6cb9bb18de19cb2735d02bbc4e4d6cec2c0"} Jun 11 15:02:48.488047 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:48.488024 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lqrrd" event={"ID":"e8d0e901-1b06-4e8a-b6af-a2b11c8ad7b4","Type":"ContainerStarted","Data":"7da559d2625eb67c68cdd89acc3adf9e35973c9e341645d8cacae7c5894aaae4"} Jun 11 15:02:48.489082 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:48.489059 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gjwn5" event={"ID":"a5ddf0c9-e1fc-49b7-9adb-80504c04c71b","Type":"ContainerStarted","Data":"e725c84cbf7d7e58ccd6177e481f740004ace4054a0ebbaea7b4df8dcf07eff6"} Jun 11 15:02:48.490109 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:48.490083 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-nshvv" event={"ID":"6a10fef5-133c-4a0b-85d5-2af4705ce4e2","Type":"ContainerStarted","Data":"5181b71b0bea1e1127118371fa3cfa05baaa03c06dc4b19837f205328d50cb16"} Jun 11 15:02:48.490697 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:48.490653 2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 14:57:47 +0000 UTC" deadline="2027-12-25 03:57:16.448367512 +0000 UTC" Jun 11 15:02:48.490697 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:48.490696 2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13476h54m27.957674759s" Jun 11 15:02:48.491240 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:48.491213 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9fgfz" event={"ID":"9329cd7d-8d39-4a1a-b7da-d6604e6274bb","Type":"ContainerStarted","Data":"6749795b84215f42e0ce2d49453bf8eecf1798addd9924f94de0378d8b981982"} Jun 11 15:02:48.492264 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:48.492245 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pl4zp" event={"ID":"702ed42e-bdb8-4845-bc4d-cfa514fa6dff","Type":"ContainerStarted","Data":"31fd8ab557d2c2ddaf0e5d140c12f027145a9bcbfd655fb9a999fe52224412e7"} Jun 11 15:02:48.493484 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:48.493463 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6779b" event={"ID":"5b430c4f-2679-47e4-bf04-6037fbd86c34","Type":"ContainerStarted","Data":"65e403187bb8f90bf044073d45ce92fe24756053c555e3ea937de6d3655fd1d7"} Jun 11 15:02:48.494436 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:48.494418 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pqqnp" event={"ID":"4dca31c7-6860-4b5c-8631-a8e7d5a09d72","Type":"ContainerStarted","Data":"e3e38ee7cc41e03970506e2b47e869e22c3c32314f1010faf89b2e7097be3eb5"} Jun 11 15:02:48.513597 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:48.513560 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-147.ec2.internal" podStartSLOduration=2.51354887 podStartE2EDuration="2.51354887s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 15:02:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:02:48.513250923 +0000 UTC m=+3.461875186" watchObservedRunningTime="2026-06-11 15:02:48.51354887 +0000 UTC m=+3.462173131" Jun 11 15:02:49.033467 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:49.033331 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f5813fd7-de59-42f7-b4ee-de396547742d-original-pull-secret\") pod \"global-pull-secret-syncer-9xq6t\" (UID: \"f5813fd7-de59-42f7-b4ee-de396547742d\") " pod="kube-system/global-pull-secret-syncer-9xq6t" Jun 11 15:02:49.033624 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:02:49.033477 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 15:02:49.033624 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:02:49.033541 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5813fd7-de59-42f7-b4ee-de396547742d-original-pull-secret podName:f5813fd7-de59-42f7-b4ee-de396547742d nodeName:}" failed. No retries permitted until 2026-06-11 15:02:51.033521742 +0000 UTC m=+5.982146002 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f5813fd7-de59-42f7-b4ee-de396547742d-original-pull-secret") pod "global-pull-secret-syncer-9xq6t" (UID: "f5813fd7-de59-42f7-b4ee-de396547742d") : object "kube-system"/"original-pull-secret" not registered Jun 11 15:02:49.134042 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:49.134006 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a79c1c7a-ce77-499f-8f15-ea44cd93aeb2-metrics-certs\") pod \"network-metrics-daemon-6zlq9\" (UID: \"a79c1c7a-ce77-499f-8f15-ea44cd93aeb2\") " pod="openshift-multus/network-metrics-daemon-6zlq9" Jun 11 15:02:49.134219 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:49.134056 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9zg5\" (UniqueName: \"kubernetes.io/projected/5f5aa8b6-caed-490f-818a-9a245c7bba82-kube-api-access-w9zg5\") pod \"network-check-target-786s7\" (UID: \"5f5aa8b6-caed-490f-818a-9a245c7bba82\") " pod="openshift-network-diagnostics/network-check-target-786s7" Jun 11 15:02:49.134219 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:02:49.134194 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 15:02:49.134219 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:02:49.134213 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 15:02:49.134374 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:02:49.134225 2569 projected.go:196] Error preparing data for projected volume kube-api-access-w9zg5 for pod openshift-network-diagnostics/network-check-target-786s7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 15:02:49.134374 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:02:49.134194 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 15:02:49.134374 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:02:49.134282 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5f5aa8b6-caed-490f-818a-9a245c7bba82-kube-api-access-w9zg5 podName:5f5aa8b6-caed-490f-818a-9a245c7bba82 nodeName:}" failed. No retries permitted until 2026-06-11 15:02:51.134265215 +0000 UTC m=+6.082889461 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-w9zg5" (UniqueName: "kubernetes.io/projected/5f5aa8b6-caed-490f-818a-9a245c7bba82-kube-api-access-w9zg5") pod "network-check-target-786s7" (UID: "5f5aa8b6-caed-490f-818a-9a245c7bba82") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 15:02:49.134374 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:02:49.134326 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a79c1c7a-ce77-499f-8f15-ea44cd93aeb2-metrics-certs podName:a79c1c7a-ce77-499f-8f15-ea44cd93aeb2 nodeName:}" failed. No retries permitted until 2026-06-11 15:02:51.13430839 +0000 UTC m=+6.082932633 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a79c1c7a-ce77-499f-8f15-ea44cd93aeb2-metrics-certs") pod "network-metrics-daemon-6zlq9" (UID: "a79c1c7a-ce77-499f-8f15-ea44cd93aeb2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 15:02:49.477613 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:49.476723 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9xq6t" Jun 11 15:02:49.477613 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:02:49.476881 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9xq6t" podUID="f5813fd7-de59-42f7-b4ee-de396547742d" Jun 11 15:02:49.477613 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:49.477265 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-786s7" Jun 11 15:02:49.477613 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:02:49.477356 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-786s7" podUID="5f5aa8b6-caed-490f-818a-9a245c7bba82" Jun 11 15:02:49.477613 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:49.477428 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6zlq9" Jun 11 15:02:49.477613 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:02:49.477513 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6zlq9" podUID="a79c1c7a-ce77-499f-8f15-ea44cd93aeb2" Jun 11 15:02:49.490870 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:49.490821 2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 14:57:47 +0000 UTC" deadline="2027-11-19 04:35:59.708999007 +0000 UTC" Jun 11 15:02:49.490870 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:49.490848 2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12613h33m10.218155277s" Jun 11 15:02:49.506657 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:49.506629 2569 generic.go:356] "Generic (PLEG): container finished" podID="759a219e0bec71c2eaeea66fcc1c48b7" containerID="0a56947bd9d8817df58df6da2e7f22a78e339ac3be82317044db209971616d95" exitCode=0 Jun 11 15:02:49.507491 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:49.507466 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-147.ec2.internal" event={"ID":"759a219e0bec71c2eaeea66fcc1c48b7","Type":"ContainerDied","Data":"0a56947bd9d8817df58df6da2e7f22a78e339ac3be82317044db209971616d95"} Jun 11 15:02:50.516204 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:50.515916 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-147.ec2.internal" event={"ID":"759a219e0bec71c2eaeea66fcc1c48b7","Type":"ContainerStarted","Data":"4ca66b5c76d84d611972036d337f1257e222054e6faa0aa8c2597c8d08fd1e54"} Jun 11 15:02:50.539413 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:50.539359 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-147.ec2.internal" podStartSLOduration=4.539340041 podStartE2EDuration="4.539340041s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 15:02:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:02:50.539049384 +0000 UTC m=+5.487673647" watchObservedRunningTime="2026-06-11 15:02:50.539340041 +0000 UTC m=+5.487964304" Jun 11 15:02:51.050857 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:51.050816 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f5813fd7-de59-42f7-b4ee-de396547742d-original-pull-secret\") pod \"global-pull-secret-syncer-9xq6t\" (UID: \"f5813fd7-de59-42f7-b4ee-de396547742d\") " pod="kube-system/global-pull-secret-syncer-9xq6t" Jun 11 15:02:51.051038 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:02:51.051015 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 15:02:51.051102 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:02:51.051080 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5813fd7-de59-42f7-b4ee-de396547742d-original-pull-secret podName:f5813fd7-de59-42f7-b4ee-de396547742d nodeName:}" failed. No retries permitted until 2026-06-11 15:02:55.051059884 +0000 UTC m=+9.999684126 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f5813fd7-de59-42f7-b4ee-de396547742d-original-pull-secret") pod "global-pull-secret-syncer-9xq6t" (UID: "f5813fd7-de59-42f7-b4ee-de396547742d") : object "kube-system"/"original-pull-secret" not registered Jun 11 15:02:51.151987 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:51.151952 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a79c1c7a-ce77-499f-8f15-ea44cd93aeb2-metrics-certs\") pod \"network-metrics-daemon-6zlq9\" (UID: \"a79c1c7a-ce77-499f-8f15-ea44cd93aeb2\") " pod="openshift-multus/network-metrics-daemon-6zlq9" Jun 11 15:02:51.152145 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:51.152000 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9zg5\" (UniqueName: \"kubernetes.io/projected/5f5aa8b6-caed-490f-818a-9a245c7bba82-kube-api-access-w9zg5\") pod \"network-check-target-786s7\" (UID: \"5f5aa8b6-caed-490f-818a-9a245c7bba82\") " pod="openshift-network-diagnostics/network-check-target-786s7" Jun 11 15:02:51.152206 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:02:51.152148 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 15:02:51.152206 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:02:51.152167 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 15:02:51.152206 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:02:51.152181 2569 projected.go:196] Error preparing data for projected volume kube-api-access-w9zg5 for pod openshift-network-diagnostics/network-check-target-786s7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 15:02:51.152300 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:02:51.152237 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5f5aa8b6-caed-490f-818a-9a245c7bba82-kube-api-access-w9zg5 podName:5f5aa8b6-caed-490f-818a-9a245c7bba82 nodeName:}" failed. No retries permitted until 2026-06-11 15:02:55.15221891 +0000 UTC m=+10.100843162 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-w9zg5" (UniqueName: "kubernetes.io/projected/5f5aa8b6-caed-490f-818a-9a245c7bba82-kube-api-access-w9zg5") pod "network-check-target-786s7" (UID: "5f5aa8b6-caed-490f-818a-9a245c7bba82") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 15:02:51.152628 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:02:51.152609 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 15:02:51.152702 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:02:51.152666 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a79c1c7a-ce77-499f-8f15-ea44cd93aeb2-metrics-certs podName:a79c1c7a-ce77-499f-8f15-ea44cd93aeb2 nodeName:}" failed. No retries permitted until 2026-06-11 15:02:55.152651078 +0000 UTC m=+10.101275318 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a79c1c7a-ce77-499f-8f15-ea44cd93aeb2-metrics-certs") pod "network-metrics-daemon-6zlq9" (UID: "a79c1c7a-ce77-499f-8f15-ea44cd93aeb2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 15:02:51.474527 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:51.474451 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-786s7" Jun 11 15:02:51.474527 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:51.474501 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9xq6t" Jun 11 15:02:51.474685 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:51.474458 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6zlq9" Jun 11 15:02:51.474685 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:02:51.474591 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-786s7" podUID="5f5aa8b6-caed-490f-818a-9a245c7bba82" Jun 11 15:02:51.474748 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:02:51.474707 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6zlq9" podUID="a79c1c7a-ce77-499f-8f15-ea44cd93aeb2" Jun 11 15:02:51.474844 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:02:51.474820 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9xq6t" podUID="f5813fd7-de59-42f7-b4ee-de396547742d" Jun 11 15:02:53.474818 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:53.474779 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-786s7" Jun 11 15:02:53.475277 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:53.474779 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9xq6t" Jun 11 15:02:53.475277 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:02:53.474913 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-786s7" podUID="5f5aa8b6-caed-490f-818a-9a245c7bba82" Jun 11 15:02:53.475277 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:53.474926 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6zlq9" Jun 11 15:02:53.475277 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:02:53.474977 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9xq6t" podUID="f5813fd7-de59-42f7-b4ee-de396547742d" Jun 11 15:02:53.475277 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:02:53.475052 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6zlq9" podUID="a79c1c7a-ce77-499f-8f15-ea44cd93aeb2" Jun 11 15:02:55.083078 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:55.083037 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f5813fd7-de59-42f7-b4ee-de396547742d-original-pull-secret\") pod \"global-pull-secret-syncer-9xq6t\" (UID: \"f5813fd7-de59-42f7-b4ee-de396547742d\") " pod="kube-system/global-pull-secret-syncer-9xq6t" Jun 11 15:02:55.083611 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:02:55.083204 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 15:02:55.083611 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:02:55.083292 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5813fd7-de59-42f7-b4ee-de396547742d-original-pull-secret podName:f5813fd7-de59-42f7-b4ee-de396547742d nodeName:}" failed. No retries permitted until 2026-06-11 15:03:03.083265656 +0000 UTC m=+18.031889913 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f5813fd7-de59-42f7-b4ee-de396547742d-original-pull-secret") pod "global-pull-secret-syncer-9xq6t" (UID: "f5813fd7-de59-42f7-b4ee-de396547742d") : object "kube-system"/"original-pull-secret" not registered Jun 11 15:02:55.183701 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:55.183664 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a79c1c7a-ce77-499f-8f15-ea44cd93aeb2-metrics-certs\") pod \"network-metrics-daemon-6zlq9\" (UID: \"a79c1c7a-ce77-499f-8f15-ea44cd93aeb2\") " pod="openshift-multus/network-metrics-daemon-6zlq9" Jun 11 15:02:55.183701 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:55.183704 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9zg5\" (UniqueName: \"kubernetes.io/projected/5f5aa8b6-caed-490f-818a-9a245c7bba82-kube-api-access-w9zg5\") pod \"network-check-target-786s7\" (UID: \"5f5aa8b6-caed-490f-818a-9a245c7bba82\") " pod="openshift-network-diagnostics/network-check-target-786s7" Jun 11 15:02:55.183965 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:02:55.183842 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 15:02:55.183965 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:02:55.183917 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a79c1c7a-ce77-499f-8f15-ea44cd93aeb2-metrics-certs podName:a79c1c7a-ce77-499f-8f15-ea44cd93aeb2 nodeName:}" failed. No retries permitted until 2026-06-11 15:03:03.183896898 +0000 UTC m=+18.132521154 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a79c1c7a-ce77-499f-8f15-ea44cd93aeb2-metrics-certs") pod "network-metrics-daemon-6zlq9" (UID: "a79c1c7a-ce77-499f-8f15-ea44cd93aeb2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 15:02:55.183965 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:02:55.183846 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 15:02:55.184148 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:02:55.183987 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 15:02:55.184148 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:02:55.184004 2569 projected.go:196] Error preparing data for projected volume kube-api-access-w9zg5 for pod openshift-network-diagnostics/network-check-target-786s7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 15:02:55.184148 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:02:55.184057 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5f5aa8b6-caed-490f-818a-9a245c7bba82-kube-api-access-w9zg5 podName:5f5aa8b6-caed-490f-818a-9a245c7bba82 nodeName:}" failed. No retries permitted until 2026-06-11 15:03:03.184043631 +0000 UTC m=+18.132667871 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-w9zg5" (UniqueName: "kubernetes.io/projected/5f5aa8b6-caed-490f-818a-9a245c7bba82-kube-api-access-w9zg5") pod "network-check-target-786s7" (UID: "5f5aa8b6-caed-490f-818a-9a245c7bba82") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 15:02:55.474850 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:55.474746 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-786s7" Jun 11 15:02:55.474985 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:55.474854 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6zlq9" Jun 11 15:02:55.474985 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:55.474885 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9xq6t" Jun 11 15:02:55.474985 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:02:55.474936 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-786s7" podUID="5f5aa8b6-caed-490f-818a-9a245c7bba82" Jun 11 15:02:55.474985 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:02:55.474962 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9xq6t" podUID="f5813fd7-de59-42f7-b4ee-de396547742d" Jun 11 15:02:55.475186 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:02:55.475041 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6zlq9" podUID="a79c1c7a-ce77-499f-8f15-ea44cd93aeb2" Jun 11 15:02:57.474793 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:57.474745 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9xq6t" Jun 11 15:02:57.475281 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:57.474768 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-786s7" Jun 11 15:02:57.475281 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:57.474885 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6zlq9" Jun 11 15:02:57.475281 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:02:57.474901 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9xq6t" podUID="f5813fd7-de59-42f7-b4ee-de396547742d" Jun 11 15:02:57.475281 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:02:57.475026 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6zlq9" podUID="a79c1c7a-ce77-499f-8f15-ea44cd93aeb2" Jun 11 15:02:57.475281 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:02:57.475206 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-786s7" podUID="5f5aa8b6-caed-490f-818a-9a245c7bba82" Jun 11 15:02:59.475444 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:59.474737 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9xq6t" Jun 11 15:02:59.475444 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:59.474737 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6zlq9" Jun 11 15:02:59.475444 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:02:59.474882 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-786s7" Jun 11 15:02:59.475444 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:02:59.474887 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9xq6t" podUID="f5813fd7-de59-42f7-b4ee-de396547742d" Jun 11 15:02:59.475444 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:02:59.474994 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6zlq9" podUID="a79c1c7a-ce77-499f-8f15-ea44cd93aeb2" Jun 11 15:02:59.475444 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:02:59.475073 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-786s7" podUID="5f5aa8b6-caed-490f-818a-9a245c7bba82" Jun 11 15:03:01.473887 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:01.473852 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6zlq9" Jun 11 15:03:01.474336 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:01.473857 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-786s7" Jun 11 15:03:01.474336 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:03:01.474010 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6zlq9" podUID="a79c1c7a-ce77-499f-8f15-ea44cd93aeb2" Jun 11 15:03:01.474336 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:01.473858 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9xq6t" Jun 11 15:03:01.474336 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:03:01.474061 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-786s7" podUID="5f5aa8b6-caed-490f-818a-9a245c7bba82" Jun 11 15:03:01.474336 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:03:01.474116 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9xq6t" podUID="f5813fd7-de59-42f7-b4ee-de396547742d" Jun 11 15:03:03.148221 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:03.148185 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f5813fd7-de59-42f7-b4ee-de396547742d-original-pull-secret\") pod \"global-pull-secret-syncer-9xq6t\" (UID: \"f5813fd7-de59-42f7-b4ee-de396547742d\") " pod="kube-system/global-pull-secret-syncer-9xq6t" Jun 11 15:03:03.148696 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:03:03.148370 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 15:03:03.148696 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:03:03.148451 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5813fd7-de59-42f7-b4ee-de396547742d-original-pull-secret podName:f5813fd7-de59-42f7-b4ee-de396547742d nodeName:}" failed. No retries permitted until 2026-06-11 15:03:19.148428764 +0000 UTC m=+34.097053009 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f5813fd7-de59-42f7-b4ee-de396547742d-original-pull-secret") pod "global-pull-secret-syncer-9xq6t" (UID: "f5813fd7-de59-42f7-b4ee-de396547742d") : object "kube-system"/"original-pull-secret" not registered Jun 11 15:03:03.248922 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:03.248874 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a79c1c7a-ce77-499f-8f15-ea44cd93aeb2-metrics-certs\") pod \"network-metrics-daemon-6zlq9\" (UID: \"a79c1c7a-ce77-499f-8f15-ea44cd93aeb2\") " pod="openshift-multus/network-metrics-daemon-6zlq9" Jun 11 15:03:03.248922 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:03.248929 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9zg5\" (UniqueName: \"kubernetes.io/projected/5f5aa8b6-caed-490f-818a-9a245c7bba82-kube-api-access-w9zg5\") pod \"network-check-target-786s7\" (UID: \"5f5aa8b6-caed-490f-818a-9a245c7bba82\") " pod="openshift-network-diagnostics/network-check-target-786s7" Jun 11 15:03:03.249160 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:03:03.249037 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 15:03:03.249160 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:03:03.249061 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 15:03:03.249160 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:03:03.249083 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 15:03:03.249160 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:03:03.249095 2569 projected.go:196] Error preparing data for projected volume kube-api-access-w9zg5 for pod openshift-network-diagnostics/network-check-target-786s7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 15:03:03.249160 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:03:03.249106 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a79c1c7a-ce77-499f-8f15-ea44cd93aeb2-metrics-certs podName:a79c1c7a-ce77-499f-8f15-ea44cd93aeb2 nodeName:}" failed. No retries permitted until 2026-06-11 15:03:19.249087742 +0000 UTC m=+34.197712004 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a79c1c7a-ce77-499f-8f15-ea44cd93aeb2-metrics-certs") pod "network-metrics-daemon-6zlq9" (UID: "a79c1c7a-ce77-499f-8f15-ea44cd93aeb2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 15:03:03.249160 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:03:03.249144 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5f5aa8b6-caed-490f-818a-9a245c7bba82-kube-api-access-w9zg5 podName:5f5aa8b6-caed-490f-818a-9a245c7bba82 nodeName:}" failed. No retries permitted until 2026-06-11 15:03:19.249128578 +0000 UTC m=+34.197752824 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-w9zg5" (UniqueName: "kubernetes.io/projected/5f5aa8b6-caed-490f-818a-9a245c7bba82-kube-api-access-w9zg5") pod "network-check-target-786s7" (UID: "5f5aa8b6-caed-490f-818a-9a245c7bba82") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 15:03:03.474268 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:03.474184 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9xq6t" Jun 11 15:03:03.474426 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:03.474184 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6zlq9" Jun 11 15:03:03.474426 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:03.474321 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-786s7" Jun 11 15:03:03.474426 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:03:03.474319 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9xq6t" podUID="f5813fd7-de59-42f7-b4ee-de396547742d" Jun 11 15:03:03.474572 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:03:03.474433 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6zlq9" podUID="a79c1c7a-ce77-499f-8f15-ea44cd93aeb2" Jun 11 15:03:03.474572 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:03:03.474514 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-786s7" podUID="5f5aa8b6-caed-490f-818a-9a245c7bba82" Jun 11 15:03:05.474687 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:05.474655 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-786s7" Jun 11 15:03:05.475184 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:05.474783 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9xq6t" Jun 11 15:03:05.475184 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:03:05.474802 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-786s7" podUID="5f5aa8b6-caed-490f-818a-9a245c7bba82" Jun 11 15:03:05.475184 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:03:05.474876 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9xq6t" podUID="f5813fd7-de59-42f7-b4ee-de396547742d" Jun 11 15:03:05.475184 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:05.474892 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6zlq9" Jun 11 15:03:05.475184 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:03:05.474972 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6zlq9" podUID="a79c1c7a-ce77-499f-8f15-ea44cd93aeb2" Jun 11 15:03:07.474587 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:07.474245 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6zlq9" Jun 11 15:03:07.475158 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:07.474243 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-786s7" Jun 11 15:03:07.475158 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:07.474287 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9xq6t" Jun 11 15:03:07.475158 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:03:07.474705 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6zlq9" podUID="a79c1c7a-ce77-499f-8f15-ea44cd93aeb2" Jun 11 15:03:07.475158 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:03:07.474818 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9xq6t" podUID="f5813fd7-de59-42f7-b4ee-de396547742d" Jun 11 15:03:07.475158 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:03:07.474892 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-786s7" podUID="5f5aa8b6-caed-490f-818a-9a245c7bba82" Jun 11 15:03:07.551789 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:07.551769 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5lcln_77786904-9829-4966-9657-c97854cb6555/ovn-acl-logging/0.log" Jun 11 15:03:07.552166 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:07.552142 2569 generic.go:356] "Generic (PLEG): container finished" podID="77786904-9829-4966-9657-c97854cb6555" containerID="615e7d06d8f20c24742c190092762a3de49458bc7550dc60b60b7290825501b4" exitCode=1 Jun 11 15:03:07.552275 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:07.552212 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5lcln" event={"ID":"77786904-9829-4966-9657-c97854cb6555","Type":"ContainerStarted","Data":"fb4fec77770a8aa8055327789d7992e32ad513fc2257d7c96fe0c51b9bd89b97"} Jun 11 15:03:07.552337 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:07.552293 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5lcln" event={"ID":"77786904-9829-4966-9657-c97854cb6555","Type":"ContainerStarted","Data":"bee27d70928446cf3e891be22bbf813af97be00faa30dc0d7c9b303de7050989"} Jun 11 15:03:07.552399 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:07.552336 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5lcln" event={"ID":"77786904-9829-4966-9657-c97854cb6555","Type":"ContainerStarted","Data":"377ca2941aea28ed32dc45ba2090e13e591798f10c71fa5ec66aa006bf5a278b"} Jun 11 15:03:07.552399 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:07.552372 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5lcln" event={"ID":"77786904-9829-4966-9657-c97854cb6555","Type":"ContainerDied","Data":"615e7d06d8f20c24742c190092762a3de49458bc7550dc60b60b7290825501b4"} Jun 11 15:03:07.552500 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:07.552408 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5lcln" event={"ID":"77786904-9829-4966-9657-c97854cb6555","Type":"ContainerStarted","Data":"f4b5f88df5c78ee7a99774601fef7a71d28d110e449f27561a9f202dcc90bda2"} Jun 11 15:03:07.553812 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:07.553786 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fzhq9" event={"ID":"c1a1d2ac-69d9-4fd9-a430-4392613b148f","Type":"ContainerStarted","Data":"e4014f433af819ee5b3417d4e3c1a748d060a2985a86e0cbe94369b62fd14430"} Jun 11 15:03:07.555412 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:07.555391 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gjwn5" event={"ID":"a5ddf0c9-e1fc-49b7-9adb-80504c04c71b","Type":"ContainerStarted","Data":"6a96fc0261e7a077f60f863186ab7f4be668d3cbbca46654c46e1b04b5dba7d4"} Jun 11 15:03:07.557091 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:07.557011 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-nshvv" event={"ID":"6a10fef5-133c-4a0b-85d5-2af4705ce4e2","Type":"ContainerStarted","Data":"52ea5b6396d0d0c27cb958c359698ab64f059386b5b181e8a066d84e20c7ab61"} Jun 11 15:03:07.558418 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:07.558393 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9fgfz" event={"ID":"9329cd7d-8d39-4a1a-b7da-d6604e6274bb","Type":"ContainerStarted","Data":"3a80a78a616bf2426f8d6bb671f815117cff56e190a19c991063b8b2c70fdd61"} Jun 11 15:03:07.559816 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:07.559780 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pl4zp" event={"ID":"702ed42e-bdb8-4845-bc4d-cfa514fa6dff","Type":"ContainerStarted","Data":"f13bbcafbb7a114d242c50680e77bc3bb7e6bc7867fea08914128a67b7e2038b"} Jun 11 15:03:07.561352 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:07.561327 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6779b" event={"ID":"5b430c4f-2679-47e4-bf04-6037fbd86c34","Type":"ContainerStarted","Data":"6fc451e4f7efefa62192649ca7d2e911ca10af3d04a70e6ec1ba4e49985c7f86"} Jun 11 15:03:07.563299 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:07.563274 2569 generic.go:356] "Generic (PLEG): container finished" podID="4dca31c7-6860-4b5c-8631-a8e7d5a09d72" containerID="2094641f0df014d248c5f7c62e48e9d683ab09ae39cea1e0ddc932b00bc586e6" exitCode=0 Jun 11 15:03:07.563390 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:07.563311 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pqqnp" event={"ID":"4dca31c7-6860-4b5c-8631-a8e7d5a09d72","Type":"ContainerDied","Data":"2094641f0df014d248c5f7c62e48e9d683ab09ae39cea1e0ddc932b00bc586e6"} Jun 11 15:03:07.608319 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:07.608260 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-fzhq9" podStartSLOduration=4.110091454 podStartE2EDuration="22.608242639s" totalImagesPullingTime="18.498151185s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 15:02:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:03:07.603015823 +0000 UTC m=+22.551640085" watchObservedRunningTime="2026-06-11 15:03:07.608242639 +0000 UTC m=+22.556866895" Jun 11 15:03:07.643479 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:07.643415 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-gjwn5" podStartSLOduration=8.915175752 podStartE2EDuration="22.643396731s" totalImagesPullingTime="13.728220979s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:02:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:03:07.643081742 +0000 UTC m=+22.591706015" watchObservedRunningTime="2026-06-11 15:03:07.643396731 +0000 UTC m=+22.592020996" Jun 11 15:03:07.740383 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:07.740339 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-nshvv" podStartSLOduration=4.2936817959999996 podStartE2EDuration="22.740324048s" totalImagesPullingTime="18.446642252s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 15:02:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:03:07.720651731 +0000 UTC m=+22.669275992" watchObservedRunningTime="2026-06-11 15:03:07.740324048 +0000 UTC m=+22.688948364" Jun 11 15:03:07.740560 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:07.740460 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-9fgfz" podStartSLOduration=4.270716088 podStartE2EDuration="22.740442689s" totalImagesPullingTime="18.469726601s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 15:02:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:03:07.739459193 +0000 UTC m=+22.688083455" watchObservedRunningTime="2026-06-11 15:03:07.740442689 +0000 UTC m=+22.689066952" Jun 11 15:03:07.763297 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:07.763249 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-6779b" podStartSLOduration=4.248444128 podStartE2EDuration="22.763232359s" totalImagesPullingTime="18.514788231s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 15:02:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:03:07.762710431 +0000 UTC m=+22.711334689" watchObservedRunningTime="2026-06-11 15:03:07.763232359 +0000 UTC m=+22.711856620" Jun 11 15:03:08.464602 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:08.464574 2569 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 11 15:03:08.475316 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:08.475223 2569 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-11T15:03:08.464597153Z","UUID":"a104d29e-fb43-40b4-959d-4eb2330d0757","Handler":null,"Name":"","Endpoint":""} Jun 11 15:03:08.476734 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:08.476713 2569 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 11 15:03:08.476860 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:08.476810 2569 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 11 15:03:08.569618 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:08.569555 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5lcln_77786904-9829-4966-9657-c97854cb6555/ovn-acl-logging/0.log" Jun 11 15:03:08.569982 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:08.569945 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5lcln" event={"ID":"77786904-9829-4966-9657-c97854cb6555","Type":"ContainerStarted","Data":"b03f7b618cbf10c7800cd1dd7aa65c2be67f760bc3e16a8626e071021566a475"} Jun 11 15:03:08.571582 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:08.571555 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lqrrd" event={"ID":"e8d0e901-1b06-4e8a-b6af-a2b11c8ad7b4","Type":"ContainerStarted","Data":"a13bcd1b42a6db9ff92e7332d751b75155cce499f70334aa4dbe3f1eb8c36f15"} Jun 11 15:03:08.573517 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:08.573489 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pl4zp" event={"ID":"702ed42e-bdb8-4845-bc4d-cfa514fa6dff","Type":"ContainerStarted","Data":"ec01467fcc32203cb5f659896e3b149aa43fde96edb0e45dc9ff0e5a81c43b6c"} Jun 11 15:03:08.598660 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:08.598611 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-lqrrd" podStartSLOduration=5.126032629 podStartE2EDuration="23.598593992s" totalImagesPullingTime="18.472561363s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 15:02:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:03:08.598105925 +0000 UTC m=+23.546730188" watchObservedRunningTime="2026-06-11 15:03:08.598593992 +0000 UTC m=+23.547218253" Jun 11 15:03:09.474037 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:09.474006 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6zlq9" Jun 11 15:03:09.474174 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:03:09.474158 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6zlq9" podUID="a79c1c7a-ce77-499f-8f15-ea44cd93aeb2" Jun 11 15:03:09.474583 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:09.474561 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9xq6t" Jun 11 15:03:09.474693 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:03:09.474670 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9xq6t" podUID="f5813fd7-de59-42f7-b4ee-de396547742d" Jun 11 15:03:09.474793 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:09.474771 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-786s7" Jun 11 15:03:09.474863 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:03:09.474842 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-786s7" podUID="5f5aa8b6-caed-490f-818a-9a245c7bba82" Jun 11 15:03:09.577974 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:09.577946 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pl4zp" event={"ID":"702ed42e-bdb8-4845-bc4d-cfa514fa6dff","Type":"ContainerStarted","Data":"aeaf1266fc3509b4b0f64da8ca8f6f13b3cb63e2ef91319f015aa3e1776c3431"} Jun 11 15:03:10.584267 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:10.584011 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5lcln_77786904-9829-4966-9657-c97854cb6555/ovn-acl-logging/0.log" Jun 11 15:03:10.584671 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:10.584612 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5lcln" event={"ID":"77786904-9829-4966-9657-c97854cb6555","Type":"ContainerStarted","Data":"ec5f37e99a5357c4606d377a272694a6140746bc71e821a9f814fc32eca40b71"} Jun 11 15:03:11.383668 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:11.383622 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-gjwn5" Jun 11 15:03:11.384201 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:11.384176 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-gjwn5" Jun 11 15:03:11.418328 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:11.418282 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pl4zp" podStartSLOduration=5.785205321 podStartE2EDuration="26.418262941s" totalImagesPullingTime="20.63305762s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 15:02:45 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:03:09.612094481 +0000 UTC m=+24.560718768" watchObservedRunningTime="2026-06-11 15:03:11.418262941 +0000 UTC m=+26.366887206" Jun 11 15:03:11.473944 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:11.473909 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6zlq9" Jun 11 15:03:11.474076 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:11.473912 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9xq6t" Jun 11 15:03:11.474076 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:11.474034 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-786s7" Jun 11 15:03:11.474076 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:03:11.474037 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6zlq9" podUID="a79c1c7a-ce77-499f-8f15-ea44cd93aeb2" Jun 11 15:03:11.474201 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:03:11.474121 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9xq6t" podUID="f5813fd7-de59-42f7-b4ee-de396547742d" Jun 11 15:03:11.474246 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:03:11.474221 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-786s7" podUID="5f5aa8b6-caed-490f-818a-9a245c7bba82" Jun 11 15:03:12.591549 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:12.591300 2569 generic.go:356] "Generic (PLEG): container finished" podID="4dca31c7-6860-4b5c-8631-a8e7d5a09d72" containerID="c6676bb4df588390a34a5d46aad863320ac4a44f088b1b625ba7445a520be321" exitCode=0 Jun 11 15:03:12.592306 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:12.591356 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pqqnp" event={"ID":"4dca31c7-6860-4b5c-8631-a8e7d5a09d72","Type":"ContainerDied","Data":"c6676bb4df588390a34a5d46aad863320ac4a44f088b1b625ba7445a520be321"} Jun 11 15:03:12.595269 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:12.595186 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5lcln_77786904-9829-4966-9657-c97854cb6555/ovn-acl-logging/0.log" Jun 11 15:03:12.595535 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:12.595510 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5lcln" event={"ID":"77786904-9829-4966-9657-c97854cb6555","Type":"ContainerStarted","Data":"f56830bdfb7e8c3e1ab28a46b4c1b6bd352e4e4b362049265cfc108bdf443d5d"} Jun 11 15:03:12.595801 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:12.595778 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5lcln" Jun 11 15:03:12.595881 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:12.595869 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5lcln" Jun 11 15:03:12.595953 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:12.595938 2569 scope.go:117] "RemoveContainer" containerID="615e7d06d8f20c24742c190092762a3de49458bc7550dc60b60b7290825501b4" Jun 11 15:03:12.611421 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:12.611398 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5lcln" Jun 11 15:03:13.474320 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:13.474297 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-786s7" Jun 11 15:03:13.474475 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:13.474299 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9xq6t" Jun 11 15:03:13.474475 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:03:13.474384 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-786s7" podUID="5f5aa8b6-caed-490f-818a-9a245c7bba82" Jun 11 15:03:13.474475 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:13.474411 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6zlq9" Jun 11 15:03:13.474649 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:03:13.474486 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9xq6t" podUID="f5813fd7-de59-42f7-b4ee-de396547742d" Jun 11 15:03:13.474649 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:03:13.474554 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6zlq9" podUID="a79c1c7a-ce77-499f-8f15-ea44cd93aeb2" Jun 11 15:03:13.599419 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:13.599391 2569 generic.go:356] "Generic (PLEG): container finished" podID="4dca31c7-6860-4b5c-8631-a8e7d5a09d72" containerID="f2ef416b99a1f7bef7b27289d5ef513bc64e825e4cb2a7772b7247c66521e8f0" exitCode=0 Jun 11 15:03:13.599733 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:13.599477 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pqqnp" event={"ID":"4dca31c7-6860-4b5c-8631-a8e7d5a09d72","Type":"ContainerDied","Data":"f2ef416b99a1f7bef7b27289d5ef513bc64e825e4cb2a7772b7247c66521e8f0"} Jun 11 15:03:13.603193 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:13.603176 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5lcln_77786904-9829-4966-9657-c97854cb6555/ovn-acl-logging/0.log" Jun 11 15:03:13.603498 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:13.603481 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5lcln" event={"ID":"77786904-9829-4966-9657-c97854cb6555","Type":"ContainerStarted","Data":"5337c2f577566060de27f2eb4f4352b44c55680ae764ab715958f6b48f27ff28"} Jun 11 15:03:13.603714 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:13.603698 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5lcln" Jun 11 15:03:13.617363 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:13.617345 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5lcln" Jun 11 15:03:13.698883 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:13.698838 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-5lcln" podStartSLOduration=10.15358461 podStartE2EDuration="28.698825715s" totalImagesPullingTime="18.545241105s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 15:02:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:03:13.698463379 +0000 UTC m=+28.647087651" watchObservedRunningTime="2026-06-11 15:03:13.698825715 +0000 UTC m=+28.647449985" Jun 11 15:03:14.112300 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:14.112265 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-gjwn5" Jun 11 15:03:14.112517 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:14.112403 2569 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 11 15:03:14.113037 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:14.113009 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-gjwn5" Jun 11 15:03:14.608197 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:14.608167 2569 generic.go:356] "Generic (PLEG): container finished" podID="4dca31c7-6860-4b5c-8631-a8e7d5a09d72" containerID="556c7dff9a4febcb34fca8ba02652afde65f935ef21836d2ca0b290176c1d390" exitCode=0 Jun 11 15:03:14.608577 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:14.608242 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pqqnp" event={"ID":"4dca31c7-6860-4b5c-8631-a8e7d5a09d72","Type":"ContainerDied","Data":"556c7dff9a4febcb34fca8ba02652afde65f935ef21836d2ca0b290176c1d390"} Jun 11 15:03:15.474956 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:15.474927 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6zlq9" Jun 11 15:03:15.475129 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:15.475023 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9xq6t" Jun 11 15:03:15.475129 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:15.475061 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-786s7" Jun 11 15:03:15.475129 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:03:15.475074 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6zlq9" podUID="a79c1c7a-ce77-499f-8f15-ea44cd93aeb2" Jun 11 15:03:15.475129 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:03:15.475121 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-786s7" podUID="5f5aa8b6-caed-490f-818a-9a245c7bba82" Jun 11 15:03:15.475297 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:03:15.475188 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9xq6t" podUID="f5813fd7-de59-42f7-b4ee-de396547742d" Jun 11 15:03:17.473814 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:17.473780 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6zlq9" Jun 11 15:03:17.474300 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:17.473780 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9xq6t" Jun 11 15:03:17.474300 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:03:17.473929 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6zlq9" podUID="a79c1c7a-ce77-499f-8f15-ea44cd93aeb2" Jun 11 15:03:17.474300 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:17.473781 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-786s7" Jun 11 15:03:17.474300 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:03:17.474014 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9xq6t" podUID="f5813fd7-de59-42f7-b4ee-de396547742d" Jun 11 15:03:17.474300 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:03:17.474106 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-786s7" podUID="5f5aa8b6-caed-490f-818a-9a245c7bba82" Jun 11 15:03:19.173222 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:19.173141 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f5813fd7-de59-42f7-b4ee-de396547742d-original-pull-secret\") pod \"global-pull-secret-syncer-9xq6t\" (UID: \"f5813fd7-de59-42f7-b4ee-de396547742d\") " pod="kube-system/global-pull-secret-syncer-9xq6t" Jun 11 15:03:19.173627 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:03:19.173252 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 15:03:19.173627 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:03:19.173299 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5813fd7-de59-42f7-b4ee-de396547742d-original-pull-secret podName:f5813fd7-de59-42f7-b4ee-de396547742d nodeName:}" failed. No retries permitted until 2026-06-11 15:03:51.173286354 +0000 UTC m=+66.121910594 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f5813fd7-de59-42f7-b4ee-de396547742d-original-pull-secret") pod "global-pull-secret-syncer-9xq6t" (UID: "f5813fd7-de59-42f7-b4ee-de396547742d") : object "kube-system"/"original-pull-secret" not registered Jun 11 15:03:19.274018 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:19.273980 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a79c1c7a-ce77-499f-8f15-ea44cd93aeb2-metrics-certs\") pod \"network-metrics-daemon-6zlq9\" (UID: \"a79c1c7a-ce77-499f-8f15-ea44cd93aeb2\") " pod="openshift-multus/network-metrics-daemon-6zlq9" Jun 11 15:03:19.274018 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:19.274022 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9zg5\" (UniqueName: \"kubernetes.io/projected/5f5aa8b6-caed-490f-818a-9a245c7bba82-kube-api-access-w9zg5\") pod \"network-check-target-786s7\" (UID: \"5f5aa8b6-caed-490f-818a-9a245c7bba82\") " pod="openshift-network-diagnostics/network-check-target-786s7" Jun 11 15:03:19.274301 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:03:19.274123 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 15:03:19.274301 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:03:19.274152 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 15:03:19.274301 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:03:19.274167 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 15:03:19.274301 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:03:19.274179 2569 projected.go:196] Error preparing data for projected volume kube-api-access-w9zg5 for pod openshift-network-diagnostics/network-check-target-786s7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 15:03:19.274301 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:03:19.274188 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a79c1c7a-ce77-499f-8f15-ea44cd93aeb2-metrics-certs podName:a79c1c7a-ce77-499f-8f15-ea44cd93aeb2 nodeName:}" failed. No retries permitted until 2026-06-11 15:03:51.274170544 +0000 UTC m=+66.222794784 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a79c1c7a-ce77-499f-8f15-ea44cd93aeb2-metrics-certs") pod "network-metrics-daemon-6zlq9" (UID: "a79c1c7a-ce77-499f-8f15-ea44cd93aeb2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 15:03:19.274301 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:03:19.274227 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5f5aa8b6-caed-490f-818a-9a245c7bba82-kube-api-access-w9zg5 podName:5f5aa8b6-caed-490f-818a-9a245c7bba82 nodeName:}" failed. No retries permitted until 2026-06-11 15:03:51.274211399 +0000 UTC m=+66.222835652 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-w9zg5" (UniqueName: "kubernetes.io/projected/5f5aa8b6-caed-490f-818a-9a245c7bba82-kube-api-access-w9zg5") pod "network-check-target-786s7" (UID: "5f5aa8b6-caed-490f-818a-9a245c7bba82") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 15:03:19.474578 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:19.474495 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9xq6t" Jun 11 15:03:19.474578 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:19.474501 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-786s7" Jun 11 15:03:19.474880 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:03:19.474585 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9xq6t" podUID="f5813fd7-de59-42f7-b4ee-de396547742d" Jun 11 15:03:19.474880 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:03:19.474654 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-786s7" podUID="5f5aa8b6-caed-490f-818a-9a245c7bba82" Jun 11 15:03:19.474880 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:19.474704 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6zlq9" Jun 11 15:03:19.474880 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:03:19.474784 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6zlq9" podUID="a79c1c7a-ce77-499f-8f15-ea44cd93aeb2" Jun 11 15:03:19.621847 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:19.621811 2569 generic.go:356] "Generic (PLEG): container finished" podID="4dca31c7-6860-4b5c-8631-a8e7d5a09d72" containerID="fd7b9a769820fa1289d4c95b0f368d036786a9f29611a4b844e5a160f25faba4" exitCode=0 Jun 11 15:03:19.622052 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:19.621868 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pqqnp" event={"ID":"4dca31c7-6860-4b5c-8631-a8e7d5a09d72","Type":"ContainerDied","Data":"fd7b9a769820fa1289d4c95b0f368d036786a9f29611a4b844e5a160f25faba4"} Jun 11 15:03:20.627173 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:20.627143 2569 generic.go:356] "Generic (PLEG): container finished" podID="4dca31c7-6860-4b5c-8631-a8e7d5a09d72" containerID="12f6dc37a52c0e115ea50040c880b8220a04d95f8959cd4cfc24ca6ba52fd7fa" exitCode=0 Jun 11 15:03:20.627646 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:20.627179 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pqqnp" event={"ID":"4dca31c7-6860-4b5c-8631-a8e7d5a09d72","Type":"ContainerDied","Data":"12f6dc37a52c0e115ea50040c880b8220a04d95f8959cd4cfc24ca6ba52fd7fa"} Jun 11 15:03:21.473948 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:21.473911 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9xq6t" Jun 11 15:03:21.474131 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:21.473911 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-786s7" Jun 11 15:03:21.474131 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:21.474035 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6zlq9" Jun 11 15:03:21.474131 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:03:21.474036 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9xq6t" podUID="f5813fd7-de59-42f7-b4ee-de396547742d" Jun 11 15:03:21.474296 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:03:21.474147 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-786s7" podUID="5f5aa8b6-caed-490f-818a-9a245c7bba82" Jun 11 15:03:21.474296 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:03:21.474250 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6zlq9" podUID="a79c1c7a-ce77-499f-8f15-ea44cd93aeb2" Jun 11 15:03:21.632461 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:21.632429 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pqqnp" event={"ID":"4dca31c7-6860-4b5c-8631-a8e7d5a09d72","Type":"ContainerStarted","Data":"8a6a39c5c3cbeafee56dc3e7bc73a3cd9d3e60858a98c47da1b411042d69bf0a"} Jun 11 15:03:23.474601 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:23.474575 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6zlq9" Jun 11 15:03:23.474601 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:23.474593 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-786s7" Jun 11 15:03:23.475003 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:23.474593 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9xq6t" Jun 11 15:03:23.475003 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:03:23.474671 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6zlq9" podUID="a79c1c7a-ce77-499f-8f15-ea44cd93aeb2" Jun 11 15:03:23.475003 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:03:23.474777 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-786s7" podUID="5f5aa8b6-caed-490f-818a-9a245c7bba82" Jun 11 15:03:23.475003 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:03:23.474839 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9xq6t" podUID="f5813fd7-de59-42f7-b4ee-de396547742d" Jun 11 15:03:25.475048 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:25.475019 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6zlq9" Jun 11 15:03:25.475495 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:25.475115 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9xq6t" Jun 11 15:03:25.475495 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:25.475159 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-786s7" Jun 11 15:03:25.475495 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:03:25.475164 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6zlq9" podUID="a79c1c7a-ce77-499f-8f15-ea44cd93aeb2" Jun 11 15:03:25.475495 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:03:25.475249 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-786s7" podUID="5f5aa8b6-caed-490f-818a-9a245c7bba82" Jun 11 15:03:25.475495 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:03:25.475336 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9xq6t" podUID="f5813fd7-de59-42f7-b4ee-de396547742d" Jun 11 15:03:27.476701 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:27.476667 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-786s7" Jun 11 15:03:27.477184 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:03:27.476803 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-786s7" podUID="5f5aa8b6-caed-490f-818a-9a245c7bba82" Jun 11 15:03:27.477184 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:27.476871 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6zlq9" Jun 11 15:03:27.477184 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:03:27.476964 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6zlq9" podUID="a79c1c7a-ce77-499f-8f15-ea44cd93aeb2" Jun 11 15:03:27.477184 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:27.476999 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9xq6t" Jun 11 15:03:27.477184 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:03:27.477056 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9xq6t" podUID="f5813fd7-de59-42f7-b4ee-de396547742d" Jun 11 15:03:29.474839 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:29.474804 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-786s7" Jun 11 15:03:29.475196 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:29.474813 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6zlq9" Jun 11 15:03:29.475196 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:03:29.474905 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-786s7" podUID="5f5aa8b6-caed-490f-818a-9a245c7bba82" Jun 11 15:03:29.475196 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:29.474938 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9xq6t" Jun 11 15:03:29.475196 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:03:29.475023 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6zlq9" podUID="a79c1c7a-ce77-499f-8f15-ea44cd93aeb2" Jun 11 15:03:29.475196 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:03:29.475085 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9xq6t" podUID="f5813fd7-de59-42f7-b4ee-de396547742d" Jun 11 15:03:31.474430 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:31.474400 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-786s7" Jun 11 15:03:31.474430 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:31.474425 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6zlq9" Jun 11 15:03:31.474861 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:03:31.474512 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-786s7" podUID="5f5aa8b6-caed-490f-818a-9a245c7bba82" Jun 11 15:03:31.474861 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:03:31.474558 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6zlq9" podUID="a79c1c7a-ce77-499f-8f15-ea44cd93aeb2" Jun 11 15:03:31.474861 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:31.474598 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9xq6t" Jun 11 15:03:31.474861 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:03:31.474692 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9xq6t" podUID="f5813fd7-de59-42f7-b4ee-de396547742d" Jun 11 15:03:33.473967 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:33.473934 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9xq6t" Jun 11 15:03:33.474413 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:33.473935 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6zlq9" Jun 11 15:03:33.474413 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:03:33.474048 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9xq6t" podUID="f5813fd7-de59-42f7-b4ee-de396547742d" Jun 11 15:03:33.474413 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:33.473938 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-786s7" Jun 11 15:03:33.474413 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:03:33.474109 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6zlq9" podUID="a79c1c7a-ce77-499f-8f15-ea44cd93aeb2" Jun 11 15:03:33.474413 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:03:33.474180 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-786s7" podUID="5f5aa8b6-caed-490f-818a-9a245c7bba82" Jun 11 15:03:35.474740 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:35.474704 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9xq6t" Jun 11 15:03:35.475293 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:35.474817 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6zlq9" Jun 11 15:03:35.475293 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:03:35.474838 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9xq6t" podUID="f5813fd7-de59-42f7-b4ee-de396547742d" Jun 11 15:03:35.475293 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:03:35.474892 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6zlq9" podUID="a79c1c7a-ce77-499f-8f15-ea44cd93aeb2" Jun 11 15:03:35.475293 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:35.474921 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-786s7" Jun 11 15:03:35.475293 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:03:35.475004 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-786s7" podUID="5f5aa8b6-caed-490f-818a-9a245c7bba82" Jun 11 15:03:37.474644 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:37.474615 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-786s7" Jun 11 15:03:37.475161 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:37.474615 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9xq6t" Jun 11 15:03:37.475161 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:03:37.475016 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-786s7" podUID="5f5aa8b6-caed-490f-818a-9a245c7bba82" Jun 11 15:03:37.475273 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:37.475253 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6zlq9" Jun 11 15:03:37.475505 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:03:37.475476 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9xq6t" podUID="f5813fd7-de59-42f7-b4ee-de396547742d" Jun 11 15:03:37.475652 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:03:37.475589 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6zlq9" podUID="a79c1c7a-ce77-499f-8f15-ea44cd93aeb2" Jun 11 15:03:39.474598 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:39.474565 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-786s7" Jun 11 15:03:39.474984 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:39.474572 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6zlq9" Jun 11 15:03:39.474984 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:03:39.474656 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-786s7" podUID="5f5aa8b6-caed-490f-818a-9a245c7bba82" Jun 11 15:03:39.474984 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:03:39.474737 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6zlq9" podUID="a79c1c7a-ce77-499f-8f15-ea44cd93aeb2" Jun 11 15:03:39.474984 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:39.474799 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9xq6t" Jun 11 15:03:39.474984 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:03:39.474850 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9xq6t" podUID="f5813fd7-de59-42f7-b4ee-de396547742d" Jun 11 15:03:41.474138 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:41.474105 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6zlq9" Jun 11 15:03:41.474138 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:41.474135 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-786s7" Jun 11 15:03:41.474644 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:41.474110 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9xq6t" Jun 11 15:03:41.474644 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:03:41.474235 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6zlq9" podUID="a79c1c7a-ce77-499f-8f15-ea44cd93aeb2" Jun 11 15:03:41.474644 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:03:41.474312 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9xq6t" podUID="f5813fd7-de59-42f7-b4ee-de396547742d" Jun 11 15:03:41.474644 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:03:41.474397 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-786s7" podUID="5f5aa8b6-caed-490f-818a-9a245c7bba82" Jun 11 15:03:43.474185 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:43.474155 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6zlq9" Jun 11 15:03:43.474557 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:43.474161 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9xq6t" Jun 11 15:03:43.474557 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:03:43.474265 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6zlq9" podUID="a79c1c7a-ce77-499f-8f15-ea44cd93aeb2" Jun 11 15:03:43.474557 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:43.474168 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-786s7" Jun 11 15:03:43.474557 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:03:43.474318 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9xq6t" podUID="f5813fd7-de59-42f7-b4ee-de396547742d" Jun 11 15:03:43.474557 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:03:43.474423 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-786s7" podUID="5f5aa8b6-caed-490f-818a-9a245c7bba82" Jun 11 15:03:45.474927 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:45.474747 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6zlq9" Jun 11 15:03:45.475321 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:45.474818 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9xq6t" Jun 11 15:03:45.475321 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:45.474853 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-786s7" Jun 11 15:03:45.475321 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:03:45.475007 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6zlq9" podUID="a79c1c7a-ce77-499f-8f15-ea44cd93aeb2" Jun 11 15:03:45.475321 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:03:45.475080 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-786s7" podUID="5f5aa8b6-caed-490f-818a-9a245c7bba82" Jun 11 15:03:45.475321 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:03:45.475147 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9xq6t" podUID="f5813fd7-de59-42f7-b4ee-de396547742d" Jun 11 15:03:45.620957 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:45.620918 2569 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-5lcln" podUID="77786904-9829-4966-9657-c97854cb6555" containerName="ovnkube-controller" probeResult="failure" output="" Jun 11 15:03:47.474506 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:47.474477 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6zlq9" Jun 11 15:03:47.474977 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:47.474486 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9xq6t" Jun 11 15:03:47.474977 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:03:47.474588 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6zlq9" podUID="a79c1c7a-ce77-499f-8f15-ea44cd93aeb2" Jun 11 15:03:47.474977 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:03:47.474688 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9xq6t" podUID="f5813fd7-de59-42f7-b4ee-de396547742d" Jun 11 15:03:47.474977 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:47.474485 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-786s7" Jun 11 15:03:47.474977 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:03:47.474808 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-786s7" podUID="5f5aa8b6-caed-490f-818a-9a245c7bba82" Jun 11 15:03:48.504583 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:48.504526 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-pqqnp" podStartSLOduration=35.139180943 podStartE2EDuration="1m3.504510628s" totalImagesPullingTime="28.365329685s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 15:02:45 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:03:21.673388208 +0000 UTC m=+36.622012469" watchObservedRunningTime="2026-06-11 15:03:48.504510628 +0000 UTC m=+63.453134890" Jun 11 15:03:48.505680 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:48.504985 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-786s7"] Jun 11 15:03:48.505680 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:48.505144 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-786s7" Jun 11 15:03:48.505680 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:03:48.505241 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-786s7" podUID="5f5aa8b6-caed-490f-818a-9a245c7bba82" Jun 11 15:03:48.507364 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:48.507331 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6zlq9"] Jun 11 15:03:48.507478 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:48.507463 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6zlq9" Jun 11 15:03:48.507589 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:03:48.507565 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6zlq9" podUID="a79c1c7a-ce77-499f-8f15-ea44cd93aeb2" Jun 11 15:03:48.507977 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:48.507954 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9xq6t"] Jun 11 15:03:48.508085 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:48.508057 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9xq6t" Jun 11 15:03:48.508187 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:03:48.508147 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9xq6t" podUID="f5813fd7-de59-42f7-b4ee-de396547742d" Jun 11 15:03:50.474613 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:50.474521 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9xq6t" Jun 11 15:03:50.475074 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:50.474660 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-786s7" Jun 11 15:03:50.475074 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:50.474687 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6zlq9" Jun 11 15:03:50.475074 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:03:50.474674 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9xq6t" podUID="f5813fd7-de59-42f7-b4ee-de396547742d" Jun 11 15:03:50.475074 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:03:50.474791 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-786s7" podUID="5f5aa8b6-caed-490f-818a-9a245c7bba82" Jun 11 15:03:50.475074 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:03:50.474866 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6zlq9" podUID="a79c1c7a-ce77-499f-8f15-ea44cd93aeb2" Jun 11 15:03:51.238169 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:51.238133 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f5813fd7-de59-42f7-b4ee-de396547742d-original-pull-secret\") pod \"global-pull-secret-syncer-9xq6t\" (UID: \"f5813fd7-de59-42f7-b4ee-de396547742d\") " pod="kube-system/global-pull-secret-syncer-9xq6t" Jun 11 15:03:51.238343 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:03:51.238242 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 15:03:51.238343 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:03:51.238291 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5813fd7-de59-42f7-b4ee-de396547742d-original-pull-secret podName:f5813fd7-de59-42f7-b4ee-de396547742d nodeName:}" failed. No retries permitted until 2026-06-11 15:04:55.238278317 +0000 UTC m=+130.186902557 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f5813fd7-de59-42f7-b4ee-de396547742d-original-pull-secret") pod "global-pull-secret-syncer-9xq6t" (UID: "f5813fd7-de59-42f7-b4ee-de396547742d") : object "kube-system"/"original-pull-secret" not registered Jun 11 15:03:51.339324 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:51.339292 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a79c1c7a-ce77-499f-8f15-ea44cd93aeb2-metrics-certs\") pod \"network-metrics-daemon-6zlq9\" (UID: \"a79c1c7a-ce77-499f-8f15-ea44cd93aeb2\") " pod="openshift-multus/network-metrics-daemon-6zlq9" Jun 11 15:03:51.339324 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:51.339326 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9zg5\" (UniqueName: \"kubernetes.io/projected/5f5aa8b6-caed-490f-818a-9a245c7bba82-kube-api-access-w9zg5\") pod \"network-check-target-786s7\" (UID: \"5f5aa8b6-caed-490f-818a-9a245c7bba82\") " pod="openshift-network-diagnostics/network-check-target-786s7" Jun 11 15:03:51.339530 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:03:51.339425 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 15:03:51.339530 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:03:51.339486 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a79c1c7a-ce77-499f-8f15-ea44cd93aeb2-metrics-certs podName:a79c1c7a-ce77-499f-8f15-ea44cd93aeb2 nodeName:}" failed. No retries permitted until 2026-06-11 15:04:55.339471854 +0000 UTC m=+130.288096094 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a79c1c7a-ce77-499f-8f15-ea44cd93aeb2-metrics-certs") pod "network-metrics-daemon-6zlq9" (UID: "a79c1c7a-ce77-499f-8f15-ea44cd93aeb2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 15:03:51.339530 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:03:51.339429 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 15:03:51.339627 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:03:51.339540 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 15:03:51.339627 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:03:51.339555 2569 projected.go:196] Error preparing data for projected volume kube-api-access-w9zg5 for pod openshift-network-diagnostics/network-check-target-786s7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 15:03:51.339627 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:03:51.339604 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5f5aa8b6-caed-490f-818a-9a245c7bba82-kube-api-access-w9zg5 podName:5f5aa8b6-caed-490f-818a-9a245c7bba82 nodeName:}" failed. No retries permitted until 2026-06-11 15:04:55.339592468 +0000 UTC m=+130.288216714 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "kube-api-access-w9zg5" (UniqueName: "kubernetes.io/projected/5f5aa8b6-caed-490f-818a-9a245c7bba82-kube-api-access-w9zg5") pod "network-check-target-786s7" (UID: "5f5aa8b6-caed-490f-818a-9a245c7bba82") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 15:03:51.886947 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:51.886786 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-147.ec2.internal" event="NodeReady" Jun 11 15:03:51.887299 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:51.887020 2569 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 11 15:03:51.934821 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:51.934786 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7678565674-mglc9"] Jun 11 15:03:51.936462 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:51.936448 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7678565674-mglc9" Jun 11 15:03:51.938903 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:51.938884 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 11 15:03:51.943880 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:51.941690 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 11 15:03:51.943880 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:51.941915 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 11 15:03:51.943880 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:51.942430 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-bwk6k\"" Jun 11 15:03:51.948403 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:51.948382 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-24qb9"] Jun 11 15:03:51.948872 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:51.948857 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 11 15:03:51.949879 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:51.949865 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-24qb9" Jun 11 15:03:51.960213 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:51.960196 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-t8gh8"] Jun 11 15:03:51.960730 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:51.960704 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 11 15:03:51.960822 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:51.960809 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 11 15:03:51.960866 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:51.960813 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xrxl5\"" Jun 11 15:03:51.961854 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:51.961841 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-t8gh8" Jun 11 15:03:51.969569 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:51.969555 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 11 15:03:51.969569 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:51.969561 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 11 15:03:51.969705 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:51.969576 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 11 15:03:51.969705 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:51.969666 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-tbbfw\"" Jun 11 15:03:51.976961 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:51.976945 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7678565674-mglc9"] Jun 11 15:03:51.982016 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:51.981997 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-t8gh8"] Jun 11 15:03:51.984283 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:51.984256 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-24qb9"] Jun 11 15:03:52.004709 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:52.004688 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-8p88n"] Jun 11 15:03:52.006496 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:52.006483 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8p88n" Jun 11 15:03:52.010029 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:52.010011 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 11 15:03:52.010116 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:52.010102 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 11 15:03:52.010306 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:52.010293 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-w7w7l\"" Jun 11 15:03:52.010461 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:52.010449 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 11 15:03:52.010529 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:52.010514 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 11 15:03:52.028469 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:52.028449 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8p88n"] Jun 11 15:03:52.045466 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:52.045447 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2080c350-9dd7-464a-a6d1-ae454d44c4a0-registry-certificates\") pod \"image-registry-7678565674-mglc9\" (UID: \"2080c350-9dd7-464a-a6d1-ae454d44c4a0\") " pod="openshift-image-registry/image-registry-7678565674-mglc9" Jun 11 15:03:52.045576 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:52.045485 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2080c350-9dd7-464a-a6d1-ae454d44c4a0-image-registry-private-configuration\") pod \"image-registry-7678565674-mglc9\" (UID: \"2080c350-9dd7-464a-a6d1-ae454d44c4a0\") " pod="openshift-image-registry/image-registry-7678565674-mglc9" Jun 11 15:03:52.045576 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:52.045511 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2080c350-9dd7-464a-a6d1-ae454d44c4a0-registry-tls\") pod \"image-registry-7678565674-mglc9\" (UID: \"2080c350-9dd7-464a-a6d1-ae454d44c4a0\") " pod="openshift-image-registry/image-registry-7678565674-mglc9" Jun 11 15:03:52.045576 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:52.045535 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7knj\" (UniqueName: \"kubernetes.io/projected/2080c350-9dd7-464a-a6d1-ae454d44c4a0-kube-api-access-w7knj\") pod \"image-registry-7678565674-mglc9\" (UID: \"2080c350-9dd7-464a-a6d1-ae454d44c4a0\") " pod="openshift-image-registry/image-registry-7678565674-mglc9" Jun 11 15:03:52.045576 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:52.045565 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fb07ba89-003b-4871-bf42-c63ff69b6d3a-cert\") pod \"ingress-canary-t8gh8\" (UID: \"fb07ba89-003b-4871-bf42-c63ff69b6d3a\") " pod="openshift-ingress-canary/ingress-canary-t8gh8" Jun 11 15:03:52.045713 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:52.045588 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tvw8\" (UniqueName: \"kubernetes.io/projected/fb07ba89-003b-4871-bf42-c63ff69b6d3a-kube-api-access-8tvw8\") pod \"ingress-canary-t8gh8\" (UID: \"fb07ba89-003b-4871-bf42-c63ff69b6d3a\") " pod="openshift-ingress-canary/ingress-canary-t8gh8" Jun 11 15:03:52.045713 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:52.045614 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7ab0932f-0e62-4a6d-96aa-03730640b94f-tmp-dir\") pod \"dns-default-24qb9\" (UID: \"7ab0932f-0e62-4a6d-96aa-03730640b94f\") " pod="openshift-dns/dns-default-24qb9" Jun 11 15:03:52.045713 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:52.045640 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2080c350-9dd7-464a-a6d1-ae454d44c4a0-ca-trust-extracted\") pod \"image-registry-7678565674-mglc9\" (UID: \"2080c350-9dd7-464a-a6d1-ae454d44c4a0\") " pod="openshift-image-registry/image-registry-7678565674-mglc9" Jun 11 15:03:52.045713 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:52.045655 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7ab0932f-0e62-4a6d-96aa-03730640b94f-config-volume\") pod \"dns-default-24qb9\" (UID: \"7ab0932f-0e62-4a6d-96aa-03730640b94f\") " pod="openshift-dns/dns-default-24qb9" Jun 11 15:03:52.045713 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:52.045682 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2080c350-9dd7-464a-a6d1-ae454d44c4a0-bound-sa-token\") pod \"image-registry-7678565674-mglc9\" (UID: \"2080c350-9dd7-464a-a6d1-ae454d44c4a0\") " pod="openshift-image-registry/image-registry-7678565674-mglc9" Jun 11 15:03:52.045916 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:52.045715 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7ab0932f-0e62-4a6d-96aa-03730640b94f-metrics-tls\") pod \"dns-default-24qb9\" (UID: \"7ab0932f-0e62-4a6d-96aa-03730640b94f\") " pod="openshift-dns/dns-default-24qb9" Jun 11 15:03:52.045916 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:52.045738 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2080c350-9dd7-464a-a6d1-ae454d44c4a0-trusted-ca\") pod \"image-registry-7678565674-mglc9\" (UID: \"2080c350-9dd7-464a-a6d1-ae454d44c4a0\") " pod="openshift-image-registry/image-registry-7678565674-mglc9" Jun 11 15:03:52.045916 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:52.045778 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2080c350-9dd7-464a-a6d1-ae454d44c4a0-installation-pull-secrets\") pod \"image-registry-7678565674-mglc9\" (UID: \"2080c350-9dd7-464a-a6d1-ae454d44c4a0\") " pod="openshift-image-registry/image-registry-7678565674-mglc9" Jun 11 15:03:52.045916 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:52.045808 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wp8bn\" (UniqueName: \"kubernetes.io/projected/7ab0932f-0e62-4a6d-96aa-03730640b94f-kube-api-access-wp8bn\") pod \"dns-default-24qb9\" (UID: \"7ab0932f-0e62-4a6d-96aa-03730640b94f\") " pod="openshift-dns/dns-default-24qb9" Jun 11 15:03:52.146456 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:52.146351 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9af3479b-46bb-4f61-ba00-f98c42f7be10-data-volume\") pod \"insights-runtime-extractor-8p88n\" (UID: \"9af3479b-46bb-4f61-ba00-f98c42f7be10\") " pod="openshift-insights/insights-runtime-extractor-8p88n" Jun 11 15:03:52.146456 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:52.146388 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9af3479b-46bb-4f61-ba00-f98c42f7be10-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8p88n\" (UID: \"9af3479b-46bb-4f61-ba00-f98c42f7be10\") " pod="openshift-insights/insights-runtime-extractor-8p88n" Jun 11 15:03:52.146456 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:52.146409 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8tvw8\" (UniqueName: \"kubernetes.io/projected/fb07ba89-003b-4871-bf42-c63ff69b6d3a-kube-api-access-8tvw8\") pod \"ingress-canary-t8gh8\" (UID: \"fb07ba89-003b-4871-bf42-c63ff69b6d3a\") " pod="openshift-ingress-canary/ingress-canary-t8gh8" Jun 11 15:03:52.146456 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:52.146425 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9af3479b-46bb-4f61-ba00-f98c42f7be10-crio-socket\") pod \"insights-runtime-extractor-8p88n\" (UID: \"9af3479b-46bb-4f61-ba00-f98c42f7be10\") " pod="openshift-insights/insights-runtime-extractor-8p88n" Jun 11 15:03:52.146789 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:52.146570 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7ab0932f-0e62-4a6d-96aa-03730640b94f-tmp-dir\") pod \"dns-default-24qb9\" (UID: \"7ab0932f-0e62-4a6d-96aa-03730640b94f\") " pod="openshift-dns/dns-default-24qb9" Jun 11 15:03:52.146789 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:52.146608 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9pkx7\" (UniqueName: \"kubernetes.io/projected/9af3479b-46bb-4f61-ba00-f98c42f7be10-kube-api-access-9pkx7\") pod \"insights-runtime-extractor-8p88n\" (UID: \"9af3479b-46bb-4f61-ba00-f98c42f7be10\") " pod="openshift-insights/insights-runtime-extractor-8p88n" Jun 11 15:03:52.146789 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:52.146655 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2080c350-9dd7-464a-a6d1-ae454d44c4a0-ca-trust-extracted\") pod \"image-registry-7678565674-mglc9\" (UID: \"2080c350-9dd7-464a-a6d1-ae454d44c4a0\") " pod="openshift-image-registry/image-registry-7678565674-mglc9" Jun 11 15:03:52.146789 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:52.146691 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7ab0932f-0e62-4a6d-96aa-03730640b94f-config-volume\") pod \"dns-default-24qb9\" (UID: \"7ab0932f-0e62-4a6d-96aa-03730640b94f\") " pod="openshift-dns/dns-default-24qb9" Jun 11 15:03:52.146789 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:52.146721 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2080c350-9dd7-464a-a6d1-ae454d44c4a0-bound-sa-token\") pod \"image-registry-7678565674-mglc9\" (UID: \"2080c350-9dd7-464a-a6d1-ae454d44c4a0\") " pod="openshift-image-registry/image-registry-7678565674-mglc9" Jun 11 15:03:52.146789 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:52.146783 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7ab0932f-0e62-4a6d-96aa-03730640b94f-metrics-tls\") pod \"dns-default-24qb9\" (UID: \"7ab0932f-0e62-4a6d-96aa-03730640b94f\") " pod="openshift-dns/dns-default-24qb9" Jun 11 15:03:52.147086 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:52.146820 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2080c350-9dd7-464a-a6d1-ae454d44c4a0-trusted-ca\") pod \"image-registry-7678565674-mglc9\" (UID: \"2080c350-9dd7-464a-a6d1-ae454d44c4a0\") " pod="openshift-image-registry/image-registry-7678565674-mglc9" Jun 11 15:03:52.147086 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:52.146845 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2080c350-9dd7-464a-a6d1-ae454d44c4a0-installation-pull-secrets\") pod \"image-registry-7678565674-mglc9\" (UID: \"2080c350-9dd7-464a-a6d1-ae454d44c4a0\") " pod="openshift-image-registry/image-registry-7678565674-mglc9" Jun 11 15:03:52.147086 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:52.146887 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wp8bn\" (UniqueName: \"kubernetes.io/projected/7ab0932f-0e62-4a6d-96aa-03730640b94f-kube-api-access-wp8bn\") pod \"dns-default-24qb9\" (UID: \"7ab0932f-0e62-4a6d-96aa-03730640b94f\") " pod="openshift-dns/dns-default-24qb9" Jun 11 15:03:52.147086 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:52.146915 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9af3479b-46bb-4f61-ba00-f98c42f7be10-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8p88n\" (UID: \"9af3479b-46bb-4f61-ba00-f98c42f7be10\") " pod="openshift-insights/insights-runtime-extractor-8p88n" Jun 11 15:03:52.147086 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:52.146948 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2080c350-9dd7-464a-a6d1-ae454d44c4a0-registry-certificates\") pod \"image-registry-7678565674-mglc9\" (UID: \"2080c350-9dd7-464a-a6d1-ae454d44c4a0\") " pod="openshift-image-registry/image-registry-7678565674-mglc9" Jun 11 15:03:52.147086 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:52.146972 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7ab0932f-0e62-4a6d-96aa-03730640b94f-tmp-dir\") pod \"dns-default-24qb9\" (UID: \"7ab0932f-0e62-4a6d-96aa-03730640b94f\") " pod="openshift-dns/dns-default-24qb9" Jun 11 15:03:52.147086 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:52.146992 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2080c350-9dd7-464a-a6d1-ae454d44c4a0-image-registry-private-configuration\") pod \"image-registry-7678565674-mglc9\" (UID: \"2080c350-9dd7-464a-a6d1-ae454d44c4a0\") " pod="openshift-image-registry/image-registry-7678565674-mglc9" Jun 11 15:03:52.147086 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:52.147038 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2080c350-9dd7-464a-a6d1-ae454d44c4a0-registry-tls\") pod \"image-registry-7678565674-mglc9\" (UID: \"2080c350-9dd7-464a-a6d1-ae454d44c4a0\") " pod="openshift-image-registry/image-registry-7678565674-mglc9" Jun 11 15:03:52.147086 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:52.147067 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7knj\" (UniqueName: \"kubernetes.io/projected/2080c350-9dd7-464a-a6d1-ae454d44c4a0-kube-api-access-w7knj\") pod \"image-registry-7678565674-mglc9\" (UID: \"2080c350-9dd7-464a-a6d1-ae454d44c4a0\") " pod="openshift-image-registry/image-registry-7678565674-mglc9" Jun 11 15:03:52.147515 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:52.147100 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fb07ba89-003b-4871-bf42-c63ff69b6d3a-cert\") pod \"ingress-canary-t8gh8\" (UID: \"fb07ba89-003b-4871-bf42-c63ff69b6d3a\") " pod="openshift-ingress-canary/ingress-canary-t8gh8" Jun 11 15:03:52.147515 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:52.147039 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2080c350-9dd7-464a-a6d1-ae454d44c4a0-ca-trust-extracted\") pod \"image-registry-7678565674-mglc9\" (UID: \"2080c350-9dd7-464a-a6d1-ae454d44c4a0\") " pod="openshift-image-registry/image-registry-7678565674-mglc9" Jun 11 15:03:52.147515 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:52.147341 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7ab0932f-0e62-4a6d-96aa-03730640b94f-config-volume\") pod \"dns-default-24qb9\" (UID: \"7ab0932f-0e62-4a6d-96aa-03730640b94f\") " pod="openshift-dns/dns-default-24qb9" Jun 11 15:03:52.147937 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:52.147749 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2080c350-9dd7-464a-a6d1-ae454d44c4a0-registry-certificates\") pod \"image-registry-7678565674-mglc9\" (UID: \"2080c350-9dd7-464a-a6d1-ae454d44c4a0\") " pod="openshift-image-registry/image-registry-7678565674-mglc9" Jun 11 15:03:52.147937 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:52.147906 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2080c350-9dd7-464a-a6d1-ae454d44c4a0-trusted-ca\") pod \"image-registry-7678565674-mglc9\" (UID: \"2080c350-9dd7-464a-a6d1-ae454d44c4a0\") " pod="openshift-image-registry/image-registry-7678565674-mglc9" Jun 11 15:03:52.150857 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:52.150830 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7ab0932f-0e62-4a6d-96aa-03730640b94f-metrics-tls\") pod \"dns-default-24qb9\" (UID: \"7ab0932f-0e62-4a6d-96aa-03730640b94f\") " pod="openshift-dns/dns-default-24qb9" Jun 11 15:03:52.150963 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:52.150884 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2080c350-9dd7-464a-a6d1-ae454d44c4a0-installation-pull-secrets\") pod \"image-registry-7678565674-mglc9\" (UID: \"2080c350-9dd7-464a-a6d1-ae454d44c4a0\") " pod="openshift-image-registry/image-registry-7678565674-mglc9" Jun 11 15:03:52.150963 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:52.150916 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2080c350-9dd7-464a-a6d1-ae454d44c4a0-image-registry-private-configuration\") pod \"image-registry-7678565674-mglc9\" (UID: \"2080c350-9dd7-464a-a6d1-ae454d44c4a0\") " pod="openshift-image-registry/image-registry-7678565674-mglc9" Jun 11 15:03:52.150963 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:52.150952 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fb07ba89-003b-4871-bf42-c63ff69b6d3a-cert\") pod \"ingress-canary-t8gh8\" (UID: \"fb07ba89-003b-4871-bf42-c63ff69b6d3a\") " pod="openshift-ingress-canary/ingress-canary-t8gh8" Jun 11 15:03:52.151065 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:52.150950 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2080c350-9dd7-464a-a6d1-ae454d44c4a0-registry-tls\") pod \"image-registry-7678565674-mglc9\" (UID: \"2080c350-9dd7-464a-a6d1-ae454d44c4a0\") " pod="openshift-image-registry/image-registry-7678565674-mglc9" Jun 11 15:03:52.162101 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:52.162077 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2080c350-9dd7-464a-a6d1-ae454d44c4a0-bound-sa-token\") pod \"image-registry-7678565674-mglc9\" (UID: \"2080c350-9dd7-464a-a6d1-ae454d44c4a0\") " pod="openshift-image-registry/image-registry-7678565674-mglc9" Jun 11 15:03:52.162208 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:52.162107 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7knj\" (UniqueName: \"kubernetes.io/projected/2080c350-9dd7-464a-a6d1-ae454d44c4a0-kube-api-access-w7knj\") pod \"image-registry-7678565674-mglc9\" (UID: \"2080c350-9dd7-464a-a6d1-ae454d44c4a0\") " pod="openshift-image-registry/image-registry-7678565674-mglc9" Jun 11 15:03:52.162835 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:52.162813 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wp8bn\" (UniqueName: \"kubernetes.io/projected/7ab0932f-0e62-4a6d-96aa-03730640b94f-kube-api-access-wp8bn\") pod \"dns-default-24qb9\" (UID: \"7ab0932f-0e62-4a6d-96aa-03730640b94f\") " pod="openshift-dns/dns-default-24qb9" Jun 11 15:03:52.162940 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:52.162898 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tvw8\" (UniqueName: \"kubernetes.io/projected/fb07ba89-003b-4871-bf42-c63ff69b6d3a-kube-api-access-8tvw8\") pod \"ingress-canary-t8gh8\" (UID: \"fb07ba89-003b-4871-bf42-c63ff69b6d3a\") " pod="openshift-ingress-canary/ingress-canary-t8gh8" Jun 11 15:03:52.247372 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:52.247348 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7678565674-mglc9" Jun 11 15:03:52.247470 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:52.247445 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9af3479b-46bb-4f61-ba00-f98c42f7be10-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8p88n\" (UID: \"9af3479b-46bb-4f61-ba00-f98c42f7be10\") " pod="openshift-insights/insights-runtime-extractor-8p88n" Jun 11 15:03:52.247510 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:52.247486 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9af3479b-46bb-4f61-ba00-f98c42f7be10-data-volume\") pod \"insights-runtime-extractor-8p88n\" (UID: \"9af3479b-46bb-4f61-ba00-f98c42f7be10\") " pod="openshift-insights/insights-runtime-extractor-8p88n" Jun 11 15:03:52.247510 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:52.247502 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9af3479b-46bb-4f61-ba00-f98c42f7be10-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8p88n\" (UID: \"9af3479b-46bb-4f61-ba00-f98c42f7be10\") " pod="openshift-insights/insights-runtime-extractor-8p88n" Jun 11 15:03:52.247593 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:52.247518 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9af3479b-46bb-4f61-ba00-f98c42f7be10-crio-socket\") pod \"insights-runtime-extractor-8p88n\" (UID: \"9af3479b-46bb-4f61-ba00-f98c42f7be10\") " pod="openshift-insights/insights-runtime-extractor-8p88n" Jun 11 15:03:52.247593 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:52.247550 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9pkx7\" (UniqueName: \"kubernetes.io/projected/9af3479b-46bb-4f61-ba00-f98c42f7be10-kube-api-access-9pkx7\") pod \"insights-runtime-extractor-8p88n\" (UID: \"9af3479b-46bb-4f61-ba00-f98c42f7be10\") " pod="openshift-insights/insights-runtime-extractor-8p88n" Jun 11 15:03:52.247714 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:52.247695 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9af3479b-46bb-4f61-ba00-f98c42f7be10-crio-socket\") pod \"insights-runtime-extractor-8p88n\" (UID: \"9af3479b-46bb-4f61-ba00-f98c42f7be10\") " pod="openshift-insights/insights-runtime-extractor-8p88n" Jun 11 15:03:52.247860 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:52.247841 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9af3479b-46bb-4f61-ba00-f98c42f7be10-data-volume\") pod \"insights-runtime-extractor-8p88n\" (UID: \"9af3479b-46bb-4f61-ba00-f98c42f7be10\") " pod="openshift-insights/insights-runtime-extractor-8p88n" Jun 11 15:03:52.248107 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:52.248091 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9af3479b-46bb-4f61-ba00-f98c42f7be10-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8p88n\" (UID: \"9af3479b-46bb-4f61-ba00-f98c42f7be10\") " pod="openshift-insights/insights-runtime-extractor-8p88n" Jun 11 15:03:52.249528 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:52.249512 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9af3479b-46bb-4f61-ba00-f98c42f7be10-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8p88n\" (UID: \"9af3479b-46bb-4f61-ba00-f98c42f7be10\") " pod="openshift-insights/insights-runtime-extractor-8p88n" Jun 11 15:03:52.256774 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:52.256742 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9pkx7\" (UniqueName: \"kubernetes.io/projected/9af3479b-46bb-4f61-ba00-f98c42f7be10-kube-api-access-9pkx7\") pod \"insights-runtime-extractor-8p88n\" (UID: \"9af3479b-46bb-4f61-ba00-f98c42f7be10\") " pod="openshift-insights/insights-runtime-extractor-8p88n" Jun 11 15:03:52.257563 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:52.257539 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-24qb9" Jun 11 15:03:52.268612 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:52.268587 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-t8gh8" Jun 11 15:03:52.315413 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:52.315383 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8p88n" Jun 11 15:03:52.425532 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:52.425436 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-24qb9"] Jun 11 15:03:52.426123 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:52.426098 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7678565674-mglc9"] Jun 11 15:03:52.429825 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:03:52.429802 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ab0932f_0e62_4a6d_96aa_03730640b94f.slice/crio-4dc391d359ea5403e717eb034ff1da6aa69d1c0422e8ff3e453291d8edbdc888 WatchSource:0}: Error finding container 4dc391d359ea5403e717eb034ff1da6aa69d1c0422e8ff3e453291d8edbdc888: Status 404 returned error can't find the container with id 4dc391d359ea5403e717eb034ff1da6aa69d1c0422e8ff3e453291d8edbdc888 Jun 11 15:03:52.430823 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:03:52.430797 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2080c350_9dd7_464a_a6d1_ae454d44c4a0.slice/crio-570cf5c7681343b288b5f22e8ba2a14ce5c202ecfa5a1b6a94de51aaad68fb81 WatchSource:0}: Error finding container 570cf5c7681343b288b5f22e8ba2a14ce5c202ecfa5a1b6a94de51aaad68fb81: Status 404 returned error can't find the container with id 570cf5c7681343b288b5f22e8ba2a14ce5c202ecfa5a1b6a94de51aaad68fb81 Jun 11 15:03:52.434283 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:52.434259 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-t8gh8"] Jun 11 15:03:52.438123 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:03:52.438100 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb07ba89_003b_4871_bf42_c63ff69b6d3a.slice/crio-4cf579472ea007349642cb09ac25c9d736c81df346e2e2be8c0cd5d774dd093c WatchSource:0}: Error finding container 4cf579472ea007349642cb09ac25c9d736c81df346e2e2be8c0cd5d774dd093c: Status 404 returned error can't find the container with id 4cf579472ea007349642cb09ac25c9d736c81df346e2e2be8c0cd5d774dd093c Jun 11 15:03:52.473743 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:52.473711 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-786s7" Jun 11 15:03:52.473880 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:52.473743 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6zlq9" Jun 11 15:03:52.473880 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:52.473711 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9xq6t" Jun 11 15:03:52.476968 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:52.476950 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dgmcw\"" Jun 11 15:03:52.477847 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:52.477830 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-7v5wg\"" Jun 11 15:03:52.477989 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:52.477970 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 15:03:52.479916 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:52.479898 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 15:03:52.480857 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:52.480807 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8p88n"] Jun 11 15:03:52.482631 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:52.482151 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 15:03:52.482631 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:52.482461 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 15:03:52.484513 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:03:52.484493 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9af3479b_46bb_4f61_ba00_f98c42f7be10.slice/crio-b4ffa33c9a6c9baf826fb884a52b77948039ddab8a83651cf26ca8808fc66778 WatchSource:0}: Error finding container b4ffa33c9a6c9baf826fb884a52b77948039ddab8a83651cf26ca8808fc66778: Status 404 returned error can't find the container with id b4ffa33c9a6c9baf826fb884a52b77948039ddab8a83651cf26ca8808fc66778 Jun 11 15:03:52.697015 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:52.696778 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-t8gh8" event={"ID":"fb07ba89-003b-4871-bf42-c63ff69b6d3a","Type":"ContainerStarted","Data":"4cf579472ea007349642cb09ac25c9d736c81df346e2e2be8c0cd5d774dd093c"} Jun 11 15:03:52.698259 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:52.698233 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7678565674-mglc9" event={"ID":"2080c350-9dd7-464a-a6d1-ae454d44c4a0","Type":"ContainerStarted","Data":"53d839b59fe5664b640cebc84a5d85e80ce1494627d21805a9aaf91deec29c71"} Jun 11 15:03:52.698376 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:52.698277 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7678565674-mglc9" event={"ID":"2080c350-9dd7-464a-a6d1-ae454d44c4a0","Type":"ContainerStarted","Data":"570cf5c7681343b288b5f22e8ba2a14ce5c202ecfa5a1b6a94de51aaad68fb81"} Jun 11 15:03:52.698376 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:52.698321 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7678565674-mglc9" Jun 11 15:03:52.699690 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:52.699668 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8p88n" event={"ID":"9af3479b-46bb-4f61-ba00-f98c42f7be10","Type":"ContainerStarted","Data":"c2b42b5afa1fd17a2fb22e2e902d624894926e8de1e6659187bd85cbbe599620"} Jun 11 15:03:52.699802 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:52.699708 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8p88n" event={"ID":"9af3479b-46bb-4f61-ba00-f98c42f7be10","Type":"ContainerStarted","Data":"b4ffa33c9a6c9baf826fb884a52b77948039ddab8a83651cf26ca8808fc66778"} Jun 11 15:03:52.700817 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:52.700799 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-24qb9" event={"ID":"7ab0932f-0e62-4a6d-96aa-03730640b94f","Type":"ContainerStarted","Data":"4dc391d359ea5403e717eb034ff1da6aa69d1c0422e8ff3e453291d8edbdc888"} Jun 11 15:03:52.728620 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:52.728571 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7678565674-mglc9" podStartSLOduration=6.72855679 podStartE2EDuration="6.72855679s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:03:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:03:52.727129131 +0000 UTC m=+67.675753393" watchObservedRunningTime="2026-06-11 15:03:52.72855679 +0000 UTC m=+67.677181052" Jun 11 15:03:53.738245 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:53.738190 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-67646c5d8b-8qwpt"] Jun 11 15:03:53.740925 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:53.740902 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67646c5d8b-8qwpt" Jun 11 15:03:53.748778 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:53.748739 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 11 15:03:53.749052 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:53.749033 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 11 15:03:53.750101 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:53.749360 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 11 15:03:53.751525 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:53.751505 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 11 15:03:53.751624 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:53.751515 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 11 15:03:53.758087 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:53.758065 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-tc7xj\"" Jun 11 15:03:53.758200 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:53.758101 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 11 15:03:53.758285 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:53.758246 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 11 15:03:53.783895 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:53.783865 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67646c5d8b-8qwpt"] Jun 11 15:03:53.859186 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:53.859162 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/94ef105d-b176-4e2c-bf38-848e2c2a4982-console-oauth-config\") pod \"console-67646c5d8b-8qwpt\" (UID: \"94ef105d-b176-4e2c-bf38-848e2c2a4982\") " pod="openshift-console/console-67646c5d8b-8qwpt" Jun 11 15:03:53.859250 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:53.859203 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/94ef105d-b176-4e2c-bf38-848e2c2a4982-service-ca\") pod \"console-67646c5d8b-8qwpt\" (UID: \"94ef105d-b176-4e2c-bf38-848e2c2a4982\") " pod="openshift-console/console-67646c5d8b-8qwpt" Jun 11 15:03:53.859351 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:53.859333 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/94ef105d-b176-4e2c-bf38-848e2c2a4982-console-serving-cert\") pod \"console-67646c5d8b-8qwpt\" (UID: \"94ef105d-b176-4e2c-bf38-848e2c2a4982\") " pod="openshift-console/console-67646c5d8b-8qwpt" Jun 11 15:03:53.859463 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:53.859445 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/94ef105d-b176-4e2c-bf38-848e2c2a4982-console-config\") pod \"console-67646c5d8b-8qwpt\" (UID: \"94ef105d-b176-4e2c-bf38-848e2c2a4982\") " pod="openshift-console/console-67646c5d8b-8qwpt" Jun 11 15:03:53.859523 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:53.859495 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/94ef105d-b176-4e2c-bf38-848e2c2a4982-oauth-serving-cert\") pod \"console-67646c5d8b-8qwpt\" (UID: \"94ef105d-b176-4e2c-bf38-848e2c2a4982\") " pod="openshift-console/console-67646c5d8b-8qwpt" Jun 11 15:03:53.859581 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:53.859545 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2hc8\" (UniqueName: \"kubernetes.io/projected/94ef105d-b176-4e2c-bf38-848e2c2a4982-kube-api-access-p2hc8\") pod \"console-67646c5d8b-8qwpt\" (UID: \"94ef105d-b176-4e2c-bf38-848e2c2a4982\") " pod="openshift-console/console-67646c5d8b-8qwpt" Jun 11 15:03:53.960864 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:53.960837 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/94ef105d-b176-4e2c-bf38-848e2c2a4982-console-serving-cert\") pod \"console-67646c5d8b-8qwpt\" (UID: \"94ef105d-b176-4e2c-bf38-848e2c2a4982\") " pod="openshift-console/console-67646c5d8b-8qwpt" Jun 11 15:03:53.961008 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:53.960881 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/94ef105d-b176-4e2c-bf38-848e2c2a4982-console-config\") pod \"console-67646c5d8b-8qwpt\" (UID: \"94ef105d-b176-4e2c-bf38-848e2c2a4982\") " pod="openshift-console/console-67646c5d8b-8qwpt" Jun 11 15:03:53.961008 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:53.960904 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/94ef105d-b176-4e2c-bf38-848e2c2a4982-oauth-serving-cert\") pod \"console-67646c5d8b-8qwpt\" (UID: \"94ef105d-b176-4e2c-bf38-848e2c2a4982\") " pod="openshift-console/console-67646c5d8b-8qwpt" Jun 11 15:03:53.961008 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:53.960924 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2hc8\" (UniqueName: \"kubernetes.io/projected/94ef105d-b176-4e2c-bf38-848e2c2a4982-kube-api-access-p2hc8\") pod \"console-67646c5d8b-8qwpt\" (UID: \"94ef105d-b176-4e2c-bf38-848e2c2a4982\") " pod="openshift-console/console-67646c5d8b-8qwpt" Jun 11 15:03:53.961008 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:53.960972 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/94ef105d-b176-4e2c-bf38-848e2c2a4982-console-oauth-config\") pod \"console-67646c5d8b-8qwpt\" (UID: \"94ef105d-b176-4e2c-bf38-848e2c2a4982\") " pod="openshift-console/console-67646c5d8b-8qwpt" Jun 11 15:03:53.961008 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:53.960993 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/94ef105d-b176-4e2c-bf38-848e2c2a4982-service-ca\") pod \"console-67646c5d8b-8qwpt\" (UID: \"94ef105d-b176-4e2c-bf38-848e2c2a4982\") " pod="openshift-console/console-67646c5d8b-8qwpt" Jun 11 15:03:53.961910 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:53.961889 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/94ef105d-b176-4e2c-bf38-848e2c2a4982-console-config\") pod \"console-67646c5d8b-8qwpt\" (UID: \"94ef105d-b176-4e2c-bf38-848e2c2a4982\") " pod="openshift-console/console-67646c5d8b-8qwpt" Jun 11 15:03:53.961999 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:53.961947 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/94ef105d-b176-4e2c-bf38-848e2c2a4982-service-ca\") pod \"console-67646c5d8b-8qwpt\" (UID: \"94ef105d-b176-4e2c-bf38-848e2c2a4982\") " pod="openshift-console/console-67646c5d8b-8qwpt" Jun 11 15:03:53.961999 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:53.961947 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/94ef105d-b176-4e2c-bf38-848e2c2a4982-oauth-serving-cert\") pod \"console-67646c5d8b-8qwpt\" (UID: \"94ef105d-b176-4e2c-bf38-848e2c2a4982\") " pod="openshift-console/console-67646c5d8b-8qwpt" Jun 11 15:03:53.964175 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:53.964155 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/94ef105d-b176-4e2c-bf38-848e2c2a4982-console-oauth-config\") pod \"console-67646c5d8b-8qwpt\" (UID: \"94ef105d-b176-4e2c-bf38-848e2c2a4982\") " pod="openshift-console/console-67646c5d8b-8qwpt" Jun 11 15:03:53.964261 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:53.964244 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/94ef105d-b176-4e2c-bf38-848e2c2a4982-console-serving-cert\") pod \"console-67646c5d8b-8qwpt\" (UID: \"94ef105d-b176-4e2c-bf38-848e2c2a4982\") " pod="openshift-console/console-67646c5d8b-8qwpt" Jun 11 15:03:53.972126 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:53.972105 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2hc8\" (UniqueName: \"kubernetes.io/projected/94ef105d-b176-4e2c-bf38-848e2c2a4982-kube-api-access-p2hc8\") pod \"console-67646c5d8b-8qwpt\" (UID: \"94ef105d-b176-4e2c-bf38-848e2c2a4982\") " pod="openshift-console/console-67646c5d8b-8qwpt" Jun 11 15:03:54.052516 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:54.052491 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67646c5d8b-8qwpt" Jun 11 15:03:54.208084 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:03:54.207936 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94ef105d_b176_4e2c_bf38_848e2c2a4982.slice/crio-d6c4138b45c7ceb8dfd7fa60305143e4d5ede5b7d73a9690bb874ad13cf50b65 WatchSource:0}: Error finding container d6c4138b45c7ceb8dfd7fa60305143e4d5ede5b7d73a9690bb874ad13cf50b65: Status 404 returned error can't find the container with id d6c4138b45c7ceb8dfd7fa60305143e4d5ede5b7d73a9690bb874ad13cf50b65 Jun 11 15:03:54.208313 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:54.208293 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67646c5d8b-8qwpt"] Jun 11 15:03:54.709145 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:54.709105 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67646c5d8b-8qwpt" event={"ID":"94ef105d-b176-4e2c-bf38-848e2c2a4982","Type":"ContainerStarted","Data":"d6c4138b45c7ceb8dfd7fa60305143e4d5ede5b7d73a9690bb874ad13cf50b65"} Jun 11 15:03:54.711473 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:54.711441 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8p88n" event={"ID":"9af3479b-46bb-4f61-ba00-f98c42f7be10","Type":"ContainerStarted","Data":"fb7e5e74efd3437997b642bcec5a282802c7c4c0ed5d7332c60df514b96507e3"} Jun 11 15:03:56.720831 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:56.720794 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-24qb9" event={"ID":"7ab0932f-0e62-4a6d-96aa-03730640b94f","Type":"ContainerStarted","Data":"f2aeb626fc4c6c8b92fe01cbe9837871d421303b7a7efaabc5cf293886fb91c2"} Jun 11 15:03:56.721525 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:56.720858 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-24qb9" event={"ID":"7ab0932f-0e62-4a6d-96aa-03730640b94f","Type":"ContainerStarted","Data":"6f84e14e8f95e90f89de3b73563fdc9ae5c04d1c2b6225cf7caed62a9edf09ca"} Jun 11 15:03:56.721525 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:56.720884 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-24qb9" Jun 11 15:03:56.722367 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:56.722342 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-t8gh8" event={"ID":"fb07ba89-003b-4871-bf42-c63ff69b6d3a","Type":"ContainerStarted","Data":"20b6295e84e6678838c48b0d59765364b194dcfe15fd1e2196e0e6ed2a796c6a"} Jun 11 15:03:56.724541 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:56.724517 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8p88n" event={"ID":"9af3479b-46bb-4f61-ba00-f98c42f7be10","Type":"ContainerStarted","Data":"e5baf553d253155f84e44b2e477096fc687aab0f49c60a7a9d32cba58ef5b9c5"} Jun 11 15:03:56.743699 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:56.743658 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-24qb9" podStartSLOduration=2.182683707 podStartE2EDuration="5.743644675s" totalImagesPullingTime="3.560960968s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:03:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:03:56.743227034 +0000 UTC m=+71.691851321" watchObservedRunningTime="2026-06-11 15:03:56.743644675 +0000 UTC m=+71.692268927" Jun 11 15:03:56.763893 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:56.763843 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-t8gh8" podStartSLOduration=2.217621804 podStartE2EDuration="5.763830036s" totalImagesPullingTime="3.546208232s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:03:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:03:56.762636545 +0000 UTC m=+71.711260807" watchObservedRunningTime="2026-06-11 15:03:56.763830036 +0000 UTC m=+71.712454297" Jun 11 15:03:56.784993 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:56.784933 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-8p88n" podStartSLOduration=2.394477522 podStartE2EDuration="5.784918999s" totalImagesPullingTime="3.390441477s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 15:03:51 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:03:56.784070953 +0000 UTC m=+71.732695216" watchObservedRunningTime="2026-06-11 15:03:56.784918999 +0000 UTC m=+71.733543260" Jun 11 15:03:57.729798 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:57.729750 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67646c5d8b-8qwpt" event={"ID":"94ef105d-b176-4e2c-bf38-848e2c2a4982","Type":"ContainerStarted","Data":"39167530b1fff5586c50c39222d1482e9bb601ad683877830c9a83c21d764ce2"} Jun 11 15:03:57.752828 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:57.752780 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-67646c5d8b-8qwpt" podStartSLOduration=1.423382259 podStartE2EDuration="4.75274129s" totalImagesPullingTime="3.329359031s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:03:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:03:57.751895031 +0000 UTC m=+72.700519290" watchObservedRunningTime="2026-06-11 15:03:57.75274129 +0000 UTC m=+72.701365553" Jun 11 15:03:57.933693 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:57.933612 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-sqqds"] Jun 11 15:03:57.938700 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:57.938684 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-sqqds" Jun 11 15:03:57.941879 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:57.941856 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-dh4fv\"" Jun 11 15:03:57.941991 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:57.941878 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 11 15:03:57.941991 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:57.941897 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 11 15:03:57.941991 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:57.941856 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 11 15:03:57.941991 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:57.941856 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 11 15:03:57.942259 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:57.942247 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 11 15:03:57.959735 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:57.959705 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-sqqds"] Jun 11 15:03:57.965184 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:57.965164 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-rq2bp"] Jun 11 15:03:57.967295 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:57.967282 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-rq2bp" Jun 11 15:03:57.969906 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:57.969890 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 11 15:03:57.969991 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:57.969891 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 11 15:03:57.970523 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:57.970500 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-q826t\"" Jun 11 15:03:57.973241 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:57.973202 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-kscd8"] Jun 11 15:03:57.973480 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:57.973458 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 11 15:03:57.975155 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:57.975138 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kscd8" Jun 11 15:03:57.979369 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:57.979350 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 11 15:03:57.979988 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:57.979969 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 11 15:03:57.980100 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:57.980045 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 11 15:03:57.980580 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:57.980535 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-j8zqb\"" Jun 11 15:03:58.012815 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:58.012789 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-rq2bp"] Jun 11 15:03:58.093316 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:58.093286 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/90726557-a154-421b-b150-b042c021f9ab-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-sqqds\" (UID: \"90726557-a154-421b-b150-b042c021f9ab\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-sqqds" Jun 11 15:03:58.093316 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:58.093321 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/90726557-a154-421b-b150-b042c021f9ab-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-sqqds\" (UID: \"90726557-a154-421b-b150-b042c021f9ab\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-sqqds" Jun 11 15:03:58.093538 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:58.093352 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqn44\" (UniqueName: \"kubernetes.io/projected/90726557-a154-421b-b150-b042c021f9ab-kube-api-access-rqn44\") pod \"openshift-state-metrics-65f78d5c66-sqqds\" (UID: \"90726557-a154-421b-b150-b042c021f9ab\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-sqqds" Jun 11 15:03:58.093538 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:58.093411 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/032eda1b-5d44-4124-81d8-bba06fda9990-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-rq2bp\" (UID: \"032eda1b-5d44-4124-81d8-bba06fda9990\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-rq2bp" Jun 11 15:03:58.093538 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:58.093459 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/813b240a-c0b4-4344-b3ed-84eaff07a99d-metrics-client-ca\") pod \"node-exporter-kscd8\" (UID: \"813b240a-c0b4-4344-b3ed-84eaff07a99d\") " pod="openshift-monitoring/node-exporter-kscd8" Jun 11 15:03:58.093538 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:58.093482 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/813b240a-c0b4-4344-b3ed-84eaff07a99d-root\") pod \"node-exporter-kscd8\" (UID: \"813b240a-c0b4-4344-b3ed-84eaff07a99d\") " pod="openshift-monitoring/node-exporter-kscd8" Jun 11 15:03:58.093538 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:58.093501 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5cc8\" (UniqueName: \"kubernetes.io/projected/032eda1b-5d44-4124-81d8-bba06fda9990-kube-api-access-t5cc8\") pod \"kube-state-metrics-57bbf8bfb5-rq2bp\" (UID: \"032eda1b-5d44-4124-81d8-bba06fda9990\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-rq2bp" Jun 11 15:03:58.093538 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:58.093519 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/032eda1b-5d44-4124-81d8-bba06fda9990-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-rq2bp\" (UID: \"032eda1b-5d44-4124-81d8-bba06fda9990\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-rq2bp" Jun 11 15:03:58.093810 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:58.093591 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/813b240a-c0b4-4344-b3ed-84eaff07a99d-sys\") pod \"node-exporter-kscd8\" (UID: \"813b240a-c0b4-4344-b3ed-84eaff07a99d\") " pod="openshift-monitoring/node-exporter-kscd8" Jun 11 15:03:58.093810 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:58.093616 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/813b240a-c0b4-4344-b3ed-84eaff07a99d-node-exporter-textfile\") pod \"node-exporter-kscd8\" (UID: \"813b240a-c0b4-4344-b3ed-84eaff07a99d\") " pod="openshift-monitoring/node-exporter-kscd8" Jun 11 15:03:58.093810 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:58.093639 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/032eda1b-5d44-4124-81d8-bba06fda9990-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-rq2bp\" (UID: \"032eda1b-5d44-4124-81d8-bba06fda9990\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-rq2bp" Jun 11 15:03:58.093810 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:58.093667 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/032eda1b-5d44-4124-81d8-bba06fda9990-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-rq2bp\" (UID: \"032eda1b-5d44-4124-81d8-bba06fda9990\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-rq2bp" Jun 11 15:03:58.093810 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:58.093686 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5nhp\" (UniqueName: \"kubernetes.io/projected/813b240a-c0b4-4344-b3ed-84eaff07a99d-kube-api-access-c5nhp\") pod \"node-exporter-kscd8\" (UID: \"813b240a-c0b4-4344-b3ed-84eaff07a99d\") " pod="openshift-monitoring/node-exporter-kscd8" Jun 11 15:03:58.093810 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:58.093733 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/813b240a-c0b4-4344-b3ed-84eaff07a99d-node-exporter-accelerators-collector-config\") pod \"node-exporter-kscd8\" (UID: \"813b240a-c0b4-4344-b3ed-84eaff07a99d\") " pod="openshift-monitoring/node-exporter-kscd8" Jun 11 15:03:58.093810 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:58.093805 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/813b240a-c0b4-4344-b3ed-84eaff07a99d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kscd8\" (UID: \"813b240a-c0b4-4344-b3ed-84eaff07a99d\") " pod="openshift-monitoring/node-exporter-kscd8" Jun 11 15:03:58.094097 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:58.093832 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/813b240a-c0b4-4344-b3ed-84eaff07a99d-node-exporter-wtmp\") pod \"node-exporter-kscd8\" (UID: \"813b240a-c0b4-4344-b3ed-84eaff07a99d\") " pod="openshift-monitoring/node-exporter-kscd8" Jun 11 15:03:58.094097 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:58.093870 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/90726557-a154-421b-b150-b042c021f9ab-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-sqqds\" (UID: \"90726557-a154-421b-b150-b042c021f9ab\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-sqqds" Jun 11 15:03:58.094097 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:58.093912 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/032eda1b-5d44-4124-81d8-bba06fda9990-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-rq2bp\" (UID: \"032eda1b-5d44-4124-81d8-bba06fda9990\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-rq2bp" Jun 11 15:03:58.094097 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:58.093936 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/813b240a-c0b4-4344-b3ed-84eaff07a99d-node-exporter-tls\") pod \"node-exporter-kscd8\" (UID: \"813b240a-c0b4-4344-b3ed-84eaff07a99d\") " pod="openshift-monitoring/node-exporter-kscd8" Jun 11 15:03:58.195225 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:58.195137 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/032eda1b-5d44-4124-81d8-bba06fda9990-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-rq2bp\" (UID: \"032eda1b-5d44-4124-81d8-bba06fda9990\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-rq2bp" Jun 11 15:03:58.195225 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:58.195179 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/813b240a-c0b4-4344-b3ed-84eaff07a99d-node-exporter-tls\") pod \"node-exporter-kscd8\" (UID: \"813b240a-c0b4-4344-b3ed-84eaff07a99d\") " pod="openshift-monitoring/node-exporter-kscd8" Jun 11 15:03:58.195225 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:58.195199 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/90726557-a154-421b-b150-b042c021f9ab-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-sqqds\" (UID: \"90726557-a154-421b-b150-b042c021f9ab\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-sqqds" Jun 11 15:03:58.195225 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:58.195225 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/90726557-a154-421b-b150-b042c021f9ab-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-sqqds\" (UID: \"90726557-a154-421b-b150-b042c021f9ab\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-sqqds" Jun 11 15:03:58.195546 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:58.195405 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqn44\" (UniqueName: \"kubernetes.io/projected/90726557-a154-421b-b150-b042c021f9ab-kube-api-access-rqn44\") pod \"openshift-state-metrics-65f78d5c66-sqqds\" (UID: \"90726557-a154-421b-b150-b042c021f9ab\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-sqqds" Jun 11 15:03:58.195546 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:58.195444 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/032eda1b-5d44-4124-81d8-bba06fda9990-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-rq2bp\" (UID: \"032eda1b-5d44-4124-81d8-bba06fda9990\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-rq2bp" Jun 11 15:03:58.195546 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:58.195464 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/813b240a-c0b4-4344-b3ed-84eaff07a99d-metrics-client-ca\") pod \"node-exporter-kscd8\" (UID: \"813b240a-c0b4-4344-b3ed-84eaff07a99d\") " pod="openshift-monitoring/node-exporter-kscd8" Jun 11 15:03:58.195546 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:58.195489 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/813b240a-c0b4-4344-b3ed-84eaff07a99d-root\") pod \"node-exporter-kscd8\" (UID: \"813b240a-c0b4-4344-b3ed-84eaff07a99d\") " pod="openshift-monitoring/node-exporter-kscd8" Jun 11 15:03:58.195546 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:58.195520 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5cc8\" (UniqueName: \"kubernetes.io/projected/032eda1b-5d44-4124-81d8-bba06fda9990-kube-api-access-t5cc8\") pod \"kube-state-metrics-57bbf8bfb5-rq2bp\" (UID: \"032eda1b-5d44-4124-81d8-bba06fda9990\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-rq2bp" Jun 11 15:03:58.195823 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:58.195547 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/032eda1b-5d44-4124-81d8-bba06fda9990-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-rq2bp\" (UID: \"032eda1b-5d44-4124-81d8-bba06fda9990\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-rq2bp" Jun 11 15:03:58.195823 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:58.195588 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/813b240a-c0b4-4344-b3ed-84eaff07a99d-sys\") pod \"node-exporter-kscd8\" (UID: \"813b240a-c0b4-4344-b3ed-84eaff07a99d\") " pod="openshift-monitoring/node-exporter-kscd8" Jun 11 15:03:58.195823 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:58.195610 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/813b240a-c0b4-4344-b3ed-84eaff07a99d-node-exporter-textfile\") pod \"node-exporter-kscd8\" (UID: \"813b240a-c0b4-4344-b3ed-84eaff07a99d\") " pod="openshift-monitoring/node-exporter-kscd8" Jun 11 15:03:58.195823 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:58.195637 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/032eda1b-5d44-4124-81d8-bba06fda9990-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-rq2bp\" (UID: \"032eda1b-5d44-4124-81d8-bba06fda9990\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-rq2bp" Jun 11 15:03:58.195823 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:58.195683 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/032eda1b-5d44-4124-81d8-bba06fda9990-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-rq2bp\" (UID: \"032eda1b-5d44-4124-81d8-bba06fda9990\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-rq2bp" Jun 11 15:03:58.195823 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:58.195714 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5nhp\" (UniqueName: \"kubernetes.io/projected/813b240a-c0b4-4344-b3ed-84eaff07a99d-kube-api-access-c5nhp\") pod \"node-exporter-kscd8\" (UID: \"813b240a-c0b4-4344-b3ed-84eaff07a99d\") " pod="openshift-monitoring/node-exporter-kscd8" Jun 11 15:03:58.195823 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:58.195781 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/813b240a-c0b4-4344-b3ed-84eaff07a99d-node-exporter-accelerators-collector-config\") pod \"node-exporter-kscd8\" (UID: \"813b240a-c0b4-4344-b3ed-84eaff07a99d\") " pod="openshift-monitoring/node-exporter-kscd8" Jun 11 15:03:58.196162 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:58.195836 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/813b240a-c0b4-4344-b3ed-84eaff07a99d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kscd8\" (UID: \"813b240a-c0b4-4344-b3ed-84eaff07a99d\") " pod="openshift-monitoring/node-exporter-kscd8" Jun 11 15:03:58.196162 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:58.195864 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/813b240a-c0b4-4344-b3ed-84eaff07a99d-node-exporter-wtmp\") pod \"node-exporter-kscd8\" (UID: \"813b240a-c0b4-4344-b3ed-84eaff07a99d\") " pod="openshift-monitoring/node-exporter-kscd8" Jun 11 15:03:58.196162 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:58.195896 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/90726557-a154-421b-b150-b042c021f9ab-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-sqqds\" (UID: \"90726557-a154-421b-b150-b042c021f9ab\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-sqqds" Jun 11 15:03:58.196162 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:03:58.196023 2569 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jun 11 15:03:58.196162 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:03:58.196086 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90726557-a154-421b-b150-b042c021f9ab-openshift-state-metrics-tls podName:90726557-a154-421b-b150-b042c021f9ab nodeName:}" failed. No retries permitted until 2026-06-11 15:03:58.696067485 +0000 UTC m=+73.644691741 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/90726557-a154-421b-b150-b042c021f9ab-openshift-state-metrics-tls") pod "openshift-state-metrics-65f78d5c66-sqqds" (UID: "90726557-a154-421b-b150-b042c021f9ab") : secret "openshift-state-metrics-tls" not found Jun 11 15:03:58.196162 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:58.196088 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/90726557-a154-421b-b150-b042c021f9ab-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-sqqds\" (UID: \"90726557-a154-421b-b150-b042c021f9ab\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-sqqds" Jun 11 15:03:58.196566 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:58.196248 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/032eda1b-5d44-4124-81d8-bba06fda9990-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-rq2bp\" (UID: \"032eda1b-5d44-4124-81d8-bba06fda9990\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-rq2bp" Jun 11 15:03:58.196566 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:58.196301 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/813b240a-c0b4-4344-b3ed-84eaff07a99d-root\") pod \"node-exporter-kscd8\" (UID: \"813b240a-c0b4-4344-b3ed-84eaff07a99d\") " pod="openshift-monitoring/node-exporter-kscd8" Jun 11 15:03:58.196566 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:58.196306 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/813b240a-c0b4-4344-b3ed-84eaff07a99d-metrics-client-ca\") pod \"node-exporter-kscd8\" (UID: \"813b240a-c0b4-4344-b3ed-84eaff07a99d\") " pod="openshift-monitoring/node-exporter-kscd8" Jun 11 15:03:58.196734 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:58.196567 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/813b240a-c0b4-4344-b3ed-84eaff07a99d-node-exporter-textfile\") pod \"node-exporter-kscd8\" (UID: \"813b240a-c0b4-4344-b3ed-84eaff07a99d\") " pod="openshift-monitoring/node-exporter-kscd8" Jun 11 15:03:58.196734 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:58.195835 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/813b240a-c0b4-4344-b3ed-84eaff07a99d-sys\") pod \"node-exporter-kscd8\" (UID: \"813b240a-c0b4-4344-b3ed-84eaff07a99d\") " pod="openshift-monitoring/node-exporter-kscd8" Jun 11 15:03:58.196734 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:58.196666 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/032eda1b-5d44-4124-81d8-bba06fda9990-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-rq2bp\" (UID: \"032eda1b-5d44-4124-81d8-bba06fda9990\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-rq2bp" Jun 11 15:03:58.196734 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:58.196677 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/813b240a-c0b4-4344-b3ed-84eaff07a99d-node-exporter-wtmp\") pod \"node-exporter-kscd8\" (UID: \"813b240a-c0b4-4344-b3ed-84eaff07a99d\") " pod="openshift-monitoring/node-exporter-kscd8" Jun 11 15:03:58.196956 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:03:58.196792 2569 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jun 11 15:03:58.196956 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:03:58.196843 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/032eda1b-5d44-4124-81d8-bba06fda9990-kube-state-metrics-tls podName:032eda1b-5d44-4124-81d8-bba06fda9990 nodeName:}" failed. No retries permitted until 2026-06-11 15:03:58.696826647 +0000 UTC m=+73.645450901 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/032eda1b-5d44-4124-81d8-bba06fda9990-kube-state-metrics-tls") pod "kube-state-metrics-57bbf8bfb5-rq2bp" (UID: "032eda1b-5d44-4124-81d8-bba06fda9990") : secret "kube-state-metrics-tls" not found Jun 11 15:03:58.196956 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:58.196940 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/032eda1b-5d44-4124-81d8-bba06fda9990-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-rq2bp\" (UID: \"032eda1b-5d44-4124-81d8-bba06fda9990\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-rq2bp" Jun 11 15:03:58.197189 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:58.197165 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/813b240a-c0b4-4344-b3ed-84eaff07a99d-node-exporter-accelerators-collector-config\") pod \"node-exporter-kscd8\" (UID: \"813b240a-c0b4-4344-b3ed-84eaff07a99d\") " pod="openshift-monitoring/node-exporter-kscd8" Jun 11 15:03:58.198647 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:58.198624 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/813b240a-c0b4-4344-b3ed-84eaff07a99d-node-exporter-tls\") pod \"node-exporter-kscd8\" (UID: \"813b240a-c0b4-4344-b3ed-84eaff07a99d\") " pod="openshift-monitoring/node-exporter-kscd8" Jun 11 15:03:58.198739 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:58.198702 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/90726557-a154-421b-b150-b042c021f9ab-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-sqqds\" (UID: \"90726557-a154-421b-b150-b042c021f9ab\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-sqqds" Jun 11 15:03:58.198996 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:58.198977 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/813b240a-c0b4-4344-b3ed-84eaff07a99d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kscd8\" (UID: \"813b240a-c0b4-4344-b3ed-84eaff07a99d\") " pod="openshift-monitoring/node-exporter-kscd8" Jun 11 15:03:58.199049 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:58.199031 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/032eda1b-5d44-4124-81d8-bba06fda9990-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-rq2bp\" (UID: \"032eda1b-5d44-4124-81d8-bba06fda9990\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-rq2bp" Jun 11 15:03:58.211355 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:58.211329 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5cc8\" (UniqueName: \"kubernetes.io/projected/032eda1b-5d44-4124-81d8-bba06fda9990-kube-api-access-t5cc8\") pod \"kube-state-metrics-57bbf8bfb5-rq2bp\" (UID: \"032eda1b-5d44-4124-81d8-bba06fda9990\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-rq2bp" Jun 11 15:03:58.212623 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:58.212605 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqn44\" (UniqueName: \"kubernetes.io/projected/90726557-a154-421b-b150-b042c021f9ab-kube-api-access-rqn44\") pod \"openshift-state-metrics-65f78d5c66-sqqds\" (UID: \"90726557-a154-421b-b150-b042c021f9ab\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-sqqds" Jun 11 15:03:58.212891 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:58.212875 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5nhp\" (UniqueName: \"kubernetes.io/projected/813b240a-c0b4-4344-b3ed-84eaff07a99d-kube-api-access-c5nhp\") pod \"node-exporter-kscd8\" (UID: \"813b240a-c0b4-4344-b3ed-84eaff07a99d\") " pod="openshift-monitoring/node-exporter-kscd8" Jun 11 15:03:58.283164 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:58.283145 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kscd8" Jun 11 15:03:58.292173 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:03:58.292154 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod813b240a_c0b4_4344_b3ed_84eaff07a99d.slice/crio-3504f200458d9827c138a5f291fe0e520c6b2b2a20cd2e94302b5b1f7e7932fa WatchSource:0}: Error finding container 3504f200458d9827c138a5f291fe0e520c6b2b2a20cd2e94302b5b1f7e7932fa: Status 404 returned error can't find the container with id 3504f200458d9827c138a5f291fe0e520c6b2b2a20cd2e94302b5b1f7e7932fa Jun 11 15:03:58.700075 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:58.700036 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/032eda1b-5d44-4124-81d8-bba06fda9990-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-rq2bp\" (UID: \"032eda1b-5d44-4124-81d8-bba06fda9990\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-rq2bp" Jun 11 15:03:58.700247 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:58.700145 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/90726557-a154-421b-b150-b042c021f9ab-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-sqqds\" (UID: \"90726557-a154-421b-b150-b042c021f9ab\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-sqqds" Jun 11 15:03:58.702745 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:58.702723 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/032eda1b-5d44-4124-81d8-bba06fda9990-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-rq2bp\" (UID: \"032eda1b-5d44-4124-81d8-bba06fda9990\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-rq2bp" Jun 11 15:03:58.702994 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:58.702968 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/90726557-a154-421b-b150-b042c021f9ab-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-sqqds\" (UID: \"90726557-a154-421b-b150-b042c021f9ab\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-sqqds" Jun 11 15:03:58.734372 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:58.734340 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kscd8" event={"ID":"813b240a-c0b4-4344-b3ed-84eaff07a99d","Type":"ContainerStarted","Data":"3504f200458d9827c138a5f291fe0e520c6b2b2a20cd2e94302b5b1f7e7932fa"} Jun 11 15:03:58.848018 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:58.847987 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-sqqds" Jun 11 15:03:58.876460 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:58.876428 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-rq2bp" Jun 11 15:03:58.970143 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:58.970068 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 15:03:58.972671 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:58.972651 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:03:58.977077 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:58.977045 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 11 15:03:58.977077 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:58.977059 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 11 15:03:58.977225 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:58.977172 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 11 15:03:58.993195 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:58.993026 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 11 15:03:58.993195 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:58.993056 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-tx755\"" Jun 11 15:03:58.993195 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:58.993060 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 11 15:03:58.993195 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:58.993116 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 11 15:03:58.993195 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:58.993120 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 11 15:03:58.993195 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:58.993124 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 11 15:03:58.993478 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:58.993442 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 11 15:03:59.024289 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:59.024170 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-sqqds"] Jun 11 15:03:59.045430 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:59.045355 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 15:03:59.085852 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:03:59.085812 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90726557_a154_421b_b150_b042c021f9ab.slice/crio-585b7ab0022e0f68a784ffe8637e65c6e3fa69f1c9693d13253d9a18ca70f2db WatchSource:0}: Error finding container 585b7ab0022e0f68a784ffe8637e65c6e3fa69f1c9693d13253d9a18ca70f2db: Status 404 returned error can't find the container with id 585b7ab0022e0f68a784ffe8637e65c6e3fa69f1c9693d13253d9a18ca70f2db Jun 11 15:03:59.103305 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:59.103279 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:03:59.103437 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:59.103323 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:03:59.103437 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:59.103346 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c-config-out\") pod \"alertmanager-main-0\" (UID: \"d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:03:59.103437 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:59.103363 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:03:59.103437 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:59.103383 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:03:59.103437 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:59.103420 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c-config-volume\") pod \"alertmanager-main-0\" (UID: \"d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:03:59.103626 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:59.103554 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:03:59.103670 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:59.103624 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c-web-config\") pod \"alertmanager-main-0\" (UID: \"d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:03:59.103670 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:59.103661 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:03:59.103746 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:59.103689 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:03:59.103746 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:59.103710 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:03:59.103875 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:59.103828 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmknl\" (UniqueName: \"kubernetes.io/projected/d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c-kube-api-access-gmknl\") pod \"alertmanager-main-0\" (UID: \"d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:03:59.103875 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:59.103863 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:03:59.205506 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:59.205046 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:03:59.205506 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:59.205090 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:03:59.205506 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:59.205147 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmknl\" (UniqueName: \"kubernetes.io/projected/d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c-kube-api-access-gmknl\") pod \"alertmanager-main-0\" (UID: \"d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:03:59.205506 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:59.205172 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:03:59.205506 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:59.205198 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:03:59.205506 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:59.205232 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:03:59.205506 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:59.205265 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c-config-out\") pod \"alertmanager-main-0\" (UID: \"d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:03:59.205506 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:59.205301 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:03:59.205506 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:59.205325 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:03:59.205506 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:59.205353 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c-config-volume\") pod \"alertmanager-main-0\" (UID: \"d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:03:59.205506 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:59.205380 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:03:59.205506 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:59.205447 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c-web-config\") pod \"alertmanager-main-0\" (UID: \"d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:03:59.205506 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:59.205494 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:03:59.206479 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:59.206450 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:03:59.207429 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:59.207353 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:03:59.208157 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:59.207986 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:03:59.208427 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:59.208403 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:03:59.211012 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:59.210969 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:03:59.211012 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:59.211006 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c-config-volume\") pod \"alertmanager-main-0\" (UID: \"d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:03:59.211802 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:59.211317 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c-web-config\") pod \"alertmanager-main-0\" (UID: \"d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:03:59.211802 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:59.211677 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:03:59.211802 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:59.211802 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:03:59.212357 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:59.212325 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:03:59.212877 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:59.212843 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c-config-out\") pod \"alertmanager-main-0\" (UID: \"d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:03:59.213380 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:59.213360 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:03:59.221948 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:59.221887 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmknl\" (UniqueName: \"kubernetes.io/projected/d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c-kube-api-access-gmknl\") pod \"alertmanager-main-0\" (UID: \"d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:03:59.236260 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:59.236176 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-rq2bp"] Jun 11 15:03:59.239451 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:03:59.239395 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod032eda1b_5d44_4124_81d8_bba06fda9990.slice/crio-24b24493941c1effc995eead4a40714b79aae3b36e31851f67af1865da339020 WatchSource:0}: Error finding container 24b24493941c1effc995eead4a40714b79aae3b36e31851f67af1865da339020: Status 404 returned error can't find the container with id 24b24493941c1effc995eead4a40714b79aae3b36e31851f67af1865da339020 Jun 11 15:03:59.282708 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:59.282678 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:03:59.423010 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:59.422978 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 15:03:59.426474 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:03:59.426448 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd34c1138_26af_4d0a_bcb6_a6bbbe0b5d3c.slice/crio-4f4e9883c854d7d28c9e62c9c8f456b409937615334903a52e2cf1512e8f8379 WatchSource:0}: Error finding container 4f4e9883c854d7d28c9e62c9c8f456b409937615334903a52e2cf1512e8f8379: Status 404 returned error can't find the container with id 4f4e9883c854d7d28c9e62c9c8f456b409937615334903a52e2cf1512e8f8379 Jun 11 15:03:59.740516 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:59.740456 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c","Type":"ContainerStarted","Data":"4f4e9883c854d7d28c9e62c9c8f456b409937615334903a52e2cf1512e8f8379"} Jun 11 15:03:59.742409 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:59.742372 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-sqqds" event={"ID":"90726557-a154-421b-b150-b042c021f9ab","Type":"ContainerStarted","Data":"ce07723272b734bbf15fe9a0d04062fe4abf204b1a71d63c5a3180d489ad2dbd"} Jun 11 15:03:59.742538 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:59.742434 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-sqqds" event={"ID":"90726557-a154-421b-b150-b042c021f9ab","Type":"ContainerStarted","Data":"125ec00c135799d492ffe74e34e93b1f4ea44dc88331545c55a356a763b3b93e"} Jun 11 15:03:59.742538 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:59.742465 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-sqqds" event={"ID":"90726557-a154-421b-b150-b042c021f9ab","Type":"ContainerStarted","Data":"585b7ab0022e0f68a784ffe8637e65c6e3fa69f1c9693d13253d9a18ca70f2db"} Jun 11 15:03:59.743808 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:59.743783 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-rq2bp" event={"ID":"032eda1b-5d44-4124-81d8-bba06fda9990","Type":"ContainerStarted","Data":"24b24493941c1effc995eead4a40714b79aae3b36e31851f67af1865da339020"} Jun 11 15:03:59.745354 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:59.745329 2569 generic.go:356] "Generic (PLEG): container finished" podID="813b240a-c0b4-4344-b3ed-84eaff07a99d" containerID="314c2bba2ae6b18372a910cf4c29133b6ffab9a7192e303bc93d18b7eabb0a90" exitCode=0 Jun 11 15:03:59.745436 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:03:59.745363 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kscd8" event={"ID":"813b240a-c0b4-4344-b3ed-84eaff07a99d","Type":"ContainerDied","Data":"314c2bba2ae6b18372a910cf4c29133b6ffab9a7192e303bc93d18b7eabb0a90"} Jun 11 15:04:00.016421 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:00.016333 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7898878f7c-d5srf"] Jun 11 15:04:00.020535 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:00.020510 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7898878f7c-d5srf" Jun 11 15:04:00.023858 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:00.023660 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 11 15:04:00.023858 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:00.023740 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-dbqw5\"" Jun 11 15:04:00.025396 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:00.025000 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 11 15:04:00.025396 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:00.025041 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-bicg90qu2gku4\"" Jun 11 15:04:00.025396 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:00.025177 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 11 15:04:00.025396 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:00.025257 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 11 15:04:00.025396 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:00.025315 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 11 15:04:00.051715 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:00.051622 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7898878f7c-d5srf"] Jun 11 15:04:00.112994 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:00.112546 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b9206504-36c2-4856-93ef-e37ae24c9db6-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7898878f7c-d5srf\" (UID: \"b9206504-36c2-4856-93ef-e37ae24c9db6\") " pod="openshift-monitoring/thanos-querier-7898878f7c-d5srf" Jun 11 15:04:00.112994 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:00.112600 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b9206504-36c2-4856-93ef-e37ae24c9db6-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7898878f7c-d5srf\" (UID: \"b9206504-36c2-4856-93ef-e37ae24c9db6\") " pod="openshift-monitoring/thanos-querier-7898878f7c-d5srf" Jun 11 15:04:00.112994 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:00.112644 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b9206504-36c2-4856-93ef-e37ae24c9db6-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7898878f7c-d5srf\" (UID: \"b9206504-36c2-4856-93ef-e37ae24c9db6\") " pod="openshift-monitoring/thanos-querier-7898878f7c-d5srf" Jun 11 15:04:00.112994 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:00.112669 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b9206504-36c2-4856-93ef-e37ae24c9db6-secret-grpc-tls\") pod \"thanos-querier-7898878f7c-d5srf\" (UID: \"b9206504-36c2-4856-93ef-e37ae24c9db6\") " pod="openshift-monitoring/thanos-querier-7898878f7c-d5srf" Jun 11 15:04:00.112994 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:00.112695 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dhtk\" (UniqueName: \"kubernetes.io/projected/b9206504-36c2-4856-93ef-e37ae24c9db6-kube-api-access-6dhtk\") pod \"thanos-querier-7898878f7c-d5srf\" (UID: \"b9206504-36c2-4856-93ef-e37ae24c9db6\") " pod="openshift-monitoring/thanos-querier-7898878f7c-d5srf" Jun 11 15:04:00.112994 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:00.112771 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b9206504-36c2-4856-93ef-e37ae24c9db6-secret-thanos-querier-tls\") pod \"thanos-querier-7898878f7c-d5srf\" (UID: \"b9206504-36c2-4856-93ef-e37ae24c9db6\") " pod="openshift-monitoring/thanos-querier-7898878f7c-d5srf" Jun 11 15:04:00.112994 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:00.112803 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b9206504-36c2-4856-93ef-e37ae24c9db6-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7898878f7c-d5srf\" (UID: \"b9206504-36c2-4856-93ef-e37ae24c9db6\") " pod="openshift-monitoring/thanos-querier-7898878f7c-d5srf" Jun 11 15:04:00.112994 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:00.112846 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b9206504-36c2-4856-93ef-e37ae24c9db6-metrics-client-ca\") pod \"thanos-querier-7898878f7c-d5srf\" (UID: \"b9206504-36c2-4856-93ef-e37ae24c9db6\") " pod="openshift-monitoring/thanos-querier-7898878f7c-d5srf" Jun 11 15:04:00.213651 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:00.213611 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b9206504-36c2-4856-93ef-e37ae24c9db6-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7898878f7c-d5srf\" (UID: \"b9206504-36c2-4856-93ef-e37ae24c9db6\") " pod="openshift-monitoring/thanos-querier-7898878f7c-d5srf" Jun 11 15:04:00.213853 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:00.213663 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b9206504-36c2-4856-93ef-e37ae24c9db6-secret-grpc-tls\") pod \"thanos-querier-7898878f7c-d5srf\" (UID: \"b9206504-36c2-4856-93ef-e37ae24c9db6\") " pod="openshift-monitoring/thanos-querier-7898878f7c-d5srf" Jun 11 15:04:00.213853 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:00.213692 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dhtk\" (UniqueName: \"kubernetes.io/projected/b9206504-36c2-4856-93ef-e37ae24c9db6-kube-api-access-6dhtk\") pod \"thanos-querier-7898878f7c-d5srf\" (UID: \"b9206504-36c2-4856-93ef-e37ae24c9db6\") " pod="openshift-monitoring/thanos-querier-7898878f7c-d5srf" Jun 11 15:04:00.213853 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:00.213747 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b9206504-36c2-4856-93ef-e37ae24c9db6-secret-thanos-querier-tls\") pod \"thanos-querier-7898878f7c-d5srf\" (UID: \"b9206504-36c2-4856-93ef-e37ae24c9db6\") " pod="openshift-monitoring/thanos-querier-7898878f7c-d5srf" Jun 11 15:04:00.213853 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:00.213798 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b9206504-36c2-4856-93ef-e37ae24c9db6-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7898878f7c-d5srf\" (UID: \"b9206504-36c2-4856-93ef-e37ae24c9db6\") " pod="openshift-monitoring/thanos-querier-7898878f7c-d5srf" Jun 11 15:04:00.213853 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:00.213847 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b9206504-36c2-4856-93ef-e37ae24c9db6-metrics-client-ca\") pod \"thanos-querier-7898878f7c-d5srf\" (UID: \"b9206504-36c2-4856-93ef-e37ae24c9db6\") " pod="openshift-monitoring/thanos-querier-7898878f7c-d5srf" Jun 11 15:04:00.214132 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:00.213929 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b9206504-36c2-4856-93ef-e37ae24c9db6-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7898878f7c-d5srf\" (UID: \"b9206504-36c2-4856-93ef-e37ae24c9db6\") " pod="openshift-monitoring/thanos-querier-7898878f7c-d5srf" Jun 11 15:04:00.214132 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:00.213970 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b9206504-36c2-4856-93ef-e37ae24c9db6-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7898878f7c-d5srf\" (UID: \"b9206504-36c2-4856-93ef-e37ae24c9db6\") " pod="openshift-monitoring/thanos-querier-7898878f7c-d5srf" Jun 11 15:04:00.214988 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:00.214958 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b9206504-36c2-4856-93ef-e37ae24c9db6-metrics-client-ca\") pod \"thanos-querier-7898878f7c-d5srf\" (UID: \"b9206504-36c2-4856-93ef-e37ae24c9db6\") " pod="openshift-monitoring/thanos-querier-7898878f7c-d5srf" Jun 11 15:04:00.216872 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:00.216775 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b9206504-36c2-4856-93ef-e37ae24c9db6-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7898878f7c-d5srf\" (UID: \"b9206504-36c2-4856-93ef-e37ae24c9db6\") " pod="openshift-monitoring/thanos-querier-7898878f7c-d5srf" Jun 11 15:04:00.216872 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:00.216818 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b9206504-36c2-4856-93ef-e37ae24c9db6-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7898878f7c-d5srf\" (UID: \"b9206504-36c2-4856-93ef-e37ae24c9db6\") " pod="openshift-monitoring/thanos-querier-7898878f7c-d5srf" Jun 11 15:04:00.217550 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:00.217501 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b9206504-36c2-4856-93ef-e37ae24c9db6-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7898878f7c-d5srf\" (UID: \"b9206504-36c2-4856-93ef-e37ae24c9db6\") " pod="openshift-monitoring/thanos-querier-7898878f7c-d5srf" Jun 11 15:04:00.218303 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:00.218271 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b9206504-36c2-4856-93ef-e37ae24c9db6-secret-thanos-querier-tls\") pod \"thanos-querier-7898878f7c-d5srf\" (UID: \"b9206504-36c2-4856-93ef-e37ae24c9db6\") " pod="openshift-monitoring/thanos-querier-7898878f7c-d5srf" Jun 11 15:04:00.218712 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:00.218680 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b9206504-36c2-4856-93ef-e37ae24c9db6-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7898878f7c-d5srf\" (UID: \"b9206504-36c2-4856-93ef-e37ae24c9db6\") " pod="openshift-monitoring/thanos-querier-7898878f7c-d5srf" Jun 11 15:04:00.219175 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:00.219158 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b9206504-36c2-4856-93ef-e37ae24c9db6-secret-grpc-tls\") pod \"thanos-querier-7898878f7c-d5srf\" (UID: \"b9206504-36c2-4856-93ef-e37ae24c9db6\") " pod="openshift-monitoring/thanos-querier-7898878f7c-d5srf" Jun 11 15:04:00.229171 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:00.229150 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dhtk\" (UniqueName: \"kubernetes.io/projected/b9206504-36c2-4856-93ef-e37ae24c9db6-kube-api-access-6dhtk\") pod \"thanos-querier-7898878f7c-d5srf\" (UID: \"b9206504-36c2-4856-93ef-e37ae24c9db6\") " pod="openshift-monitoring/thanos-querier-7898878f7c-d5srf" Jun 11 15:04:00.333747 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:00.333661 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7898878f7c-d5srf" Jun 11 15:04:00.752850 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:00.752777 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kscd8" event={"ID":"813b240a-c0b4-4344-b3ed-84eaff07a99d","Type":"ContainerStarted","Data":"8dd793330002eba9d3cf50c1be9bf96dbf8ada61fb3c60ec230ec0feeab10ae7"} Jun 11 15:04:00.752850 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:00.752824 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kscd8" event={"ID":"813b240a-c0b4-4344-b3ed-84eaff07a99d","Type":"ContainerStarted","Data":"c09c845289dd20f7cae312db0872435df573e2be06b2b52914755e204d4ce391"} Jun 11 15:04:00.777549 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:00.777502 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-kscd8" podStartSLOduration=2.879129437 podStartE2EDuration="3.777486261s" totalImagesPullingTime="824.753743ms" totalInitContainerRuntime="73.603081ms" isStatefulPod=true podCreationTimestamp="2026-06-11 15:03:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:04:00.777065214 +0000 UTC m=+75.725689477" watchObservedRunningTime="2026-06-11 15:04:00.777486261 +0000 UTC m=+75.726110529" Jun 11 15:04:00.909680 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:00.909638 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-68c66b4b67-hrqpg"] Jun 11 15:04:00.914661 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:00.914602 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68c66b4b67-hrqpg" Jun 11 15:04:00.930645 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:00.930144 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 11 15:04:00.940706 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:00.940461 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-68c66b4b67-hrqpg"] Jun 11 15:04:00.998575 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:00.998532 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7898878f7c-d5srf"] Jun 11 15:04:00.999655 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:04:00.999627 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9206504_36c2_4856_93ef_e37ae24c9db6.slice/crio-816498ad4e91ed1f36042b86e5444685bb1212a5fcb7be63f2033201e4ce20f3 WatchSource:0}: Error finding container 816498ad4e91ed1f36042b86e5444685bb1212a5fcb7be63f2033201e4ce20f3: Status 404 returned error can't find the container with id 816498ad4e91ed1f36042b86e5444685bb1212a5fcb7be63f2033201e4ce20f3 Jun 11 15:04:01.022473 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:01.022425 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0e238523-dca8-4b8e-9045-1bd0120a2028-console-oauth-config\") pod \"console-68c66b4b67-hrqpg\" (UID: \"0e238523-dca8-4b8e-9045-1bd0120a2028\") " pod="openshift-console/console-68c66b4b67-hrqpg" Jun 11 15:04:01.022600 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:01.022511 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0e238523-dca8-4b8e-9045-1bd0120a2028-console-serving-cert\") pod \"console-68c66b4b67-hrqpg\" (UID: \"0e238523-dca8-4b8e-9045-1bd0120a2028\") " pod="openshift-console/console-68c66b4b67-hrqpg" Jun 11 15:04:01.022600 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:01.022543 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0e238523-dca8-4b8e-9045-1bd0120a2028-console-config\") pod \"console-68c66b4b67-hrqpg\" (UID: \"0e238523-dca8-4b8e-9045-1bd0120a2028\") " pod="openshift-console/console-68c66b4b67-hrqpg" Jun 11 15:04:01.022600 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:01.022574 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67zlz\" (UniqueName: \"kubernetes.io/projected/0e238523-dca8-4b8e-9045-1bd0120a2028-kube-api-access-67zlz\") pod \"console-68c66b4b67-hrqpg\" (UID: \"0e238523-dca8-4b8e-9045-1bd0120a2028\") " pod="openshift-console/console-68c66b4b67-hrqpg" Jun 11 15:04:01.022808 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:01.022603 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0e238523-dca8-4b8e-9045-1bd0120a2028-oauth-serving-cert\") pod \"console-68c66b4b67-hrqpg\" (UID: \"0e238523-dca8-4b8e-9045-1bd0120a2028\") " pod="openshift-console/console-68c66b4b67-hrqpg" Jun 11 15:04:01.022808 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:01.022657 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e238523-dca8-4b8e-9045-1bd0120a2028-trusted-ca-bundle\") pod \"console-68c66b4b67-hrqpg\" (UID: \"0e238523-dca8-4b8e-9045-1bd0120a2028\") " pod="openshift-console/console-68c66b4b67-hrqpg" Jun 11 15:04:01.022808 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:01.022700 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0e238523-dca8-4b8e-9045-1bd0120a2028-service-ca\") pod \"console-68c66b4b67-hrqpg\" (UID: \"0e238523-dca8-4b8e-9045-1bd0120a2028\") " pod="openshift-console/console-68c66b4b67-hrqpg" Jun 11 15:04:01.124098 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:01.124064 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0e238523-dca8-4b8e-9045-1bd0120a2028-console-serving-cert\") pod \"console-68c66b4b67-hrqpg\" (UID: \"0e238523-dca8-4b8e-9045-1bd0120a2028\") " pod="openshift-console/console-68c66b4b67-hrqpg" Jun 11 15:04:01.124288 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:01.124206 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0e238523-dca8-4b8e-9045-1bd0120a2028-console-config\") pod \"console-68c66b4b67-hrqpg\" (UID: \"0e238523-dca8-4b8e-9045-1bd0120a2028\") " pod="openshift-console/console-68c66b4b67-hrqpg" Jun 11 15:04:01.124288 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:01.124245 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67zlz\" (UniqueName: \"kubernetes.io/projected/0e238523-dca8-4b8e-9045-1bd0120a2028-kube-api-access-67zlz\") pod \"console-68c66b4b67-hrqpg\" (UID: \"0e238523-dca8-4b8e-9045-1bd0120a2028\") " pod="openshift-console/console-68c66b4b67-hrqpg" Jun 11 15:04:01.124288 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:01.124274 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0e238523-dca8-4b8e-9045-1bd0120a2028-oauth-serving-cert\") pod \"console-68c66b4b67-hrqpg\" (UID: \"0e238523-dca8-4b8e-9045-1bd0120a2028\") " pod="openshift-console/console-68c66b4b67-hrqpg" Jun 11 15:04:01.124457 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:01.124313 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e238523-dca8-4b8e-9045-1bd0120a2028-trusted-ca-bundle\") pod \"console-68c66b4b67-hrqpg\" (UID: \"0e238523-dca8-4b8e-9045-1bd0120a2028\") " pod="openshift-console/console-68c66b4b67-hrqpg" Jun 11 15:04:01.124457 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:01.124340 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0e238523-dca8-4b8e-9045-1bd0120a2028-service-ca\") pod \"console-68c66b4b67-hrqpg\" (UID: \"0e238523-dca8-4b8e-9045-1bd0120a2028\") " pod="openshift-console/console-68c66b4b67-hrqpg" Jun 11 15:04:01.124457 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:01.124434 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0e238523-dca8-4b8e-9045-1bd0120a2028-console-oauth-config\") pod \"console-68c66b4b67-hrqpg\" (UID: \"0e238523-dca8-4b8e-9045-1bd0120a2028\") " pod="openshift-console/console-68c66b4b67-hrqpg" Jun 11 15:04:01.125167 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:01.125137 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0e238523-dca8-4b8e-9045-1bd0120a2028-oauth-serving-cert\") pod \"console-68c66b4b67-hrqpg\" (UID: \"0e238523-dca8-4b8e-9045-1bd0120a2028\") " pod="openshift-console/console-68c66b4b67-hrqpg" Jun 11 15:04:01.125348 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:01.125143 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0e238523-dca8-4b8e-9045-1bd0120a2028-service-ca\") pod \"console-68c66b4b67-hrqpg\" (UID: \"0e238523-dca8-4b8e-9045-1bd0120a2028\") " pod="openshift-console/console-68c66b4b67-hrqpg" Jun 11 15:04:01.125462 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:01.125438 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0e238523-dca8-4b8e-9045-1bd0120a2028-console-config\") pod \"console-68c66b4b67-hrqpg\" (UID: \"0e238523-dca8-4b8e-9045-1bd0120a2028\") " pod="openshift-console/console-68c66b4b67-hrqpg" Jun 11 15:04:01.125706 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:01.125686 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e238523-dca8-4b8e-9045-1bd0120a2028-trusted-ca-bundle\") pod \"console-68c66b4b67-hrqpg\" (UID: \"0e238523-dca8-4b8e-9045-1bd0120a2028\") " pod="openshift-console/console-68c66b4b67-hrqpg" Jun 11 15:04:01.126710 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:01.126684 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0e238523-dca8-4b8e-9045-1bd0120a2028-console-serving-cert\") pod \"console-68c66b4b67-hrqpg\" (UID: \"0e238523-dca8-4b8e-9045-1bd0120a2028\") " pod="openshift-console/console-68c66b4b67-hrqpg" Jun 11 15:04:01.126827 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:01.126723 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0e238523-dca8-4b8e-9045-1bd0120a2028-console-oauth-config\") pod \"console-68c66b4b67-hrqpg\" (UID: \"0e238523-dca8-4b8e-9045-1bd0120a2028\") " pod="openshift-console/console-68c66b4b67-hrqpg" Jun 11 15:04:01.134995 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:01.134975 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-67zlz\" (UniqueName: \"kubernetes.io/projected/0e238523-dca8-4b8e-9045-1bd0120a2028-kube-api-access-67zlz\") pod \"console-68c66b4b67-hrqpg\" (UID: \"0e238523-dca8-4b8e-9045-1bd0120a2028\") " pod="openshift-console/console-68c66b4b67-hrqpg" Jun 11 15:04:01.281806 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:01.281751 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68c66b4b67-hrqpg" Jun 11 15:04:01.419371 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:01.419342 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-68c66b4b67-hrqpg"] Jun 11 15:04:01.422383 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:04:01.422355 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e238523_dca8_4b8e_9045_1bd0120a2028.slice/crio-50c3662ce03e0e2e63ff4c9fa5af2c8e7737378cac898ed025a13af6f9204a68 WatchSource:0}: Error finding container 50c3662ce03e0e2e63ff4c9fa5af2c8e7737378cac898ed025a13af6f9204a68: Status 404 returned error can't find the container with id 50c3662ce03e0e2e63ff4c9fa5af2c8e7737378cac898ed025a13af6f9204a68 Jun 11 15:04:01.758598 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:01.758518 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-rq2bp" event={"ID":"032eda1b-5d44-4124-81d8-bba06fda9990","Type":"ContainerStarted","Data":"dd4564a17dc54ed8f970a4be18d2b62aeb589eed43941865d2ae7f78a35f6f12"} Jun 11 15:04:01.758598 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:01.758571 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-rq2bp" event={"ID":"032eda1b-5d44-4124-81d8-bba06fda9990","Type":"ContainerStarted","Data":"439f690e78a4d8a183783a31f2f0167a1306a1545737353542d70acd6add1ec9"} Jun 11 15:04:01.758598 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:01.758599 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-rq2bp" event={"ID":"032eda1b-5d44-4124-81d8-bba06fda9990","Type":"ContainerStarted","Data":"ef4623976009ef03b58487efb1f6a577ab44e009dafb3c25ceee60e57840f0d8"} Jun 11 15:04:01.760038 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:01.760013 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68c66b4b67-hrqpg" event={"ID":"0e238523-dca8-4b8e-9045-1bd0120a2028","Type":"ContainerStarted","Data":"b6846efd3fda072737f244979a751f2c9bf4cfc1f5e83d5afc9c105f2fca3f44"} Jun 11 15:04:01.760088 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:01.760063 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68c66b4b67-hrqpg" event={"ID":"0e238523-dca8-4b8e-9045-1bd0120a2028","Type":"ContainerStarted","Data":"50c3662ce03e0e2e63ff4c9fa5af2c8e7737378cac898ed025a13af6f9204a68"} Jun 11 15:04:01.761138 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:01.761120 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7898878f7c-d5srf" event={"ID":"b9206504-36c2-4856-93ef-e37ae24c9db6","Type":"ContainerStarted","Data":"816498ad4e91ed1f36042b86e5444685bb1212a5fcb7be63f2033201e4ce20f3"} Jun 11 15:04:01.762422 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:01.762403 2569 generic.go:356] "Generic (PLEG): container finished" podID="d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c" containerID="1982f480ab8281f410e1225a84adef498ab30e8f92b60ea3bdad8d7acc21a31f" exitCode=0 Jun 11 15:04:01.762480 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:01.762468 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c","Type":"ContainerDied","Data":"1982f480ab8281f410e1225a84adef498ab30e8f92b60ea3bdad8d7acc21a31f"} Jun 11 15:04:01.764629 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:01.764603 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-sqqds" event={"ID":"90726557-a154-421b-b150-b042c021f9ab","Type":"ContainerStarted","Data":"9e8a0575b4e953136eaa57e2efe7e50497c8d4f8da339b98d91d27fd175d9a87"} Jun 11 15:04:01.783264 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:01.783224 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-rq2bp" podStartSLOduration=3.194791066 podStartE2EDuration="4.783207392s" totalImagesPullingTime="1.588416326s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:03:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:04:01.783135071 +0000 UTC m=+76.731759347" watchObservedRunningTime="2026-06-11 15:04:01.783207392 +0000 UTC m=+76.731831655" Jun 11 15:04:01.815606 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:01.815548 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-68c66b4b67-hrqpg" podStartSLOduration=1.815533695 podStartE2EDuration="1.815533695s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:04:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:04:01.81426926 +0000 UTC m=+76.762893523" watchObservedRunningTime="2026-06-11 15:04:01.815533695 +0000 UTC m=+76.764157934" Jun 11 15:04:01.842109 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:01.842057 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-sqqds" podStartSLOduration=3.223548178 podStartE2EDuration="4.842038437s" totalImagesPullingTime="1.618490259s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:03:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:04:01.841128968 +0000 UTC m=+76.789753242" watchObservedRunningTime="2026-06-11 15:04:01.842038437 +0000 UTC m=+76.790662700" Jun 11 15:04:02.523510 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:02.523460 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-64fbbc7dc8-87vt6"] Jun 11 15:04:02.525951 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:02.525929 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-64fbbc7dc8-87vt6" Jun 11 15:04:02.536844 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:02.536819 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 11 15:04:02.538007 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:02.537822 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-bj4d5\"" Jun 11 15:04:02.538007 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:02.537851 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 11 15:04:02.538007 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:02.537907 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 11 15:04:02.538007 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:02.537954 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 11 15:04:02.538274 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:02.538119 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-e8d3032n7qo3g\"" Jun 11 15:04:02.552697 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:02.552671 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-64fbbc7dc8-87vt6"] Jun 11 15:04:02.640772 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:02.640707 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/df14e275-a2d3-4f4b-ba2d-58a4fbe60491-secret-metrics-server-tls\") pod \"metrics-server-64fbbc7dc8-87vt6\" (UID: \"df14e275-a2d3-4f4b-ba2d-58a4fbe60491\") " pod="openshift-monitoring/metrics-server-64fbbc7dc8-87vt6" Jun 11 15:04:02.640772 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:02.640770 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/df14e275-a2d3-4f4b-ba2d-58a4fbe60491-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-64fbbc7dc8-87vt6\" (UID: \"df14e275-a2d3-4f4b-ba2d-58a4fbe60491\") " pod="openshift-monitoring/metrics-server-64fbbc7dc8-87vt6" Jun 11 15:04:02.640996 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:02.640798 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/df14e275-a2d3-4f4b-ba2d-58a4fbe60491-metrics-server-audit-profiles\") pod \"metrics-server-64fbbc7dc8-87vt6\" (UID: \"df14e275-a2d3-4f4b-ba2d-58a4fbe60491\") " pod="openshift-monitoring/metrics-server-64fbbc7dc8-87vt6" Jun 11 15:04:02.640996 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:02.640818 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hcp4\" (UniqueName: \"kubernetes.io/projected/df14e275-a2d3-4f4b-ba2d-58a4fbe60491-kube-api-access-8hcp4\") pod \"metrics-server-64fbbc7dc8-87vt6\" (UID: \"df14e275-a2d3-4f4b-ba2d-58a4fbe60491\") " pod="openshift-monitoring/metrics-server-64fbbc7dc8-87vt6" Jun 11 15:04:02.640996 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:02.640885 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/df14e275-a2d3-4f4b-ba2d-58a4fbe60491-secret-metrics-server-client-certs\") pod \"metrics-server-64fbbc7dc8-87vt6\" (UID: \"df14e275-a2d3-4f4b-ba2d-58a4fbe60491\") " pod="openshift-monitoring/metrics-server-64fbbc7dc8-87vt6" Jun 11 15:04:02.640996 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:02.640917 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/df14e275-a2d3-4f4b-ba2d-58a4fbe60491-client-ca-bundle\") pod \"metrics-server-64fbbc7dc8-87vt6\" (UID: \"df14e275-a2d3-4f4b-ba2d-58a4fbe60491\") " pod="openshift-monitoring/metrics-server-64fbbc7dc8-87vt6" Jun 11 15:04:02.640996 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:02.640941 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/df14e275-a2d3-4f4b-ba2d-58a4fbe60491-audit-log\") pod \"metrics-server-64fbbc7dc8-87vt6\" (UID: \"df14e275-a2d3-4f4b-ba2d-58a4fbe60491\") " pod="openshift-monitoring/metrics-server-64fbbc7dc8-87vt6" Jun 11 15:04:02.694771 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:02.694725 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-689px"] Jun 11 15:04:02.697159 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:02.697141 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-689px" Jun 11 15:04:02.700976 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:02.700952 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-f2nwg\"" Jun 11 15:04:02.701346 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:02.701328 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 11 15:04:02.709330 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:02.709277 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-689px"] Jun 11 15:04:02.741660 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:02.741635 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hcp4\" (UniqueName: \"kubernetes.io/projected/df14e275-a2d3-4f4b-ba2d-58a4fbe60491-kube-api-access-8hcp4\") pod \"metrics-server-64fbbc7dc8-87vt6\" (UID: \"df14e275-a2d3-4f4b-ba2d-58a4fbe60491\") " pod="openshift-monitoring/metrics-server-64fbbc7dc8-87vt6" Jun 11 15:04:02.741793 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:02.741686 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/df14e275-a2d3-4f4b-ba2d-58a4fbe60491-secret-metrics-server-client-certs\") pod \"metrics-server-64fbbc7dc8-87vt6\" (UID: \"df14e275-a2d3-4f4b-ba2d-58a4fbe60491\") " pod="openshift-monitoring/metrics-server-64fbbc7dc8-87vt6" Jun 11 15:04:02.741793 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:02.741721 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/df14e275-a2d3-4f4b-ba2d-58a4fbe60491-client-ca-bundle\") pod \"metrics-server-64fbbc7dc8-87vt6\" (UID: \"df14e275-a2d3-4f4b-ba2d-58a4fbe60491\") " pod="openshift-monitoring/metrics-server-64fbbc7dc8-87vt6" Jun 11 15:04:02.741793 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:02.741745 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/df14e275-a2d3-4f4b-ba2d-58a4fbe60491-audit-log\") pod \"metrics-server-64fbbc7dc8-87vt6\" (UID: \"df14e275-a2d3-4f4b-ba2d-58a4fbe60491\") " pod="openshift-monitoring/metrics-server-64fbbc7dc8-87vt6" Jun 11 15:04:02.741922 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:02.741871 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/df14e275-a2d3-4f4b-ba2d-58a4fbe60491-secret-metrics-server-tls\") pod \"metrics-server-64fbbc7dc8-87vt6\" (UID: \"df14e275-a2d3-4f4b-ba2d-58a4fbe60491\") " pod="openshift-monitoring/metrics-server-64fbbc7dc8-87vt6" Jun 11 15:04:02.741922 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:02.741901 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/df14e275-a2d3-4f4b-ba2d-58a4fbe60491-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-64fbbc7dc8-87vt6\" (UID: \"df14e275-a2d3-4f4b-ba2d-58a4fbe60491\") " pod="openshift-monitoring/metrics-server-64fbbc7dc8-87vt6" Jun 11 15:04:02.742015 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:02.741924 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/df14e275-a2d3-4f4b-ba2d-58a4fbe60491-metrics-server-audit-profiles\") pod \"metrics-server-64fbbc7dc8-87vt6\" (UID: \"df14e275-a2d3-4f4b-ba2d-58a4fbe60491\") " pod="openshift-monitoring/metrics-server-64fbbc7dc8-87vt6" Jun 11 15:04:02.742501 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:02.742462 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/df14e275-a2d3-4f4b-ba2d-58a4fbe60491-audit-log\") pod \"metrics-server-64fbbc7dc8-87vt6\" (UID: \"df14e275-a2d3-4f4b-ba2d-58a4fbe60491\") " pod="openshift-monitoring/metrics-server-64fbbc7dc8-87vt6" Jun 11 15:04:02.742746 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:02.742724 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/df14e275-a2d3-4f4b-ba2d-58a4fbe60491-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-64fbbc7dc8-87vt6\" (UID: \"df14e275-a2d3-4f4b-ba2d-58a4fbe60491\") " pod="openshift-monitoring/metrics-server-64fbbc7dc8-87vt6" Jun 11 15:04:02.742879 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:02.742860 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/df14e275-a2d3-4f4b-ba2d-58a4fbe60491-metrics-server-audit-profiles\") pod \"metrics-server-64fbbc7dc8-87vt6\" (UID: \"df14e275-a2d3-4f4b-ba2d-58a4fbe60491\") " pod="openshift-monitoring/metrics-server-64fbbc7dc8-87vt6" Jun 11 15:04:02.744215 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:02.744196 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/df14e275-a2d3-4f4b-ba2d-58a4fbe60491-secret-metrics-server-client-certs\") pod \"metrics-server-64fbbc7dc8-87vt6\" (UID: \"df14e275-a2d3-4f4b-ba2d-58a4fbe60491\") " pod="openshift-monitoring/metrics-server-64fbbc7dc8-87vt6" Jun 11 15:04:02.744654 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:02.744639 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/df14e275-a2d3-4f4b-ba2d-58a4fbe60491-client-ca-bundle\") pod \"metrics-server-64fbbc7dc8-87vt6\" (UID: \"df14e275-a2d3-4f4b-ba2d-58a4fbe60491\") " pod="openshift-monitoring/metrics-server-64fbbc7dc8-87vt6" Jun 11 15:04:02.744708 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:02.744661 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/df14e275-a2d3-4f4b-ba2d-58a4fbe60491-secret-metrics-server-tls\") pod \"metrics-server-64fbbc7dc8-87vt6\" (UID: \"df14e275-a2d3-4f4b-ba2d-58a4fbe60491\") " pod="openshift-monitoring/metrics-server-64fbbc7dc8-87vt6" Jun 11 15:04:02.755487 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:02.755463 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hcp4\" (UniqueName: \"kubernetes.io/projected/df14e275-a2d3-4f4b-ba2d-58a4fbe60491-kube-api-access-8hcp4\") pod \"metrics-server-64fbbc7dc8-87vt6\" (UID: \"df14e275-a2d3-4f4b-ba2d-58a4fbe60491\") " pod="openshift-monitoring/metrics-server-64fbbc7dc8-87vt6" Jun 11 15:04:02.837571 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:02.837492 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-64fbbc7dc8-87vt6" Jun 11 15:04:02.842785 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:02.842741 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnk7n\" (UniqueName: \"kubernetes.io/projected/32ac3102-d5ad-46b3-b166-7b5cd4a9725b-kube-api-access-hnk7n\") pod \"monitoring-plugin-76b68cc874-689px\" (UID: \"32ac3102-d5ad-46b3-b166-7b5cd4a9725b\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-689px" Jun 11 15:04:02.842891 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:02.842815 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/32ac3102-d5ad-46b3-b166-7b5cd4a9725b-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-689px\" (UID: \"32ac3102-d5ad-46b3-b166-7b5cd4a9725b\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-689px" Jun 11 15:04:02.944105 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:02.944064 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hnk7n\" (UniqueName: \"kubernetes.io/projected/32ac3102-d5ad-46b3-b166-7b5cd4a9725b-kube-api-access-hnk7n\") pod \"monitoring-plugin-76b68cc874-689px\" (UID: \"32ac3102-d5ad-46b3-b166-7b5cd4a9725b\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-689px" Jun 11 15:04:02.944280 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:02.944174 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/32ac3102-d5ad-46b3-b166-7b5cd4a9725b-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-689px\" (UID: \"32ac3102-d5ad-46b3-b166-7b5cd4a9725b\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-689px" Jun 11 15:04:02.948963 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:02.948937 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/32ac3102-d5ad-46b3-b166-7b5cd4a9725b-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-689px\" (UID: \"32ac3102-d5ad-46b3-b166-7b5cd4a9725b\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-689px" Jun 11 15:04:02.956043 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:02.955994 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnk7n\" (UniqueName: \"kubernetes.io/projected/32ac3102-d5ad-46b3-b166-7b5cd4a9725b-kube-api-access-hnk7n\") pod \"monitoring-plugin-76b68cc874-689px\" (UID: \"32ac3102-d5ad-46b3-b166-7b5cd4a9725b\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-689px" Jun 11 15:04:03.009187 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:03.009154 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-689px" Jun 11 15:04:03.147972 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:03.147901 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-75f77978d7-976x9"] Jun 11 15:04:03.150279 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:03.150259 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-75f77978d7-976x9" Jun 11 15:04:03.153339 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:03.153316 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-mbgfj\"" Jun 11 15:04:03.153339 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:03.153332 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 11 15:04:03.153472 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:03.153459 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 11 15:04:03.153691 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:03.153675 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 11 15:04:03.153786 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:03.153768 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 11 15:04:03.154344 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:03.154318 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 11 15:04:03.162039 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:03.162020 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 11 15:04:03.177232 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:03.177210 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-75f77978d7-976x9"] Jun 11 15:04:03.247120 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:03.247080 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/2430e48b-c1f3-4346-b284-8404e13a45e7-secret-telemeter-client\") pod \"telemeter-client-75f77978d7-976x9\" (UID: \"2430e48b-c1f3-4346-b284-8404e13a45e7\") " pod="openshift-monitoring/telemeter-client-75f77978d7-976x9" Jun 11 15:04:03.247275 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:03.247187 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2430e48b-c1f3-4346-b284-8404e13a45e7-serving-certs-ca-bundle\") pod \"telemeter-client-75f77978d7-976x9\" (UID: \"2430e48b-c1f3-4346-b284-8404e13a45e7\") " pod="openshift-monitoring/telemeter-client-75f77978d7-976x9" Jun 11 15:04:03.247275 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:03.247216 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2430e48b-c1f3-4346-b284-8404e13a45e7-metrics-client-ca\") pod \"telemeter-client-75f77978d7-976x9\" (UID: \"2430e48b-c1f3-4346-b284-8404e13a45e7\") " pod="openshift-monitoring/telemeter-client-75f77978d7-976x9" Jun 11 15:04:03.247275 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:03.247243 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/2430e48b-c1f3-4346-b284-8404e13a45e7-federate-client-tls\") pod \"telemeter-client-75f77978d7-976x9\" (UID: \"2430e48b-c1f3-4346-b284-8404e13a45e7\") " pod="openshift-monitoring/telemeter-client-75f77978d7-976x9" Jun 11 15:04:03.247431 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:03.247276 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2430e48b-c1f3-4346-b284-8404e13a45e7-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-75f77978d7-976x9\" (UID: \"2430e48b-c1f3-4346-b284-8404e13a45e7\") " pod="openshift-monitoring/telemeter-client-75f77978d7-976x9" Jun 11 15:04:03.247431 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:03.247316 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2430e48b-c1f3-4346-b284-8404e13a45e7-telemeter-trusted-ca-bundle\") pod \"telemeter-client-75f77978d7-976x9\" (UID: \"2430e48b-c1f3-4346-b284-8404e13a45e7\") " pod="openshift-monitoring/telemeter-client-75f77978d7-976x9" Jun 11 15:04:03.247431 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:03.247390 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/2430e48b-c1f3-4346-b284-8404e13a45e7-telemeter-client-tls\") pod \"telemeter-client-75f77978d7-976x9\" (UID: \"2430e48b-c1f3-4346-b284-8404e13a45e7\") " pod="openshift-monitoring/telemeter-client-75f77978d7-976x9" Jun 11 15:04:03.247524 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:03.247462 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrgsk\" (UniqueName: \"kubernetes.io/projected/2430e48b-c1f3-4346-b284-8404e13a45e7-kube-api-access-vrgsk\") pod \"telemeter-client-75f77978d7-976x9\" (UID: \"2430e48b-c1f3-4346-b284-8404e13a45e7\") " pod="openshift-monitoring/telemeter-client-75f77978d7-976x9" Jun 11 15:04:03.348871 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:03.348836 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2430e48b-c1f3-4346-b284-8404e13a45e7-serving-certs-ca-bundle\") pod \"telemeter-client-75f77978d7-976x9\" (UID: \"2430e48b-c1f3-4346-b284-8404e13a45e7\") " pod="openshift-monitoring/telemeter-client-75f77978d7-976x9" Jun 11 15:04:03.348871 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:03.348874 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2430e48b-c1f3-4346-b284-8404e13a45e7-metrics-client-ca\") pod \"telemeter-client-75f77978d7-976x9\" (UID: \"2430e48b-c1f3-4346-b284-8404e13a45e7\") " pod="openshift-monitoring/telemeter-client-75f77978d7-976x9" Jun 11 15:04:03.349106 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:03.348895 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/2430e48b-c1f3-4346-b284-8404e13a45e7-federate-client-tls\") pod \"telemeter-client-75f77978d7-976x9\" (UID: \"2430e48b-c1f3-4346-b284-8404e13a45e7\") " pod="openshift-monitoring/telemeter-client-75f77978d7-976x9" Jun 11 15:04:03.349106 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:03.349038 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2430e48b-c1f3-4346-b284-8404e13a45e7-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-75f77978d7-976x9\" (UID: \"2430e48b-c1f3-4346-b284-8404e13a45e7\") " pod="openshift-monitoring/telemeter-client-75f77978d7-976x9" Jun 11 15:04:03.349214 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:03.349105 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2430e48b-c1f3-4346-b284-8404e13a45e7-telemeter-trusted-ca-bundle\") pod \"telemeter-client-75f77978d7-976x9\" (UID: \"2430e48b-c1f3-4346-b284-8404e13a45e7\") " pod="openshift-monitoring/telemeter-client-75f77978d7-976x9" Jun 11 15:04:03.349214 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:03.349155 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/2430e48b-c1f3-4346-b284-8404e13a45e7-telemeter-client-tls\") pod \"telemeter-client-75f77978d7-976x9\" (UID: \"2430e48b-c1f3-4346-b284-8404e13a45e7\") " pod="openshift-monitoring/telemeter-client-75f77978d7-976x9" Jun 11 15:04:03.349295 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:03.349213 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrgsk\" (UniqueName: \"kubernetes.io/projected/2430e48b-c1f3-4346-b284-8404e13a45e7-kube-api-access-vrgsk\") pod \"telemeter-client-75f77978d7-976x9\" (UID: \"2430e48b-c1f3-4346-b284-8404e13a45e7\") " pod="openshift-monitoring/telemeter-client-75f77978d7-976x9" Jun 11 15:04:03.349331 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:03.349293 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/2430e48b-c1f3-4346-b284-8404e13a45e7-secret-telemeter-client\") pod \"telemeter-client-75f77978d7-976x9\" (UID: \"2430e48b-c1f3-4346-b284-8404e13a45e7\") " pod="openshift-monitoring/telemeter-client-75f77978d7-976x9" Jun 11 15:04:03.349698 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:03.349671 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2430e48b-c1f3-4346-b284-8404e13a45e7-metrics-client-ca\") pod \"telemeter-client-75f77978d7-976x9\" (UID: \"2430e48b-c1f3-4346-b284-8404e13a45e7\") " pod="openshift-monitoring/telemeter-client-75f77978d7-976x9" Jun 11 15:04:03.350299 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:03.350027 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2430e48b-c1f3-4346-b284-8404e13a45e7-serving-certs-ca-bundle\") pod \"telemeter-client-75f77978d7-976x9\" (UID: \"2430e48b-c1f3-4346-b284-8404e13a45e7\") " pod="openshift-monitoring/telemeter-client-75f77978d7-976x9" Jun 11 15:04:03.350299 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:03.350132 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2430e48b-c1f3-4346-b284-8404e13a45e7-telemeter-trusted-ca-bundle\") pod \"telemeter-client-75f77978d7-976x9\" (UID: \"2430e48b-c1f3-4346-b284-8404e13a45e7\") " pod="openshift-monitoring/telemeter-client-75f77978d7-976x9" Jun 11 15:04:03.351893 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:03.351872 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/2430e48b-c1f3-4346-b284-8404e13a45e7-federate-client-tls\") pod \"telemeter-client-75f77978d7-976x9\" (UID: \"2430e48b-c1f3-4346-b284-8404e13a45e7\") " pod="openshift-monitoring/telemeter-client-75f77978d7-976x9" Jun 11 15:04:03.352084 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:03.352066 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/2430e48b-c1f3-4346-b284-8404e13a45e7-telemeter-client-tls\") pod \"telemeter-client-75f77978d7-976x9\" (UID: \"2430e48b-c1f3-4346-b284-8404e13a45e7\") " pod="openshift-monitoring/telemeter-client-75f77978d7-976x9" Jun 11 15:04:03.352261 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:03.352240 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2430e48b-c1f3-4346-b284-8404e13a45e7-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-75f77978d7-976x9\" (UID: \"2430e48b-c1f3-4346-b284-8404e13a45e7\") " pod="openshift-monitoring/telemeter-client-75f77978d7-976x9" Jun 11 15:04:03.352398 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:03.352381 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/2430e48b-c1f3-4346-b284-8404e13a45e7-secret-telemeter-client\") pod \"telemeter-client-75f77978d7-976x9\" (UID: \"2430e48b-c1f3-4346-b284-8404e13a45e7\") " pod="openshift-monitoring/telemeter-client-75f77978d7-976x9" Jun 11 15:04:03.360688 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:03.360668 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrgsk\" (UniqueName: \"kubernetes.io/projected/2430e48b-c1f3-4346-b284-8404e13a45e7-kube-api-access-vrgsk\") pod \"telemeter-client-75f77978d7-976x9\" (UID: \"2430e48b-c1f3-4346-b284-8404e13a45e7\") " pod="openshift-monitoring/telemeter-client-75f77978d7-976x9" Jun 11 15:04:03.462035 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:03.461957 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-75f77978d7-976x9" Jun 11 15:04:03.786248 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:03.786108 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7898878f7c-d5srf" event={"ID":"b9206504-36c2-4856-93ef-e37ae24c9db6","Type":"ContainerStarted","Data":"c0deddc9f7c3b89275ffc3ab302cb962b43e504120f94cf7d9774b4be27a388c"} Jun 11 15:04:03.791155 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:03.791002 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c","Type":"ContainerStarted","Data":"5058c2d45a6efddd58ba0f207ac24b3cac3e053c19870bc1ef26c9522f6fa2b0"} Jun 11 15:04:03.807547 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:03.807456 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-64fbbc7dc8-87vt6"] Jun 11 15:04:03.822400 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:04:03.822370 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf14e275_a2d3_4f4b_ba2d_58a4fbe60491.slice/crio-9da36d8f0d8e48df5819b33436131e7945edcc9b483155b2b4082d1084dc9637 WatchSource:0}: Error finding container 9da36d8f0d8e48df5819b33436131e7945edcc9b483155b2b4082d1084dc9637: Status 404 returned error can't find the container with id 9da36d8f0d8e48df5819b33436131e7945edcc9b483155b2b4082d1084dc9637 Jun 11 15:04:03.833330 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:03.833280 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-689px"] Jun 11 15:04:03.854026 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:04:03.853990 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32ac3102_d5ad_46b3_b166_7b5cd4a9725b.slice/crio-9d0dc25520b64c98fcbb13e27a6abfe6c78581678d34608543af61bac9ad99f2 WatchSource:0}: Error finding container 9d0dc25520b64c98fcbb13e27a6abfe6c78581678d34608543af61bac9ad99f2: Status 404 returned error can't find the container with id 9d0dc25520b64c98fcbb13e27a6abfe6c78581678d34608543af61bac9ad99f2 Jun 11 15:04:03.858138 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:03.858114 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-75f77978d7-976x9"] Jun 11 15:04:03.859815 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:04:03.859437 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2430e48b_c1f3_4346_b284_8404e13a45e7.slice/crio-7fc7d9fe0a1b14ffbc7fc89cf12f31a6bdc207af11442805f8fc3bf01d4d6081 WatchSource:0}: Error finding container 7fc7d9fe0a1b14ffbc7fc89cf12f31a6bdc207af11442805f8fc3bf01d4d6081: Status 404 returned error can't find the container with id 7fc7d9fe0a1b14ffbc7fc89cf12f31a6bdc207af11442805f8fc3bf01d4d6081 Jun 11 15:04:04.052698 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:04.052671 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-67646c5d8b-8qwpt" Jun 11 15:04:04.052863 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:04.052778 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-67646c5d8b-8qwpt" Jun 11 15:04:04.058382 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:04.058355 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-67646c5d8b-8qwpt" Jun 11 15:04:04.311547 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:04.311244 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 15:04:04.316327 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:04.316303 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:04:04.320594 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:04.320567 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 11 15:04:04.321285 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:04.321045 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 11 15:04:04.321285 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:04.321059 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 11 15:04:04.321285 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:04.321154 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 11 15:04:04.321285 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:04.321068 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 11 15:04:04.321583 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:04.321476 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 11 15:04:04.321583 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:04.321517 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 11 15:04:04.321841 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:04.321824 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-czdpz\"" Jun 11 15:04:04.322070 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:04.322044 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-c9gh1o8qka45g\"" Jun 11 15:04:04.322181 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:04.322099 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 11 15:04:04.322579 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:04.322560 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 11 15:04:04.322646 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:04.322616 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 11 15:04:04.322846 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:04.322832 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 11 15:04:04.322986 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:04.322972 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 11 15:04:04.326236 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:04.326215 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 11 15:04:04.327978 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:04.327960 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 11 15:04:04.342980 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:04.342956 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 15:04:04.459997 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:04.459173 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/52b832a7-f6c6-4a4f-9df2-8d02063155c4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"52b832a7-f6c6-4a4f-9df2-8d02063155c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:04:04.459997 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:04.459233 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/52b832a7-f6c6-4a4f-9df2-8d02063155c4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"52b832a7-f6c6-4a4f-9df2-8d02063155c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:04:04.459997 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:04.459254 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52b832a7-f6c6-4a4f-9df2-8d02063155c4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"52b832a7-f6c6-4a4f-9df2-8d02063155c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:04:04.459997 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:04.459268 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/52b832a7-f6c6-4a4f-9df2-8d02063155c4-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"52b832a7-f6c6-4a4f-9df2-8d02063155c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:04:04.459997 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:04.459286 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/52b832a7-f6c6-4a4f-9df2-8d02063155c4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"52b832a7-f6c6-4a4f-9df2-8d02063155c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:04:04.459997 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:04.459305 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/52b832a7-f6c6-4a4f-9df2-8d02063155c4-web-config\") pod \"prometheus-k8s-0\" (UID: \"52b832a7-f6c6-4a4f-9df2-8d02063155c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:04:04.459997 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:04.459321 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/52b832a7-f6c6-4a4f-9df2-8d02063155c4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"52b832a7-f6c6-4a4f-9df2-8d02063155c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:04:04.459997 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:04.459336 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/52b832a7-f6c6-4a4f-9df2-8d02063155c4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"52b832a7-f6c6-4a4f-9df2-8d02063155c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:04:04.459997 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:04.459357 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52b832a7-f6c6-4a4f-9df2-8d02063155c4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"52b832a7-f6c6-4a4f-9df2-8d02063155c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:04:04.459997 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:04.459378 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/52b832a7-f6c6-4a4f-9df2-8d02063155c4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"52b832a7-f6c6-4a4f-9df2-8d02063155c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:04:04.459997 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:04.459401 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/52b832a7-f6c6-4a4f-9df2-8d02063155c4-config-out\") pod \"prometheus-k8s-0\" (UID: \"52b832a7-f6c6-4a4f-9df2-8d02063155c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:04:04.459997 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:04.459429 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/52b832a7-f6c6-4a4f-9df2-8d02063155c4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"52b832a7-f6c6-4a4f-9df2-8d02063155c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:04:04.459997 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:04.459461 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/52b832a7-f6c6-4a4f-9df2-8d02063155c4-config\") pod \"prometheus-k8s-0\" (UID: \"52b832a7-f6c6-4a4f-9df2-8d02063155c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:04:04.459997 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:04.459501 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52b832a7-f6c6-4a4f-9df2-8d02063155c4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"52b832a7-f6c6-4a4f-9df2-8d02063155c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:04:04.459997 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:04.459552 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/52b832a7-f6c6-4a4f-9df2-8d02063155c4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"52b832a7-f6c6-4a4f-9df2-8d02063155c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:04:04.459997 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:04.459582 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpx8r\" (UniqueName: \"kubernetes.io/projected/52b832a7-f6c6-4a4f-9df2-8d02063155c4-kube-api-access-lpx8r\") pod \"prometheus-k8s-0\" (UID: \"52b832a7-f6c6-4a4f-9df2-8d02063155c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:04:04.460996 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:04.459626 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/52b832a7-f6c6-4a4f-9df2-8d02063155c4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"52b832a7-f6c6-4a4f-9df2-8d02063155c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:04:04.460996 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:04.459654 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/52b832a7-f6c6-4a4f-9df2-8d02063155c4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"52b832a7-f6c6-4a4f-9df2-8d02063155c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:04:04.460996 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:04.459701 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/52b832a7-f6c6-4a4f-9df2-8d02063155c4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"52b832a7-f6c6-4a4f-9df2-8d02063155c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:04:04.460996 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:04.459741 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/52b832a7-f6c6-4a4f-9df2-8d02063155c4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"52b832a7-f6c6-4a4f-9df2-8d02063155c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:04:04.560884 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:04.560850 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/52b832a7-f6c6-4a4f-9df2-8d02063155c4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"52b832a7-f6c6-4a4f-9df2-8d02063155c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:04:04.561061 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:04.560897 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpx8r\" (UniqueName: \"kubernetes.io/projected/52b832a7-f6c6-4a4f-9df2-8d02063155c4-kube-api-access-lpx8r\") pod \"prometheus-k8s-0\" (UID: \"52b832a7-f6c6-4a4f-9df2-8d02063155c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:04:04.561061 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:04.560941 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/52b832a7-f6c6-4a4f-9df2-8d02063155c4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"52b832a7-f6c6-4a4f-9df2-8d02063155c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:04:04.561061 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:04.560962 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/52b832a7-f6c6-4a4f-9df2-8d02063155c4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"52b832a7-f6c6-4a4f-9df2-8d02063155c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:04:04.561061 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:04.560999 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/52b832a7-f6c6-4a4f-9df2-8d02063155c4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"52b832a7-f6c6-4a4f-9df2-8d02063155c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:04:04.561061 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:04.561024 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/52b832a7-f6c6-4a4f-9df2-8d02063155c4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"52b832a7-f6c6-4a4f-9df2-8d02063155c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:04:04.561061 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:04.561056 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/52b832a7-f6c6-4a4f-9df2-8d02063155c4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"52b832a7-f6c6-4a4f-9df2-8d02063155c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:04:04.561337 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:04.561100 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/52b832a7-f6c6-4a4f-9df2-8d02063155c4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"52b832a7-f6c6-4a4f-9df2-8d02063155c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:04:04.561337 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:04.561128 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52b832a7-f6c6-4a4f-9df2-8d02063155c4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"52b832a7-f6c6-4a4f-9df2-8d02063155c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:04:04.561337 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:04.561154 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/52b832a7-f6c6-4a4f-9df2-8d02063155c4-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"52b832a7-f6c6-4a4f-9df2-8d02063155c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:04:04.563223 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:04.561182 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/52b832a7-f6c6-4a4f-9df2-8d02063155c4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"52b832a7-f6c6-4a4f-9df2-8d02063155c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:04:04.563223 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:04.561599 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/52b832a7-f6c6-4a4f-9df2-8d02063155c4-web-config\") pod \"prometheus-k8s-0\" (UID: \"52b832a7-f6c6-4a4f-9df2-8d02063155c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:04:04.563223 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:04.561672 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/52b832a7-f6c6-4a4f-9df2-8d02063155c4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"52b832a7-f6c6-4a4f-9df2-8d02063155c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:04:04.563223 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:04.561718 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/52b832a7-f6c6-4a4f-9df2-8d02063155c4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"52b832a7-f6c6-4a4f-9df2-8d02063155c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:04:04.563223 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:04.562029 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/52b832a7-f6c6-4a4f-9df2-8d02063155c4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"52b832a7-f6c6-4a4f-9df2-8d02063155c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:04:04.563223 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:04.562141 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/52b832a7-f6c6-4a4f-9df2-8d02063155c4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"52b832a7-f6c6-4a4f-9df2-8d02063155c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:04:04.563223 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:04.562508 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52b832a7-f6c6-4a4f-9df2-8d02063155c4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"52b832a7-f6c6-4a4f-9df2-8d02063155c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:04:04.563223 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:04.562556 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/52b832a7-f6c6-4a4f-9df2-8d02063155c4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"52b832a7-f6c6-4a4f-9df2-8d02063155c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:04:04.563223 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:04.562592 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/52b832a7-f6c6-4a4f-9df2-8d02063155c4-config-out\") pod \"prometheus-k8s-0\" (UID: \"52b832a7-f6c6-4a4f-9df2-8d02063155c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:04:04.563223 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:04.562624 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/52b832a7-f6c6-4a4f-9df2-8d02063155c4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"52b832a7-f6c6-4a4f-9df2-8d02063155c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:04:04.563223 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:04.562663 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/52b832a7-f6c6-4a4f-9df2-8d02063155c4-config\") pod \"prometheus-k8s-0\" (UID: \"52b832a7-f6c6-4a4f-9df2-8d02063155c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:04:04.563223 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:04.562706 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52b832a7-f6c6-4a4f-9df2-8d02063155c4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"52b832a7-f6c6-4a4f-9df2-8d02063155c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:04:04.563223 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:04.562703 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52b832a7-f6c6-4a4f-9df2-8d02063155c4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"52b832a7-f6c6-4a4f-9df2-8d02063155c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:04:04.563947 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:04.563236 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/52b832a7-f6c6-4a4f-9df2-8d02063155c4-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"52b832a7-f6c6-4a4f-9df2-8d02063155c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:04:04.565566 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:04.565224 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/52b832a7-f6c6-4a4f-9df2-8d02063155c4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"52b832a7-f6c6-4a4f-9df2-8d02063155c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:04:04.566511 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:04.566484 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/52b832a7-f6c6-4a4f-9df2-8d02063155c4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"52b832a7-f6c6-4a4f-9df2-8d02063155c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:04:04.567785 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:04.566615 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52b832a7-f6c6-4a4f-9df2-8d02063155c4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"52b832a7-f6c6-4a4f-9df2-8d02063155c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:04:04.569239 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:04.568300 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/52b832a7-f6c6-4a4f-9df2-8d02063155c4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"52b832a7-f6c6-4a4f-9df2-8d02063155c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:04:04.569239 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:04.568488 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/52b832a7-f6c6-4a4f-9df2-8d02063155c4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"52b832a7-f6c6-4a4f-9df2-8d02063155c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:04:04.569239 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:04.568710 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/52b832a7-f6c6-4a4f-9df2-8d02063155c4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"52b832a7-f6c6-4a4f-9df2-8d02063155c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:04:04.569239 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:04.569146 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/52b832a7-f6c6-4a4f-9df2-8d02063155c4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"52b832a7-f6c6-4a4f-9df2-8d02063155c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:04:04.569239 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:04.569199 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/52b832a7-f6c6-4a4f-9df2-8d02063155c4-web-config\") pod \"prometheus-k8s-0\" (UID: \"52b832a7-f6c6-4a4f-9df2-8d02063155c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:04:04.569515 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:04.569468 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52b832a7-f6c6-4a4f-9df2-8d02063155c4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"52b832a7-f6c6-4a4f-9df2-8d02063155c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:04:04.570427 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:04.570074 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/52b832a7-f6c6-4a4f-9df2-8d02063155c4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"52b832a7-f6c6-4a4f-9df2-8d02063155c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:04:04.570427 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:04.570390 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/52b832a7-f6c6-4a4f-9df2-8d02063155c4-config-out\") pod \"prometheus-k8s-0\" (UID: \"52b832a7-f6c6-4a4f-9df2-8d02063155c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:04:04.570662 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:04.570430 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/52b832a7-f6c6-4a4f-9df2-8d02063155c4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"52b832a7-f6c6-4a4f-9df2-8d02063155c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:04:04.571050 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:04.570965 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/52b832a7-f6c6-4a4f-9df2-8d02063155c4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"52b832a7-f6c6-4a4f-9df2-8d02063155c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:04:04.579997 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:04.571998 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/52b832a7-f6c6-4a4f-9df2-8d02063155c4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"52b832a7-f6c6-4a4f-9df2-8d02063155c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:04:04.579997 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:04.573593 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/52b832a7-f6c6-4a4f-9df2-8d02063155c4-config\") pod \"prometheus-k8s-0\" (UID: \"52b832a7-f6c6-4a4f-9df2-8d02063155c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:04:04.582336 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:04.582292 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpx8r\" (UniqueName: \"kubernetes.io/projected/52b832a7-f6c6-4a4f-9df2-8d02063155c4-kube-api-access-lpx8r\") pod \"prometheus-k8s-0\" (UID: \"52b832a7-f6c6-4a4f-9df2-8d02063155c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:04:04.628681 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:04.628366 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:04:04.805051 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:04.805010 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-64fbbc7dc8-87vt6" event={"ID":"df14e275-a2d3-4f4b-ba2d-58a4fbe60491","Type":"ContainerStarted","Data":"9da36d8f0d8e48df5819b33436131e7945edcc9b483155b2b4082d1084dc9637"} Jun 11 15:04:04.808994 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:04.808965 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7898878f7c-d5srf" event={"ID":"b9206504-36c2-4856-93ef-e37ae24c9db6","Type":"ContainerStarted","Data":"703ddda04480d68d5fcaba252a4300971275cf2c4a43d5f2ce30292cde719271"} Jun 11 15:04:04.809116 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:04.809041 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7898878f7c-d5srf" event={"ID":"b9206504-36c2-4856-93ef-e37ae24c9db6","Type":"ContainerStarted","Data":"a8d06d2b636cd6145dc84afa0ee3409429f3a231fe4d056a8b38371b194560d0"} Jun 11 15:04:04.811394 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:04.811323 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-75f77978d7-976x9" event={"ID":"2430e48b-c1f3-4346-b284-8404e13a45e7","Type":"ContainerStarted","Data":"7fc7d9fe0a1b14ffbc7fc89cf12f31a6bdc207af11442805f8fc3bf01d4d6081"} Jun 11 15:04:04.819579 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:04.819314 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c","Type":"ContainerStarted","Data":"17a1a107068be50048219c27be2aa6dc9f04afa970ae6eca5e2a77de1046021e"} Jun 11 15:04:04.819579 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:04.819388 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c","Type":"ContainerStarted","Data":"b00eefeb12cace96a9e381d25e343d359c88ffb64cf4d41977bca500327c5d11"} Jun 11 15:04:04.819579 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:04.819433 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c","Type":"ContainerStarted","Data":"3bd46f37c74431104bf41932b54fb69bee0290ce1ce8c1c4310e7393a854f439"} Jun 11 15:04:04.819579 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:04.819476 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c","Type":"ContainerStarted","Data":"c87301b770df901cb577f3cb89021d84f544da7b4001976fd4d91c6abf375566"} Jun 11 15:04:04.822507 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:04.822477 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-689px" event={"ID":"32ac3102-d5ad-46b3-b166-7b5cd4a9725b","Type":"ContainerStarted","Data":"9d0dc25520b64c98fcbb13e27a6abfe6c78581678d34608543af61bac9ad99f2"} Jun 11 15:04:04.828293 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:04.828270 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-67646c5d8b-8qwpt" Jun 11 15:04:04.835083 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:04.835062 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 15:04:04.987484 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:04:04.987456 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52b832a7_f6c6_4a4f_9df2_8d02063155c4.slice/crio-2b64671527bbfe440f20c2e0783bd8ce7f8d132448ab9b27e24163952e00f297 WatchSource:0}: Error finding container 2b64671527bbfe440f20c2e0783bd8ce7f8d132448ab9b27e24163952e00f297: Status 404 returned error can't find the container with id 2b64671527bbfe440f20c2e0783bd8ce7f8d132448ab9b27e24163952e00f297 Jun 11 15:04:05.826907 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:05.826872 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"52b832a7-f6c6-4a4f-9df2-8d02063155c4","Type":"ContainerStarted","Data":"2b64671527bbfe440f20c2e0783bd8ce7f8d132448ab9b27e24163952e00f297"} Jun 11 15:04:06.732251 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:06.732170 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-24qb9" Jun 11 15:04:06.839746 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:06.839705 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c","Type":"ContainerStarted","Data":"e1f8f4552466d2f9478b137a1ef689c41ba916ee6894942bbbe179b2742d6151"} Jun 11 15:04:06.841236 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:06.841208 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-689px" event={"ID":"32ac3102-d5ad-46b3-b166-7b5cd4a9725b","Type":"ContainerStarted","Data":"fd9cf4e06319dfa241166342acdfd7c19df9f4072391d96ed3a01ffd3554d043"} Jun 11 15:04:06.841403 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:06.841374 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-689px" Jun 11 15:04:06.842837 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:06.842811 2569 generic.go:356] "Generic (PLEG): container finished" podID="52b832a7-f6c6-4a4f-9df2-8d02063155c4" containerID="a689ac6864db86052f68da2243dfcedc6d284f48956c4c56fa93a60292d54d2c" exitCode=0 Jun 11 15:04:06.842927 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:06.842901 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"52b832a7-f6c6-4a4f-9df2-8d02063155c4","Type":"ContainerDied","Data":"a689ac6864db86052f68da2243dfcedc6d284f48956c4c56fa93a60292d54d2c"} Jun 11 15:04:06.845222 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:06.845199 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-64fbbc7dc8-87vt6" event={"ID":"df14e275-a2d3-4f4b-ba2d-58a4fbe60491","Type":"ContainerStarted","Data":"1ea9fc08a135303e439b03aa163f5cfc4dc37c70aadb7b1a9a29c8069c511988"} Jun 11 15:04:06.847691 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:06.847674 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-689px" Jun 11 15:04:06.848600 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:06.848576 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7898878f7c-d5srf" event={"ID":"b9206504-36c2-4856-93ef-e37ae24c9db6","Type":"ContainerStarted","Data":"2261103c0a9f6de35197b97fdb3f49ab477bb4f9b0f6f4472321618efb3beb9f"} Jun 11 15:04:06.848690 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:06.848628 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7898878f7c-d5srf" event={"ID":"b9206504-36c2-4856-93ef-e37ae24c9db6","Type":"ContainerStarted","Data":"304833ffbc1b9de5173691d14b39ca4721c500acfeafe90c80542bae94cfc985"} Jun 11 15:04:06.848690 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:06.848659 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7898878f7c-d5srf" event={"ID":"b9206504-36c2-4856-93ef-e37ae24c9db6","Type":"ContainerStarted","Data":"afbb02ada0d1400359614a9ddf06a02109a78f4dc2e4d16dfc59879cd0f7351c"} Jun 11 15:04:06.848817 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:06.848706 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7898878f7c-d5srf" Jun 11 15:04:06.850732 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:06.850714 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-75f77978d7-976x9" event={"ID":"2430e48b-c1f3-4346-b284-8404e13a45e7","Type":"ContainerStarted","Data":"d50390e4068c7640d4c9224ddb3189fd6d7ee48e8c0686a72fcf2805fce2df8b"} Jun 11 15:04:06.850845 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:06.850783 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-75f77978d7-976x9" event={"ID":"2430e48b-c1f3-4346-b284-8404e13a45e7","Type":"ContainerStarted","Data":"1399857932d23ce07fcd4e85fa9c081ef3a735d1cc5ff286c1caa72fc95474c1"} Jun 11 15:04:06.850845 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:06.850816 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-75f77978d7-976x9" event={"ID":"2430e48b-c1f3-4346-b284-8404e13a45e7","Type":"ContainerStarted","Data":"2d415d573f1d98f0f3e20fe2eff87576a7db17987012e9796d0ca5ef72eaf8f4"} Jun 11 15:04:06.875542 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:06.875489 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.433553813 podStartE2EDuration="8.875476588s" totalImagesPullingTime="5.411366715s" totalInitContainerRuntime="30.55606ms" isStatefulPod=false podCreationTimestamp="2026-06-11 15:03:58 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:04:06.873737685 +0000 UTC m=+81.822361948" watchObservedRunningTime="2026-06-11 15:04:06.875476588 +0000 UTC m=+81.824100850" Jun 11 15:04:06.901443 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:06.901394 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-64fbbc7dc8-87vt6" podStartSLOduration=2.535250396 podStartE2EDuration="4.901379426s" totalImagesPullingTime="2.36612903s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:04:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:04:06.900476033 +0000 UTC m=+81.849100296" watchObservedRunningTime="2026-06-11 15:04:06.901379426 +0000 UTC m=+81.850003687" Jun 11 15:04:06.924984 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:06.924930 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-76b68cc874-689px" podStartSLOduration=2.587786839 podStartE2EDuration="4.924912769s" totalImagesPullingTime="2.33712593s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:04:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:04:06.923473426 +0000 UTC m=+81.872097713" watchObservedRunningTime="2026-06-11 15:04:06.924912769 +0000 UTC m=+81.873537033" Jun 11 15:04:06.954989 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:06.954938 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7898878f7c-d5srf" podStartSLOduration=3.04538228 podStartE2EDuration="7.954918764s" totalImagesPullingTime="4.909536484s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:03:59 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:04:06.953889045 +0000 UTC m=+81.902513307" watchObservedRunningTime="2026-06-11 15:04:06.954918764 +0000 UTC m=+81.903543026" Jun 11 15:04:06.982152 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:06.982090 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-75f77978d7-976x9" podStartSLOduration=1.646615103 podStartE2EDuration="3.982070181s" totalImagesPullingTime="2.335455078s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:04:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:04:06.97961908 +0000 UTC m=+81.928243343" watchObservedRunningTime="2026-06-11 15:04:06.982070181 +0000 UTC m=+81.930694444" Jun 11 15:04:10.873700 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:10.873611 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"52b832a7-f6c6-4a4f-9df2-8d02063155c4","Type":"ContainerStarted","Data":"8516918dcf5574ff42bff02b53e0ecc840d612ac3ccf188c6108d2593d472eaa"} Jun 11 15:04:10.873700 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:10.873679 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"52b832a7-f6c6-4a4f-9df2-8d02063155c4","Type":"ContainerStarted","Data":"5dc5b510af71c103804732dcd95a799de401f8bb781b98772dff5e898d955972"} Jun 11 15:04:10.874081 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:10.873713 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"52b832a7-f6c6-4a4f-9df2-8d02063155c4","Type":"ContainerStarted","Data":"674cf6aa1520ead4ecd9c5175b27f6f8a19fcf2e0384833472941c843516aa14"} Jun 11 15:04:10.874081 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:10.873741 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"52b832a7-f6c6-4a4f-9df2-8d02063155c4","Type":"ContainerStarted","Data":"caeb35456754cd538c201c358cd3b9b8002f1662ab42e67c4fbe730d3f36fa20"} Jun 11 15:04:10.874081 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:10.873791 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"52b832a7-f6c6-4a4f-9df2-8d02063155c4","Type":"ContainerStarted","Data":"7046015441ac5bd7f22afa5235ee11a50c78c6ca258440d1612a9630bb0e5254"} Jun 11 15:04:10.874081 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:10.873816 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"52b832a7-f6c6-4a4f-9df2-8d02063155c4","Type":"ContainerStarted","Data":"0a340daf3d36502ed57f37091aefedaacc291a0ffb558d5a9f0600b08af0a9a3"} Jun 11 15:04:10.914835 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:10.914785 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.396764448 podStartE2EDuration="6.914745856s" totalImagesPullingTime="3.477895114s" totalInitContainerRuntime="40.086294ms" isStatefulPod=false podCreationTimestamp="2026-06-11 15:04:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:04:10.914121367 +0000 UTC m=+85.862745665" watchObservedRunningTime="2026-06-11 15:04:10.914745856 +0000 UTC m=+85.863370118" Jun 11 15:04:11.208704 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:11.208615 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-68c66b4b67-hrqpg"] Jun 11 15:04:11.261552 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:11.261517 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-74f7779c97-zlm68"] Jun 11 15:04:11.265644 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:11.265620 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74f7779c97-zlm68" Jun 11 15:04:11.279577 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:11.279550 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-74f7779c97-zlm68"] Jun 11 15:04:11.282126 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:11.282101 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-68c66b4b67-hrqpg" Jun 11 15:04:11.334291 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:11.334265 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d5332b8a-d33c-46df-af25-86238f634c2c-console-config\") pod \"console-74f7779c97-zlm68\" (UID: \"d5332b8a-d33c-46df-af25-86238f634c2c\") " pod="openshift-console/console-74f7779c97-zlm68" Jun 11 15:04:11.334417 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:11.334295 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d5332b8a-d33c-46df-af25-86238f634c2c-oauth-serving-cert\") pod \"console-74f7779c97-zlm68\" (UID: \"d5332b8a-d33c-46df-af25-86238f634c2c\") " pod="openshift-console/console-74f7779c97-zlm68" Jun 11 15:04:11.334417 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:11.334368 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d5332b8a-d33c-46df-af25-86238f634c2c-service-ca\") pod \"console-74f7779c97-zlm68\" (UID: \"d5332b8a-d33c-46df-af25-86238f634c2c\") " pod="openshift-console/console-74f7779c97-zlm68" Jun 11 15:04:11.334417 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:11.334399 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d5332b8a-d33c-46df-af25-86238f634c2c-console-oauth-config\") pod \"console-74f7779c97-zlm68\" (UID: \"d5332b8a-d33c-46df-af25-86238f634c2c\") " pod="openshift-console/console-74f7779c97-zlm68" Jun 11 15:04:11.334543 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:11.334444 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ch6gb\" (UniqueName: \"kubernetes.io/projected/d5332b8a-d33c-46df-af25-86238f634c2c-kube-api-access-ch6gb\") pod \"console-74f7779c97-zlm68\" (UID: \"d5332b8a-d33c-46df-af25-86238f634c2c\") " pod="openshift-console/console-74f7779c97-zlm68" Jun 11 15:04:11.334543 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:11.334479 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5332b8a-d33c-46df-af25-86238f634c2c-trusted-ca-bundle\") pod \"console-74f7779c97-zlm68\" (UID: \"d5332b8a-d33c-46df-af25-86238f634c2c\") " pod="openshift-console/console-74f7779c97-zlm68" Jun 11 15:04:11.334543 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:11.334510 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d5332b8a-d33c-46df-af25-86238f634c2c-console-serving-cert\") pod \"console-74f7779c97-zlm68\" (UID: \"d5332b8a-d33c-46df-af25-86238f634c2c\") " pod="openshift-console/console-74f7779c97-zlm68" Jun 11 15:04:11.435284 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:11.435254 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d5332b8a-d33c-46df-af25-86238f634c2c-console-oauth-config\") pod \"console-74f7779c97-zlm68\" (UID: \"d5332b8a-d33c-46df-af25-86238f634c2c\") " pod="openshift-console/console-74f7779c97-zlm68" Jun 11 15:04:11.435405 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:11.435297 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ch6gb\" (UniqueName: \"kubernetes.io/projected/d5332b8a-d33c-46df-af25-86238f634c2c-kube-api-access-ch6gb\") pod \"console-74f7779c97-zlm68\" (UID: \"d5332b8a-d33c-46df-af25-86238f634c2c\") " pod="openshift-console/console-74f7779c97-zlm68" Jun 11 15:04:11.435405 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:11.435325 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5332b8a-d33c-46df-af25-86238f634c2c-trusted-ca-bundle\") pod \"console-74f7779c97-zlm68\" (UID: \"d5332b8a-d33c-46df-af25-86238f634c2c\") " pod="openshift-console/console-74f7779c97-zlm68" Jun 11 15:04:11.435405 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:11.435366 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d5332b8a-d33c-46df-af25-86238f634c2c-console-serving-cert\") pod \"console-74f7779c97-zlm68\" (UID: \"d5332b8a-d33c-46df-af25-86238f634c2c\") " pod="openshift-console/console-74f7779c97-zlm68" Jun 11 15:04:11.435558 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:11.435417 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d5332b8a-d33c-46df-af25-86238f634c2c-console-config\") pod \"console-74f7779c97-zlm68\" (UID: \"d5332b8a-d33c-46df-af25-86238f634c2c\") " pod="openshift-console/console-74f7779c97-zlm68" Jun 11 15:04:11.435558 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:11.435438 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d5332b8a-d33c-46df-af25-86238f634c2c-oauth-serving-cert\") pod \"console-74f7779c97-zlm68\" (UID: \"d5332b8a-d33c-46df-af25-86238f634c2c\") " pod="openshift-console/console-74f7779c97-zlm68" Jun 11 15:04:11.435558 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:11.435513 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d5332b8a-d33c-46df-af25-86238f634c2c-service-ca\") pod \"console-74f7779c97-zlm68\" (UID: \"d5332b8a-d33c-46df-af25-86238f634c2c\") " pod="openshift-console/console-74f7779c97-zlm68" Jun 11 15:04:11.436170 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:11.436145 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d5332b8a-d33c-46df-af25-86238f634c2c-console-config\") pod \"console-74f7779c97-zlm68\" (UID: \"d5332b8a-d33c-46df-af25-86238f634c2c\") " pod="openshift-console/console-74f7779c97-zlm68" Jun 11 15:04:11.436290 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:11.436263 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d5332b8a-d33c-46df-af25-86238f634c2c-oauth-serving-cert\") pod \"console-74f7779c97-zlm68\" (UID: \"d5332b8a-d33c-46df-af25-86238f634c2c\") " pod="openshift-console/console-74f7779c97-zlm68" Jun 11 15:04:11.436337 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:11.436276 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5332b8a-d33c-46df-af25-86238f634c2c-trusted-ca-bundle\") pod \"console-74f7779c97-zlm68\" (UID: \"d5332b8a-d33c-46df-af25-86238f634c2c\") " pod="openshift-console/console-74f7779c97-zlm68" Jun 11 15:04:11.436337 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:11.436320 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d5332b8a-d33c-46df-af25-86238f634c2c-service-ca\") pod \"console-74f7779c97-zlm68\" (UID: \"d5332b8a-d33c-46df-af25-86238f634c2c\") " pod="openshift-console/console-74f7779c97-zlm68" Jun 11 15:04:11.437790 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:11.437771 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d5332b8a-d33c-46df-af25-86238f634c2c-console-serving-cert\") pod \"console-74f7779c97-zlm68\" (UID: \"d5332b8a-d33c-46df-af25-86238f634c2c\") " pod="openshift-console/console-74f7779c97-zlm68" Jun 11 15:04:11.437881 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:11.437792 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d5332b8a-d33c-46df-af25-86238f634c2c-console-oauth-config\") pod \"console-74f7779c97-zlm68\" (UID: \"d5332b8a-d33c-46df-af25-86238f634c2c\") " pod="openshift-console/console-74f7779c97-zlm68" Jun 11 15:04:11.446980 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:11.446959 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ch6gb\" (UniqueName: \"kubernetes.io/projected/d5332b8a-d33c-46df-af25-86238f634c2c-kube-api-access-ch6gb\") pod \"console-74f7779c97-zlm68\" (UID: \"d5332b8a-d33c-46df-af25-86238f634c2c\") " pod="openshift-console/console-74f7779c97-zlm68" Jun 11 15:04:11.574282 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:11.574250 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74f7779c97-zlm68" Jun 11 15:04:11.703381 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:11.703357 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-74f7779c97-zlm68"] Jun 11 15:04:11.705287 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:04:11.705258 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5332b8a_d33c_46df_af25_86238f634c2c.slice/crio-f4047ef78b61d1d384b39424fc843aa9232b4b3e5d2fc18b21efd1e1d2417ca7 WatchSource:0}: Error finding container f4047ef78b61d1d384b39424fc843aa9232b4b3e5d2fc18b21efd1e1d2417ca7: Status 404 returned error can't find the container with id f4047ef78b61d1d384b39424fc843aa9232b4b3e5d2fc18b21efd1e1d2417ca7 Jun 11 15:04:11.879695 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:11.879615 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74f7779c97-zlm68" event={"ID":"d5332b8a-d33c-46df-af25-86238f634c2c","Type":"ContainerStarted","Data":"fe02a9d16508c5da7ce5d51830613c17eb009d76c3f08b867332607fa5f8f8c2"} Jun 11 15:04:11.879695 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:11.879668 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74f7779c97-zlm68" event={"ID":"d5332b8a-d33c-46df-af25-86238f634c2c","Type":"ContainerStarted","Data":"f4047ef78b61d1d384b39424fc843aa9232b4b3e5d2fc18b21efd1e1d2417ca7"} Jun 11 15:04:12.863592 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:12.863565 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7898878f7c-d5srf" Jun 11 15:04:12.895574 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:12.895522 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-74f7779c97-zlm68" podStartSLOduration=1.895505422 podStartE2EDuration="1.895505422s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:04:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:04:11.909623152 +0000 UTC m=+86.858247415" watchObservedRunningTime="2026-06-11 15:04:12.895505422 +0000 UTC m=+87.844129683" Jun 11 15:04:13.708359 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:13.708332 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7678565674-mglc9" Jun 11 15:04:14.628923 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:14.628893 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:04:15.621669 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:15.621641 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5lcln" Jun 11 15:04:21.197912 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:21.197877 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-t8gh8_fb07ba89-003b-4871-bf42-c63ff69b6d3a/serve-healthcheck-canary/0.log" Jun 11 15:04:21.574458 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:21.574425 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-74f7779c97-zlm68" Jun 11 15:04:21.574628 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:21.574503 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-74f7779c97-zlm68" Jun 11 15:04:21.579421 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:21.579403 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-74f7779c97-zlm68" Jun 11 15:04:21.926443 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:21.926364 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-74f7779c97-zlm68" Jun 11 15:04:21.982743 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:21.982712 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-67646c5d8b-8qwpt"] Jun 11 15:04:22.837831 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:22.837789 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-64fbbc7dc8-87vt6" Jun 11 15:04:22.838178 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:22.837857 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-64fbbc7dc8-87vt6" Jun 11 15:04:36.228122 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:36.228049 2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-68c66b4b67-hrqpg" podUID="0e238523-dca8-4b8e-9045-1bd0120a2028" containerName="console" containerID="cri-o://b6846efd3fda072737f244979a751f2c9bf4cfc1f5e83d5afc9c105f2fca3f44" gracePeriod=15 Jun 11 15:04:36.498415 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:36.498358 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68c66b4b67-hrqpg" Jun 11 15:04:36.590445 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:36.590413 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0e238523-dca8-4b8e-9045-1bd0120a2028-console-oauth-config\") pod \"0e238523-dca8-4b8e-9045-1bd0120a2028\" (UID: \"0e238523-dca8-4b8e-9045-1bd0120a2028\") " Jun 11 15:04:36.590604 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:36.590456 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-67zlz\" (UniqueName: \"kubernetes.io/projected/0e238523-dca8-4b8e-9045-1bd0120a2028-kube-api-access-67zlz\") pod \"0e238523-dca8-4b8e-9045-1bd0120a2028\" (UID: \"0e238523-dca8-4b8e-9045-1bd0120a2028\") " Jun 11 15:04:36.590604 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:36.590509 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0e238523-dca8-4b8e-9045-1bd0120a2028-console-serving-cert\") pod \"0e238523-dca8-4b8e-9045-1bd0120a2028\" (UID: \"0e238523-dca8-4b8e-9045-1bd0120a2028\") " Jun 11 15:04:36.590604 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:36.590549 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0e238523-dca8-4b8e-9045-1bd0120a2028-oauth-serving-cert\") pod \"0e238523-dca8-4b8e-9045-1bd0120a2028\" (UID: \"0e238523-dca8-4b8e-9045-1bd0120a2028\") " Jun 11 15:04:36.590793 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:36.590695 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e238523-dca8-4b8e-9045-1bd0120a2028-trusted-ca-bundle\") pod \"0e238523-dca8-4b8e-9045-1bd0120a2028\" (UID: \"0e238523-dca8-4b8e-9045-1bd0120a2028\") " Jun 11 15:04:36.590793 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:36.590729 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0e238523-dca8-4b8e-9045-1bd0120a2028-service-ca\") pod \"0e238523-dca8-4b8e-9045-1bd0120a2028\" (UID: \"0e238523-dca8-4b8e-9045-1bd0120a2028\") " Jun 11 15:04:36.590904 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:36.590848 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0e238523-dca8-4b8e-9045-1bd0120a2028-console-config\") pod \"0e238523-dca8-4b8e-9045-1bd0120a2028\" (UID: \"0e238523-dca8-4b8e-9045-1bd0120a2028\") " Jun 11 15:04:36.591413 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:36.591027 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e238523-dca8-4b8e-9045-1bd0120a2028-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0e238523-dca8-4b8e-9045-1bd0120a2028" (UID: "0e238523-dca8-4b8e-9045-1bd0120a2028"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 15:04:36.591413 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:36.591104 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e238523-dca8-4b8e-9045-1bd0120a2028-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "0e238523-dca8-4b8e-9045-1bd0120a2028" (UID: "0e238523-dca8-4b8e-9045-1bd0120a2028"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 15:04:36.591413 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:36.591143 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e238523-dca8-4b8e-9045-1bd0120a2028-service-ca" (OuterVolumeSpecName: "service-ca") pod "0e238523-dca8-4b8e-9045-1bd0120a2028" (UID: "0e238523-dca8-4b8e-9045-1bd0120a2028"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 15:04:36.591413 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:36.591350 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e238523-dca8-4b8e-9045-1bd0120a2028-console-config" (OuterVolumeSpecName: "console-config") pod "0e238523-dca8-4b8e-9045-1bd0120a2028" (UID: "0e238523-dca8-4b8e-9045-1bd0120a2028"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 15:04:36.591687 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:36.591437 2569 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0e238523-dca8-4b8e-9045-1bd0120a2028-service-ca\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\"" Jun 11 15:04:36.591687 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:36.591470 2569 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0e238523-dca8-4b8e-9045-1bd0120a2028-console-config\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\"" Jun 11 15:04:36.591687 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:36.591485 2569 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0e238523-dca8-4b8e-9045-1bd0120a2028-oauth-serving-cert\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\"" Jun 11 15:04:36.591687 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:36.591499 2569 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e238523-dca8-4b8e-9045-1bd0120a2028-trusted-ca-bundle\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\"" Jun 11 15:04:36.592911 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:36.592883 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e238523-dca8-4b8e-9045-1bd0120a2028-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0e238523-dca8-4b8e-9045-1bd0120a2028" (UID: "0e238523-dca8-4b8e-9045-1bd0120a2028"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:04:36.593007 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:36.592945 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e238523-dca8-4b8e-9045-1bd0120a2028-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0e238523-dca8-4b8e-9045-1bd0120a2028" (UID: "0e238523-dca8-4b8e-9045-1bd0120a2028"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:04:36.593007 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:36.592959 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e238523-dca8-4b8e-9045-1bd0120a2028-kube-api-access-67zlz" (OuterVolumeSpecName: "kube-api-access-67zlz") pod "0e238523-dca8-4b8e-9045-1bd0120a2028" (UID: "0e238523-dca8-4b8e-9045-1bd0120a2028"). InnerVolumeSpecName "kube-api-access-67zlz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 15:04:36.692414 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:36.692385 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-67zlz\" (UniqueName: \"kubernetes.io/projected/0e238523-dca8-4b8e-9045-1bd0120a2028-kube-api-access-67zlz\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\"" Jun 11 15:04:36.692414 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:36.692407 2569 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0e238523-dca8-4b8e-9045-1bd0120a2028-console-serving-cert\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\"" Jun 11 15:04:36.692414 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:36.692416 2569 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0e238523-dca8-4b8e-9045-1bd0120a2028-console-oauth-config\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\"" Jun 11 15:04:36.983950 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:36.983912 2569 generic.go:356] "Generic (PLEG): container finished" podID="0e238523-dca8-4b8e-9045-1bd0120a2028" containerID="b6846efd3fda072737f244979a751f2c9bf4cfc1f5e83d5afc9c105f2fca3f44" exitCode=0 Jun 11 15:04:36.984124 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:36.983955 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68c66b4b67-hrqpg" Jun 11 15:04:36.984124 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:36.983995 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68c66b4b67-hrqpg" event={"ID":"0e238523-dca8-4b8e-9045-1bd0120a2028","Type":"ContainerDied","Data":"b6846efd3fda072737f244979a751f2c9bf4cfc1f5e83d5afc9c105f2fca3f44"} Jun 11 15:04:36.984124 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:36.984042 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68c66b4b67-hrqpg" event={"ID":"0e238523-dca8-4b8e-9045-1bd0120a2028","Type":"ContainerDied","Data":"50c3662ce03e0e2e63ff4c9fa5af2c8e7737378cac898ed025a13af6f9204a68"} Jun 11 15:04:36.984124 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:36.984061 2569 scope.go:117] "RemoveContainer" containerID="b6846efd3fda072737f244979a751f2c9bf4cfc1f5e83d5afc9c105f2fca3f44" Jun 11 15:04:36.992737 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:36.992720 2569 scope.go:117] "RemoveContainer" containerID="b6846efd3fda072737f244979a751f2c9bf4cfc1f5e83d5afc9c105f2fca3f44" Jun 11 15:04:36.993025 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:04:36.993006 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6846efd3fda072737f244979a751f2c9bf4cfc1f5e83d5afc9c105f2fca3f44\": container with ID starting with b6846efd3fda072737f244979a751f2c9bf4cfc1f5e83d5afc9c105f2fca3f44 not found: ID does not exist" containerID="b6846efd3fda072737f244979a751f2c9bf4cfc1f5e83d5afc9c105f2fca3f44" Jun 11 15:04:36.993102 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:36.993037 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6846efd3fda072737f244979a751f2c9bf4cfc1f5e83d5afc9c105f2fca3f44"} err="failed to get container status \"b6846efd3fda072737f244979a751f2c9bf4cfc1f5e83d5afc9c105f2fca3f44\": rpc error: code = NotFound desc = could not find container \"b6846efd3fda072737f244979a751f2c9bf4cfc1f5e83d5afc9c105f2fca3f44\": container with ID starting with b6846efd3fda072737f244979a751f2c9bf4cfc1f5e83d5afc9c105f2fca3f44 not found: ID does not exist" Jun 11 15:04:37.011702 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:37.011669 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-68c66b4b67-hrqpg"] Jun 11 15:04:37.017524 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:37.017499 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-68c66b4b67-hrqpg"] Jun 11 15:04:37.479309 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:37.479280 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e238523-dca8-4b8e-9045-1bd0120a2028" path="/var/lib/kubelet/pods/0e238523-dca8-4b8e-9045-1bd0120a2028/volumes" Jun 11 15:04:42.843684 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:42.843656 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-64fbbc7dc8-87vt6" Jun 11 15:04:42.847500 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:42.847480 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-64fbbc7dc8-87vt6" Jun 11 15:04:47.002652 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:47.002605 2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-67646c5d8b-8qwpt" podUID="94ef105d-b176-4e2c-bf38-848e2c2a4982" containerName="console" containerID="cri-o://39167530b1fff5586c50c39222d1482e9bb601ad683877830c9a83c21d764ce2" gracePeriod=15 Jun 11 15:04:47.243356 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:47.243327 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67646c5d8b-8qwpt" Jun 11 15:04:47.287612 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:47.287586 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/94ef105d-b176-4e2c-bf38-848e2c2a4982-console-serving-cert\") pod \"94ef105d-b176-4e2c-bf38-848e2c2a4982\" (UID: \"94ef105d-b176-4e2c-bf38-848e2c2a4982\") " Jun 11 15:04:47.287796 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:47.287633 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p2hc8\" (UniqueName: \"kubernetes.io/projected/94ef105d-b176-4e2c-bf38-848e2c2a4982-kube-api-access-p2hc8\") pod \"94ef105d-b176-4e2c-bf38-848e2c2a4982\" (UID: \"94ef105d-b176-4e2c-bf38-848e2c2a4982\") " Jun 11 15:04:47.287796 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:47.287769 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/94ef105d-b176-4e2c-bf38-848e2c2a4982-oauth-serving-cert\") pod \"94ef105d-b176-4e2c-bf38-848e2c2a4982\" (UID: \"94ef105d-b176-4e2c-bf38-848e2c2a4982\") " Jun 11 15:04:47.287926 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:47.287798 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/94ef105d-b176-4e2c-bf38-848e2c2a4982-console-oauth-config\") pod \"94ef105d-b176-4e2c-bf38-848e2c2a4982\" (UID: \"94ef105d-b176-4e2c-bf38-848e2c2a4982\") " Jun 11 15:04:47.287926 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:47.287851 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/94ef105d-b176-4e2c-bf38-848e2c2a4982-service-ca\") pod \"94ef105d-b176-4e2c-bf38-848e2c2a4982\" (UID: \"94ef105d-b176-4e2c-bf38-848e2c2a4982\") " Jun 11 15:04:47.287926 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:47.287876 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/94ef105d-b176-4e2c-bf38-848e2c2a4982-console-config\") pod \"94ef105d-b176-4e2c-bf38-848e2c2a4982\" (UID: \"94ef105d-b176-4e2c-bf38-848e2c2a4982\") " Jun 11 15:04:47.288269 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:47.288154 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/94ef105d-b176-4e2c-bf38-848e2c2a4982-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "94ef105d-b176-4e2c-bf38-848e2c2a4982" (UID: "94ef105d-b176-4e2c-bf38-848e2c2a4982"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 15:04:47.288428 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:47.288401 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/94ef105d-b176-4e2c-bf38-848e2c2a4982-service-ca" (OuterVolumeSpecName: "service-ca") pod "94ef105d-b176-4e2c-bf38-848e2c2a4982" (UID: "94ef105d-b176-4e2c-bf38-848e2c2a4982"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 15:04:47.288491 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:47.288407 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/94ef105d-b176-4e2c-bf38-848e2c2a4982-console-config" (OuterVolumeSpecName: "console-config") pod "94ef105d-b176-4e2c-bf38-848e2c2a4982" (UID: "94ef105d-b176-4e2c-bf38-848e2c2a4982"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 15:04:47.289894 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:47.289859 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/94ef105d-b176-4e2c-bf38-848e2c2a4982-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "94ef105d-b176-4e2c-bf38-848e2c2a4982" (UID: "94ef105d-b176-4e2c-bf38-848e2c2a4982"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:04:47.290142 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:47.290108 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94ef105d-b176-4e2c-bf38-848e2c2a4982-kube-api-access-p2hc8" (OuterVolumeSpecName: "kube-api-access-p2hc8") pod "94ef105d-b176-4e2c-bf38-848e2c2a4982" (UID: "94ef105d-b176-4e2c-bf38-848e2c2a4982"). InnerVolumeSpecName "kube-api-access-p2hc8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 15:04:47.290231 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:47.290138 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/94ef105d-b176-4e2c-bf38-848e2c2a4982-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "94ef105d-b176-4e2c-bf38-848e2c2a4982" (UID: "94ef105d-b176-4e2c-bf38-848e2c2a4982"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:04:47.389111 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:47.389069 2569 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/94ef105d-b176-4e2c-bf38-848e2c2a4982-service-ca\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\"" Jun 11 15:04:47.389111 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:47.389099 2569 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/94ef105d-b176-4e2c-bf38-848e2c2a4982-console-config\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\"" Jun 11 15:04:47.389111 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:47.389109 2569 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/94ef105d-b176-4e2c-bf38-848e2c2a4982-console-serving-cert\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\"" Jun 11 15:04:47.389111 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:47.389119 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p2hc8\" (UniqueName: \"kubernetes.io/projected/94ef105d-b176-4e2c-bf38-848e2c2a4982-kube-api-access-p2hc8\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\"" Jun 11 15:04:47.389438 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:47.389128 2569 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/94ef105d-b176-4e2c-bf38-848e2c2a4982-oauth-serving-cert\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\"" Jun 11 15:04:47.389438 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:47.389138 2569 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/94ef105d-b176-4e2c-bf38-848e2c2a4982-console-oauth-config\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\"" Jun 11 15:04:48.025772 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:48.025716 2569 generic.go:356] "Generic (PLEG): container finished" podID="94ef105d-b176-4e2c-bf38-848e2c2a4982" containerID="39167530b1fff5586c50c39222d1482e9bb601ad683877830c9a83c21d764ce2" exitCode=0 Jun 11 15:04:48.026219 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:48.025806 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67646c5d8b-8qwpt" Jun 11 15:04:48.026219 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:48.025799 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67646c5d8b-8qwpt" event={"ID":"94ef105d-b176-4e2c-bf38-848e2c2a4982","Type":"ContainerDied","Data":"39167530b1fff5586c50c39222d1482e9bb601ad683877830c9a83c21d764ce2"} Jun 11 15:04:48.026219 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:48.025905 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67646c5d8b-8qwpt" event={"ID":"94ef105d-b176-4e2c-bf38-848e2c2a4982","Type":"ContainerDied","Data":"d6c4138b45c7ceb8dfd7fa60305143e4d5ede5b7d73a9690bb874ad13cf50b65"} Jun 11 15:04:48.026219 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:48.025938 2569 scope.go:117] "RemoveContainer" containerID="39167530b1fff5586c50c39222d1482e9bb601ad683877830c9a83c21d764ce2" Jun 11 15:04:48.033847 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:48.033827 2569 scope.go:117] "RemoveContainer" containerID="39167530b1fff5586c50c39222d1482e9bb601ad683877830c9a83c21d764ce2" Jun 11 15:04:48.034130 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:04:48.034107 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"39167530b1fff5586c50c39222d1482e9bb601ad683877830c9a83c21d764ce2\": container with ID starting with 39167530b1fff5586c50c39222d1482e9bb601ad683877830c9a83c21d764ce2 not found: ID does not exist" containerID="39167530b1fff5586c50c39222d1482e9bb601ad683877830c9a83c21d764ce2" Jun 11 15:04:48.034229 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:48.034135 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39167530b1fff5586c50c39222d1482e9bb601ad683877830c9a83c21d764ce2"} err="failed to get container status \"39167530b1fff5586c50c39222d1482e9bb601ad683877830c9a83c21d764ce2\": rpc error: code = NotFound desc = could not find container \"39167530b1fff5586c50c39222d1482e9bb601ad683877830c9a83c21d764ce2\": container with ID starting with 39167530b1fff5586c50c39222d1482e9bb601ad683877830c9a83c21d764ce2 not found: ID does not exist" Jun 11 15:04:48.047966 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:48.047943 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-67646c5d8b-8qwpt"] Jun 11 15:04:48.053413 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:48.053393 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-67646c5d8b-8qwpt"] Jun 11 15:04:49.479330 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:49.479302 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94ef105d-b176-4e2c-bf38-848e2c2a4982" path="/var/lib/kubelet/pods/94ef105d-b176-4e2c-bf38-848e2c2a4982/volumes" Jun 11 15:04:55.260154 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:55.260111 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f5813fd7-de59-42f7-b4ee-de396547742d-original-pull-secret\") pod \"global-pull-secret-syncer-9xq6t\" (UID: \"f5813fd7-de59-42f7-b4ee-de396547742d\") " pod="kube-system/global-pull-secret-syncer-9xq6t" Jun 11 15:04:55.264421 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:55.264399 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 15:04:55.272764 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:55.272738 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f5813fd7-de59-42f7-b4ee-de396547742d-original-pull-secret\") pod \"global-pull-secret-syncer-9xq6t\" (UID: \"f5813fd7-de59-42f7-b4ee-de396547742d\") " pod="kube-system/global-pull-secret-syncer-9xq6t" Jun 11 15:04:55.361322 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:55.361285 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9zg5\" (UniqueName: \"kubernetes.io/projected/5f5aa8b6-caed-490f-818a-9a245c7bba82-kube-api-access-w9zg5\") pod \"network-check-target-786s7\" (UID: \"5f5aa8b6-caed-490f-818a-9a245c7bba82\") " pod="openshift-network-diagnostics/network-check-target-786s7" Jun 11 15:04:55.361465 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:55.361339 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a79c1c7a-ce77-499f-8f15-ea44cd93aeb2-metrics-certs\") pod \"network-metrics-daemon-6zlq9\" (UID: \"a79c1c7a-ce77-499f-8f15-ea44cd93aeb2\") " pod="openshift-multus/network-metrics-daemon-6zlq9" Jun 11 15:04:55.365179 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:55.365159 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 15:04:55.365246 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:55.365160 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 15:04:55.374621 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:55.374593 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a79c1c7a-ce77-499f-8f15-ea44cd93aeb2-metrics-certs\") pod \"network-metrics-daemon-6zlq9\" (UID: \"a79c1c7a-ce77-499f-8f15-ea44cd93aeb2\") " pod="openshift-multus/network-metrics-daemon-6zlq9" Jun 11 15:04:55.375304 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:55.375285 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 15:04:55.385475 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:55.385455 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9zg5\" (UniqueName: \"kubernetes.io/projected/5f5aa8b6-caed-490f-818a-9a245c7bba82-kube-api-access-w9zg5\") pod \"network-check-target-786s7\" (UID: \"5f5aa8b6-caed-490f-818a-9a245c7bba82\") " pod="openshift-network-diagnostics/network-check-target-786s7" Jun 11 15:04:55.493976 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:55.493932 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9xq6t" Jun 11 15:04:55.497986 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:55.497962 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dgmcw\"" Jun 11 15:04:55.498698 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:55.498683 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-786s7" Jun 11 15:04:55.501223 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:55.501206 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-7v5wg\"" Jun 11 15:04:55.509323 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:55.509126 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6zlq9" Jun 11 15:04:55.658379 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:55.658302 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-786s7"] Jun 11 15:04:55.660940 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:04:55.660913 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f5aa8b6_caed_490f_818a_9a245c7bba82.slice/crio-bc8a992fcc2bc61ac5bc4bf1000392722981d1c95a458a12fab157ab35195f46 WatchSource:0}: Error finding container bc8a992fcc2bc61ac5bc4bf1000392722981d1c95a458a12fab157ab35195f46: Status 404 returned error can't find the container with id bc8a992fcc2bc61ac5bc4bf1000392722981d1c95a458a12fab157ab35195f46 Jun 11 15:04:55.897167 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:55.897146 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9xq6t"] Jun 11 15:04:55.898910 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:04:55.898886 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5813fd7_de59_42f7_b4ee_de396547742d.slice/crio-9cf11290a5fe5318e835140651868820bde29d1b53febc0e4bb86db02278e4b4 WatchSource:0}: Error finding container 9cf11290a5fe5318e835140651868820bde29d1b53febc0e4bb86db02278e4b4: Status 404 returned error can't find the container with id 9cf11290a5fe5318e835140651868820bde29d1b53febc0e4bb86db02278e4b4 Jun 11 15:04:55.902040 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:55.902016 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6zlq9"] Jun 11 15:04:55.904611 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:04:55.904590 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda79c1c7a_ce77_499f_8f15_ea44cd93aeb2.slice/crio-3846cf5fbec3bf3ac42f11525fa6c142946be3766b35331d5b2f6a2d3aa57d75 WatchSource:0}: Error finding container 3846cf5fbec3bf3ac42f11525fa6c142946be3766b35331d5b2f6a2d3aa57d75: Status 404 returned error can't find the container with id 3846cf5fbec3bf3ac42f11525fa6c142946be3766b35331d5b2f6a2d3aa57d75 Jun 11 15:04:56.060769 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:56.060717 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9xq6t" event={"ID":"f5813fd7-de59-42f7-b4ee-de396547742d","Type":"ContainerStarted","Data":"9cf11290a5fe5318e835140651868820bde29d1b53febc0e4bb86db02278e4b4"} Jun 11 15:04:56.062110 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:56.062084 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-786s7" event={"ID":"5f5aa8b6-caed-490f-818a-9a245c7bba82","Type":"ContainerStarted","Data":"bc8a992fcc2bc61ac5bc4bf1000392722981d1c95a458a12fab157ab35195f46"} Jun 11 15:04:56.063479 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:56.063456 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6zlq9" event={"ID":"a79c1c7a-ce77-499f-8f15-ea44cd93aeb2","Type":"ContainerStarted","Data":"3846cf5fbec3bf3ac42f11525fa6c142946be3766b35331d5b2f6a2d3aa57d75"} Jun 11 15:04:57.077161 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:57.077087 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6zlq9" event={"ID":"a79c1c7a-ce77-499f-8f15-ea44cd93aeb2","Type":"ContainerStarted","Data":"264fe7ffc4c222b1bba99b90e09b2ead3b4242f0b6a28dc60ae884b46cba35fd"} Jun 11 15:04:58.084566 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:58.084529 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6zlq9" event={"ID":"a79c1c7a-ce77-499f-8f15-ea44cd93aeb2","Type":"ContainerStarted","Data":"977226e5bcdfbe25d49018157c928dc8097e29ad9edf653a192569466046d33d"} Jun 11 15:04:58.115163 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:58.115109 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-6zlq9" podStartSLOduration=132.160605888 podStartE2EDuration="2m13.115088256s" totalImagesPullingTime="954.482368ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:02:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:04:58.11384391 +0000 UTC m=+133.062468173" watchObservedRunningTime="2026-06-11 15:04:58.115088256 +0000 UTC m=+133.063712522" Jun 11 15:04:59.091653 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:59.091617 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-786s7" event={"ID":"5f5aa8b6-caed-490f-818a-9a245c7bba82","Type":"ContainerStarted","Data":"7a926f398afaf1c90f6d7258da6703e5ad7c3c62bbf880b3e1424e18af2c7990"} Jun 11 15:04:59.092153 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:04:59.091712 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-786s7" Jun 11 15:05:01.102479 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:01.102446 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9xq6t" event={"ID":"f5813fd7-de59-42f7-b4ee-de396547742d","Type":"ContainerStarted","Data":"fabbcfa1d6ce15c9058ea62baba9296f81e13886f94e5fa34b5535ff1b80ac47"} Jun 11 15:05:01.148117 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:01.148070 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-9xq6t" podStartSLOduration=131.690455717 podStartE2EDuration="2m16.148055388s" totalImagesPullingTime="4.457599671s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 15:02:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:05:01.147827826 +0000 UTC m=+136.096452101" watchObservedRunningTime="2026-06-11 15:05:01.148055388 +0000 UTC m=+136.096679650" Jun 11 15:05:01.148326 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:01.148306 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-786s7" podStartSLOduration=133.160639604 podStartE2EDuration="2m16.148300915s" totalImagesPullingTime="2.987661311s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:02:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:04:59.124485369 +0000 UTC m=+134.073109631" watchObservedRunningTime="2026-06-11 15:05:01.148300915 +0000 UTC m=+136.096925176" Jun 11 15:05:04.629621 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:04.629582 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:05:04.648651 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:04.648627 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:05:05.133950 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:05.133922 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:05:18.695564 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:18.695532 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 15:05:18.696088 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:18.695798 2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c" containerName="alertmanager" containerID="cri-o://5058c2d45a6efddd58ba0f207ac24b3cac3e053c19870bc1ef26c9522f6fa2b0" gracePeriod=120 Jun 11 15:05:18.696088 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:18.695873 2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c" containerName="kube-rbac-proxy-metric" containerID="cri-o://17a1a107068be50048219c27be2aa6dc9f04afa970ae6eca5e2a77de1046021e" gracePeriod=120 Jun 11 15:05:18.696088 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:18.695884 2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c" containerName="kube-rbac-proxy-web" containerID="cri-o://3bd46f37c74431104bf41932b54fb69bee0290ce1ce8c1c4310e7393a854f439" gracePeriod=120 Jun 11 15:05:18.696088 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:18.695934 2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c" containerName="config-reloader" containerID="cri-o://c87301b770df901cb577f3cb89021d84f544da7b4001976fd4d91c6abf375566" gracePeriod=120 Jun 11 15:05:18.696088 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:18.695971 2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c" containerName="prom-label-proxy" containerID="cri-o://e1f8f4552466d2f9478b137a1ef689c41ba916ee6894942bbbe179b2742d6151" gracePeriod=120 Jun 11 15:05:18.696088 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:18.695934 2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c" containerName="kube-rbac-proxy" containerID="cri-o://b00eefeb12cace96a9e381d25e343d359c88ffb64cf4d41977bca500327c5d11" gracePeriod=120 Jun 11 15:05:19.178428 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:19.178399 2569 generic.go:356] "Generic (PLEG): container finished" podID="d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c" containerID="e1f8f4552466d2f9478b137a1ef689c41ba916ee6894942bbbe179b2742d6151" exitCode=0 Jun 11 15:05:19.178428 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:19.178422 2569 generic.go:356] "Generic (PLEG): container finished" podID="d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c" containerID="b00eefeb12cace96a9e381d25e343d359c88ffb64cf4d41977bca500327c5d11" exitCode=0 Jun 11 15:05:19.178428 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:19.178429 2569 generic.go:356] "Generic (PLEG): container finished" podID="d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c" containerID="c87301b770df901cb577f3cb89021d84f544da7b4001976fd4d91c6abf375566" exitCode=0 Jun 11 15:05:19.178428 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:19.178435 2569 generic.go:356] "Generic (PLEG): container finished" podID="d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c" containerID="5058c2d45a6efddd58ba0f207ac24b3cac3e053c19870bc1ef26c9522f6fa2b0" exitCode=0 Jun 11 15:05:19.178666 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:19.178469 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c","Type":"ContainerDied","Data":"e1f8f4552466d2f9478b137a1ef689c41ba916ee6894942bbbe179b2742d6151"} Jun 11 15:05:19.178666 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:19.178530 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c","Type":"ContainerDied","Data":"b00eefeb12cace96a9e381d25e343d359c88ffb64cf4d41977bca500327c5d11"} Jun 11 15:05:19.178666 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:19.178557 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c","Type":"ContainerDied","Data":"c87301b770df901cb577f3cb89021d84f544da7b4001976fd4d91c6abf375566"} Jun 11 15:05:19.178666 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:19.178588 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c","Type":"ContainerDied","Data":"5058c2d45a6efddd58ba0f207ac24b3cac3e053c19870bc1ef26c9522f6fa2b0"} Jun 11 15:05:19.354226 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:19.354196 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7ffb94b689-nfjxt"] Jun 11 15:05:19.354571 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:19.354556 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e238523-dca8-4b8e-9045-1bd0120a2028" containerName="console" Jun 11 15:05:19.354614 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:19.354573 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e238523-dca8-4b8e-9045-1bd0120a2028" containerName="console" Jun 11 15:05:19.354614 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:19.354587 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94ef105d-b176-4e2c-bf38-848e2c2a4982" containerName="console" Jun 11 15:05:19.354614 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:19.354594 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="94ef105d-b176-4e2c-bf38-848e2c2a4982" containerName="console" Jun 11 15:05:19.354704 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:19.354652 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="94ef105d-b176-4e2c-bf38-848e2c2a4982" containerName="console" Jun 11 15:05:19.354704 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:19.354659 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e238523-dca8-4b8e-9045-1bd0120a2028" containerName="console" Jun 11 15:05:19.376954 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:19.376930 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7ffb94b689-nfjxt" Jun 11 15:05:19.381883 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:19.381858 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7ffb94b689-nfjxt"] Jun 11 15:05:19.495644 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:19.495568 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2501788c-0d56-425b-8c43-917ce4f28953-console-serving-cert\") pod \"console-7ffb94b689-nfjxt\" (UID: \"2501788c-0d56-425b-8c43-917ce4f28953\") " pod="openshift-console/console-7ffb94b689-nfjxt" Jun 11 15:05:19.495644 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:19.495600 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2501788c-0d56-425b-8c43-917ce4f28953-trusted-ca-bundle\") pod \"console-7ffb94b689-nfjxt\" (UID: \"2501788c-0d56-425b-8c43-917ce4f28953\") " pod="openshift-console/console-7ffb94b689-nfjxt" Jun 11 15:05:19.495644 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:19.495642 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2501788c-0d56-425b-8c43-917ce4f28953-console-oauth-config\") pod \"console-7ffb94b689-nfjxt\" (UID: \"2501788c-0d56-425b-8c43-917ce4f28953\") " pod="openshift-console/console-7ffb94b689-nfjxt" Jun 11 15:05:19.495898 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:19.495659 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8gvg\" (UniqueName: \"kubernetes.io/projected/2501788c-0d56-425b-8c43-917ce4f28953-kube-api-access-j8gvg\") pod \"console-7ffb94b689-nfjxt\" (UID: \"2501788c-0d56-425b-8c43-917ce4f28953\") " pod="openshift-console/console-7ffb94b689-nfjxt" Jun 11 15:05:19.495898 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:19.495680 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2501788c-0d56-425b-8c43-917ce4f28953-console-config\") pod \"console-7ffb94b689-nfjxt\" (UID: \"2501788c-0d56-425b-8c43-917ce4f28953\") " pod="openshift-console/console-7ffb94b689-nfjxt" Jun 11 15:05:19.495898 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:19.495746 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2501788c-0d56-425b-8c43-917ce4f28953-service-ca\") pod \"console-7ffb94b689-nfjxt\" (UID: \"2501788c-0d56-425b-8c43-917ce4f28953\") " pod="openshift-console/console-7ffb94b689-nfjxt" Jun 11 15:05:19.495898 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:19.495801 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2501788c-0d56-425b-8c43-917ce4f28953-oauth-serving-cert\") pod \"console-7ffb94b689-nfjxt\" (UID: \"2501788c-0d56-425b-8c43-917ce4f28953\") " pod="openshift-console/console-7ffb94b689-nfjxt" Jun 11 15:05:19.596195 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:19.596160 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2501788c-0d56-425b-8c43-917ce4f28953-console-oauth-config\") pod \"console-7ffb94b689-nfjxt\" (UID: \"2501788c-0d56-425b-8c43-917ce4f28953\") " pod="openshift-console/console-7ffb94b689-nfjxt" Jun 11 15:05:19.596195 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:19.596193 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8gvg\" (UniqueName: \"kubernetes.io/projected/2501788c-0d56-425b-8c43-917ce4f28953-kube-api-access-j8gvg\") pod \"console-7ffb94b689-nfjxt\" (UID: \"2501788c-0d56-425b-8c43-917ce4f28953\") " pod="openshift-console/console-7ffb94b689-nfjxt" Jun 11 15:05:19.596427 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:19.596211 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2501788c-0d56-425b-8c43-917ce4f28953-console-config\") pod \"console-7ffb94b689-nfjxt\" (UID: \"2501788c-0d56-425b-8c43-917ce4f28953\") " pod="openshift-console/console-7ffb94b689-nfjxt" Jun 11 15:05:19.596427 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:19.596244 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2501788c-0d56-425b-8c43-917ce4f28953-service-ca\") pod \"console-7ffb94b689-nfjxt\" (UID: \"2501788c-0d56-425b-8c43-917ce4f28953\") " pod="openshift-console/console-7ffb94b689-nfjxt" Jun 11 15:05:19.596427 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:19.596271 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2501788c-0d56-425b-8c43-917ce4f28953-oauth-serving-cert\") pod \"console-7ffb94b689-nfjxt\" (UID: \"2501788c-0d56-425b-8c43-917ce4f28953\") " pod="openshift-console/console-7ffb94b689-nfjxt" Jun 11 15:05:19.596427 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:19.596290 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2501788c-0d56-425b-8c43-917ce4f28953-console-serving-cert\") pod \"console-7ffb94b689-nfjxt\" (UID: \"2501788c-0d56-425b-8c43-917ce4f28953\") " pod="openshift-console/console-7ffb94b689-nfjxt" Jun 11 15:05:19.596427 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:19.596305 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2501788c-0d56-425b-8c43-917ce4f28953-trusted-ca-bundle\") pod \"console-7ffb94b689-nfjxt\" (UID: \"2501788c-0d56-425b-8c43-917ce4f28953\") " pod="openshift-console/console-7ffb94b689-nfjxt" Jun 11 15:05:19.597100 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:19.597071 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2501788c-0d56-425b-8c43-917ce4f28953-oauth-serving-cert\") pod \"console-7ffb94b689-nfjxt\" (UID: \"2501788c-0d56-425b-8c43-917ce4f28953\") " pod="openshift-console/console-7ffb94b689-nfjxt" Jun 11 15:05:19.597227 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:19.597123 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2501788c-0d56-425b-8c43-917ce4f28953-console-config\") pod \"console-7ffb94b689-nfjxt\" (UID: \"2501788c-0d56-425b-8c43-917ce4f28953\") " pod="openshift-console/console-7ffb94b689-nfjxt" Jun 11 15:05:19.597227 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:19.597119 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2501788c-0d56-425b-8c43-917ce4f28953-service-ca\") pod \"console-7ffb94b689-nfjxt\" (UID: \"2501788c-0d56-425b-8c43-917ce4f28953\") " pod="openshift-console/console-7ffb94b689-nfjxt" Jun 11 15:05:19.597227 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:19.597189 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2501788c-0d56-425b-8c43-917ce4f28953-trusted-ca-bundle\") pod \"console-7ffb94b689-nfjxt\" (UID: \"2501788c-0d56-425b-8c43-917ce4f28953\") " pod="openshift-console/console-7ffb94b689-nfjxt" Jun 11 15:05:19.598690 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:19.598662 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2501788c-0d56-425b-8c43-917ce4f28953-console-oauth-config\") pod \"console-7ffb94b689-nfjxt\" (UID: \"2501788c-0d56-425b-8c43-917ce4f28953\") " pod="openshift-console/console-7ffb94b689-nfjxt" Jun 11 15:05:19.598799 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:19.598749 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2501788c-0d56-425b-8c43-917ce4f28953-console-serving-cert\") pod \"console-7ffb94b689-nfjxt\" (UID: \"2501788c-0d56-425b-8c43-917ce4f28953\") " pod="openshift-console/console-7ffb94b689-nfjxt" Jun 11 15:05:19.608531 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:19.608509 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8gvg\" (UniqueName: \"kubernetes.io/projected/2501788c-0d56-425b-8c43-917ce4f28953-kube-api-access-j8gvg\") pod \"console-7ffb94b689-nfjxt\" (UID: \"2501788c-0d56-425b-8c43-917ce4f28953\") " pod="openshift-console/console-7ffb94b689-nfjxt" Jun 11 15:05:19.686839 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:19.686805 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7ffb94b689-nfjxt" Jun 11 15:05:19.860713 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:19.860690 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7ffb94b689-nfjxt"] Jun 11 15:05:19.862747 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:05:19.862719 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2501788c_0d56_425b_8c43_917ce4f28953.slice/crio-ed611353055c8852eae4b5c7c0e37624bd31b18b11b8a181447c67573ca4136d WatchSource:0}: Error finding container ed611353055c8852eae4b5c7c0e37624bd31b18b11b8a181447c67573ca4136d: Status 404 returned error can't find the container with id ed611353055c8852eae4b5c7c0e37624bd31b18b11b8a181447c67573ca4136d Jun 11 15:05:20.186165 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:20.186133 2569 generic.go:356] "Generic (PLEG): container finished" podID="d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c" containerID="17a1a107068be50048219c27be2aa6dc9f04afa970ae6eca5e2a77de1046021e" exitCode=0 Jun 11 15:05:20.186165 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:20.186163 2569 generic.go:356] "Generic (PLEG): container finished" podID="d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c" containerID="3bd46f37c74431104bf41932b54fb69bee0290ce1ce8c1c4310e7393a854f439" exitCode=0 Jun 11 15:05:20.186406 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:20.186209 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c","Type":"ContainerDied","Data":"17a1a107068be50048219c27be2aa6dc9f04afa970ae6eca5e2a77de1046021e"} Jun 11 15:05:20.186406 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:20.186334 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c","Type":"ContainerDied","Data":"3bd46f37c74431104bf41932b54fb69bee0290ce1ce8c1c4310e7393a854f439"} Jun 11 15:05:20.187619 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:20.187596 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7ffb94b689-nfjxt" event={"ID":"2501788c-0d56-425b-8c43-917ce4f28953","Type":"ContainerStarted","Data":"ebbdf913cc7e463d6075c17c49394e77118ce17e6ae826c2f8e94efcccda2b3e"} Jun 11 15:05:20.187710 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:20.187633 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7ffb94b689-nfjxt" event={"ID":"2501788c-0d56-425b-8c43-917ce4f28953","Type":"ContainerStarted","Data":"ed611353055c8852eae4b5c7c0e37624bd31b18b11b8a181447c67573ca4136d"} Jun 11 15:05:20.214280 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:20.214236 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7ffb94b689-nfjxt" podStartSLOduration=1.214222983 podStartE2EDuration="1.214222983s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:05:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:05:20.21311271 +0000 UTC m=+155.161736996" watchObservedRunningTime="2026-06-11 15:05:20.214222983 +0000 UTC m=+155.162847248" Jun 11 15:05:20.470607 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:20.470575 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:05:20.505070 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:20.505041 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c-config-volume\") pod \"d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c\" (UID: \"d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c\") " Jun 11 15:05:20.505249 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:20.505090 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c-web-config\") pod \"d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c\" (UID: \"d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c\") " Jun 11 15:05:20.505249 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:20.505122 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c-tls-assets\") pod \"d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c\" (UID: \"d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c\") " Jun 11 15:05:20.505249 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:20.505153 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c-alertmanager-trusted-ca-bundle\") pod \"d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c\" (UID: \"d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c\") " Jun 11 15:05:20.505249 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:20.505183 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c\" (UID: \"d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c\") " Jun 11 15:05:20.505249 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:20.505207 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gmknl\" (UniqueName: \"kubernetes.io/projected/d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c-kube-api-access-gmknl\") pod \"d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c\" (UID: \"d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c\") " Jun 11 15:05:20.505520 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:20.505281 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c-secret-alertmanager-kube-rbac-proxy-web\") pod \"d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c\" (UID: \"d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c\") " Jun 11 15:05:20.505520 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:20.505309 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c-secret-alertmanager-main-tls\") pod \"d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c\" (UID: \"d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c\") " Jun 11 15:05:20.505520 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:20.505345 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c-alertmanager-main-db\") pod \"d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c\" (UID: \"d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c\") " Jun 11 15:05:20.505520 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:20.505379 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c-metrics-client-ca\") pod \"d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c\" (UID: \"d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c\") " Jun 11 15:05:20.505520 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:20.505418 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c-cluster-tls-config\") pod \"d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c\" (UID: \"d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c\") " Jun 11 15:05:20.505520 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:20.505451 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c-config-out\") pod \"d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c\" (UID: \"d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c\") " Jun 11 15:05:20.505520 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:20.505481 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c-secret-alertmanager-kube-rbac-proxy\") pod \"d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c\" (UID: \"d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c\") " Jun 11 15:05:20.505868 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:20.505709 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c" (UID: "d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 15:05:20.505868 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:20.505857 2569 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\"" Jun 11 15:05:20.507420 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:20.506851 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c" (UID: "d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 15:05:20.507420 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:20.507154 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c" (UID: "d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 15:05:20.509300 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:20.509271 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c-config-volume" (OuterVolumeSpecName: "config-volume") pod "d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c" (UID: "d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:05:20.509547 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:20.509522 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c" (UID: "d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 15:05:20.510739 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:20.510411 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c" (UID: "d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:05:20.510739 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:20.510554 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c-kube-api-access-gmknl" (OuterVolumeSpecName: "kube-api-access-gmknl") pod "d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c" (UID: "d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c"). InnerVolumeSpecName "kube-api-access-gmknl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 15:05:20.510739 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:20.510683 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c" (UID: "d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:05:20.511052 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:20.511027 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c" (UID: "d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:05:20.511445 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:20.511268 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c-config-out" (OuterVolumeSpecName: "config-out") pod "d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c" (UID: "d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 15:05:20.511593 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:20.511566 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c" (UID: "d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:05:20.515723 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:20.515701 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c" (UID: "d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:05:20.523604 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:20.523577 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c-web-config" (OuterVolumeSpecName: "web-config") pod "d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c" (UID: "d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:05:20.606507 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:20.606473 2569 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\"" Jun 11 15:05:20.606507 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:20.606501 2569 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c-secret-alertmanager-main-tls\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\"" Jun 11 15:05:20.606507 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:20.606514 2569 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c-alertmanager-main-db\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\"" Jun 11 15:05:20.606725 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:20.606524 2569 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c-metrics-client-ca\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\"" Jun 11 15:05:20.606725 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:20.606532 2569 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c-cluster-tls-config\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\"" Jun 11 15:05:20.606725 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:20.606541 2569 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c-config-out\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\"" Jun 11 15:05:20.606725 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:20.606550 2569 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\"" Jun 11 15:05:20.606725 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:20.606558 2569 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c-config-volume\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\"" Jun 11 15:05:20.606725 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:20.606568 2569 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c-web-config\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\"" Jun 11 15:05:20.606725 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:20.606578 2569 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c-tls-assets\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\"" Jun 11 15:05:20.606725 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:20.606586 2569 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\"" Jun 11 15:05:20.606725 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:20.606596 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gmknl\" (UniqueName: \"kubernetes.io/projected/d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c-kube-api-access-gmknl\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\"" Jun 11 15:05:21.194923 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:21.194893 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c","Type":"ContainerDied","Data":"4f4e9883c854d7d28c9e62c9c8f456b409937615334903a52e2cf1512e8f8379"} Jun 11 15:05:21.195311 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:21.194973 2569 scope.go:117] "RemoveContainer" containerID="e1f8f4552466d2f9478b137a1ef689c41ba916ee6894942bbbe179b2742d6151" Jun 11 15:05:21.195311 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:21.194903 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:05:21.202936 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:21.202813 2569 scope.go:117] "RemoveContainer" containerID="17a1a107068be50048219c27be2aa6dc9f04afa970ae6eca5e2a77de1046021e" Jun 11 15:05:21.210006 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:21.209990 2569 scope.go:117] "RemoveContainer" containerID="b00eefeb12cace96a9e381d25e343d359c88ffb64cf4d41977bca500327c5d11" Jun 11 15:05:21.216549 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:21.216529 2569 scope.go:117] "RemoveContainer" containerID="3bd46f37c74431104bf41932b54fb69bee0290ce1ce8c1c4310e7393a854f439" Jun 11 15:05:21.220502 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:21.220483 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 15:05:21.223827 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:21.223813 2569 scope.go:117] "RemoveContainer" containerID="c87301b770df901cb577f3cb89021d84f544da7b4001976fd4d91c6abf375566" Jun 11 15:05:21.228582 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:21.228555 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 15:05:21.231025 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:21.231004 2569 scope.go:117] "RemoveContainer" containerID="5058c2d45a6efddd58ba0f207ac24b3cac3e053c19870bc1ef26c9522f6fa2b0" Jun 11 15:05:21.237580 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:21.237563 2569 scope.go:117] "RemoveContainer" containerID="1982f480ab8281f410e1225a84adef498ab30e8f92b60ea3bdad8d7acc21a31f" Jun 11 15:05:21.479301 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:21.479220 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c" path="/var/lib/kubelet/pods/d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c/volumes" Jun 11 15:05:22.985455 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:22.985420 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 15:05:22.985898 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:22.985775 2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="52b832a7-f6c6-4a4f-9df2-8d02063155c4" containerName="prometheus" containerID="cri-o://0a340daf3d36502ed57f37091aefedaacc291a0ffb558d5a9f0600b08af0a9a3" gracePeriod=600 Jun 11 15:05:22.985898 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:22.985790 2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="52b832a7-f6c6-4a4f-9df2-8d02063155c4" containerName="thanos-sidecar" containerID="cri-o://caeb35456754cd538c201c358cd3b9b8002f1662ab42e67c4fbe730d3f36fa20" gracePeriod=600 Jun 11 15:05:22.985898 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:22.985807 2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="52b832a7-f6c6-4a4f-9df2-8d02063155c4" containerName="kube-rbac-proxy-web" containerID="cri-o://674cf6aa1520ead4ecd9c5175b27f6f8a19fcf2e0384833472941c843516aa14" gracePeriod=600 Jun 11 15:05:22.985898 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:22.985823 2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="52b832a7-f6c6-4a4f-9df2-8d02063155c4" containerName="config-reloader" containerID="cri-o://7046015441ac5bd7f22afa5235ee11a50c78c6ca258440d1612a9630bb0e5254" gracePeriod=600 Jun 11 15:05:22.985898 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:22.985854 2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="52b832a7-f6c6-4a4f-9df2-8d02063155c4" containerName="kube-rbac-proxy" containerID="cri-o://5dc5b510af71c103804732dcd95a799de401f8bb781b98772dff5e898d955972" gracePeriod=600 Jun 11 15:05:22.985898 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:22.985814 2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="52b832a7-f6c6-4a4f-9df2-8d02063155c4" containerName="kube-rbac-proxy-thanos" containerID="cri-o://8516918dcf5574ff42bff02b53e0ecc840d612ac3ccf188c6108d2593d472eaa" gracePeriod=600 Jun 11 15:05:23.207436 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:23.207407 2569 generic.go:356] "Generic (PLEG): container finished" podID="52b832a7-f6c6-4a4f-9df2-8d02063155c4" containerID="8516918dcf5574ff42bff02b53e0ecc840d612ac3ccf188c6108d2593d472eaa" exitCode=0 Jun 11 15:05:23.207436 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:23.207432 2569 generic.go:356] "Generic (PLEG): container finished" podID="52b832a7-f6c6-4a4f-9df2-8d02063155c4" containerID="5dc5b510af71c103804732dcd95a799de401f8bb781b98772dff5e898d955972" exitCode=0 Jun 11 15:05:23.207436 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:23.207439 2569 generic.go:356] "Generic (PLEG): container finished" podID="52b832a7-f6c6-4a4f-9df2-8d02063155c4" containerID="674cf6aa1520ead4ecd9c5175b27f6f8a19fcf2e0384833472941c843516aa14" exitCode=0 Jun 11 15:05:23.207436 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:23.207444 2569 generic.go:356] "Generic (PLEG): container finished" podID="52b832a7-f6c6-4a4f-9df2-8d02063155c4" containerID="caeb35456754cd538c201c358cd3b9b8002f1662ab42e67c4fbe730d3f36fa20" exitCode=0 Jun 11 15:05:23.207707 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:23.207450 2569 generic.go:356] "Generic (PLEG): container finished" podID="52b832a7-f6c6-4a4f-9df2-8d02063155c4" containerID="7046015441ac5bd7f22afa5235ee11a50c78c6ca258440d1612a9630bb0e5254" exitCode=0 Jun 11 15:05:23.207707 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:23.207457 2569 generic.go:356] "Generic (PLEG): container finished" podID="52b832a7-f6c6-4a4f-9df2-8d02063155c4" containerID="0a340daf3d36502ed57f37091aefedaacc291a0ffb558d5a9f0600b08af0a9a3" exitCode=0 Jun 11 15:05:23.207707 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:23.207484 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"52b832a7-f6c6-4a4f-9df2-8d02063155c4","Type":"ContainerDied","Data":"8516918dcf5574ff42bff02b53e0ecc840d612ac3ccf188c6108d2593d472eaa"} Jun 11 15:05:23.207707 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:23.207549 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"52b832a7-f6c6-4a4f-9df2-8d02063155c4","Type":"ContainerDied","Data":"5dc5b510af71c103804732dcd95a799de401f8bb781b98772dff5e898d955972"} Jun 11 15:05:23.207707 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:23.207576 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"52b832a7-f6c6-4a4f-9df2-8d02063155c4","Type":"ContainerDied","Data":"674cf6aa1520ead4ecd9c5175b27f6f8a19fcf2e0384833472941c843516aa14"} Jun 11 15:05:23.207707 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:23.207602 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"52b832a7-f6c6-4a4f-9df2-8d02063155c4","Type":"ContainerDied","Data":"caeb35456754cd538c201c358cd3b9b8002f1662ab42e67c4fbe730d3f36fa20"} Jun 11 15:05:23.207707 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:23.207626 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"52b832a7-f6c6-4a4f-9df2-8d02063155c4","Type":"ContainerDied","Data":"7046015441ac5bd7f22afa5235ee11a50c78c6ca258440d1612a9630bb0e5254"} Jun 11 15:05:23.207707 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:23.207650 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"52b832a7-f6c6-4a4f-9df2-8d02063155c4","Type":"ContainerDied","Data":"0a340daf3d36502ed57f37091aefedaacc291a0ffb558d5a9f0600b08af0a9a3"} Jun 11 15:05:23.241338 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:23.241288 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:05:23.329350 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:23.329323 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/52b832a7-f6c6-4a4f-9df2-8d02063155c4-secret-metrics-client-certs\") pod \"52b832a7-f6c6-4a4f-9df2-8d02063155c4\" (UID: \"52b832a7-f6c6-4a4f-9df2-8d02063155c4\") " Jun 11 15:05:23.329493 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:23.329359 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/52b832a7-f6c6-4a4f-9df2-8d02063155c4-thanos-prometheus-http-client-file\") pod \"52b832a7-f6c6-4a4f-9df2-8d02063155c4\" (UID: \"52b832a7-f6c6-4a4f-9df2-8d02063155c4\") " Jun 11 15:05:23.329493 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:23.329394 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/52b832a7-f6c6-4a4f-9df2-8d02063155c4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"52b832a7-f6c6-4a4f-9df2-8d02063155c4\" (UID: \"52b832a7-f6c6-4a4f-9df2-8d02063155c4\") " Jun 11 15:05:23.329493 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:23.329422 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/52b832a7-f6c6-4a4f-9df2-8d02063155c4-config\") pod \"52b832a7-f6c6-4a4f-9df2-8d02063155c4\" (UID: \"52b832a7-f6c6-4a4f-9df2-8d02063155c4\") " Jun 11 15:05:23.329493 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:23.329451 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/52b832a7-f6c6-4a4f-9df2-8d02063155c4-config-out\") pod \"52b832a7-f6c6-4a4f-9df2-8d02063155c4\" (UID: \"52b832a7-f6c6-4a4f-9df2-8d02063155c4\") " Jun 11 15:05:23.329493 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:23.329474 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/52b832a7-f6c6-4a4f-9df2-8d02063155c4-web-config\") pod \"52b832a7-f6c6-4a4f-9df2-8d02063155c4\" (UID: \"52b832a7-f6c6-4a4f-9df2-8d02063155c4\") " Jun 11 15:05:23.329800 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:23.329504 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/52b832a7-f6c6-4a4f-9df2-8d02063155c4-configmap-metrics-client-ca\") pod \"52b832a7-f6c6-4a4f-9df2-8d02063155c4\" (UID: \"52b832a7-f6c6-4a4f-9df2-8d02063155c4\") " Jun 11 15:05:23.329960 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:23.329936 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/52b832a7-f6c6-4a4f-9df2-8d02063155c4-prometheus-k8s-rulefiles-2\") pod \"52b832a7-f6c6-4a4f-9df2-8d02063155c4\" (UID: \"52b832a7-f6c6-4a4f-9df2-8d02063155c4\") " Jun 11 15:05:23.330038 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:23.329984 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/52b832a7-f6c6-4a4f-9df2-8d02063155c4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"52b832a7-f6c6-4a4f-9df2-8d02063155c4\" (UID: \"52b832a7-f6c6-4a4f-9df2-8d02063155c4\") " Jun 11 15:05:23.330097 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:23.330061 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/52b832a7-f6c6-4a4f-9df2-8d02063155c4-prometheus-k8s-rulefiles-0\") pod \"52b832a7-f6c6-4a4f-9df2-8d02063155c4\" (UID: \"52b832a7-f6c6-4a4f-9df2-8d02063155c4\") " Jun 11 15:05:23.330146 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:23.330110 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lpx8r\" (UniqueName: \"kubernetes.io/projected/52b832a7-f6c6-4a4f-9df2-8d02063155c4-kube-api-access-lpx8r\") pod \"52b832a7-f6c6-4a4f-9df2-8d02063155c4\" (UID: \"52b832a7-f6c6-4a4f-9df2-8d02063155c4\") " Jun 11 15:05:23.330146 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:23.330136 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/52b832a7-f6c6-4a4f-9df2-8d02063155c4-secret-prometheus-k8s-tls\") pod \"52b832a7-f6c6-4a4f-9df2-8d02063155c4\" (UID: \"52b832a7-f6c6-4a4f-9df2-8d02063155c4\") " Jun 11 15:05:23.330241 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:23.330175 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52b832a7-f6c6-4a4f-9df2-8d02063155c4-configmap-kubelet-serving-ca-bundle\") pod \"52b832a7-f6c6-4a4f-9df2-8d02063155c4\" (UID: \"52b832a7-f6c6-4a4f-9df2-8d02063155c4\") " Jun 11 15:05:23.330241 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:23.330202 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/52b832a7-f6c6-4a4f-9df2-8d02063155c4-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "52b832a7-f6c6-4a4f-9df2-8d02063155c4" (UID: "52b832a7-f6c6-4a4f-9df2-8d02063155c4"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 15:05:23.330349 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:23.330237 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/52b832a7-f6c6-4a4f-9df2-8d02063155c4-tls-assets\") pod \"52b832a7-f6c6-4a4f-9df2-8d02063155c4\" (UID: \"52b832a7-f6c6-4a4f-9df2-8d02063155c4\") " Jun 11 15:05:23.330852 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:23.330817 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/52b832a7-f6c6-4a4f-9df2-8d02063155c4-prometheus-k8s-rulefiles-1\") pod \"52b832a7-f6c6-4a4f-9df2-8d02063155c4\" (UID: \"52b832a7-f6c6-4a4f-9df2-8d02063155c4\") " Jun 11 15:05:23.330946 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:23.330863 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/52b832a7-f6c6-4a4f-9df2-8d02063155c4-secret-grpc-tls\") pod \"52b832a7-f6c6-4a4f-9df2-8d02063155c4\" (UID: \"52b832a7-f6c6-4a4f-9df2-8d02063155c4\") " Jun 11 15:05:23.330946 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:23.330890 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52b832a7-f6c6-4a4f-9df2-8d02063155c4-prometheus-trusted-ca-bundle\") pod \"52b832a7-f6c6-4a4f-9df2-8d02063155c4\" (UID: \"52b832a7-f6c6-4a4f-9df2-8d02063155c4\") " Jun 11 15:05:23.330946 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:23.330919 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52b832a7-f6c6-4a4f-9df2-8d02063155c4-configmap-serving-certs-ca-bundle\") pod \"52b832a7-f6c6-4a4f-9df2-8d02063155c4\" (UID: \"52b832a7-f6c6-4a4f-9df2-8d02063155c4\") " Jun 11 15:05:23.331101 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:23.330955 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/52b832a7-f6c6-4a4f-9df2-8d02063155c4-secret-kube-rbac-proxy\") pod \"52b832a7-f6c6-4a4f-9df2-8d02063155c4\" (UID: \"52b832a7-f6c6-4a4f-9df2-8d02063155c4\") " Jun 11 15:05:23.331101 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:23.330988 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/52b832a7-f6c6-4a4f-9df2-8d02063155c4-prometheus-k8s-db\") pod \"52b832a7-f6c6-4a4f-9df2-8d02063155c4\" (UID: \"52b832a7-f6c6-4a4f-9df2-8d02063155c4\") " Jun 11 15:05:23.331313 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:23.331294 2569 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/52b832a7-f6c6-4a4f-9df2-8d02063155c4-configmap-metrics-client-ca\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\"" Jun 11 15:05:23.332927 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:23.330949 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/52b832a7-f6c6-4a4f-9df2-8d02063155c4-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "52b832a7-f6c6-4a4f-9df2-8d02063155c4" (UID: "52b832a7-f6c6-4a4f-9df2-8d02063155c4"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 15:05:23.333033 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:23.331896 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/52b832a7-f6c6-4a4f-9df2-8d02063155c4-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "52b832a7-f6c6-4a4f-9df2-8d02063155c4" (UID: "52b832a7-f6c6-4a4f-9df2-8d02063155c4"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 15:05:23.333033 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:23.332504 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/52b832a7-f6c6-4a4f-9df2-8d02063155c4-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "52b832a7-f6c6-4a4f-9df2-8d02063155c4" (UID: "52b832a7-f6c6-4a4f-9df2-8d02063155c4"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 15:05:23.333033 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:23.332896 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52b832a7-f6c6-4a4f-9df2-8d02063155c4-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "52b832a7-f6c6-4a4f-9df2-8d02063155c4" (UID: "52b832a7-f6c6-4a4f-9df2-8d02063155c4"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 15:05:23.333033 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:23.333001 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/52b832a7-f6c6-4a4f-9df2-8d02063155c4-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "52b832a7-f6c6-4a4f-9df2-8d02063155c4" (UID: "52b832a7-f6c6-4a4f-9df2-8d02063155c4"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 15:05:23.333452 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:23.333425 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/52b832a7-f6c6-4a4f-9df2-8d02063155c4-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "52b832a7-f6c6-4a4f-9df2-8d02063155c4" (UID: "52b832a7-f6c6-4a4f-9df2-8d02063155c4"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 15:05:23.333587 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:23.333432 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/52b832a7-f6c6-4a4f-9df2-8d02063155c4-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "52b832a7-f6c6-4a4f-9df2-8d02063155c4" (UID: "52b832a7-f6c6-4a4f-9df2-8d02063155c4"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 15:05:23.333587 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:23.333528 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/52b832a7-f6c6-4a4f-9df2-8d02063155c4-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "52b832a7-f6c6-4a4f-9df2-8d02063155c4" (UID: "52b832a7-f6c6-4a4f-9df2-8d02063155c4"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:05:23.333733 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:23.333683 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/52b832a7-f6c6-4a4f-9df2-8d02063155c4-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "52b832a7-f6c6-4a4f-9df2-8d02063155c4" (UID: "52b832a7-f6c6-4a4f-9df2-8d02063155c4"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:05:23.333946 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:23.333901 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/52b832a7-f6c6-4a4f-9df2-8d02063155c4-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "52b832a7-f6c6-4a4f-9df2-8d02063155c4" (UID: "52b832a7-f6c6-4a4f-9df2-8d02063155c4"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:05:23.334050 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:23.334024 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/52b832a7-f6c6-4a4f-9df2-8d02063155c4-config" (OuterVolumeSpecName: "config") pod "52b832a7-f6c6-4a4f-9df2-8d02063155c4" (UID: "52b832a7-f6c6-4a4f-9df2-8d02063155c4"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:05:23.334209 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:23.334183 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/52b832a7-f6c6-4a4f-9df2-8d02063155c4-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "52b832a7-f6c6-4a4f-9df2-8d02063155c4" (UID: "52b832a7-f6c6-4a4f-9df2-8d02063155c4"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 15:05:23.334391 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:23.334353 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/52b832a7-f6c6-4a4f-9df2-8d02063155c4-kube-api-access-lpx8r" (OuterVolumeSpecName: "kube-api-access-lpx8r") pod "52b832a7-f6c6-4a4f-9df2-8d02063155c4" (UID: "52b832a7-f6c6-4a4f-9df2-8d02063155c4"). InnerVolumeSpecName "kube-api-access-lpx8r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 15:05:23.334611 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:23.334571 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/52b832a7-f6c6-4a4f-9df2-8d02063155c4-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "52b832a7-f6c6-4a4f-9df2-8d02063155c4" (UID: "52b832a7-f6c6-4a4f-9df2-8d02063155c4"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:05:23.334788 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:23.334747 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52b832a7-f6c6-4a4f-9df2-8d02063155c4-config-out" (OuterVolumeSpecName: "config-out") pod "52b832a7-f6c6-4a4f-9df2-8d02063155c4" (UID: "52b832a7-f6c6-4a4f-9df2-8d02063155c4"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 15:05:23.335115 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:23.335098 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/52b832a7-f6c6-4a4f-9df2-8d02063155c4-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "52b832a7-f6c6-4a4f-9df2-8d02063155c4" (UID: "52b832a7-f6c6-4a4f-9df2-8d02063155c4"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:05:23.335564 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:23.335545 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/52b832a7-f6c6-4a4f-9df2-8d02063155c4-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "52b832a7-f6c6-4a4f-9df2-8d02063155c4" (UID: "52b832a7-f6c6-4a4f-9df2-8d02063155c4"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:05:23.336058 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:23.336041 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/52b832a7-f6c6-4a4f-9df2-8d02063155c4-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "52b832a7-f6c6-4a4f-9df2-8d02063155c4" (UID: "52b832a7-f6c6-4a4f-9df2-8d02063155c4"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:05:23.344486 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:23.344465 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/52b832a7-f6c6-4a4f-9df2-8d02063155c4-web-config" (OuterVolumeSpecName: "web-config") pod "52b832a7-f6c6-4a4f-9df2-8d02063155c4" (UID: "52b832a7-f6c6-4a4f-9df2-8d02063155c4"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:05:23.432319 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:23.432281 2569 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/52b832a7-f6c6-4a4f-9df2-8d02063155c4-secret-grpc-tls\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\"" Jun 11 15:05:23.432319 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:23.432318 2569 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52b832a7-f6c6-4a4f-9df2-8d02063155c4-prometheus-trusted-ca-bundle\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\"" Jun 11 15:05:23.432319 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:23.432329 2569 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52b832a7-f6c6-4a4f-9df2-8d02063155c4-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\"" Jun 11 15:05:23.432492 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:23.432339 2569 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/52b832a7-f6c6-4a4f-9df2-8d02063155c4-secret-kube-rbac-proxy\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\"" Jun 11 15:05:23.432492 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:23.432347 2569 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/52b832a7-f6c6-4a4f-9df2-8d02063155c4-prometheus-k8s-db\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\"" Jun 11 15:05:23.432492 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:23.432356 2569 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/52b832a7-f6c6-4a4f-9df2-8d02063155c4-secret-metrics-client-certs\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\"" Jun 11 15:05:23.432492 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:23.432364 2569 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/52b832a7-f6c6-4a4f-9df2-8d02063155c4-thanos-prometheus-http-client-file\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\"" Jun 11 15:05:23.432492 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:23.432375 2569 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/52b832a7-f6c6-4a4f-9df2-8d02063155c4-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\"" Jun 11 15:05:23.432492 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:23.432384 2569 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/52b832a7-f6c6-4a4f-9df2-8d02063155c4-config\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\"" Jun 11 15:05:23.432492 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:23.432392 2569 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/52b832a7-f6c6-4a4f-9df2-8d02063155c4-config-out\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\"" Jun 11 15:05:23.432492 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:23.432417 2569 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/52b832a7-f6c6-4a4f-9df2-8d02063155c4-web-config\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\"" Jun 11 15:05:23.432492 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:23.432425 2569 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/52b832a7-f6c6-4a4f-9df2-8d02063155c4-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\"" Jun 11 15:05:23.432492 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:23.432434 2569 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/52b832a7-f6c6-4a4f-9df2-8d02063155c4-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\"" Jun 11 15:05:23.432492 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:23.432442 2569 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/52b832a7-f6c6-4a4f-9df2-8d02063155c4-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\"" Jun 11 15:05:23.432492 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:23.432452 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lpx8r\" (UniqueName: \"kubernetes.io/projected/52b832a7-f6c6-4a4f-9df2-8d02063155c4-kube-api-access-lpx8r\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\"" Jun 11 15:05:23.432492 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:23.432460 2569 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/52b832a7-f6c6-4a4f-9df2-8d02063155c4-secret-prometheus-k8s-tls\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\"" Jun 11 15:05:23.432492 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:23.432469 2569 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52b832a7-f6c6-4a4f-9df2-8d02063155c4-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\"" Jun 11 15:05:23.432492 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:23.432477 2569 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/52b832a7-f6c6-4a4f-9df2-8d02063155c4-tls-assets\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\"" Jun 11 15:05:23.432492 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:23.432485 2569 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/52b832a7-f6c6-4a4f-9df2-8d02063155c4-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\"" Jun 11 15:05:24.214492 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.214460 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"52b832a7-f6c6-4a4f-9df2-8d02063155c4","Type":"ContainerDied","Data":"2b64671527bbfe440f20c2e0783bd8ce7f8d132448ab9b27e24163952e00f297"} Jun 11 15:05:24.214989 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.214506 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:05:24.214989 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.214546 2569 scope.go:117] "RemoveContainer" containerID="8516918dcf5574ff42bff02b53e0ecc840d612ac3ccf188c6108d2593d472eaa" Jun 11 15:05:24.221933 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.221912 2569 scope.go:117] "RemoveContainer" containerID="5dc5b510af71c103804732dcd95a799de401f8bb781b98772dff5e898d955972" Jun 11 15:05:24.228612 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.228588 2569 scope.go:117] "RemoveContainer" containerID="674cf6aa1520ead4ecd9c5175b27f6f8a19fcf2e0384833472941c843516aa14" Jun 11 15:05:24.234963 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.234946 2569 scope.go:117] "RemoveContainer" containerID="caeb35456754cd538c201c358cd3b9b8002f1662ab42e67c4fbe730d3f36fa20" Jun 11 15:05:24.240960 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.240935 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 15:05:24.241812 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.241798 2569 scope.go:117] "RemoveContainer" containerID="7046015441ac5bd7f22afa5235ee11a50c78c6ca258440d1612a9630bb0e5254" Jun 11 15:05:24.248522 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.248419 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 15:05:24.248581 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.248547 2569 scope.go:117] "RemoveContainer" containerID="0a340daf3d36502ed57f37091aefedaacc291a0ffb558d5a9f0600b08af0a9a3" Jun 11 15:05:24.255281 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.255262 2569 scope.go:117] "RemoveContainer" containerID="a689ac6864db86052f68da2243dfcedc6d284f48956c4c56fa93a60292d54d2c" Jun 11 15:05:24.277220 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.277197 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 15:05:24.277472 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.277460 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52b832a7-f6c6-4a4f-9df2-8d02063155c4" containerName="kube-rbac-proxy-thanos" Jun 11 15:05:24.277519 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.277473 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="52b832a7-f6c6-4a4f-9df2-8d02063155c4" containerName="kube-rbac-proxy-thanos" Jun 11 15:05:24.277519 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.277483 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c" containerName="kube-rbac-proxy" Jun 11 15:05:24.277519 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.277489 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c" containerName="kube-rbac-proxy" Jun 11 15:05:24.277519 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.277501 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c" containerName="prom-label-proxy" Jun 11 15:05:24.277519 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.277507 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c" containerName="prom-label-proxy" Jun 11 15:05:24.277519 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.277513 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52b832a7-f6c6-4a4f-9df2-8d02063155c4" containerName="kube-rbac-proxy" Jun 11 15:05:24.277519 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.277518 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="52b832a7-f6c6-4a4f-9df2-8d02063155c4" containerName="kube-rbac-proxy" Jun 11 15:05:24.277744 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.277525 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c" containerName="config-reloader" Jun 11 15:05:24.277744 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.277530 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c" containerName="config-reloader" Jun 11 15:05:24.277744 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.277537 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c" containerName="kube-rbac-proxy-metric" Jun 11 15:05:24.277744 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.277542 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c" containerName="kube-rbac-proxy-metric" Jun 11 15:05:24.277744 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.277548 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52b832a7-f6c6-4a4f-9df2-8d02063155c4" containerName="config-reloader" Jun 11 15:05:24.277744 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.277554 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="52b832a7-f6c6-4a4f-9df2-8d02063155c4" containerName="config-reloader" Jun 11 15:05:24.277744 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.277561 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52b832a7-f6c6-4a4f-9df2-8d02063155c4" containerName="init-config-reloader" Jun 11 15:05:24.277744 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.277566 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="52b832a7-f6c6-4a4f-9df2-8d02063155c4" containerName="init-config-reloader" Jun 11 15:05:24.277744 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.277572 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c" containerName="alertmanager" Jun 11 15:05:24.277744 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.277578 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c" containerName="alertmanager" Jun 11 15:05:24.277744 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.277585 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52b832a7-f6c6-4a4f-9df2-8d02063155c4" containerName="kube-rbac-proxy-web" Jun 11 15:05:24.277744 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.277589 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="52b832a7-f6c6-4a4f-9df2-8d02063155c4" containerName="kube-rbac-proxy-web" Jun 11 15:05:24.277744 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.277597 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52b832a7-f6c6-4a4f-9df2-8d02063155c4" containerName="thanos-sidecar" Jun 11 15:05:24.277744 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.277602 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="52b832a7-f6c6-4a4f-9df2-8d02063155c4" containerName="thanos-sidecar" Jun 11 15:05:24.277744 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.277608 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c" containerName="init-config-reloader" Jun 11 15:05:24.277744 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.277613 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c" containerName="init-config-reloader" Jun 11 15:05:24.277744 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.277620 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c" containerName="kube-rbac-proxy-web" Jun 11 15:05:24.277744 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.277625 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c" containerName="kube-rbac-proxy-web" Jun 11 15:05:24.277744 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.277631 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52b832a7-f6c6-4a4f-9df2-8d02063155c4" containerName="prometheus" Jun 11 15:05:24.277744 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.277636 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="52b832a7-f6c6-4a4f-9df2-8d02063155c4" containerName="prometheus" Jun 11 15:05:24.277744 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.277681 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="52b832a7-f6c6-4a4f-9df2-8d02063155c4" containerName="config-reloader" Jun 11 15:05:24.277744 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.277689 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="52b832a7-f6c6-4a4f-9df2-8d02063155c4" containerName="kube-rbac-proxy" Jun 11 15:05:24.277744 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.277694 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c" containerName="kube-rbac-proxy" Jun 11 15:05:24.277744 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.277700 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="52b832a7-f6c6-4a4f-9df2-8d02063155c4" containerName="kube-rbac-proxy-web" Jun 11 15:05:24.277744 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.277705 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c" containerName="alertmanager" Jun 11 15:05:24.277744 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.277709 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="52b832a7-f6c6-4a4f-9df2-8d02063155c4" containerName="prometheus" Jun 11 15:05:24.277744 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.277714 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="52b832a7-f6c6-4a4f-9df2-8d02063155c4" containerName="kube-rbac-proxy-thanos" Jun 11 15:05:24.277744 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.277719 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c" containerName="kube-rbac-proxy-web" Jun 11 15:05:24.277744 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.277724 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="52b832a7-f6c6-4a4f-9df2-8d02063155c4" containerName="thanos-sidecar" Jun 11 15:05:24.277744 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.277729 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c" containerName="config-reloader" Jun 11 15:05:24.277744 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.277735 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c" containerName="prom-label-proxy" Jun 11 15:05:24.277744 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.277740 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="d34c1138-26af-4d0a-bcb6-a6bbbe0b5d3c" containerName="kube-rbac-proxy-metric" Jun 11 15:05:24.282807 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.282792 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:05:24.285632 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.285471 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 11 15:05:24.285632 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.285478 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 11 15:05:24.285632 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.285477 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 11 15:05:24.285632 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.285514 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-czdpz\"" Jun 11 15:05:24.285632 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.285479 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 11 15:05:24.285632 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.285631 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-c9gh1o8qka45g\"" Jun 11 15:05:24.285951 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.285663 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 11 15:05:24.285951 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.285913 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 11 15:05:24.285951 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.285930 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 11 15:05:24.286080 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.285962 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 11 15:05:24.286080 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.286043 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 11 15:05:24.286080 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.286045 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 11 15:05:24.286370 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.286355 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 11 15:05:24.286421 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.286354 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 11 15:05:24.288722 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.288702 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 11 15:05:24.291626 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.291608 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 11 15:05:24.304077 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.304054 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 15:05:24.340500 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.340476 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:05:24.340603 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.340503 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:05:24.340603 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.340523 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2srdv\" (UniqueName: \"kubernetes.io/projected/3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2-kube-api-access-2srdv\") pod \"prometheus-k8s-0\" (UID: \"3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:05:24.340603 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.340540 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:05:24.340603 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.340600 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:05:24.340748 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.340622 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:05:24.340748 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.340652 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:05:24.340748 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.340669 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:05:24.340748 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.340686 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:05:24.340748 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.340704 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2-config\") pod \"prometheus-k8s-0\" (UID: \"3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:05:24.340748 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.340741 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:05:24.340957 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.340796 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:05:24.340957 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.340824 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:05:24.340957 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.340877 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2-web-config\") pod \"prometheus-k8s-0\" (UID: \"3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:05:24.340957 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.340899 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:05:24.340957 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.340931 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:05:24.340957 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.340955 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:05:24.341132 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.340972 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:05:24.341132 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.341026 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2-config-out\") pod \"prometheus-k8s-0\" (UID: \"3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:05:24.341132 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.341043 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:05:24.442275 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.442246 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:05:24.442275 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.442280 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:05:24.442474 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.442302 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2-config-out\") pod \"prometheus-k8s-0\" (UID: \"3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:05:24.442474 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.442318 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:05:24.442474 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.442347 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:05:24.442474 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.442362 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:05:24.442671 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.442575 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2srdv\" (UniqueName: \"kubernetes.io/projected/3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2-kube-api-access-2srdv\") pod \"prometheus-k8s-0\" (UID: \"3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:05:24.442671 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.442610 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:05:24.442671 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.442647 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:05:24.442855 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.442685 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:05:24.442855 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.442734 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:05:24.442855 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.442791 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:05:24.442855 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.442819 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:05:24.442855 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.442852 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2-config\") pod \"prometheus-k8s-0\" (UID: \"3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:05:24.443110 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.442881 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:05:24.443110 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.442905 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:05:24.443110 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.442932 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:05:24.443110 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.442958 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2-web-config\") pod \"prometheus-k8s-0\" (UID: \"3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:05:24.443110 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.442991 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:05:24.443110 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.443025 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:05:24.443386 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.443113 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:05:24.443386 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.443147 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:05:24.446998 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.443545 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:05:24.446998 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.443611 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:05:24.446998 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.443885 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:05:24.446998 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.443892 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:05:24.446998 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.444140 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:05:24.446998 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.445431 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:05:24.446998 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.445507 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2-config-out\") pod \"prometheus-k8s-0\" (UID: \"3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:05:24.446998 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.445516 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:05:24.446998 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.446273 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:05:24.446998 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.446531 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2-config\") pod \"prometheus-k8s-0\" (UID: \"3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:05:24.446998 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.446948 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:05:24.447849 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.447826 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:05:24.447849 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.447843 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:05:24.447964 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.447869 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:05:24.448051 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.448035 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:05:24.448144 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.448124 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2-web-config\") pod \"prometheus-k8s-0\" (UID: \"3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:05:24.448555 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.448541 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:05:24.455107 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.455090 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2srdv\" (UniqueName: \"kubernetes.io/projected/3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2-kube-api-access-2srdv\") pod \"prometheus-k8s-0\" (UID: \"3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:05:24.593160 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.593124 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:05:24.732877 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:24.732833 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 15:05:24.735605 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:05:24.735567 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ce1bc41_9c5d_4a62_9d0b_c4703d2f44e2.slice/crio-ccd9e2ab487abb9b3f7e70939352dc87d260db1131ba605098642eef563d961b WatchSource:0}: Error finding container ccd9e2ab487abb9b3f7e70939352dc87d260db1131ba605098642eef563d961b: Status 404 returned error can't find the container with id ccd9e2ab487abb9b3f7e70939352dc87d260db1131ba605098642eef563d961b Jun 11 15:05:25.219457 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:25.219417 2569 generic.go:356] "Generic (PLEG): container finished" podID="3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2" containerID="e1da9442595297ab3a26ff9783bcc951bddb9ae221433784152cdcd0a3b9dfe5" exitCode=0 Jun 11 15:05:25.219900 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:25.219507 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2","Type":"ContainerDied","Data":"e1da9442595297ab3a26ff9783bcc951bddb9ae221433784152cdcd0a3b9dfe5"} Jun 11 15:05:25.219900 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:25.219576 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2","Type":"ContainerStarted","Data":"ccd9e2ab487abb9b3f7e70939352dc87d260db1131ba605098642eef563d961b"} Jun 11 15:05:25.480243 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:25.480212 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="52b832a7-f6c6-4a4f-9df2-8d02063155c4" path="/var/lib/kubelet/pods/52b832a7-f6c6-4a4f-9df2-8d02063155c4/volumes" Jun 11 15:05:26.227977 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:26.227934 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2","Type":"ContainerStarted","Data":"7b9403200ffcf87d57c362a4e7ddbab59913f68933d471219bd7cb0d404fcccb"} Jun 11 15:05:26.228360 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:26.228003 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2","Type":"ContainerStarted","Data":"9de4413c0883432ebc2df8a901b5ce36a3acdad1186e5d96e1c98581ddc990f3"} Jun 11 15:05:26.228360 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:26.228042 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2","Type":"ContainerStarted","Data":"230229b2f6348582a1dea62a64ec3ce1a6db5a04af2eb75c215dd93481da8a39"} Jun 11 15:05:26.228360 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:26.228071 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2","Type":"ContainerStarted","Data":"31ba44083ff1b4b13421a271099b02597d943772f5c8e7d8ef5bc924de051670"} Jun 11 15:05:26.228360 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:26.228094 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2","Type":"ContainerStarted","Data":"bb7ef37259e04191ce8ea3def3085d8bb55eef1d8f27d8ba5d1aa5e0042a9607"} Jun 11 15:05:26.228360 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:26.228131 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2","Type":"ContainerStarted","Data":"d4b203209dc2600c510636b546aec40909659294f5b763b66457f66b055ffd8c"} Jun 11 15:05:26.264744 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:26.264700 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.24088603 podStartE2EDuration="2.264683307s" totalImagesPullingTime="0s" totalInitContainerRuntime="23.797277ms" isStatefulPod=false podCreationTimestamp="2026-06-11 15:05:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:05:26.263539026 +0000 UTC m=+161.212163289" watchObservedRunningTime="2026-06-11 15:05:26.264683307 +0000 UTC m=+161.213307568" Jun 11 15:05:29.593952 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:29.593921 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:05:29.687168 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:29.687139 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7ffb94b689-nfjxt" Jun 11 15:05:29.687274 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:29.687196 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7ffb94b689-nfjxt" Jun 11 15:05:29.692451 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:29.692428 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7ffb94b689-nfjxt" Jun 11 15:05:30.099914 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:30.099888 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-786s7" Jun 11 15:05:30.251802 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:30.251772 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7ffb94b689-nfjxt" Jun 11 15:05:30.333898 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:30.333865 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-74f7779c97-zlm68"] Jun 11 15:05:55.354425 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:55.354365 2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-74f7779c97-zlm68" podUID="d5332b8a-d33c-46df-af25-86238f634c2c" containerName="console" containerID="cri-o://fe02a9d16508c5da7ce5d51830613c17eb009d76c3f08b867332607fa5f8f8c2" gracePeriod=15 Jun 11 15:05:55.624859 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:55.624836 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74f7779c97-zlm68" Jun 11 15:05:55.731049 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:55.731018 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d5332b8a-d33c-46df-af25-86238f634c2c-console-serving-cert\") pod \"d5332b8a-d33c-46df-af25-86238f634c2c\" (UID: \"d5332b8a-d33c-46df-af25-86238f634c2c\") " Jun 11 15:05:55.731225 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:55.731068 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5332b8a-d33c-46df-af25-86238f634c2c-trusted-ca-bundle\") pod \"d5332b8a-d33c-46df-af25-86238f634c2c\" (UID: \"d5332b8a-d33c-46df-af25-86238f634c2c\") " Jun 11 15:05:55.731225 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:55.731186 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ch6gb\" (UniqueName: \"kubernetes.io/projected/d5332b8a-d33c-46df-af25-86238f634c2c-kube-api-access-ch6gb\") pod \"d5332b8a-d33c-46df-af25-86238f634c2c\" (UID: \"d5332b8a-d33c-46df-af25-86238f634c2c\") " Jun 11 15:05:55.731347 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:55.731247 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d5332b8a-d33c-46df-af25-86238f634c2c-oauth-serving-cert\") pod \"d5332b8a-d33c-46df-af25-86238f634c2c\" (UID: \"d5332b8a-d33c-46df-af25-86238f634c2c\") " Jun 11 15:05:55.731347 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:55.731268 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d5332b8a-d33c-46df-af25-86238f634c2c-service-ca\") pod \"d5332b8a-d33c-46df-af25-86238f634c2c\" (UID: \"d5332b8a-d33c-46df-af25-86238f634c2c\") " Jun 11 15:05:55.731347 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:55.731295 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d5332b8a-d33c-46df-af25-86238f634c2c-console-config\") pod \"d5332b8a-d33c-46df-af25-86238f634c2c\" (UID: \"d5332b8a-d33c-46df-af25-86238f634c2c\") " Jun 11 15:05:55.731347 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:55.731312 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d5332b8a-d33c-46df-af25-86238f634c2c-console-oauth-config\") pod \"d5332b8a-d33c-46df-af25-86238f634c2c\" (UID: \"d5332b8a-d33c-46df-af25-86238f634c2c\") " Jun 11 15:05:55.731596 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:55.731572 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5332b8a-d33c-46df-af25-86238f634c2c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d5332b8a-d33c-46df-af25-86238f634c2c" (UID: "d5332b8a-d33c-46df-af25-86238f634c2c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 15:05:55.731669 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:55.731648 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5332b8a-d33c-46df-af25-86238f634c2c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d5332b8a-d33c-46df-af25-86238f634c2c" (UID: "d5332b8a-d33c-46df-af25-86238f634c2c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 15:05:55.731707 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:55.731653 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5332b8a-d33c-46df-af25-86238f634c2c-service-ca" (OuterVolumeSpecName: "service-ca") pod "d5332b8a-d33c-46df-af25-86238f634c2c" (UID: "d5332b8a-d33c-46df-af25-86238f634c2c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 15:05:55.731707 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:55.731675 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5332b8a-d33c-46df-af25-86238f634c2c-console-config" (OuterVolumeSpecName: "console-config") pod "d5332b8a-d33c-46df-af25-86238f634c2c" (UID: "d5332b8a-d33c-46df-af25-86238f634c2c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 15:05:55.733522 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:55.733500 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5332b8a-d33c-46df-af25-86238f634c2c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d5332b8a-d33c-46df-af25-86238f634c2c" (UID: "d5332b8a-d33c-46df-af25-86238f634c2c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:05:55.733730 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:55.733710 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5332b8a-d33c-46df-af25-86238f634c2c-kube-api-access-ch6gb" (OuterVolumeSpecName: "kube-api-access-ch6gb") pod "d5332b8a-d33c-46df-af25-86238f634c2c" (UID: "d5332b8a-d33c-46df-af25-86238f634c2c"). InnerVolumeSpecName "kube-api-access-ch6gb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 15:05:55.733810 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:55.733725 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5332b8a-d33c-46df-af25-86238f634c2c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d5332b8a-d33c-46df-af25-86238f634c2c" (UID: "d5332b8a-d33c-46df-af25-86238f634c2c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:05:55.832698 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:55.832657 2569 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d5332b8a-d33c-46df-af25-86238f634c2c-oauth-serving-cert\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\"" Jun 11 15:05:55.832698 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:55.832690 2569 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d5332b8a-d33c-46df-af25-86238f634c2c-service-ca\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\"" Jun 11 15:05:55.832698 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:55.832710 2569 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d5332b8a-d33c-46df-af25-86238f634c2c-console-config\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\"" Jun 11 15:05:55.832903 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:55.832719 2569 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d5332b8a-d33c-46df-af25-86238f634c2c-console-oauth-config\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\"" Jun 11 15:05:55.832903 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:55.832727 2569 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d5332b8a-d33c-46df-af25-86238f634c2c-console-serving-cert\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\"" Jun 11 15:05:55.832903 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:55.832736 2569 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5332b8a-d33c-46df-af25-86238f634c2c-trusted-ca-bundle\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\"" Jun 11 15:05:55.832903 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:55.832744 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ch6gb\" (UniqueName: \"kubernetes.io/projected/d5332b8a-d33c-46df-af25-86238f634c2c-kube-api-access-ch6gb\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\"" Jun 11 15:05:56.351378 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:56.351347 2569 generic.go:356] "Generic (PLEG): container finished" podID="d5332b8a-d33c-46df-af25-86238f634c2c" containerID="fe02a9d16508c5da7ce5d51830613c17eb009d76c3f08b867332607fa5f8f8c2" exitCode=0 Jun 11 15:05:56.351547 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:56.351395 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74f7779c97-zlm68" Jun 11 15:05:56.351547 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:56.351412 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74f7779c97-zlm68" event={"ID":"d5332b8a-d33c-46df-af25-86238f634c2c","Type":"ContainerDied","Data":"fe02a9d16508c5da7ce5d51830613c17eb009d76c3f08b867332607fa5f8f8c2"} Jun 11 15:05:56.351547 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:56.351453 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74f7779c97-zlm68" event={"ID":"d5332b8a-d33c-46df-af25-86238f634c2c","Type":"ContainerDied","Data":"f4047ef78b61d1d384b39424fc843aa9232b4b3e5d2fc18b21efd1e1d2417ca7"} Jun 11 15:05:56.351547 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:56.351473 2569 scope.go:117] "RemoveContainer" containerID="fe02a9d16508c5da7ce5d51830613c17eb009d76c3f08b867332607fa5f8f8c2" Jun 11 15:05:56.359968 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:56.359786 2569 scope.go:117] "RemoveContainer" containerID="fe02a9d16508c5da7ce5d51830613c17eb009d76c3f08b867332607fa5f8f8c2" Jun 11 15:05:56.360191 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:05:56.360042 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe02a9d16508c5da7ce5d51830613c17eb009d76c3f08b867332607fa5f8f8c2\": container with ID starting with fe02a9d16508c5da7ce5d51830613c17eb009d76c3f08b867332607fa5f8f8c2 not found: ID does not exist" containerID="fe02a9d16508c5da7ce5d51830613c17eb009d76c3f08b867332607fa5f8f8c2" Jun 11 15:05:56.360191 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:56.360062 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe02a9d16508c5da7ce5d51830613c17eb009d76c3f08b867332607fa5f8f8c2"} err="failed to get container status \"fe02a9d16508c5da7ce5d51830613c17eb009d76c3f08b867332607fa5f8f8c2\": rpc error: code = NotFound desc = could not find container \"fe02a9d16508c5da7ce5d51830613c17eb009d76c3f08b867332607fa5f8f8c2\": container with ID starting with fe02a9d16508c5da7ce5d51830613c17eb009d76c3f08b867332607fa5f8f8c2 not found: ID does not exist" Jun 11 15:05:56.388572 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:56.388548 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-74f7779c97-zlm68"] Jun 11 15:05:56.395552 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:56.395529 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-74f7779c97-zlm68"] Jun 11 15:05:57.478435 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:05:57.478404 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d5332b8a-d33c-46df-af25-86238f634c2c" path="/var/lib/kubelet/pods/d5332b8a-d33c-46df-af25-86238f634c2c/volumes" Jun 11 15:06:24.594133 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:06:24.594097 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:06:24.609102 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:06:24.609076 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:06:25.478238 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:06:25.478216 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:07:02.791026 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:07:02.790995 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5bfd7967cc-dgxzk"] Jun 11 15:07:02.791432 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:07:02.791313 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5332b8a-d33c-46df-af25-86238f634c2c" containerName="console" Jun 11 15:07:02.791432 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:07:02.791323 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5332b8a-d33c-46df-af25-86238f634c2c" containerName="console" Jun 11 15:07:02.791432 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:07:02.791364 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5332b8a-d33c-46df-af25-86238f634c2c" containerName="console" Jun 11 15:07:02.794383 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:07:02.794365 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5bfd7967cc-dgxzk" Jun 11 15:07:02.800749 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:07:02.800726 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 11 15:07:02.800941 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:07:02.800911 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 11 15:07:02.801035 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:07:02.800988 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-cjxmt\"" Jun 11 15:07:02.801084 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:07:02.801037 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 11 15:07:02.801084 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:07:02.800996 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 11 15:07:02.820775 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:07:02.820736 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5bfd7967cc-dgxzk"] Jun 11 15:07:02.905146 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:07:02.905104 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/46017a52-fd7d-4d05-b330-89b5f4dcb1b7-manifests\") pod \"opendatahub-operator-controller-manager-5bfd7967cc-dgxzk\" (UID: \"46017a52-fd7d-4d05-b330-89b5f4dcb1b7\") " pod="opendatahub/opendatahub-operator-controller-manager-5bfd7967cc-dgxzk" Jun 11 15:07:02.905146 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:07:02.905145 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/46017a52-fd7d-4d05-b330-89b5f4dcb1b7-webhook-cert\") pod \"opendatahub-operator-controller-manager-5bfd7967cc-dgxzk\" (UID: \"46017a52-fd7d-4d05-b330-89b5f4dcb1b7\") " pod="opendatahub/opendatahub-operator-controller-manager-5bfd7967cc-dgxzk" Jun 11 15:07:02.905339 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:07:02.905171 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/46017a52-fd7d-4d05-b330-89b5f4dcb1b7-tmp\") pod \"opendatahub-operator-controller-manager-5bfd7967cc-dgxzk\" (UID: \"46017a52-fd7d-4d05-b330-89b5f4dcb1b7\") " pod="opendatahub/opendatahub-operator-controller-manager-5bfd7967cc-dgxzk" Jun 11 15:07:02.905339 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:07:02.905245 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hftvn\" (UniqueName: \"kubernetes.io/projected/46017a52-fd7d-4d05-b330-89b5f4dcb1b7-kube-api-access-hftvn\") pod \"opendatahub-operator-controller-manager-5bfd7967cc-dgxzk\" (UID: \"46017a52-fd7d-4d05-b330-89b5f4dcb1b7\") " pod="opendatahub/opendatahub-operator-controller-manager-5bfd7967cc-dgxzk" Jun 11 15:07:02.905339 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:07:02.905280 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/46017a52-fd7d-4d05-b330-89b5f4dcb1b7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5bfd7967cc-dgxzk\" (UID: \"46017a52-fd7d-4d05-b330-89b5f4dcb1b7\") " pod="opendatahub/opendatahub-operator-controller-manager-5bfd7967cc-dgxzk" Jun 11 15:07:03.005871 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:07:03.005828 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/46017a52-fd7d-4d05-b330-89b5f4dcb1b7-manifests\") pod \"opendatahub-operator-controller-manager-5bfd7967cc-dgxzk\" (UID: \"46017a52-fd7d-4d05-b330-89b5f4dcb1b7\") " pod="opendatahub/opendatahub-operator-controller-manager-5bfd7967cc-dgxzk" Jun 11 15:07:03.005871 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:07:03.005872 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/46017a52-fd7d-4d05-b330-89b5f4dcb1b7-webhook-cert\") pod \"opendatahub-operator-controller-manager-5bfd7967cc-dgxzk\" (UID: \"46017a52-fd7d-4d05-b330-89b5f4dcb1b7\") " pod="opendatahub/opendatahub-operator-controller-manager-5bfd7967cc-dgxzk" Jun 11 15:07:03.006078 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:07:03.005980 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/46017a52-fd7d-4d05-b330-89b5f4dcb1b7-tmp\") pod \"opendatahub-operator-controller-manager-5bfd7967cc-dgxzk\" (UID: \"46017a52-fd7d-4d05-b330-89b5f4dcb1b7\") " pod="opendatahub/opendatahub-operator-controller-manager-5bfd7967cc-dgxzk" Jun 11 15:07:03.006078 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:07:03.006017 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hftvn\" (UniqueName: \"kubernetes.io/projected/46017a52-fd7d-4d05-b330-89b5f4dcb1b7-kube-api-access-hftvn\") pod \"opendatahub-operator-controller-manager-5bfd7967cc-dgxzk\" (UID: \"46017a52-fd7d-4d05-b330-89b5f4dcb1b7\") " pod="opendatahub/opendatahub-operator-controller-manager-5bfd7967cc-dgxzk" Jun 11 15:07:03.006078 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:07:03.006043 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/46017a52-fd7d-4d05-b330-89b5f4dcb1b7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5bfd7967cc-dgxzk\" (UID: \"46017a52-fd7d-4d05-b330-89b5f4dcb1b7\") " pod="opendatahub/opendatahub-operator-controller-manager-5bfd7967cc-dgxzk" Jun 11 15:07:03.006236 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:07:03.006179 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/46017a52-fd7d-4d05-b330-89b5f4dcb1b7-manifests\") pod \"opendatahub-operator-controller-manager-5bfd7967cc-dgxzk\" (UID: \"46017a52-fd7d-4d05-b330-89b5f4dcb1b7\") " pod="opendatahub/opendatahub-operator-controller-manager-5bfd7967cc-dgxzk" Jun 11 15:07:03.008300 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:07:03.008277 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/46017a52-fd7d-4d05-b330-89b5f4dcb1b7-tmp\") pod \"opendatahub-operator-controller-manager-5bfd7967cc-dgxzk\" (UID: \"46017a52-fd7d-4d05-b330-89b5f4dcb1b7\") " pod="opendatahub/opendatahub-operator-controller-manager-5bfd7967cc-dgxzk" Jun 11 15:07:03.008300 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:07:03.008287 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/46017a52-fd7d-4d05-b330-89b5f4dcb1b7-webhook-cert\") pod \"opendatahub-operator-controller-manager-5bfd7967cc-dgxzk\" (UID: \"46017a52-fd7d-4d05-b330-89b5f4dcb1b7\") " pod="opendatahub/opendatahub-operator-controller-manager-5bfd7967cc-dgxzk" Jun 11 15:07:03.008438 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:07:03.008377 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/46017a52-fd7d-4d05-b330-89b5f4dcb1b7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5bfd7967cc-dgxzk\" (UID: \"46017a52-fd7d-4d05-b330-89b5f4dcb1b7\") " pod="opendatahub/opendatahub-operator-controller-manager-5bfd7967cc-dgxzk" Jun 11 15:07:03.017917 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:07:03.017892 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hftvn\" (UniqueName: \"kubernetes.io/projected/46017a52-fd7d-4d05-b330-89b5f4dcb1b7-kube-api-access-hftvn\") pod \"opendatahub-operator-controller-manager-5bfd7967cc-dgxzk\" (UID: \"46017a52-fd7d-4d05-b330-89b5f4dcb1b7\") " pod="opendatahub/opendatahub-operator-controller-manager-5bfd7967cc-dgxzk" Jun 11 15:07:03.104238 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:07:03.104167 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5bfd7967cc-dgxzk" Jun 11 15:07:03.237257 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:07:03.237230 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5bfd7967cc-dgxzk"] Jun 11 15:07:03.239591 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:07:03.239566 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46017a52_fd7d_4d05_b330_89b5f4dcb1b7.slice/crio-5a7886fecfb69c886cb1fa21230d13d59dc219253917e86d74d1727600bbeab7 WatchSource:0}: Error finding container 5a7886fecfb69c886cb1fa21230d13d59dc219253917e86d74d1727600bbeab7: Status 404 returned error can't find the container with id 5a7886fecfb69c886cb1fa21230d13d59dc219253917e86d74d1727600bbeab7 Jun 11 15:07:03.602381 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:07:03.602344 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5bfd7967cc-dgxzk" event={"ID":"46017a52-fd7d-4d05-b330-89b5f4dcb1b7","Type":"ContainerStarted","Data":"5a7886fecfb69c886cb1fa21230d13d59dc219253917e86d74d1727600bbeab7"} Jun 11 15:07:06.617297 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:07:06.617257 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5bfd7967cc-dgxzk" event={"ID":"46017a52-fd7d-4d05-b330-89b5f4dcb1b7","Type":"ContainerStarted","Data":"a2cd480a95441dc5a5cb23595905f93737be558626717d051505c0e31a7e0f7b"} Jun 11 15:07:07.623141 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:07:07.623105 2569 generic.go:356] "Generic (PLEG): container finished" podID="46017a52-fd7d-4d05-b330-89b5f4dcb1b7" containerID="a2cd480a95441dc5a5cb23595905f93737be558626717d051505c0e31a7e0f7b" exitCode=0 Jun 11 15:07:07.623514 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:07:07.623186 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5bfd7967cc-dgxzk" event={"ID":"46017a52-fd7d-4d05-b330-89b5f4dcb1b7","Type":"ContainerDied","Data":"a2cd480a95441dc5a5cb23595905f93737be558626717d051505c0e31a7e0f7b"} Jun 11 15:07:08.628888 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:07:08.628853 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5bfd7967cc-dgxzk" event={"ID":"46017a52-fd7d-4d05-b330-89b5f4dcb1b7","Type":"ContainerStarted","Data":"0182446fd46c0b20519686b1bbbcfac6975b279def27332a7c89616c091291cf"} Jun 11 15:07:08.629254 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:07:08.628953 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5bfd7967cc-dgxzk" Jun 11 15:07:08.657244 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:07:08.657196 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5bfd7967cc-dgxzk" podStartSLOduration=2.5313699830000003 podStartE2EDuration="6.657179609s" totalImagesPullingTime="3.149837228s" totalInitContainerRuntime="975.972398ms" isStatefulPod=false podCreationTimestamp="2026-06-11 15:07:02 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:07:08.655692796 +0000 UTC m=+263.604317059" watchObservedRunningTime="2026-06-11 15:07:08.657179609 +0000 UTC m=+263.605803911" Jun 11 15:07:19.635040 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:07:19.635008 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5bfd7967cc-dgxzk" Jun 11 15:07:22.118466 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:07:22.118436 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-946684896-nsl9n"] Jun 11 15:07:22.128799 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:07:22.128771 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-946684896-nsl9n" Jun 11 15:07:22.133026 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:07:22.133003 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 11 15:07:22.133169 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:07:22.133118 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 11 15:07:22.133169 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:07:22.133139 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 11 15:07:22.133878 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:07:22.133860 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-nhn4w\"" Jun 11 15:07:22.133989 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:07:22.133940 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 11 15:07:22.148123 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:07:22.148092 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-946684896-nsl9n"] Jun 11 15:07:22.168634 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:07:22.168609 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/04e6f5d1-8f42-40f5-ac1e-c8733c10dd66-tmp\") pod \"kube-auth-proxy-946684896-nsl9n\" (UID: \"04e6f5d1-8f42-40f5-ac1e-c8733c10dd66\") " pod="openshift-ingress/kube-auth-proxy-946684896-nsl9n" Jun 11 15:07:22.168785 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:07:22.168640 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjxpb\" (UniqueName: \"kubernetes.io/projected/04e6f5d1-8f42-40f5-ac1e-c8733c10dd66-kube-api-access-hjxpb\") pod \"kube-auth-proxy-946684896-nsl9n\" (UID: \"04e6f5d1-8f42-40f5-ac1e-c8733c10dd66\") " pod="openshift-ingress/kube-auth-proxy-946684896-nsl9n" Jun 11 15:07:22.168785 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:07:22.168662 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/04e6f5d1-8f42-40f5-ac1e-c8733c10dd66-tls-certs\") pod \"kube-auth-proxy-946684896-nsl9n\" (UID: \"04e6f5d1-8f42-40f5-ac1e-c8733c10dd66\") " pod="openshift-ingress/kube-auth-proxy-946684896-nsl9n" Jun 11 15:07:22.269318 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:07:22.269285 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/04e6f5d1-8f42-40f5-ac1e-c8733c10dd66-tls-certs\") pod \"kube-auth-proxy-946684896-nsl9n\" (UID: \"04e6f5d1-8f42-40f5-ac1e-c8733c10dd66\") " pod="openshift-ingress/kube-auth-proxy-946684896-nsl9n" Jun 11 15:07:22.269515 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:07:22.269422 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/04e6f5d1-8f42-40f5-ac1e-c8733c10dd66-tmp\") pod \"kube-auth-proxy-946684896-nsl9n\" (UID: \"04e6f5d1-8f42-40f5-ac1e-c8733c10dd66\") " pod="openshift-ingress/kube-auth-proxy-946684896-nsl9n" Jun 11 15:07:22.269515 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:07:22.269429 2569 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jun 11 15:07:22.269515 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:07:22.269450 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjxpb\" (UniqueName: \"kubernetes.io/projected/04e6f5d1-8f42-40f5-ac1e-c8733c10dd66-kube-api-access-hjxpb\") pod \"kube-auth-proxy-946684896-nsl9n\" (UID: \"04e6f5d1-8f42-40f5-ac1e-c8733c10dd66\") " pod="openshift-ingress/kube-auth-proxy-946684896-nsl9n" Jun 11 15:07:22.269515 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:07:22.269515 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04e6f5d1-8f42-40f5-ac1e-c8733c10dd66-tls-certs podName:04e6f5d1-8f42-40f5-ac1e-c8733c10dd66 nodeName:}" failed. No retries permitted until 2026-06-11 15:07:22.769495006 +0000 UTC m=+277.718119259 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/04e6f5d1-8f42-40f5-ac1e-c8733c10dd66-tls-certs") pod "kube-auth-proxy-946684896-nsl9n" (UID: "04e6f5d1-8f42-40f5-ac1e-c8733c10dd66") : secret "kube-auth-proxy-tls" not found Jun 11 15:07:22.271563 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:07:22.271541 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/04e6f5d1-8f42-40f5-ac1e-c8733c10dd66-tmp\") pod \"kube-auth-proxy-946684896-nsl9n\" (UID: \"04e6f5d1-8f42-40f5-ac1e-c8733c10dd66\") " pod="openshift-ingress/kube-auth-proxy-946684896-nsl9n" Jun 11 15:07:22.285355 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:07:22.285331 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjxpb\" (UniqueName: \"kubernetes.io/projected/04e6f5d1-8f42-40f5-ac1e-c8733c10dd66-kube-api-access-hjxpb\") pod \"kube-auth-proxy-946684896-nsl9n\" (UID: \"04e6f5d1-8f42-40f5-ac1e-c8733c10dd66\") " pod="openshift-ingress/kube-auth-proxy-946684896-nsl9n" Jun 11 15:07:22.775548 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:07:22.775515 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/04e6f5d1-8f42-40f5-ac1e-c8733c10dd66-tls-certs\") pod \"kube-auth-proxy-946684896-nsl9n\" (UID: \"04e6f5d1-8f42-40f5-ac1e-c8733c10dd66\") " pod="openshift-ingress/kube-auth-proxy-946684896-nsl9n" Jun 11 15:07:22.778501 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:07:22.778474 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/04e6f5d1-8f42-40f5-ac1e-c8733c10dd66-tls-certs\") pod \"kube-auth-proxy-946684896-nsl9n\" (UID: \"04e6f5d1-8f42-40f5-ac1e-c8733c10dd66\") " pod="openshift-ingress/kube-auth-proxy-946684896-nsl9n" Jun 11 15:07:23.045111 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:07:23.045022 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-946684896-nsl9n" Jun 11 15:07:23.186480 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:07:23.186448 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-946684896-nsl9n"] Jun 11 15:07:23.188392 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:07:23.188358 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04e6f5d1_8f42_40f5_ac1e_c8733c10dd66.slice/crio-e2bdfeb84b3385e75161f209420c024a7f66b154e2bc4744c0a97be8020b167b WatchSource:0}: Error finding container e2bdfeb84b3385e75161f209420c024a7f66b154e2bc4744c0a97be8020b167b: Status 404 returned error can't find the container with id e2bdfeb84b3385e75161f209420c024a7f66b154e2bc4744c0a97be8020b167b Jun 11 15:07:23.690281 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:07:23.690246 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-946684896-nsl9n" event={"ID":"04e6f5d1-8f42-40f5-ac1e-c8733c10dd66","Type":"ContainerStarted","Data":"e2bdfeb84b3385e75161f209420c024a7f66b154e2bc4744c0a97be8020b167b"} Jun 11 15:07:27.708563 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:07:27.708523 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-946684896-nsl9n" event={"ID":"04e6f5d1-8f42-40f5-ac1e-c8733c10dd66","Type":"ContainerStarted","Data":"e04ee47439929bd94d87eb2714502f9cfd8994d8bc26ee6cb7e4549f96edd73e"} Jun 11 15:07:27.728143 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:07:27.728052 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-946684896-nsl9n" podStartSLOduration=1.456443353 podStartE2EDuration="5.728036555s" totalImagesPullingTime="4.271593202s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:07:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:07:27.726831818 +0000 UTC m=+282.675456081" watchObservedRunningTime="2026-06-11 15:07:27.728036555 +0000 UTC m=+282.676660817" Jun 11 15:07:31.324189 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:07:31.324149 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-697bc84576-pv5pg"] Jun 11 15:07:31.326413 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:07:31.326395 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-697bc84576-pv5pg" Jun 11 15:07:31.330179 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:07:31.330154 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 11 15:07:31.330288 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:07:31.330206 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 11 15:07:31.331192 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:07:31.331175 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-qsjkd\"" Jun 11 15:07:31.331448 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:07:31.331435 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 11 15:07:31.331492 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:07:31.331479 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 11 15:07:31.331793 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:07:31.331780 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 11 15:07:31.344818 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:07:31.344794 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-697bc84576-pv5pg"] Jun 11 15:07:31.455302 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:07:31.455272 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/06c5c045-3e1a-46aa-962c-50756a701b4e-metrics-cert\") pod \"lws-controller-manager-697bc84576-pv5pg\" (UID: \"06c5c045-3e1a-46aa-962c-50756a701b4e\") " pod="openshift-lws-operator/lws-controller-manager-697bc84576-pv5pg" Jun 11 15:07:31.455302 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:07:31.455305 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tf64x\" (UniqueName: \"kubernetes.io/projected/06c5c045-3e1a-46aa-962c-50756a701b4e-kube-api-access-tf64x\") pod \"lws-controller-manager-697bc84576-pv5pg\" (UID: \"06c5c045-3e1a-46aa-962c-50756a701b4e\") " pod="openshift-lws-operator/lws-controller-manager-697bc84576-pv5pg" Jun 11 15:07:31.455509 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:07:31.455325 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/06c5c045-3e1a-46aa-962c-50756a701b4e-manager-config\") pod \"lws-controller-manager-697bc84576-pv5pg\" (UID: \"06c5c045-3e1a-46aa-962c-50756a701b4e\") " pod="openshift-lws-operator/lws-controller-manager-697bc84576-pv5pg" Jun 11 15:07:31.455509 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:07:31.455415 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/06c5c045-3e1a-46aa-962c-50756a701b4e-cert\") pod \"lws-controller-manager-697bc84576-pv5pg\" (UID: \"06c5c045-3e1a-46aa-962c-50756a701b4e\") " pod="openshift-lws-operator/lws-controller-manager-697bc84576-pv5pg" Jun 11 15:07:31.556011 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:07:31.555981 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/06c5c045-3e1a-46aa-962c-50756a701b4e-manager-config\") pod \"lws-controller-manager-697bc84576-pv5pg\" (UID: \"06c5c045-3e1a-46aa-962c-50756a701b4e\") " pod="openshift-lws-operator/lws-controller-manager-697bc84576-pv5pg" Jun 11 15:07:31.556202 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:07:31.556066 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/06c5c045-3e1a-46aa-962c-50756a701b4e-cert\") pod \"lws-controller-manager-697bc84576-pv5pg\" (UID: \"06c5c045-3e1a-46aa-962c-50756a701b4e\") " pod="openshift-lws-operator/lws-controller-manager-697bc84576-pv5pg" Jun 11 15:07:31.556202 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:07:31.556152 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/06c5c045-3e1a-46aa-962c-50756a701b4e-metrics-cert\") pod \"lws-controller-manager-697bc84576-pv5pg\" (UID: \"06c5c045-3e1a-46aa-962c-50756a701b4e\") " pod="openshift-lws-operator/lws-controller-manager-697bc84576-pv5pg" Jun 11 15:07:31.556202 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:07:31.556177 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tf64x\" (UniqueName: \"kubernetes.io/projected/06c5c045-3e1a-46aa-962c-50756a701b4e-kube-api-access-tf64x\") pod \"lws-controller-manager-697bc84576-pv5pg\" (UID: \"06c5c045-3e1a-46aa-962c-50756a701b4e\") " pod="openshift-lws-operator/lws-controller-manager-697bc84576-pv5pg" Jun 11 15:07:31.557052 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:07:31.557026 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/06c5c045-3e1a-46aa-962c-50756a701b4e-manager-config\") pod \"lws-controller-manager-697bc84576-pv5pg\" (UID: \"06c5c045-3e1a-46aa-962c-50756a701b4e\") " pod="openshift-lws-operator/lws-controller-manager-697bc84576-pv5pg" Jun 11 15:07:31.559075 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:07:31.559053 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/06c5c045-3e1a-46aa-962c-50756a701b4e-cert\") pod \"lws-controller-manager-697bc84576-pv5pg\" (UID: \"06c5c045-3e1a-46aa-962c-50756a701b4e\") " pod="openshift-lws-operator/lws-controller-manager-697bc84576-pv5pg" Jun 11 15:07:31.559217 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:07:31.559198 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/06c5c045-3e1a-46aa-962c-50756a701b4e-metrics-cert\") pod \"lws-controller-manager-697bc84576-pv5pg\" (UID: \"06c5c045-3e1a-46aa-962c-50756a701b4e\") " pod="openshift-lws-operator/lws-controller-manager-697bc84576-pv5pg" Jun 11 15:07:31.568536 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:07:31.568514 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tf64x\" (UniqueName: \"kubernetes.io/projected/06c5c045-3e1a-46aa-962c-50756a701b4e-kube-api-access-tf64x\") pod \"lws-controller-manager-697bc84576-pv5pg\" (UID: \"06c5c045-3e1a-46aa-962c-50756a701b4e\") " pod="openshift-lws-operator/lws-controller-manager-697bc84576-pv5pg" Jun 11 15:07:31.635632 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:07:31.635556 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-697bc84576-pv5pg" Jun 11 15:07:31.773810 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:07:31.773786 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-697bc84576-pv5pg"] Jun 11 15:07:31.776207 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:07:31.776178 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06c5c045_3e1a_46aa_962c_50756a701b4e.slice/crio-fdbd2ae70a6025e06996e2ab07e787296d7fcb3ee6d1e29a21ad4cf313e99117 WatchSource:0}: Error finding container fdbd2ae70a6025e06996e2ab07e787296d7fcb3ee6d1e29a21ad4cf313e99117: Status 404 returned error can't find the container with id fdbd2ae70a6025e06996e2ab07e787296d7fcb3ee6d1e29a21ad4cf313e99117 Jun 11 15:07:32.732960 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:07:32.732507 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-697bc84576-pv5pg" event={"ID":"06c5c045-3e1a-46aa-962c-50756a701b4e","Type":"ContainerStarted","Data":"fdbd2ae70a6025e06996e2ab07e787296d7fcb3ee6d1e29a21ad4cf313e99117"} Jun 11 15:07:34.743314 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:07:34.743234 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-697bc84576-pv5pg" event={"ID":"06c5c045-3e1a-46aa-962c-50756a701b4e","Type":"ContainerStarted","Data":"60dd1d3499ece1c69532642547bca1e41f0ea55e0841896eac2c6b57715ec4f9"} Jun 11 15:07:34.743666 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:07:34.743372 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-697bc84576-pv5pg" Jun 11 15:07:34.777803 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:07:34.777734 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-697bc84576-pv5pg" podStartSLOduration=1.208935929 podStartE2EDuration="3.777716325s" totalImagesPullingTime="2.568780396s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:07:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:07:34.776094171 +0000 UTC m=+289.724718432" watchObservedRunningTime="2026-06-11 15:07:34.777716325 +0000 UTC m=+289.726340588" Jun 11 15:07:45.425521 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:07:45.425489 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5lcln_77786904-9829-4966-9657-c97854cb6555/ovn-acl-logging/0.log" Jun 11 15:07:45.426047 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:07:45.425928 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5lcln_77786904-9829-4966-9657-c97854cb6555/ovn-acl-logging/0.log" Jun 11 15:07:45.433074 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:07:45.433054 2569 kubelet.go:1648] "Image garbage collection succeeded" Jun 11 15:07:45.754971 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:07:45.754883 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-697bc84576-pv5pg" Jun 11 15:07:58.475361 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:07:58.475318 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-c8c54bcfc-jfdv6"] Jun 11 15:07:58.477880 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:07:58.477859 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-c8c54bcfc-jfdv6" Jun 11 15:07:58.480820 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:07:58.480801 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-vfj89\"" Jun 11 15:07:58.480927 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:07:58.480836 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 11 15:07:58.502367 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:07:58.502346 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpwhn\" (UniqueName: \"kubernetes.io/projected/8257c987-ae99-4a1d-982c-e3f2a8666265-kube-api-access-dpwhn\") pod \"dashboard-redirect-c8c54bcfc-jfdv6\" (UID: \"8257c987-ae99-4a1d-982c-e3f2a8666265\") " pod="opendatahub/dashboard-redirect-c8c54bcfc-jfdv6" Jun 11 15:07:58.502456 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:07:58.502441 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/8257c987-ae99-4a1d-982c-e3f2a8666265-redirect-config\") pod \"dashboard-redirect-c8c54bcfc-jfdv6\" (UID: \"8257c987-ae99-4a1d-982c-e3f2a8666265\") " pod="opendatahub/dashboard-redirect-c8c54bcfc-jfdv6" Jun 11 15:07:58.505593 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:07:58.505571 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-c8c54bcfc-jfdv6"] Jun 11 15:07:58.603065 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:07:58.603030 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/8257c987-ae99-4a1d-982c-e3f2a8666265-redirect-config\") pod \"dashboard-redirect-c8c54bcfc-jfdv6\" (UID: \"8257c987-ae99-4a1d-982c-e3f2a8666265\") " pod="opendatahub/dashboard-redirect-c8c54bcfc-jfdv6" Jun 11 15:07:58.603222 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:07:58.603075 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dpwhn\" (UniqueName: \"kubernetes.io/projected/8257c987-ae99-4a1d-982c-e3f2a8666265-kube-api-access-dpwhn\") pod \"dashboard-redirect-c8c54bcfc-jfdv6\" (UID: \"8257c987-ae99-4a1d-982c-e3f2a8666265\") " pod="opendatahub/dashboard-redirect-c8c54bcfc-jfdv6" Jun 11 15:07:58.603750 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:07:58.603731 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/8257c987-ae99-4a1d-982c-e3f2a8666265-redirect-config\") pod \"dashboard-redirect-c8c54bcfc-jfdv6\" (UID: \"8257c987-ae99-4a1d-982c-e3f2a8666265\") " pod="opendatahub/dashboard-redirect-c8c54bcfc-jfdv6" Jun 11 15:07:58.615398 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:07:58.615371 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpwhn\" (UniqueName: \"kubernetes.io/projected/8257c987-ae99-4a1d-982c-e3f2a8666265-kube-api-access-dpwhn\") pod \"dashboard-redirect-c8c54bcfc-jfdv6\" (UID: \"8257c987-ae99-4a1d-982c-e3f2a8666265\") " pod="opendatahub/dashboard-redirect-c8c54bcfc-jfdv6" Jun 11 15:07:58.787432 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:07:58.787400 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-c8c54bcfc-jfdv6" Jun 11 15:07:58.930610 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:07:58.930583 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-c8c54bcfc-jfdv6"] Jun 11 15:07:58.932469 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:07:58.932445 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8257c987_ae99_4a1d_982c_e3f2a8666265.slice/crio-31063000f4d1e72b8aeba4ec52c865567b8dc14a73578c50a5522cb2af100d77 WatchSource:0}: Error finding container 31063000f4d1e72b8aeba4ec52c865567b8dc14a73578c50a5522cb2af100d77: Status 404 returned error can't find the container with id 31063000f4d1e72b8aeba4ec52c865567b8dc14a73578c50a5522cb2af100d77 Jun 11 15:07:58.934138 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:07:58.934119 2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 15:07:59.862120 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:07:59.862093 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-c8c54bcfc-jfdv6" event={"ID":"8257c987-ae99-4a1d-982c-e3f2a8666265","Type":"ContainerStarted","Data":"31063000f4d1e72b8aeba4ec52c865567b8dc14a73578c50a5522cb2af100d77"} Jun 11 15:08:03.883200 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:08:03.883112 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-c8c54bcfc-jfdv6" event={"ID":"8257c987-ae99-4a1d-982c-e3f2a8666265","Type":"ContainerStarted","Data":"493c9181c84bccde1b5e2749afd03d76bafa33f2e7602bf723cedc0030920871"} Jun 11 15:08:03.906164 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:08:03.906117 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-c8c54bcfc-jfdv6" podStartSLOduration=1.216764452 podStartE2EDuration="5.906102767s" totalImagesPullingTime="4.689338315s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:07:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:08:03.904778809 +0000 UTC m=+318.853403064" watchObservedRunningTime="2026-06-11 15:08:03.906102767 +0000 UTC m=+318.854727028" Jun 11 15:08:57.278022 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:08:57.277943 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7jj5x"] Jun 11 15:08:57.290751 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:08:57.290725 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7jj5x" Jun 11 15:08:57.296006 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:08:57.295981 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 11 15:08:57.296945 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:08:57.296785 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 11 15:08:57.296945 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:08:57.296822 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-ctmfh\"" Jun 11 15:08:57.297331 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:08:57.297308 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7jj5x"] Jun 11 15:08:57.315613 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:08:57.315588 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jf8p\" (UniqueName: \"kubernetes.io/projected/ec3b2633-e52f-4799-b613-dd57b8c72c93-kube-api-access-6jf8p\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7jj5x\" (UID: \"ec3b2633-e52f-4799-b613-dd57b8c72c93\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7jj5x" Jun 11 15:08:57.315733 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:08:57.315688 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ec3b2633-e52f-4799-b613-dd57b8c72c93-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7jj5x\" (UID: \"ec3b2633-e52f-4799-b613-dd57b8c72c93\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7jj5x" Jun 11 15:08:57.416645 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:08:57.416596 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ec3b2633-e52f-4799-b613-dd57b8c72c93-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7jj5x\" (UID: \"ec3b2633-e52f-4799-b613-dd57b8c72c93\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7jj5x" Jun 11 15:08:57.416862 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:08:57.416692 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6jf8p\" (UniqueName: \"kubernetes.io/projected/ec3b2633-e52f-4799-b613-dd57b8c72c93-kube-api-access-6jf8p\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7jj5x\" (UID: \"ec3b2633-e52f-4799-b613-dd57b8c72c93\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7jj5x" Jun 11 15:08:57.417002 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:08:57.416980 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ec3b2633-e52f-4799-b613-dd57b8c72c93-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7jj5x\" (UID: \"ec3b2633-e52f-4799-b613-dd57b8c72c93\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7jj5x" Jun 11 15:08:57.429908 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:08:57.429888 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jf8p\" (UniqueName: \"kubernetes.io/projected/ec3b2633-e52f-4799-b613-dd57b8c72c93-kube-api-access-6jf8p\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7jj5x\" (UID: \"ec3b2633-e52f-4799-b613-dd57b8c72c93\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7jj5x" Jun 11 15:08:57.601794 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:08:57.601693 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7jj5x" Jun 11 15:08:57.736636 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:08:57.736612 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7jj5x"] Jun 11 15:08:57.738935 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:08:57.738905 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec3b2633_e52f_4799_b613_dd57b8c72c93.slice/crio-17df517aab0e0eceb0861307bc3cf06fba3d3e68d949543f5faab76ece927b3d WatchSource:0}: Error finding container 17df517aab0e0eceb0861307bc3cf06fba3d3e68d949543f5faab76ece927b3d: Status 404 returned error can't find the container with id 17df517aab0e0eceb0861307bc3cf06fba3d3e68d949543f5faab76ece927b3d Jun 11 15:08:58.115615 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:08:58.115578 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7jj5x" event={"ID":"ec3b2633-e52f-4799-b613-dd57b8c72c93","Type":"ContainerStarted","Data":"17df517aab0e0eceb0861307bc3cf06fba3d3e68d949543f5faab76ece927b3d"} Jun 11 15:09:03.142228 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:03.142189 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7jj5x" event={"ID":"ec3b2633-e52f-4799-b613-dd57b8c72c93","Type":"ContainerStarted","Data":"837b01d266148653da5483318ecb1dab66f3be719a15d586b610cc576fddf037"} Jun 11 15:09:03.142708 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:03.142314 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7jj5x" Jun 11 15:09:03.167112 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:03.167069 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7jj5x" podStartSLOduration=1.355555497 podStartE2EDuration="6.167056606s" totalImagesPullingTime="4.811501109s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:08:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:09:03.165449285 +0000 UTC m=+378.114073547" watchObservedRunningTime="2026-06-11 15:09:03.167056606 +0000 UTC m=+378.115680867" Jun 11 15:09:05.367243 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:05.367205 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-9zl8f"] Jun 11 15:09:05.369611 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:05.369591 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9zl8f" Jun 11 15:09:05.372276 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:05.372255 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-g9rf8\"" Jun 11 15:09:05.372405 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:05.372308 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jun 11 15:09:05.372405 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:05.372360 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jun 11 15:09:05.380524 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:05.380503 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-9zl8f"] Jun 11 15:09:05.494293 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:05.494260 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/876abaf9-19fd-44d2-ad55-713707bf2df8-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-9zl8f\" (UID: \"876abaf9-19fd-44d2-ad55-713707bf2df8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9zl8f" Jun 11 15:09:05.494449 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:05.494330 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgvh5\" (UniqueName: \"kubernetes.io/projected/876abaf9-19fd-44d2-ad55-713707bf2df8-kube-api-access-xgvh5\") pod \"kuadrant-console-plugin-66b5774985-9zl8f\" (UID: \"876abaf9-19fd-44d2-ad55-713707bf2df8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9zl8f" Jun 11 15:09:05.494449 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:05.494365 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/876abaf9-19fd-44d2-ad55-713707bf2df8-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-9zl8f\" (UID: \"876abaf9-19fd-44d2-ad55-713707bf2df8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9zl8f" Jun 11 15:09:05.595010 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:05.594981 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/876abaf9-19fd-44d2-ad55-713707bf2df8-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-9zl8f\" (UID: \"876abaf9-19fd-44d2-ad55-713707bf2df8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9zl8f" Jun 11 15:09:05.595179 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:05.595024 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgvh5\" (UniqueName: \"kubernetes.io/projected/876abaf9-19fd-44d2-ad55-713707bf2df8-kube-api-access-xgvh5\") pod \"kuadrant-console-plugin-66b5774985-9zl8f\" (UID: \"876abaf9-19fd-44d2-ad55-713707bf2df8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9zl8f" Jun 11 15:09:05.595179 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:05.595069 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/876abaf9-19fd-44d2-ad55-713707bf2df8-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-9zl8f\" (UID: \"876abaf9-19fd-44d2-ad55-713707bf2df8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9zl8f" Jun 11 15:09:05.595312 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:09:05.595196 2569 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jun 11 15:09:05.595312 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:09:05.595251 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/876abaf9-19fd-44d2-ad55-713707bf2df8-plugin-serving-cert podName:876abaf9-19fd-44d2-ad55-713707bf2df8 nodeName:}" failed. No retries permitted until 2026-06-11 15:09:06.095232792 +0000 UTC m=+381.043857045 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/876abaf9-19fd-44d2-ad55-713707bf2df8-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-9zl8f" (UID: "876abaf9-19fd-44d2-ad55-713707bf2df8") : secret "plugin-serving-cert" not found Jun 11 15:09:05.595806 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:05.595786 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/876abaf9-19fd-44d2-ad55-713707bf2df8-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-9zl8f\" (UID: \"876abaf9-19fd-44d2-ad55-713707bf2df8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9zl8f" Jun 11 15:09:05.615551 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:05.615527 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgvh5\" (UniqueName: \"kubernetes.io/projected/876abaf9-19fd-44d2-ad55-713707bf2df8-kube-api-access-xgvh5\") pod \"kuadrant-console-plugin-66b5774985-9zl8f\" (UID: \"876abaf9-19fd-44d2-ad55-713707bf2df8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9zl8f" Jun 11 15:09:06.099145 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:06.099112 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/876abaf9-19fd-44d2-ad55-713707bf2df8-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-9zl8f\" (UID: \"876abaf9-19fd-44d2-ad55-713707bf2df8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9zl8f" Jun 11 15:09:06.101490 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:06.101468 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/876abaf9-19fd-44d2-ad55-713707bf2df8-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-9zl8f\" (UID: \"876abaf9-19fd-44d2-ad55-713707bf2df8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9zl8f" Jun 11 15:09:06.287618 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:06.287588 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9zl8f" Jun 11 15:09:06.420802 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:06.420750 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-9zl8f"] Jun 11 15:09:06.423573 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:09:06.423547 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod876abaf9_19fd_44d2_ad55_713707bf2df8.slice/crio-c8bdb922c74daf891679ba1fec72716d9838995f8f9a7aaaeab9ff821e9514e0 WatchSource:0}: Error finding container c8bdb922c74daf891679ba1fec72716d9838995f8f9a7aaaeab9ff821e9514e0: Status 404 returned error can't find the container with id c8bdb922c74daf891679ba1fec72716d9838995f8f9a7aaaeab9ff821e9514e0 Jun 11 15:09:07.163893 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:07.163856 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9zl8f" event={"ID":"876abaf9-19fd-44d2-ad55-713707bf2df8","Type":"ContainerStarted","Data":"c8bdb922c74daf891679ba1fec72716d9838995f8f9a7aaaeab9ff821e9514e0"} Jun 11 15:09:14.149387 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:14.149359 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7jj5x" Jun 11 15:09:15.933486 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:15.933449 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7jj5x"] Jun 11 15:09:15.933907 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:15.933714 2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7jj5x" podUID="ec3b2633-e52f-4799-b613-dd57b8c72c93" containerName="manager" containerID="cri-o://837b01d266148653da5483318ecb1dab66f3be719a15d586b610cc576fddf037" gracePeriod=2 Jun 11 15:09:15.938863 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:15.938803 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7jj5x"] Jun 11 15:09:25.088337 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:25.088300 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7c9b86df-rfmzk"] Jun 11 15:09:25.088794 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:25.088764 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec3b2633-e52f-4799-b613-dd57b8c72c93" containerName="manager" Jun 11 15:09:25.088794 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:25.088786 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec3b2633-e52f-4799-b613-dd57b8c72c93" containerName="manager" Jun 11 15:09:25.088895 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:25.088870 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec3b2633-e52f-4799-b613-dd57b8c72c93" containerName="manager" Jun 11 15:09:25.138527 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:25.138499 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c9b86df-rfmzk"] Jun 11 15:09:25.138685 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:25.138612 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c9b86df-rfmzk" Jun 11 15:09:25.282154 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:25.282115 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/230f05d8-e5d4-4d8c-95f0-0cfdd84aa045-trusted-ca-bundle\") pod \"console-7c9b86df-rfmzk\" (UID: \"230f05d8-e5d4-4d8c-95f0-0cfdd84aa045\") " pod="openshift-console/console-7c9b86df-rfmzk" Jun 11 15:09:25.282313 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:25.282159 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4wkn\" (UniqueName: \"kubernetes.io/projected/230f05d8-e5d4-4d8c-95f0-0cfdd84aa045-kube-api-access-g4wkn\") pod \"console-7c9b86df-rfmzk\" (UID: \"230f05d8-e5d4-4d8c-95f0-0cfdd84aa045\") " pod="openshift-console/console-7c9b86df-rfmzk" Jun 11 15:09:25.282313 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:25.282193 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/230f05d8-e5d4-4d8c-95f0-0cfdd84aa045-console-serving-cert\") pod \"console-7c9b86df-rfmzk\" (UID: \"230f05d8-e5d4-4d8c-95f0-0cfdd84aa045\") " pod="openshift-console/console-7c9b86df-rfmzk" Jun 11 15:09:25.282313 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:25.282221 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/230f05d8-e5d4-4d8c-95f0-0cfdd84aa045-service-ca\") pod \"console-7c9b86df-rfmzk\" (UID: \"230f05d8-e5d4-4d8c-95f0-0cfdd84aa045\") " pod="openshift-console/console-7c9b86df-rfmzk" Jun 11 15:09:25.282313 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:25.282255 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/230f05d8-e5d4-4d8c-95f0-0cfdd84aa045-console-config\") pod \"console-7c9b86df-rfmzk\" (UID: \"230f05d8-e5d4-4d8c-95f0-0cfdd84aa045\") " pod="openshift-console/console-7c9b86df-rfmzk" Jun 11 15:09:25.282313 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:25.282270 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/230f05d8-e5d4-4d8c-95f0-0cfdd84aa045-oauth-serving-cert\") pod \"console-7c9b86df-rfmzk\" (UID: \"230f05d8-e5d4-4d8c-95f0-0cfdd84aa045\") " pod="openshift-console/console-7c9b86df-rfmzk" Jun 11 15:09:25.282313 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:25.282301 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/230f05d8-e5d4-4d8c-95f0-0cfdd84aa045-console-oauth-config\") pod \"console-7c9b86df-rfmzk\" (UID: \"230f05d8-e5d4-4d8c-95f0-0cfdd84aa045\") " pod="openshift-console/console-7c9b86df-rfmzk" Jun 11 15:09:25.383870 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:25.383790 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/230f05d8-e5d4-4d8c-95f0-0cfdd84aa045-console-oauth-config\") pod \"console-7c9b86df-rfmzk\" (UID: \"230f05d8-e5d4-4d8c-95f0-0cfdd84aa045\") " pod="openshift-console/console-7c9b86df-rfmzk" Jun 11 15:09:25.384019 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:25.383925 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/230f05d8-e5d4-4d8c-95f0-0cfdd84aa045-trusted-ca-bundle\") pod \"console-7c9b86df-rfmzk\" (UID: \"230f05d8-e5d4-4d8c-95f0-0cfdd84aa045\") " pod="openshift-console/console-7c9b86df-rfmzk" Jun 11 15:09:25.384019 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:25.383951 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4wkn\" (UniqueName: \"kubernetes.io/projected/230f05d8-e5d4-4d8c-95f0-0cfdd84aa045-kube-api-access-g4wkn\") pod \"console-7c9b86df-rfmzk\" (UID: \"230f05d8-e5d4-4d8c-95f0-0cfdd84aa045\") " pod="openshift-console/console-7c9b86df-rfmzk" Jun 11 15:09:25.384019 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:25.383981 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/230f05d8-e5d4-4d8c-95f0-0cfdd84aa045-console-serving-cert\") pod \"console-7c9b86df-rfmzk\" (UID: \"230f05d8-e5d4-4d8c-95f0-0cfdd84aa045\") " pod="openshift-console/console-7c9b86df-rfmzk" Jun 11 15:09:25.384019 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:25.384007 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/230f05d8-e5d4-4d8c-95f0-0cfdd84aa045-service-ca\") pod \"console-7c9b86df-rfmzk\" (UID: \"230f05d8-e5d4-4d8c-95f0-0cfdd84aa045\") " pod="openshift-console/console-7c9b86df-rfmzk" Jun 11 15:09:25.384224 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:25.384051 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/230f05d8-e5d4-4d8c-95f0-0cfdd84aa045-console-config\") pod \"console-7c9b86df-rfmzk\" (UID: \"230f05d8-e5d4-4d8c-95f0-0cfdd84aa045\") " pod="openshift-console/console-7c9b86df-rfmzk" Jun 11 15:09:25.384224 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:25.384077 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/230f05d8-e5d4-4d8c-95f0-0cfdd84aa045-oauth-serving-cert\") pod \"console-7c9b86df-rfmzk\" (UID: \"230f05d8-e5d4-4d8c-95f0-0cfdd84aa045\") " pod="openshift-console/console-7c9b86df-rfmzk" Jun 11 15:09:25.384985 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:25.384958 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/230f05d8-e5d4-4d8c-95f0-0cfdd84aa045-oauth-serving-cert\") pod \"console-7c9b86df-rfmzk\" (UID: \"230f05d8-e5d4-4d8c-95f0-0cfdd84aa045\") " pod="openshift-console/console-7c9b86df-rfmzk" Jun 11 15:09:25.384985 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:25.384976 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/230f05d8-e5d4-4d8c-95f0-0cfdd84aa045-trusted-ca-bundle\") pod \"console-7c9b86df-rfmzk\" (UID: \"230f05d8-e5d4-4d8c-95f0-0cfdd84aa045\") " pod="openshift-console/console-7c9b86df-rfmzk" Jun 11 15:09:25.385159 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:25.385111 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/230f05d8-e5d4-4d8c-95f0-0cfdd84aa045-console-config\") pod \"console-7c9b86df-rfmzk\" (UID: \"230f05d8-e5d4-4d8c-95f0-0cfdd84aa045\") " pod="openshift-console/console-7c9b86df-rfmzk" Jun 11 15:09:25.385159 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:25.385116 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/230f05d8-e5d4-4d8c-95f0-0cfdd84aa045-service-ca\") pod \"console-7c9b86df-rfmzk\" (UID: \"230f05d8-e5d4-4d8c-95f0-0cfdd84aa045\") " pod="openshift-console/console-7c9b86df-rfmzk" Jun 11 15:09:25.386514 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:25.386487 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/230f05d8-e5d4-4d8c-95f0-0cfdd84aa045-console-oauth-config\") pod \"console-7c9b86df-rfmzk\" (UID: \"230f05d8-e5d4-4d8c-95f0-0cfdd84aa045\") " pod="openshift-console/console-7c9b86df-rfmzk" Jun 11 15:09:25.386676 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:25.386657 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/230f05d8-e5d4-4d8c-95f0-0cfdd84aa045-console-serving-cert\") pod \"console-7c9b86df-rfmzk\" (UID: \"230f05d8-e5d4-4d8c-95f0-0cfdd84aa045\") " pod="openshift-console/console-7c9b86df-rfmzk" Jun 11 15:09:25.393803 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:25.393780 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4wkn\" (UniqueName: \"kubernetes.io/projected/230f05d8-e5d4-4d8c-95f0-0cfdd84aa045-kube-api-access-g4wkn\") pod \"console-7c9b86df-rfmzk\" (UID: \"230f05d8-e5d4-4d8c-95f0-0cfdd84aa045\") " pod="openshift-console/console-7c9b86df-rfmzk" Jun 11 15:09:25.450346 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:25.450308 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c9b86df-rfmzk" Jun 11 15:09:29.815855 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:29.815829 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c9b86df-rfmzk"] Jun 11 15:09:29.820474 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:09:29.820446 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod230f05d8_e5d4_4d8c_95f0_0cfdd84aa045.slice/crio-22cbfff8bbd1899da453f51d8bdf2b29dc8dc62ef4946a642c0ec7e1e15ef83b WatchSource:0}: Error finding container 22cbfff8bbd1899da453f51d8bdf2b29dc8dc62ef4946a642c0ec7e1e15ef83b: Status 404 returned error can't find the container with id 22cbfff8bbd1899da453f51d8bdf2b29dc8dc62ef4946a642c0ec7e1e15ef83b Jun 11 15:09:29.824638 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:29.824618 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7jj5x" Jun 11 15:09:29.827059 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:09:29.827009 2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7jj5x\" is forbidden: User \"system:node:ip-10-0-128-147.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-147.ec2.internal' and this object" podUID="ec3b2633-e52f-4799-b613-dd57b8c72c93" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7jj5x" Jun 11 15:09:29.919929 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:29.919871 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ec3b2633-e52f-4799-b613-dd57b8c72c93-extensions-socket-volume\") pod \"ec3b2633-e52f-4799-b613-dd57b8c72c93\" (UID: \"ec3b2633-e52f-4799-b613-dd57b8c72c93\") " Jun 11 15:09:29.919929 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:29.919918 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6jf8p\" (UniqueName: \"kubernetes.io/projected/ec3b2633-e52f-4799-b613-dd57b8c72c93-kube-api-access-6jf8p\") pod \"ec3b2633-e52f-4799-b613-dd57b8c72c93\" (UID: \"ec3b2633-e52f-4799-b613-dd57b8c72c93\") " Jun 11 15:09:29.920290 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:29.920263 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec3b2633-e52f-4799-b613-dd57b8c72c93-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ec3b2633-e52f-4799-b613-dd57b8c72c93" (UID: "ec3b2633-e52f-4799-b613-dd57b8c72c93"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 15:09:29.921917 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:29.921893 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec3b2633-e52f-4799-b613-dd57b8c72c93-kube-api-access-6jf8p" (OuterVolumeSpecName: "kube-api-access-6jf8p") pod "ec3b2633-e52f-4799-b613-dd57b8c72c93" (UID: "ec3b2633-e52f-4799-b613-dd57b8c72c93"). InnerVolumeSpecName "kube-api-access-6jf8p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 15:09:30.021176 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:30.021141 2569 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ec3b2633-e52f-4799-b613-dd57b8c72c93-extensions-socket-volume\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\"" Jun 11 15:09:30.021176 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:30.021169 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6jf8p\" (UniqueName: \"kubernetes.io/projected/ec3b2633-e52f-4799-b613-dd57b8c72c93-kube-api-access-6jf8p\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\"" Jun 11 15:09:30.285703 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:30.285667 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c9b86df-rfmzk" event={"ID":"230f05d8-e5d4-4d8c-95f0-0cfdd84aa045","Type":"ContainerStarted","Data":"308926fae8cbe08ae188c8a2f47b9ed867033801351d222732f8588dada748cd"} Jun 11 15:09:30.285972 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:30.285727 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c9b86df-rfmzk" event={"ID":"230f05d8-e5d4-4d8c-95f0-0cfdd84aa045","Type":"ContainerStarted","Data":"22cbfff8bbd1899da453f51d8bdf2b29dc8dc62ef4946a642c0ec7e1e15ef83b"} Jun 11 15:09:30.287195 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:30.287174 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9zl8f" event={"ID":"876abaf9-19fd-44d2-ad55-713707bf2df8","Type":"ContainerStarted","Data":"78465664b0aa54fce76f050186a19cb540401d153420acd646c18f1e41d3879f"} Jun 11 15:09:30.287910 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:09:30.287886 2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7jj5x\" is forbidden: User \"system:node:ip-10-0-128-147.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-147.ec2.internal' and this object" podUID="ec3b2633-e52f-4799-b613-dd57b8c72c93" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7jj5x" Jun 11 15:09:30.288406 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:30.288382 2569 generic.go:356] "Generic (PLEG): container finished" podID="ec3b2633-e52f-4799-b613-dd57b8c72c93" containerID="837b01d266148653da5483318ecb1dab66f3be719a15d586b610cc576fddf037" exitCode=0 Jun 11 15:09:30.288495 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:30.288418 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7jj5x" Jun 11 15:09:30.288495 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:30.288426 2569 scope.go:117] "RemoveContainer" containerID="837b01d266148653da5483318ecb1dab66f3be719a15d586b610cc576fddf037" Jun 11 15:09:30.297520 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:30.297501 2569 scope.go:117] "RemoveContainer" containerID="837b01d266148653da5483318ecb1dab66f3be719a15d586b610cc576fddf037" Jun 11 15:09:30.297784 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:09:30.297746 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"837b01d266148653da5483318ecb1dab66f3be719a15d586b610cc576fddf037\": container with ID starting with 837b01d266148653da5483318ecb1dab66f3be719a15d586b610cc576fddf037 not found: ID does not exist" containerID="837b01d266148653da5483318ecb1dab66f3be719a15d586b610cc576fddf037" Jun 11 15:09:30.297857 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:30.297792 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"837b01d266148653da5483318ecb1dab66f3be719a15d586b610cc576fddf037"} err="failed to get container status \"837b01d266148653da5483318ecb1dab66f3be719a15d586b610cc576fddf037\": rpc error: code = NotFound desc = could not find container \"837b01d266148653da5483318ecb1dab66f3be719a15d586b610cc576fddf037\": container with ID starting with 837b01d266148653da5483318ecb1dab66f3be719a15d586b610cc576fddf037 not found: ID does not exist" Jun 11 15:09:30.311829 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:30.311786 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7c9b86df-rfmzk" podStartSLOduration=5.311749819 podStartE2EDuration="5.311749819s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:09:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:09:30.310529945 +0000 UTC m=+405.259154206" watchObservedRunningTime="2026-06-11 15:09:30.311749819 +0000 UTC m=+405.260374148" Jun 11 15:09:30.331023 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:30.330975 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9zl8f" podStartSLOduration=1.986975844 podStartE2EDuration="25.330961332s" totalImagesPullingTime="23.343985488s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:09:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:09:30.328912161 +0000 UTC m=+405.277536433" watchObservedRunningTime="2026-06-11 15:09:30.330961332 +0000 UTC m=+405.279585593" Jun 11 15:09:30.331177 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:09:30.331150 2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7jj5x\" is forbidden: User \"system:node:ip-10-0-128-147.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-147.ec2.internal' and this object" podUID="ec3b2633-e52f-4799-b613-dd57b8c72c93" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7jj5x" Jun 11 15:09:31.479259 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:31.479222 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec3b2633-e52f-4799-b613-dd57b8c72c93" path="/var/lib/kubelet/pods/ec3b2633-e52f-4799-b613-dd57b8c72c93/volumes" Jun 11 15:09:35.450462 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:35.450426 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7c9b86df-rfmzk" Jun 11 15:09:35.450866 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:35.450503 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7c9b86df-rfmzk" Jun 11 15:09:35.455177 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:35.455158 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7c9b86df-rfmzk" Jun 11 15:09:36.319160 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:36.319123 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7c9b86df-rfmzk" Jun 11 15:09:36.405196 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:36.405165 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7ffb94b689-nfjxt"] Jun 11 15:09:51.641506 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:51.641471 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-dvgt8"] Jun 11 15:09:51.710715 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:51.710682 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-dvgt8"] Jun 11 15:09:51.710878 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:51.710799 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-dvgt8" Jun 11 15:09:51.713309 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:51.713279 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 11 15:09:51.757793 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:51.756179 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-dvgt8"] Jun 11 15:09:51.809050 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:51.809006 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjwkn\" (UniqueName: \"kubernetes.io/projected/51ac7e9e-26d0-43d6-9334-fece17a37c04-kube-api-access-fjwkn\") pod \"limitador-limitador-64c94fd64f-dvgt8\" (UID: \"51ac7e9e-26d0-43d6-9334-fece17a37c04\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-dvgt8" Jun 11 15:09:51.809202 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:51.809145 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/51ac7e9e-26d0-43d6-9334-fece17a37c04-config-file\") pod \"limitador-limitador-64c94fd64f-dvgt8\" (UID: \"51ac7e9e-26d0-43d6-9334-fece17a37c04\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-dvgt8" Jun 11 15:09:51.910432 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:51.910335 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjwkn\" (UniqueName: \"kubernetes.io/projected/51ac7e9e-26d0-43d6-9334-fece17a37c04-kube-api-access-fjwkn\") pod \"limitador-limitador-64c94fd64f-dvgt8\" (UID: \"51ac7e9e-26d0-43d6-9334-fece17a37c04\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-dvgt8" Jun 11 15:09:51.910598 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:51.910447 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/51ac7e9e-26d0-43d6-9334-fece17a37c04-config-file\") pod \"limitador-limitador-64c94fd64f-dvgt8\" (UID: \"51ac7e9e-26d0-43d6-9334-fece17a37c04\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-dvgt8" Jun 11 15:09:51.911053 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:51.911032 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/51ac7e9e-26d0-43d6-9334-fece17a37c04-config-file\") pod \"limitador-limitador-64c94fd64f-dvgt8\" (UID: \"51ac7e9e-26d0-43d6-9334-fece17a37c04\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-dvgt8" Jun 11 15:09:51.919882 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:51.919863 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjwkn\" (UniqueName: \"kubernetes.io/projected/51ac7e9e-26d0-43d6-9334-fece17a37c04-kube-api-access-fjwkn\") pod \"limitador-limitador-64c94fd64f-dvgt8\" (UID: \"51ac7e9e-26d0-43d6-9334-fece17a37c04\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-dvgt8" Jun 11 15:09:52.022968 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:52.022934 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-dvgt8" Jun 11 15:09:52.162979 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:52.162956 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-dvgt8"] Jun 11 15:09:52.165643 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:09:52.165616 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51ac7e9e_26d0_43d6_9334_fece17a37c04.slice/crio-4309fd3db7f975e0a6a745bed79d7171f337e7616cb4609934a520de7a6b6252 WatchSource:0}: Error finding container 4309fd3db7f975e0a6a745bed79d7171f337e7616cb4609934a520de7a6b6252: Status 404 returned error can't find the container with id 4309fd3db7f975e0a6a745bed79d7171f337e7616cb4609934a520de7a6b6252 Jun 11 15:09:52.387730 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:52.387696 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-dvgt8" event={"ID":"51ac7e9e-26d0-43d6-9334-fece17a37c04","Type":"ContainerStarted","Data":"4309fd3db7f975e0a6a745bed79d7171f337e7616cb4609934a520de7a6b6252"} Jun 11 15:09:52.517924 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:52.517896 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-6rvd9"] Jun 11 15:09:52.522646 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:52.522630 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-6rvd9" Jun 11 15:09:52.525308 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:52.525288 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-7fpfr\"" Jun 11 15:09:52.531491 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:52.531470 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-6rvd9"] Jun 11 15:09:52.615593 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:52.615564 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqn8l\" (UniqueName: \"kubernetes.io/projected/453d49d0-27b2-466d-9f2b-9790407ef55e-kube-api-access-cqn8l\") pod \"authorino-58cd955675-6rvd9\" (UID: \"453d49d0-27b2-466d-9f2b-9790407ef55e\") " pod="kuadrant-system/authorino-58cd955675-6rvd9" Jun 11 15:09:52.717406 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:52.717045 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqn8l\" (UniqueName: \"kubernetes.io/projected/453d49d0-27b2-466d-9f2b-9790407ef55e-kube-api-access-cqn8l\") pod \"authorino-58cd955675-6rvd9\" (UID: \"453d49d0-27b2-466d-9f2b-9790407ef55e\") " pod="kuadrant-system/authorino-58cd955675-6rvd9" Jun 11 15:09:52.731256 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:52.730956 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqn8l\" (UniqueName: \"kubernetes.io/projected/453d49d0-27b2-466d-9f2b-9790407ef55e-kube-api-access-cqn8l\") pod \"authorino-58cd955675-6rvd9\" (UID: \"453d49d0-27b2-466d-9f2b-9790407ef55e\") " pod="kuadrant-system/authorino-58cd955675-6rvd9" Jun 11 15:09:52.764425 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:52.763870 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-gtscv"] Jun 11 15:09:52.767845 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:52.767823 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-gtscv" Jun 11 15:09:52.774109 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:52.774021 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-gtscv"] Jun 11 15:09:52.817813 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:52.817767 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4788\" (UniqueName: \"kubernetes.io/projected/5580dae3-7157-4c12-a781-6bc9a61fc357-kube-api-access-n4788\") pod \"authorino-75d556bd77-gtscv\" (UID: \"5580dae3-7157-4c12-a781-6bc9a61fc357\") " pod="kuadrant-system/authorino-75d556bd77-gtscv" Jun 11 15:09:52.832854 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:52.832822 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-6rvd9" Jun 11 15:09:52.920652 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:52.920513 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4788\" (UniqueName: \"kubernetes.io/projected/5580dae3-7157-4c12-a781-6bc9a61fc357-kube-api-access-n4788\") pod \"authorino-75d556bd77-gtscv\" (UID: \"5580dae3-7157-4c12-a781-6bc9a61fc357\") " pod="kuadrant-system/authorino-75d556bd77-gtscv" Jun 11 15:09:52.940978 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:52.940917 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4788\" (UniqueName: \"kubernetes.io/projected/5580dae3-7157-4c12-a781-6bc9a61fc357-kube-api-access-n4788\") pod \"authorino-75d556bd77-gtscv\" (UID: \"5580dae3-7157-4c12-a781-6bc9a61fc357\") " pod="kuadrant-system/authorino-75d556bd77-gtscv" Jun 11 15:09:53.012289 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:53.012260 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-6rvd9"] Jun 11 15:09:53.016664 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:09:53.016629 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod453d49d0_27b2_466d_9f2b_9790407ef55e.slice/crio-1fc5d84982e3b1bb75bcd74ea8d62a526a6eef80447ab96cb4e1aecf81991b21 WatchSource:0}: Error finding container 1fc5d84982e3b1bb75bcd74ea8d62a526a6eef80447ab96cb4e1aecf81991b21: Status 404 returned error can't find the container with id 1fc5d84982e3b1bb75bcd74ea8d62a526a6eef80447ab96cb4e1aecf81991b21 Jun 11 15:09:53.085173 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:53.085108 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-gtscv" Jun 11 15:09:53.259333 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:53.259298 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-gtscv"] Jun 11 15:09:53.260646 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:09:53.260615 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5580dae3_7157_4c12_a781_6bc9a61fc357.slice/crio-91aff231163044874e4ad8121c646fe373a043c58760662ed205a53a5c6962de WatchSource:0}: Error finding container 91aff231163044874e4ad8121c646fe373a043c58760662ed205a53a5c6962de: Status 404 returned error can't find the container with id 91aff231163044874e4ad8121c646fe373a043c58760662ed205a53a5c6962de Jun 11 15:09:53.395276 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:53.395192 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-gtscv" event={"ID":"5580dae3-7157-4c12-a781-6bc9a61fc357","Type":"ContainerStarted","Data":"91aff231163044874e4ad8121c646fe373a043c58760662ed205a53a5c6962de"} Jun 11 15:09:53.396395 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:53.396373 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-6rvd9" event={"ID":"453d49d0-27b2-466d-9f2b-9790407ef55e","Type":"ContainerStarted","Data":"1fc5d84982e3b1bb75bcd74ea8d62a526a6eef80447ab96cb4e1aecf81991b21"} Jun 11 15:09:57.417262 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:57.417219 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-gtscv" event={"ID":"5580dae3-7157-4c12-a781-6bc9a61fc357","Type":"ContainerStarted","Data":"e9f104a877e7945eb38c19a8e28c8309a1c1a202d5b775b2dc8bb1e45368a277"} Jun 11 15:09:57.418675 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:57.418646 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-6rvd9" event={"ID":"453d49d0-27b2-466d-9f2b-9790407ef55e","Type":"ContainerStarted","Data":"e015310cdb3ded1ede6664636074bf4a78590881a439cb6f6ff3438217f578ea"} Jun 11 15:09:57.420178 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:57.420154 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-dvgt8" event={"ID":"51ac7e9e-26d0-43d6-9334-fece17a37c04","Type":"ContainerStarted","Data":"5ac697387833d6d1b0ee5231568e324b3183ac403d3297ed5560e6ff2bc88435"} Jun 11 15:09:57.420286 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:57.420249 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-dvgt8" Jun 11 15:09:57.443350 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:57.443307 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-gtscv" podStartSLOduration=1.498889359 podStartE2EDuration="5.443293445s" totalImagesPullingTime="3.944404086s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:09:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:09:57.442345179 +0000 UTC m=+432.390969442" watchObservedRunningTime="2026-06-11 15:09:57.443293445 +0000 UTC m=+432.391917705" Jun 11 15:09:57.477347 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:57.477291 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-6rvd9" podStartSLOduration=1.296037065 podStartE2EDuration="5.47727101s" totalImagesPullingTime="4.181233945s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:09:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:09:57.474585633 +0000 UTC m=+432.423209908" watchObservedRunningTime="2026-06-11 15:09:57.47727101 +0000 UTC m=+432.425895274" Jun 11 15:09:57.531689 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:57.531621 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-6rvd9"] Jun 11 15:09:59.430660 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:59.430622 2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-6rvd9" podUID="453d49d0-27b2-466d-9f2b-9790407ef55e" containerName="authorino" containerID="cri-o://e015310cdb3ded1ede6664636074bf4a78590881a439cb6f6ff3438217f578ea" gracePeriod=30 Jun 11 15:09:59.458433 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:59.458383 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-dvgt8" podStartSLOduration=3.617268472 podStartE2EDuration="8.458367799s" totalImagesPullingTime="4.841099327s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:09:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:09:57.541451714 +0000 UTC m=+432.490075975" watchObservedRunningTime="2026-06-11 15:09:59.458367799 +0000 UTC m=+434.406992061" Jun 11 15:09:59.685183 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:59.685122 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-6rvd9" Jun 11 15:09:59.790001 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:59.789972 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cqn8l\" (UniqueName: \"kubernetes.io/projected/453d49d0-27b2-466d-9f2b-9790407ef55e-kube-api-access-cqn8l\") pod \"453d49d0-27b2-466d-9f2b-9790407ef55e\" (UID: \"453d49d0-27b2-466d-9f2b-9790407ef55e\") " Jun 11 15:09:59.791955 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:59.791924 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/453d49d0-27b2-466d-9f2b-9790407ef55e-kube-api-access-cqn8l" (OuterVolumeSpecName: "kube-api-access-cqn8l") pod "453d49d0-27b2-466d-9f2b-9790407ef55e" (UID: "453d49d0-27b2-466d-9f2b-9790407ef55e"). InnerVolumeSpecName "kube-api-access-cqn8l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 15:09:59.890939 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:09:59.890903 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cqn8l\" (UniqueName: \"kubernetes.io/projected/453d49d0-27b2-466d-9f2b-9790407ef55e-kube-api-access-cqn8l\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\"" Jun 11 15:10:00.437218 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:10:00.437181 2569 generic.go:356] "Generic (PLEG): container finished" podID="453d49d0-27b2-466d-9f2b-9790407ef55e" containerID="e015310cdb3ded1ede6664636074bf4a78590881a439cb6f6ff3438217f578ea" exitCode=0 Jun 11 15:10:00.437218 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:10:00.437222 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-6rvd9" Jun 11 15:10:00.437701 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:10:00.437257 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-6rvd9" event={"ID":"453d49d0-27b2-466d-9f2b-9790407ef55e","Type":"ContainerDied","Data":"e015310cdb3ded1ede6664636074bf4a78590881a439cb6f6ff3438217f578ea"} Jun 11 15:10:00.437701 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:10:00.437297 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-6rvd9" event={"ID":"453d49d0-27b2-466d-9f2b-9790407ef55e","Type":"ContainerDied","Data":"1fc5d84982e3b1bb75bcd74ea8d62a526a6eef80447ab96cb4e1aecf81991b21"} Jun 11 15:10:00.437701 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:10:00.437314 2569 scope.go:117] "RemoveContainer" containerID="e015310cdb3ded1ede6664636074bf4a78590881a439cb6f6ff3438217f578ea" Jun 11 15:10:00.446746 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:10:00.446728 2569 scope.go:117] "RemoveContainer" containerID="e015310cdb3ded1ede6664636074bf4a78590881a439cb6f6ff3438217f578ea" Jun 11 15:10:00.447018 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:10:00.446997 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e015310cdb3ded1ede6664636074bf4a78590881a439cb6f6ff3438217f578ea\": container with ID starting with e015310cdb3ded1ede6664636074bf4a78590881a439cb6f6ff3438217f578ea not found: ID does not exist" containerID="e015310cdb3ded1ede6664636074bf4a78590881a439cb6f6ff3438217f578ea" Jun 11 15:10:00.447098 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:10:00.447024 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e015310cdb3ded1ede6664636074bf4a78590881a439cb6f6ff3438217f578ea"} err="failed to get container status \"e015310cdb3ded1ede6664636074bf4a78590881a439cb6f6ff3438217f578ea\": rpc error: code = NotFound desc = could not find container \"e015310cdb3ded1ede6664636074bf4a78590881a439cb6f6ff3438217f578ea\": container with ID starting with e015310cdb3ded1ede6664636074bf4a78590881a439cb6f6ff3438217f578ea not found: ID does not exist" Jun 11 15:10:00.464402 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:10:00.464376 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-6rvd9"] Jun 11 15:10:00.479834 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:10:00.479810 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-6rvd9"] Jun 11 15:10:01.425136 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:10:01.425096 2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7ffb94b689-nfjxt" podUID="2501788c-0d56-425b-8c43-917ce4f28953" containerName="console" containerID="cri-o://ebbdf913cc7e463d6075c17c49394e77118ce17e6ae826c2f8e94efcccda2b3e" gracePeriod=15 Jun 11 15:10:01.479058 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:10:01.479034 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="453d49d0-27b2-466d-9f2b-9790407ef55e" path="/var/lib/kubelet/pods/453d49d0-27b2-466d-9f2b-9790407ef55e/volumes" Jun 11 15:10:01.683696 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:10:01.683637 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7ffb94b689-nfjxt" Jun 11 15:10:01.808942 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:10:01.808899 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2501788c-0d56-425b-8c43-917ce4f28953-trusted-ca-bundle\") pod \"2501788c-0d56-425b-8c43-917ce4f28953\" (UID: \"2501788c-0d56-425b-8c43-917ce4f28953\") " Jun 11 15:10:01.809111 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:10:01.808995 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2501788c-0d56-425b-8c43-917ce4f28953-console-oauth-config\") pod \"2501788c-0d56-425b-8c43-917ce4f28953\" (UID: \"2501788c-0d56-425b-8c43-917ce4f28953\") " Jun 11 15:10:01.809111 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:10:01.809019 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j8gvg\" (UniqueName: \"kubernetes.io/projected/2501788c-0d56-425b-8c43-917ce4f28953-kube-api-access-j8gvg\") pod \"2501788c-0d56-425b-8c43-917ce4f28953\" (UID: \"2501788c-0d56-425b-8c43-917ce4f28953\") " Jun 11 15:10:01.809111 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:10:01.809035 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2501788c-0d56-425b-8c43-917ce4f28953-oauth-serving-cert\") pod \"2501788c-0d56-425b-8c43-917ce4f28953\" (UID: \"2501788c-0d56-425b-8c43-917ce4f28953\") " Jun 11 15:10:01.809111 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:10:01.809054 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2501788c-0d56-425b-8c43-917ce4f28953-console-serving-cert\") pod \"2501788c-0d56-425b-8c43-917ce4f28953\" (UID: \"2501788c-0d56-425b-8c43-917ce4f28953\") " Jun 11 15:10:01.809111 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:10:01.809072 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2501788c-0d56-425b-8c43-917ce4f28953-console-config\") pod \"2501788c-0d56-425b-8c43-917ce4f28953\" (UID: \"2501788c-0d56-425b-8c43-917ce4f28953\") " Jun 11 15:10:01.809111 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:10:01.809092 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2501788c-0d56-425b-8c43-917ce4f28953-service-ca\") pod \"2501788c-0d56-425b-8c43-917ce4f28953\" (UID: \"2501788c-0d56-425b-8c43-917ce4f28953\") " Jun 11 15:10:01.809458 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:10:01.809329 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2501788c-0d56-425b-8c43-917ce4f28953-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "2501788c-0d56-425b-8c43-917ce4f28953" (UID: "2501788c-0d56-425b-8c43-917ce4f28953"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 15:10:01.809537 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:10:01.809510 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2501788c-0d56-425b-8c43-917ce4f28953-console-config" (OuterVolumeSpecName: "console-config") pod "2501788c-0d56-425b-8c43-917ce4f28953" (UID: "2501788c-0d56-425b-8c43-917ce4f28953"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 15:10:01.809589 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:10:01.809533 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2501788c-0d56-425b-8c43-917ce4f28953-service-ca" (OuterVolumeSpecName: "service-ca") pod "2501788c-0d56-425b-8c43-917ce4f28953" (UID: "2501788c-0d56-425b-8c43-917ce4f28953"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 15:10:01.809895 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:10:01.809865 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2501788c-0d56-425b-8c43-917ce4f28953-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2501788c-0d56-425b-8c43-917ce4f28953" (UID: "2501788c-0d56-425b-8c43-917ce4f28953"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 15:10:01.811194 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:10:01.811165 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2501788c-0d56-425b-8c43-917ce4f28953-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2501788c-0d56-425b-8c43-917ce4f28953" (UID: "2501788c-0d56-425b-8c43-917ce4f28953"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:10:01.811278 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:10:01.811201 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2501788c-0d56-425b-8c43-917ce4f28953-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2501788c-0d56-425b-8c43-917ce4f28953" (UID: "2501788c-0d56-425b-8c43-917ce4f28953"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:10:01.811278 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:10:01.811225 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2501788c-0d56-425b-8c43-917ce4f28953-kube-api-access-j8gvg" (OuterVolumeSpecName: "kube-api-access-j8gvg") pod "2501788c-0d56-425b-8c43-917ce4f28953" (UID: "2501788c-0d56-425b-8c43-917ce4f28953"). InnerVolumeSpecName "kube-api-access-j8gvg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 15:10:01.910700 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:10:01.910664 2569 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2501788c-0d56-425b-8c43-917ce4f28953-console-oauth-config\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\"" Jun 11 15:10:01.910700 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:10:01.910694 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j8gvg\" (UniqueName: \"kubernetes.io/projected/2501788c-0d56-425b-8c43-917ce4f28953-kube-api-access-j8gvg\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\"" Jun 11 15:10:01.910700 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:10:01.910704 2569 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2501788c-0d56-425b-8c43-917ce4f28953-oauth-serving-cert\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\"" Jun 11 15:10:01.910951 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:10:01.910713 2569 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2501788c-0d56-425b-8c43-917ce4f28953-console-serving-cert\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\"" Jun 11 15:10:01.910951 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:10:01.910722 2569 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2501788c-0d56-425b-8c43-917ce4f28953-console-config\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\"" Jun 11 15:10:01.910951 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:10:01.910731 2569 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2501788c-0d56-425b-8c43-917ce4f28953-service-ca\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\"" Jun 11 15:10:01.910951 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:10:01.910738 2569 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2501788c-0d56-425b-8c43-917ce4f28953-trusted-ca-bundle\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\"" Jun 11 15:10:02.449430 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:10:02.449399 2569 generic.go:356] "Generic (PLEG): container finished" podID="2501788c-0d56-425b-8c43-917ce4f28953" containerID="ebbdf913cc7e463d6075c17c49394e77118ce17e6ae826c2f8e94efcccda2b3e" exitCode=0 Jun 11 15:10:02.449613 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:10:02.449447 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7ffb94b689-nfjxt" Jun 11 15:10:02.449613 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:10:02.449496 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7ffb94b689-nfjxt" event={"ID":"2501788c-0d56-425b-8c43-917ce4f28953","Type":"ContainerDied","Data":"ebbdf913cc7e463d6075c17c49394e77118ce17e6ae826c2f8e94efcccda2b3e"} Jun 11 15:10:02.449613 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:10:02.449568 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7ffb94b689-nfjxt" event={"ID":"2501788c-0d56-425b-8c43-917ce4f28953","Type":"ContainerDied","Data":"ed611353055c8852eae4b5c7c0e37624bd31b18b11b8a181447c67573ca4136d"} Jun 11 15:10:02.449613 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:10:02.449589 2569 scope.go:117] "RemoveContainer" containerID="ebbdf913cc7e463d6075c17c49394e77118ce17e6ae826c2f8e94efcccda2b3e" Jun 11 15:10:02.458918 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:10:02.458848 2569 scope.go:117] "RemoveContainer" containerID="ebbdf913cc7e463d6075c17c49394e77118ce17e6ae826c2f8e94efcccda2b3e" Jun 11 15:10:02.460546 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:10:02.460527 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ebbdf913cc7e463d6075c17c49394e77118ce17e6ae826c2f8e94efcccda2b3e\": container with ID starting with ebbdf913cc7e463d6075c17c49394e77118ce17e6ae826c2f8e94efcccda2b3e not found: ID does not exist" containerID="ebbdf913cc7e463d6075c17c49394e77118ce17e6ae826c2f8e94efcccda2b3e" Jun 11 15:10:02.460634 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:10:02.460554 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ebbdf913cc7e463d6075c17c49394e77118ce17e6ae826c2f8e94efcccda2b3e"} err="failed to get container status \"ebbdf913cc7e463d6075c17c49394e77118ce17e6ae826c2f8e94efcccda2b3e\": rpc error: code = NotFound desc = could not find container \"ebbdf913cc7e463d6075c17c49394e77118ce17e6ae826c2f8e94efcccda2b3e\": container with ID starting with ebbdf913cc7e463d6075c17c49394e77118ce17e6ae826c2f8e94efcccda2b3e not found: ID does not exist" Jun 11 15:10:02.481055 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:10:02.481031 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7ffb94b689-nfjxt"] Jun 11 15:10:02.485717 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:10:02.485697 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7ffb94b689-nfjxt"] Jun 11 15:10:03.479265 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:10:03.479233 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2501788c-0d56-425b-8c43-917ce4f28953" path="/var/lib/kubelet/pods/2501788c-0d56-425b-8c43-917ce4f28953/volumes" Jun 11 15:10:06.661685 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:10:06.661613 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-dvgt8"] Jun 11 15:10:06.662050 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:10:06.661820 2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-dvgt8" podUID="51ac7e9e-26d0-43d6-9334-fece17a37c04" containerName="limitador" containerID="cri-o://5ac697387833d6d1b0ee5231568e324b3183ac403d3297ed5560e6ff2bc88435" gracePeriod=30 Jun 11 15:10:06.662460 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:10:06.662423 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-dvgt8" Jun 11 15:10:07.473041 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:10:07.473011 2569 generic.go:356] "Generic (PLEG): container finished" podID="51ac7e9e-26d0-43d6-9334-fece17a37c04" containerID="5ac697387833d6d1b0ee5231568e324b3183ac403d3297ed5560e6ff2bc88435" exitCode=0 Jun 11 15:10:07.473210 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:10:07.473086 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-dvgt8" event={"ID":"51ac7e9e-26d0-43d6-9334-fece17a37c04","Type":"ContainerDied","Data":"5ac697387833d6d1b0ee5231568e324b3183ac403d3297ed5560e6ff2bc88435"} Jun 11 15:10:07.605327 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:10:07.605302 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-dvgt8" Jun 11 15:10:07.763668 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:10:07.763639 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fjwkn\" (UniqueName: \"kubernetes.io/projected/51ac7e9e-26d0-43d6-9334-fece17a37c04-kube-api-access-fjwkn\") pod \"51ac7e9e-26d0-43d6-9334-fece17a37c04\" (UID: \"51ac7e9e-26d0-43d6-9334-fece17a37c04\") " Jun 11 15:10:07.764047 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:10:07.763702 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/51ac7e9e-26d0-43d6-9334-fece17a37c04-config-file\") pod \"51ac7e9e-26d0-43d6-9334-fece17a37c04\" (UID: \"51ac7e9e-26d0-43d6-9334-fece17a37c04\") " Jun 11 15:10:07.764115 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:10:07.764088 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51ac7e9e-26d0-43d6-9334-fece17a37c04-config-file" (OuterVolumeSpecName: "config-file") pod "51ac7e9e-26d0-43d6-9334-fece17a37c04" (UID: "51ac7e9e-26d0-43d6-9334-fece17a37c04"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 15:10:07.765900 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:10:07.765873 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51ac7e9e-26d0-43d6-9334-fece17a37c04-kube-api-access-fjwkn" (OuterVolumeSpecName: "kube-api-access-fjwkn") pod "51ac7e9e-26d0-43d6-9334-fece17a37c04" (UID: "51ac7e9e-26d0-43d6-9334-fece17a37c04"). InnerVolumeSpecName "kube-api-access-fjwkn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 15:10:07.864300 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:10:07.864274 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fjwkn\" (UniqueName: \"kubernetes.io/projected/51ac7e9e-26d0-43d6-9334-fece17a37c04-kube-api-access-fjwkn\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\"" Jun 11 15:10:07.864300 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:10:07.864298 2569 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/51ac7e9e-26d0-43d6-9334-fece17a37c04-config-file\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\"" Jun 11 15:10:08.478996 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:10:08.478966 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-dvgt8" Jun 11 15:10:08.479158 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:10:08.478972 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-dvgt8" event={"ID":"51ac7e9e-26d0-43d6-9334-fece17a37c04","Type":"ContainerDied","Data":"4309fd3db7f975e0a6a745bed79d7171f337e7616cb4609934a520de7a6b6252"} Jun 11 15:10:08.479158 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:10:08.479097 2569 scope.go:117] "RemoveContainer" containerID="5ac697387833d6d1b0ee5231568e324b3183ac403d3297ed5560e6ff2bc88435" Jun 11 15:10:08.510730 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:10:08.510706 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-dvgt8"] Jun 11 15:10:08.523106 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:10:08.523085 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-dvgt8"] Jun 11 15:10:09.479692 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:10:09.479651 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="51ac7e9e-26d0-43d6-9334-fece17a37c04" path="/var/lib/kubelet/pods/51ac7e9e-26d0-43d6-9334-fece17a37c04/volumes" Jun 11 15:10:12.805735 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:10:12.805702 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-ckj4z"] Jun 11 15:10:12.806265 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:10:12.806245 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51ac7e9e-26d0-43d6-9334-fece17a37c04" containerName="limitador" Jun 11 15:10:12.806342 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:10:12.806267 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="51ac7e9e-26d0-43d6-9334-fece17a37c04" containerName="limitador" Jun 11 15:10:12.806342 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:10:12.806287 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="453d49d0-27b2-466d-9f2b-9790407ef55e" containerName="authorino" Jun 11 15:10:12.806342 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:10:12.806295 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="453d49d0-27b2-466d-9f2b-9790407ef55e" containerName="authorino" Jun 11 15:10:12.806342 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:10:12.806321 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2501788c-0d56-425b-8c43-917ce4f28953" containerName="console" Jun 11 15:10:12.806342 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:10:12.806329 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="2501788c-0d56-425b-8c43-917ce4f28953" containerName="console" Jun 11 15:10:12.806575 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:10:12.806416 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="51ac7e9e-26d0-43d6-9334-fece17a37c04" containerName="limitador" Jun 11 15:10:12.806575 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:10:12.806428 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="453d49d0-27b2-466d-9f2b-9790407ef55e" containerName="authorino" Jun 11 15:10:12.806575 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:10:12.806440 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="2501788c-0d56-425b-8c43-917ce4f28953" containerName="console" Jun 11 15:10:12.810750 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:10:12.810731 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-ckj4z" Jun 11 15:10:12.814476 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:10:12.814455 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jun 11 15:10:12.821661 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:10:12.821642 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-ckj4z"] Jun 11 15:10:12.909179 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:10:12.909149 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/3cc0ec60-4c6b-4457-8d8f-71c19a237e80-data\") pod \"postgres-69fb4594cf-ckj4z\" (UID: \"3cc0ec60-4c6b-4457-8d8f-71c19a237e80\") " pod="opendatahub/postgres-69fb4594cf-ckj4z" Jun 11 15:10:12.909318 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:10:12.909207 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5g5vp\" (UniqueName: \"kubernetes.io/projected/3cc0ec60-4c6b-4457-8d8f-71c19a237e80-kube-api-access-5g5vp\") pod \"postgres-69fb4594cf-ckj4z\" (UID: \"3cc0ec60-4c6b-4457-8d8f-71c19a237e80\") " pod="opendatahub/postgres-69fb4594cf-ckj4z" Jun 11 15:10:13.010019 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:10:13.009981 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5g5vp\" (UniqueName: \"kubernetes.io/projected/3cc0ec60-4c6b-4457-8d8f-71c19a237e80-kube-api-access-5g5vp\") pod \"postgres-69fb4594cf-ckj4z\" (UID: \"3cc0ec60-4c6b-4457-8d8f-71c19a237e80\") " pod="opendatahub/postgres-69fb4594cf-ckj4z" Jun 11 15:10:13.010167 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:10:13.010129 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/3cc0ec60-4c6b-4457-8d8f-71c19a237e80-data\") pod \"postgres-69fb4594cf-ckj4z\" (UID: \"3cc0ec60-4c6b-4457-8d8f-71c19a237e80\") " pod="opendatahub/postgres-69fb4594cf-ckj4z" Jun 11 15:10:13.010470 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:10:13.010455 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/3cc0ec60-4c6b-4457-8d8f-71c19a237e80-data\") pod \"postgres-69fb4594cf-ckj4z\" (UID: \"3cc0ec60-4c6b-4457-8d8f-71c19a237e80\") " pod="opendatahub/postgres-69fb4594cf-ckj4z" Jun 11 15:10:13.020251 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:10:13.020229 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5g5vp\" (UniqueName: \"kubernetes.io/projected/3cc0ec60-4c6b-4457-8d8f-71c19a237e80-kube-api-access-5g5vp\") pod \"postgres-69fb4594cf-ckj4z\" (UID: \"3cc0ec60-4c6b-4457-8d8f-71c19a237e80\") " pod="opendatahub/postgres-69fb4594cf-ckj4z" Jun 11 15:10:13.122447 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:10:13.122375 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-ckj4z" Jun 11 15:10:13.270135 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:10:13.270107 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-ckj4z"] Jun 11 15:10:13.271951 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:10:13.271914 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cc0ec60_4c6b_4457_8d8f_71c19a237e80.slice/crio-ec5031358ebb1d2b2cfdc13ea0d89585903e19683770e23addf325b09682f5e6 WatchSource:0}: Error finding container ec5031358ebb1d2b2cfdc13ea0d89585903e19683770e23addf325b09682f5e6: Status 404 returned error can't find the container with id ec5031358ebb1d2b2cfdc13ea0d89585903e19683770e23addf325b09682f5e6 Jun 11 15:10:13.506294 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:10:13.506219 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-ckj4z" event={"ID":"3cc0ec60-4c6b-4457-8d8f-71c19a237e80","Type":"ContainerStarted","Data":"ec5031358ebb1d2b2cfdc13ea0d89585903e19683770e23addf325b09682f5e6"} Jun 11 15:10:16.521309 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:10:16.521274 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-ckj4z" event={"ID":"3cc0ec60-4c6b-4457-8d8f-71c19a237e80","Type":"ContainerStarted","Data":"589081da9a411e9d2402c0517b21d1fa4b5bad5701ffa15c111bf8081b38cb2d"} Jun 11 15:10:16.521712 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:10:16.521398 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-ckj4z" Jun 11 15:10:16.543740 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:10:16.543680 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-ckj4z" podStartSLOduration=2.068461753 podStartE2EDuration="4.54366107s" totalImagesPullingTime="2.475199317s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:10:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:10:16.542002413 +0000 UTC m=+451.490626679" watchObservedRunningTime="2026-06-11 15:10:16.54366107 +0000 UTC m=+451.492285333" Jun 11 15:10:22.555245 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:10:22.555218 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-ckj4z" Jun 11 15:10:33.226835 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:10:33.226801 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-mbn9s"] Jun 11 15:10:33.235131 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:10:33.235109 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-mbn9s" Jun 11 15:10:33.238170 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:10:33.238145 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 11 15:10:33.238285 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:10:33.238267 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-l7br4\"" Jun 11 15:10:33.238727 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:10:33.238712 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 11 15:10:33.248995 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:10:33.248970 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-mbn9s"] Jun 11 15:10:33.291995 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:10:33.291972 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hk2nq\" (UniqueName: \"kubernetes.io/projected/02a31bdb-d161-4685-b338-43fe3d3ca398-kube-api-access-hk2nq\") pod \"keycloak-operator-d67dbbb48-mbn9s\" (UID: \"02a31bdb-d161-4685-b338-43fe3d3ca398\") " pod="keycloak-system/keycloak-operator-d67dbbb48-mbn9s" Jun 11 15:10:33.393116 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:10:33.393086 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hk2nq\" (UniqueName: \"kubernetes.io/projected/02a31bdb-d161-4685-b338-43fe3d3ca398-kube-api-access-hk2nq\") pod \"keycloak-operator-d67dbbb48-mbn9s\" (UID: \"02a31bdb-d161-4685-b338-43fe3d3ca398\") " pod="keycloak-system/keycloak-operator-d67dbbb48-mbn9s" Jun 11 15:10:33.403475 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:10:33.403439 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hk2nq\" (UniqueName: \"kubernetes.io/projected/02a31bdb-d161-4685-b338-43fe3d3ca398-kube-api-access-hk2nq\") pod \"keycloak-operator-d67dbbb48-mbn9s\" (UID: \"02a31bdb-d161-4685-b338-43fe3d3ca398\") " pod="keycloak-system/keycloak-operator-d67dbbb48-mbn9s" Jun 11 15:10:33.544840 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:10:33.544812 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-mbn9s" Jun 11 15:10:33.685853 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:10:33.685828 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-mbn9s"] Jun 11 15:10:33.688163 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:10:33.688136 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02a31bdb_d161_4685_b338_43fe3d3ca398.slice/crio-bdd69916c8a93ce3a3b0ea9c54a3242686730e4f4b5b13b40fd50381283ae7c7 WatchSource:0}: Error finding container bdd69916c8a93ce3a3b0ea9c54a3242686730e4f4b5b13b40fd50381283ae7c7: Status 404 returned error can't find the container with id bdd69916c8a93ce3a3b0ea9c54a3242686730e4f4b5b13b40fd50381283ae7c7 Jun 11 15:10:34.604796 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:10:34.604737 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-mbn9s" event={"ID":"02a31bdb-d161-4685-b338-43fe3d3ca398","Type":"ContainerStarted","Data":"bdd69916c8a93ce3a3b0ea9c54a3242686730e4f4b5b13b40fd50381283ae7c7"} Jun 11 15:10:40.642370 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:10:40.642326 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-mbn9s" event={"ID":"02a31bdb-d161-4685-b338-43fe3d3ca398","Type":"ContainerStarted","Data":"4fb67a83745dbcbc01c10d7ed66b7d2ee9fd4574e9b56d3254f694f6db1ec5d1"} Jun 11 15:11:20.716600 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:11:20.716548 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-d67dbbb48-mbn9s" podStartSLOduration=41.301030897 podStartE2EDuration="47.71652308s" totalImagesPullingTime="6.415492183s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:10:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:10:40.672196894 +0000 UTC m=+475.620821167" watchObservedRunningTime="2026-06-11 15:11:20.71652308 +0000 UTC m=+515.665147347" Jun 11 15:11:20.717095 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:11:20.716871 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-8pxlr"] Jun 11 15:11:20.723286 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:11:20.723265 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-8pxlr" Jun 11 15:11:20.727999 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:11:20.727974 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-8pxlr"] Jun 11 15:11:20.826127 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:11:20.826101 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfngx\" (UniqueName: \"kubernetes.io/projected/5c755d24-d02f-4cb9-913f-57beef80777d-kube-api-access-dfngx\") pod \"authorino-5d4b67c446-8pxlr\" (UID: \"5c755d24-d02f-4cb9-913f-57beef80777d\") " pod="kuadrant-system/authorino-5d4b67c446-8pxlr" Jun 11 15:11:20.926989 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:11:20.926959 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfngx\" (UniqueName: \"kubernetes.io/projected/5c755d24-d02f-4cb9-913f-57beef80777d-kube-api-access-dfngx\") pod \"authorino-5d4b67c446-8pxlr\" (UID: \"5c755d24-d02f-4cb9-913f-57beef80777d\") " pod="kuadrant-system/authorino-5d4b67c446-8pxlr" Jun 11 15:11:20.940299 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:11:20.940274 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfngx\" (UniqueName: \"kubernetes.io/projected/5c755d24-d02f-4cb9-913f-57beef80777d-kube-api-access-dfngx\") pod \"authorino-5d4b67c446-8pxlr\" (UID: \"5c755d24-d02f-4cb9-913f-57beef80777d\") " pod="kuadrant-system/authorino-5d4b67c446-8pxlr" Jun 11 15:11:20.969976 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:11:20.969912 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-8pxlr"] Jun 11 15:11:20.970156 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:11:20.970145 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-8pxlr" Jun 11 15:11:21.001221 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:11:21.001190 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-995f79b59-rz9nz"] Jun 11 15:11:21.006931 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:11:21.006899 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-995f79b59-rz9nz" Jun 11 15:11:21.015296 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:11:21.015268 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-995f79b59-rz9nz"] Jun 11 15:11:21.112580 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:11:21.112551 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-8pxlr"] Jun 11 15:11:21.114715 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:11:21.114687 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5c755d24_d02f_4cb9_913f_57beef80777d.slice/crio-e8bc2f1b658b08c66b4314e0f4ad6e7370a5b136d1e680647a4bd166f162292a WatchSource:0}: Error finding container e8bc2f1b658b08c66b4314e0f4ad6e7370a5b136d1e680647a4bd166f162292a: Status 404 returned error can't find the container with id e8bc2f1b658b08c66b4314e0f4ad6e7370a5b136d1e680647a4bd166f162292a Jun 11 15:11:21.129529 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:11:21.129508 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlq2t\" (UniqueName: \"kubernetes.io/projected/15dee882-334a-4793-bc7e-65ef22f137cc-kube-api-access-zlq2t\") pod \"authorino-995f79b59-rz9nz\" (UID: \"15dee882-334a-4793-bc7e-65ef22f137cc\") " pod="kuadrant-system/authorino-995f79b59-rz9nz" Jun 11 15:11:21.230887 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:11:21.230812 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zlq2t\" (UniqueName: \"kubernetes.io/projected/15dee882-334a-4793-bc7e-65ef22f137cc-kube-api-access-zlq2t\") pod \"authorino-995f79b59-rz9nz\" (UID: \"15dee882-334a-4793-bc7e-65ef22f137cc\") " pod="kuadrant-system/authorino-995f79b59-rz9nz" Jun 11 15:11:21.241495 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:11:21.241466 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlq2t\" (UniqueName: \"kubernetes.io/projected/15dee882-334a-4793-bc7e-65ef22f137cc-kube-api-access-zlq2t\") pod \"authorino-995f79b59-rz9nz\" (UID: \"15dee882-334a-4793-bc7e-65ef22f137cc\") " pod="kuadrant-system/authorino-995f79b59-rz9nz" Jun 11 15:11:21.318672 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:11:21.318644 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-995f79b59-rz9nz" Jun 11 15:11:21.351114 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:11:21.351070 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-995f79b59-rz9nz"] Jun 11 15:11:21.376810 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:11:21.376781 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6d7485b6c5-6x5qm"] Jun 11 15:11:21.379429 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:11:21.379408 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d7485b6c5-6x5qm" Jun 11 15:11:21.382021 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:11:21.382001 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 11 15:11:21.398512 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:11:21.398485 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6d7485b6c5-6x5qm"] Jun 11 15:11:21.459627 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:11:21.459479 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-995f79b59-rz9nz"] Jun 11 15:11:21.462121 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:11:21.462092 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod15dee882_334a_4793_bc7e_65ef22f137cc.slice/crio-3e2b9356001ecf1cbfc8a099687059985cb859fb6c6aeac5c60e5ebb3c911fce WatchSource:0}: Error finding container 3e2b9356001ecf1cbfc8a099687059985cb859fb6c6aeac5c60e5ebb3c911fce: Status 404 returned error can't find the container with id 3e2b9356001ecf1cbfc8a099687059985cb859fb6c6aeac5c60e5ebb3c911fce Jun 11 15:11:21.534064 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:11:21.534037 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whq2z\" (UniqueName: \"kubernetes.io/projected/0d770eb8-244a-4238-a4c4-b0ed9a3d7b84-kube-api-access-whq2z\") pod \"authorino-6d7485b6c5-6x5qm\" (UID: \"0d770eb8-244a-4238-a4c4-b0ed9a3d7b84\") " pod="kuadrant-system/authorino-6d7485b6c5-6x5qm" Jun 11 15:11:21.534221 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:11:21.534089 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0d770eb8-244a-4238-a4c4-b0ed9a3d7b84-tls-cert\") pod \"authorino-6d7485b6c5-6x5qm\" (UID: \"0d770eb8-244a-4238-a4c4-b0ed9a3d7b84\") " pod="kuadrant-system/authorino-6d7485b6c5-6x5qm" Jun 11 15:11:21.635073 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:11:21.635050 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whq2z\" (UniqueName: \"kubernetes.io/projected/0d770eb8-244a-4238-a4c4-b0ed9a3d7b84-kube-api-access-whq2z\") pod \"authorino-6d7485b6c5-6x5qm\" (UID: \"0d770eb8-244a-4238-a4c4-b0ed9a3d7b84\") " pod="kuadrant-system/authorino-6d7485b6c5-6x5qm" Jun 11 15:11:21.635166 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:11:21.635102 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0d770eb8-244a-4238-a4c4-b0ed9a3d7b84-tls-cert\") pod \"authorino-6d7485b6c5-6x5qm\" (UID: \"0d770eb8-244a-4238-a4c4-b0ed9a3d7b84\") " pod="kuadrant-system/authorino-6d7485b6c5-6x5qm" Jun 11 15:11:21.637471 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:11:21.637445 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0d770eb8-244a-4238-a4c4-b0ed9a3d7b84-tls-cert\") pod \"authorino-6d7485b6c5-6x5qm\" (UID: \"0d770eb8-244a-4238-a4c4-b0ed9a3d7b84\") " pod="kuadrant-system/authorino-6d7485b6c5-6x5qm" Jun 11 15:11:21.648245 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:11:21.648225 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-whq2z\" (UniqueName: \"kubernetes.io/projected/0d770eb8-244a-4238-a4c4-b0ed9a3d7b84-kube-api-access-whq2z\") pod \"authorino-6d7485b6c5-6x5qm\" (UID: \"0d770eb8-244a-4238-a4c4-b0ed9a3d7b84\") " pod="kuadrant-system/authorino-6d7485b6c5-6x5qm" Jun 11 15:11:21.688867 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:11:21.688834 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d7485b6c5-6x5qm" Jun 11 15:11:21.834653 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:11:21.834632 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6d7485b6c5-6x5qm"] Jun 11 15:11:21.837405 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:11:21.837379 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0d770eb8_244a_4238_a4c4_b0ed9a3d7b84.slice/crio-39c1aa54e742ea63b6a771df732ce962d4fcc6917f1bab4f2354dca510ba3594 WatchSource:0}: Error finding container 39c1aa54e742ea63b6a771df732ce962d4fcc6917f1bab4f2354dca510ba3594: Status 404 returned error can't find the container with id 39c1aa54e742ea63b6a771df732ce962d4fcc6917f1bab4f2354dca510ba3594 Jun 11 15:11:21.837807 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:11:21.837782 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-995f79b59-rz9nz" event={"ID":"15dee882-334a-4793-bc7e-65ef22f137cc","Type":"ContainerStarted","Data":"3e2b9356001ecf1cbfc8a099687059985cb859fb6c6aeac5c60e5ebb3c911fce"} Jun 11 15:11:21.839249 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:11:21.839226 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-8pxlr" event={"ID":"5c755d24-d02f-4cb9-913f-57beef80777d","Type":"ContainerStarted","Data":"9f95efad04177d05d5061c6b7511bf2fe5dcbb98be1f96a0be483f0abb0462dc"} Jun 11 15:11:21.839325 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:11:21.839259 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-8pxlr" event={"ID":"5c755d24-d02f-4cb9-913f-57beef80777d","Type":"ContainerStarted","Data":"e8bc2f1b658b08c66b4314e0f4ad6e7370a5b136d1e680647a4bd166f162292a"} Jun 11 15:11:21.839325 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:11:21.839318 2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-8pxlr" podUID="5c755d24-d02f-4cb9-913f-57beef80777d" containerName="authorino" containerID="cri-o://9f95efad04177d05d5061c6b7511bf2fe5dcbb98be1f96a0be483f0abb0462dc" gracePeriod=30 Jun 11 15:11:21.865888 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:11:21.865840 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-8pxlr" podStartSLOduration=1.4028036130000001 podStartE2EDuration="1.86582415s" totalImagesPullingTime="463.020537ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:11:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:11:21.864906842 +0000 UTC m=+516.813531103" watchObservedRunningTime="2026-06-11 15:11:21.86582415 +0000 UTC m=+516.814448455" Jun 11 15:11:22.087511 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:11:22.087490 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-8pxlr" Jun 11 15:11:22.239030 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:11:22.239000 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dfngx\" (UniqueName: \"kubernetes.io/projected/5c755d24-d02f-4cb9-913f-57beef80777d-kube-api-access-dfngx\") pod \"5c755d24-d02f-4cb9-913f-57beef80777d\" (UID: \"5c755d24-d02f-4cb9-913f-57beef80777d\") " Jun 11 15:11:22.241064 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:11:22.241036 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c755d24-d02f-4cb9-913f-57beef80777d-kube-api-access-dfngx" (OuterVolumeSpecName: "kube-api-access-dfngx") pod "5c755d24-d02f-4cb9-913f-57beef80777d" (UID: "5c755d24-d02f-4cb9-913f-57beef80777d"). InnerVolumeSpecName "kube-api-access-dfngx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 15:11:22.340690 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:11:22.340604 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dfngx\" (UniqueName: \"kubernetes.io/projected/5c755d24-d02f-4cb9-913f-57beef80777d-kube-api-access-dfngx\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\"" Jun 11 15:11:22.845432 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:11:22.845403 2569 generic.go:356] "Generic (PLEG): container finished" podID="5c755d24-d02f-4cb9-913f-57beef80777d" containerID="9f95efad04177d05d5061c6b7511bf2fe5dcbb98be1f96a0be483f0abb0462dc" exitCode=0 Jun 11 15:11:22.845930 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:11:22.845445 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-8pxlr" Jun 11 15:11:22.845930 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:11:22.845486 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-8pxlr" event={"ID":"5c755d24-d02f-4cb9-913f-57beef80777d","Type":"ContainerDied","Data":"9f95efad04177d05d5061c6b7511bf2fe5dcbb98be1f96a0be483f0abb0462dc"} Jun 11 15:11:22.845930 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:11:22.845535 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-8pxlr" event={"ID":"5c755d24-d02f-4cb9-913f-57beef80777d","Type":"ContainerDied","Data":"e8bc2f1b658b08c66b4314e0f4ad6e7370a5b136d1e680647a4bd166f162292a"} Jun 11 15:11:22.845930 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:11:22.845559 2569 scope.go:117] "RemoveContainer" containerID="9f95efad04177d05d5061c6b7511bf2fe5dcbb98be1f96a0be483f0abb0462dc" Jun 11 15:11:22.847294 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:11:22.847269 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6d7485b6c5-6x5qm" event={"ID":"0d770eb8-244a-4238-a4c4-b0ed9a3d7b84","Type":"ContainerStarted","Data":"0ab0cbbe4e792332a62b74639f53988c572f54555b8ca3817546fd9d853791de"} Jun 11 15:11:22.847431 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:11:22.847306 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6d7485b6c5-6x5qm" event={"ID":"0d770eb8-244a-4238-a4c4-b0ed9a3d7b84","Type":"ContainerStarted","Data":"39c1aa54e742ea63b6a771df732ce962d4fcc6917f1bab4f2354dca510ba3594"} Jun 11 15:11:22.848946 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:11:22.848926 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-995f79b59-rz9nz" event={"ID":"15dee882-334a-4793-bc7e-65ef22f137cc","Type":"ContainerStarted","Data":"24cb420fcabeda9d8ad68225306fad70790c72f285f4562d9321641b54aef817"} Jun 11 15:11:22.849048 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:11:22.848987 2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-995f79b59-rz9nz" podUID="15dee882-334a-4793-bc7e-65ef22f137cc" containerName="authorino" containerID="cri-o://24cb420fcabeda9d8ad68225306fad70790c72f285f4562d9321641b54aef817" gracePeriod=30 Jun 11 15:11:22.855452 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:11:22.855428 2569 scope.go:117] "RemoveContainer" containerID="9f95efad04177d05d5061c6b7511bf2fe5dcbb98be1f96a0be483f0abb0462dc" Jun 11 15:11:22.855696 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:11:22.855677 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f95efad04177d05d5061c6b7511bf2fe5dcbb98be1f96a0be483f0abb0462dc\": container with ID starting with 9f95efad04177d05d5061c6b7511bf2fe5dcbb98be1f96a0be483f0abb0462dc not found: ID does not exist" containerID="9f95efad04177d05d5061c6b7511bf2fe5dcbb98be1f96a0be483f0abb0462dc" Jun 11 15:11:22.855861 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:11:22.855710 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f95efad04177d05d5061c6b7511bf2fe5dcbb98be1f96a0be483f0abb0462dc"} err="failed to get container status \"9f95efad04177d05d5061c6b7511bf2fe5dcbb98be1f96a0be483f0abb0462dc\": rpc error: code = NotFound desc = could not find container \"9f95efad04177d05d5061c6b7511bf2fe5dcbb98be1f96a0be483f0abb0462dc\": container with ID starting with 9f95efad04177d05d5061c6b7511bf2fe5dcbb98be1f96a0be483f0abb0462dc not found: ID does not exist" Jun 11 15:11:22.884146 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:11:22.884105 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-995f79b59-rz9nz" podStartSLOduration=2.551401521 podStartE2EDuration="2.884091935s" totalImagesPullingTime="332.690414ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:11:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:11:22.865017413 +0000 UTC m=+517.813641675" watchObservedRunningTime="2026-06-11 15:11:22.884091935 +0000 UTC m=+517.832716236" Jun 11 15:11:22.884363 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:11:22.884341 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6d7485b6c5-6x5qm" podStartSLOduration=1.5629115040000001 podStartE2EDuration="1.884336082s" totalImagesPullingTime="321.424578ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:11:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:11:22.882551755 +0000 UTC m=+517.831176018" watchObservedRunningTime="2026-06-11 15:11:22.884336082 +0000 UTC m=+517.832960347" Jun 11 15:11:22.899046 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:11:22.899024 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-8pxlr"] Jun 11 15:11:22.903702 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:11:22.903683 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-8pxlr"] Jun 11 15:11:22.913822 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:11:22.913801 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-gtscv"] Jun 11 15:11:22.913958 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:11:22.913939 2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-gtscv" podUID="5580dae3-7157-4c12-a781-6bc9a61fc357" containerName="authorino" containerID="cri-o://e9f104a877e7945eb38c19a8e28c8309a1c1a202d5b775b2dc8bb1e45368a277" gracePeriod=30 Jun 11 15:11:23.152406 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:11:23.152381 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-995f79b59-rz9nz" Jun 11 15:11:23.187983 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:11:23.187953 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-gtscv" Jun 11 15:11:23.249147 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:11:23.249121 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zlq2t\" (UniqueName: \"kubernetes.io/projected/15dee882-334a-4793-bc7e-65ef22f137cc-kube-api-access-zlq2t\") pod \"15dee882-334a-4793-bc7e-65ef22f137cc\" (UID: \"15dee882-334a-4793-bc7e-65ef22f137cc\") " Jun 11 15:11:23.251090 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:11:23.251068 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15dee882-334a-4793-bc7e-65ef22f137cc-kube-api-access-zlq2t" (OuterVolumeSpecName: "kube-api-access-zlq2t") pod "15dee882-334a-4793-bc7e-65ef22f137cc" (UID: "15dee882-334a-4793-bc7e-65ef22f137cc"). InnerVolumeSpecName "kube-api-access-zlq2t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 15:11:23.350474 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:11:23.350445 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n4788\" (UniqueName: \"kubernetes.io/projected/5580dae3-7157-4c12-a781-6bc9a61fc357-kube-api-access-n4788\") pod \"5580dae3-7157-4c12-a781-6bc9a61fc357\" (UID: \"5580dae3-7157-4c12-a781-6bc9a61fc357\") " Jun 11 15:11:23.350707 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:11:23.350691 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zlq2t\" (UniqueName: \"kubernetes.io/projected/15dee882-334a-4793-bc7e-65ef22f137cc-kube-api-access-zlq2t\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\"" Jun 11 15:11:23.354794 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:11:23.353595 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5580dae3-7157-4c12-a781-6bc9a61fc357-kube-api-access-n4788" (OuterVolumeSpecName: "kube-api-access-n4788") pod "5580dae3-7157-4c12-a781-6bc9a61fc357" (UID: "5580dae3-7157-4c12-a781-6bc9a61fc357"). InnerVolumeSpecName "kube-api-access-n4788". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 15:11:23.451713 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:11:23.451642 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n4788\" (UniqueName: \"kubernetes.io/projected/5580dae3-7157-4c12-a781-6bc9a61fc357-kube-api-access-n4788\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\"" Jun 11 15:11:23.481516 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:11:23.481488 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c755d24-d02f-4cb9-913f-57beef80777d" path="/var/lib/kubelet/pods/5c755d24-d02f-4cb9-913f-57beef80777d/volumes" Jun 11 15:11:23.855559 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:11:23.855521 2569 generic.go:356] "Generic (PLEG): container finished" podID="5580dae3-7157-4c12-a781-6bc9a61fc357" containerID="e9f104a877e7945eb38c19a8e28c8309a1c1a202d5b775b2dc8bb1e45368a277" exitCode=0 Jun 11 15:11:23.856016 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:11:23.855580 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-gtscv" Jun 11 15:11:23.856016 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:11:23.855604 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-gtscv" event={"ID":"5580dae3-7157-4c12-a781-6bc9a61fc357","Type":"ContainerDied","Data":"e9f104a877e7945eb38c19a8e28c8309a1c1a202d5b775b2dc8bb1e45368a277"} Jun 11 15:11:23.856016 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:11:23.855652 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-gtscv" event={"ID":"5580dae3-7157-4c12-a781-6bc9a61fc357","Type":"ContainerDied","Data":"91aff231163044874e4ad8121c646fe373a043c58760662ed205a53a5c6962de"} Jun 11 15:11:23.856016 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:11:23.855675 2569 scope.go:117] "RemoveContainer" containerID="e9f104a877e7945eb38c19a8e28c8309a1c1a202d5b775b2dc8bb1e45368a277" Jun 11 15:11:23.856975 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:11:23.856946 2569 generic.go:356] "Generic (PLEG): container finished" podID="15dee882-334a-4793-bc7e-65ef22f137cc" containerID="24cb420fcabeda9d8ad68225306fad70790c72f285f4562d9321641b54aef817" exitCode=0 Jun 11 15:11:23.857088 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:11:23.857008 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-995f79b59-rz9nz" Jun 11 15:11:23.857088 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:11:23.857035 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-995f79b59-rz9nz" event={"ID":"15dee882-334a-4793-bc7e-65ef22f137cc","Type":"ContainerDied","Data":"24cb420fcabeda9d8ad68225306fad70790c72f285f4562d9321641b54aef817"} Jun 11 15:11:23.857088 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:11:23.857068 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-995f79b59-rz9nz" event={"ID":"15dee882-334a-4793-bc7e-65ef22f137cc","Type":"ContainerDied","Data":"3e2b9356001ecf1cbfc8a099687059985cb859fb6c6aeac5c60e5ebb3c911fce"} Jun 11 15:11:23.864107 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:11:23.864093 2569 scope.go:117] "RemoveContainer" containerID="e9f104a877e7945eb38c19a8e28c8309a1c1a202d5b775b2dc8bb1e45368a277" Jun 11 15:11:23.864362 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:11:23.864341 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e9f104a877e7945eb38c19a8e28c8309a1c1a202d5b775b2dc8bb1e45368a277\": container with ID starting with e9f104a877e7945eb38c19a8e28c8309a1c1a202d5b775b2dc8bb1e45368a277 not found: ID does not exist" containerID="e9f104a877e7945eb38c19a8e28c8309a1c1a202d5b775b2dc8bb1e45368a277" Jun 11 15:11:23.864398 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:11:23.864370 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9f104a877e7945eb38c19a8e28c8309a1c1a202d5b775b2dc8bb1e45368a277"} err="failed to get container status \"e9f104a877e7945eb38c19a8e28c8309a1c1a202d5b775b2dc8bb1e45368a277\": rpc error: code = NotFound desc = could not find container \"e9f104a877e7945eb38c19a8e28c8309a1c1a202d5b775b2dc8bb1e45368a277\": container with ID starting with e9f104a877e7945eb38c19a8e28c8309a1c1a202d5b775b2dc8bb1e45368a277 not found: ID does not exist" Jun 11 15:11:23.864398 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:11:23.864386 2569 scope.go:117] "RemoveContainer" containerID="24cb420fcabeda9d8ad68225306fad70790c72f285f4562d9321641b54aef817" Jun 11 15:11:23.871689 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:11:23.871675 2569 scope.go:117] "RemoveContainer" containerID="24cb420fcabeda9d8ad68225306fad70790c72f285f4562d9321641b54aef817" Jun 11 15:11:23.871946 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:11:23.871928 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"24cb420fcabeda9d8ad68225306fad70790c72f285f4562d9321641b54aef817\": container with ID starting with 24cb420fcabeda9d8ad68225306fad70790c72f285f4562d9321641b54aef817 not found: ID does not exist" containerID="24cb420fcabeda9d8ad68225306fad70790c72f285f4562d9321641b54aef817" Jun 11 15:11:23.871992 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:11:23.871952 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24cb420fcabeda9d8ad68225306fad70790c72f285f4562d9321641b54aef817"} err="failed to get container status \"24cb420fcabeda9d8ad68225306fad70790c72f285f4562d9321641b54aef817\": rpc error: code = NotFound desc = could not find container \"24cb420fcabeda9d8ad68225306fad70790c72f285f4562d9321641b54aef817\": container with ID starting with 24cb420fcabeda9d8ad68225306fad70790c72f285f4562d9321641b54aef817 not found: ID does not exist" Jun 11 15:11:23.878931 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:11:23.878910 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-gtscv"] Jun 11 15:11:23.885384 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:11:23.885360 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-gtscv"] Jun 11 15:11:23.897732 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:11:23.897710 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-995f79b59-rz9nz"] Jun 11 15:11:23.900531 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:11:23.900505 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-995f79b59-rz9nz"] Jun 11 15:11:25.479384 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:11:25.479351 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15dee882-334a-4793-bc7e-65ef22f137cc" path="/var/lib/kubelet/pods/15dee882-334a-4793-bc7e-65ef22f137cc/volumes" Jun 11 15:11:25.479725 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:11:25.479667 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5580dae3-7157-4c12-a781-6bc9a61fc357" path="/var/lib/kubelet/pods/5580dae3-7157-4c12-a781-6bc9a61fc357/volumes" Jun 11 15:12:45.453931 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:12:45.453902 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5lcln_77786904-9829-4966-9657-c97854cb6555/ovn-acl-logging/0.log" Jun 11 15:12:45.454990 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:12:45.454970 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5lcln_77786904-9829-4966-9657-c97854cb6555/ovn-acl-logging/0.log" Jun 11 15:14:55.135490 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:14:55.135409 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5bff58d999-24qdf"] Jun 11 15:14:55.135955 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:14:55.135791 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15dee882-334a-4793-bc7e-65ef22f137cc" containerName="authorino" Jun 11 15:14:55.135955 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:14:55.135802 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="15dee882-334a-4793-bc7e-65ef22f137cc" containerName="authorino" Jun 11 15:14:55.135955 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:14:55.135816 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c755d24-d02f-4cb9-913f-57beef80777d" containerName="authorino" Jun 11 15:14:55.135955 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:14:55.135822 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c755d24-d02f-4cb9-913f-57beef80777d" containerName="authorino" Jun 11 15:14:55.135955 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:14:55.135838 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5580dae3-7157-4c12-a781-6bc9a61fc357" containerName="authorino" Jun 11 15:14:55.135955 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:14:55.135844 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="5580dae3-7157-4c12-a781-6bc9a61fc357" containerName="authorino" Jun 11 15:14:55.135955 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:14:55.135898 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="15dee882-334a-4793-bc7e-65ef22f137cc" containerName="authorino" Jun 11 15:14:55.135955 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:14:55.135905 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="5580dae3-7157-4c12-a781-6bc9a61fc357" containerName="authorino" Jun 11 15:14:55.135955 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:14:55.135912 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c755d24-d02f-4cb9-913f-57beef80777d" containerName="authorino" Jun 11 15:14:55.138934 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:14:55.138917 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5bff58d999-24qdf" Jun 11 15:14:55.142089 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:14:55.142068 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 11 15:14:55.148505 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:14:55.148480 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5bff58d999-24qdf"] Jun 11 15:14:55.171879 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:14:55.171852 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fb2407dc-5fd0-4d7d-83ee-15c3b8172942-tls-cert\") pod \"authorino-5bff58d999-24qdf\" (UID: \"fb2407dc-5fd0-4d7d-83ee-15c3b8172942\") " pod="kuadrant-system/authorino-5bff58d999-24qdf" Jun 11 15:14:55.172009 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:14:55.171932 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v68gq\" (UniqueName: \"kubernetes.io/projected/fb2407dc-5fd0-4d7d-83ee-15c3b8172942-kube-api-access-v68gq\") pod \"authorino-5bff58d999-24qdf\" (UID: \"fb2407dc-5fd0-4d7d-83ee-15c3b8172942\") " pod="kuadrant-system/authorino-5bff58d999-24qdf" Jun 11 15:14:55.172009 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:14:55.171958 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/fb2407dc-5fd0-4d7d-83ee-15c3b8172942-oidc-ca\") pod \"authorino-5bff58d999-24qdf\" (UID: \"fb2407dc-5fd0-4d7d-83ee-15c3b8172942\") " pod="kuadrant-system/authorino-5bff58d999-24qdf" Jun 11 15:14:55.272654 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:14:55.272607 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fb2407dc-5fd0-4d7d-83ee-15c3b8172942-tls-cert\") pod \"authorino-5bff58d999-24qdf\" (UID: \"fb2407dc-5fd0-4d7d-83ee-15c3b8172942\") " pod="kuadrant-system/authorino-5bff58d999-24qdf" Jun 11 15:14:55.272899 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:14:55.272705 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v68gq\" (UniqueName: \"kubernetes.io/projected/fb2407dc-5fd0-4d7d-83ee-15c3b8172942-kube-api-access-v68gq\") pod \"authorino-5bff58d999-24qdf\" (UID: \"fb2407dc-5fd0-4d7d-83ee-15c3b8172942\") " pod="kuadrant-system/authorino-5bff58d999-24qdf" Jun 11 15:14:55.272899 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:14:55.272744 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/fb2407dc-5fd0-4d7d-83ee-15c3b8172942-oidc-ca\") pod \"authorino-5bff58d999-24qdf\" (UID: \"fb2407dc-5fd0-4d7d-83ee-15c3b8172942\") " pod="kuadrant-system/authorino-5bff58d999-24qdf" Jun 11 15:14:55.273455 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:14:55.273423 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/fb2407dc-5fd0-4d7d-83ee-15c3b8172942-oidc-ca\") pod \"authorino-5bff58d999-24qdf\" (UID: \"fb2407dc-5fd0-4d7d-83ee-15c3b8172942\") " pod="kuadrant-system/authorino-5bff58d999-24qdf" Jun 11 15:14:55.275042 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:14:55.275014 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fb2407dc-5fd0-4d7d-83ee-15c3b8172942-tls-cert\") pod \"authorino-5bff58d999-24qdf\" (UID: \"fb2407dc-5fd0-4d7d-83ee-15c3b8172942\") " pod="kuadrant-system/authorino-5bff58d999-24qdf" Jun 11 15:14:55.296030 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:14:55.295999 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v68gq\" (UniqueName: \"kubernetes.io/projected/fb2407dc-5fd0-4d7d-83ee-15c3b8172942-kube-api-access-v68gq\") pod \"authorino-5bff58d999-24qdf\" (UID: \"fb2407dc-5fd0-4d7d-83ee-15c3b8172942\") " pod="kuadrant-system/authorino-5bff58d999-24qdf" Jun 11 15:14:55.448011 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:14:55.447927 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5bff58d999-24qdf" Jun 11 15:14:55.594835 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:14:55.594808 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5bff58d999-24qdf"] Jun 11 15:14:55.596907 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:14:55.596878 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfb2407dc_5fd0_4d7d_83ee_15c3b8172942.slice/crio-255130d5c83336f1601250a1b058ee77d309a0f9fdb585062146d0286b80b0a8 WatchSource:0}: Error finding container 255130d5c83336f1601250a1b058ee77d309a0f9fdb585062146d0286b80b0a8: Status 404 returned error can't find the container with id 255130d5c83336f1601250a1b058ee77d309a0f9fdb585062146d0286b80b0a8 Jun 11 15:14:55.598216 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:14:55.598197 2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 15:14:55.825152 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:14:55.825116 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5bff58d999-24qdf" event={"ID":"fb2407dc-5fd0-4d7d-83ee-15c3b8172942","Type":"ContainerStarted","Data":"255130d5c83336f1601250a1b058ee77d309a0f9fdb585062146d0286b80b0a8"} Jun 11 15:14:56.831352 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:14:56.831313 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5bff58d999-24qdf" event={"ID":"fb2407dc-5fd0-4d7d-83ee-15c3b8172942","Type":"ContainerStarted","Data":"6cee8b4cf1cf9a10966220eeb6b77e639dfd3723923de6443dfff115f06ec78a"} Jun 11 15:14:56.858198 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:14:56.858149 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5bff58d999-24qdf" podStartSLOduration=1.515568609 podStartE2EDuration="1.858129834s" totalImagesPullingTime="342.561225ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:14:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:14:56.857438683 +0000 UTC m=+731.806062947" watchObservedRunningTime="2026-06-11 15:14:56.858129834 +0000 UTC m=+731.806754097" Jun 11 15:14:56.895892 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:14:56.895863 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d7485b6c5-6x5qm"] Jun 11 15:14:56.896053 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:14:56.896020 2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-6d7485b6c5-6x5qm" podUID="0d770eb8-244a-4238-a4c4-b0ed9a3d7b84" containerName="authorino" containerID="cri-o://0ab0cbbe4e792332a62b74639f53988c572f54555b8ca3817546fd9d853791de" gracePeriod=30 Jun 11 15:14:57.141958 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:14:57.141938 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d7485b6c5-6x5qm" Jun 11 15:14:57.187059 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:14:57.187030 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-whq2z\" (UniqueName: \"kubernetes.io/projected/0d770eb8-244a-4238-a4c4-b0ed9a3d7b84-kube-api-access-whq2z\") pod \"0d770eb8-244a-4238-a4c4-b0ed9a3d7b84\" (UID: \"0d770eb8-244a-4238-a4c4-b0ed9a3d7b84\") " Jun 11 15:14:57.187059 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:14:57.187061 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0d770eb8-244a-4238-a4c4-b0ed9a3d7b84-tls-cert\") pod \"0d770eb8-244a-4238-a4c4-b0ed9a3d7b84\" (UID: \"0d770eb8-244a-4238-a4c4-b0ed9a3d7b84\") " Jun 11 15:14:57.189143 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:14:57.189117 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d770eb8-244a-4238-a4c4-b0ed9a3d7b84-kube-api-access-whq2z" (OuterVolumeSpecName: "kube-api-access-whq2z") pod "0d770eb8-244a-4238-a4c4-b0ed9a3d7b84" (UID: "0d770eb8-244a-4238-a4c4-b0ed9a3d7b84"). InnerVolumeSpecName "kube-api-access-whq2z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 15:14:57.196660 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:14:57.196636 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0d770eb8-244a-4238-a4c4-b0ed9a3d7b84-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "0d770eb8-244a-4238-a4c4-b0ed9a3d7b84" (UID: "0d770eb8-244a-4238-a4c4-b0ed9a3d7b84"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:14:57.287559 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:14:57.287537 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-whq2z\" (UniqueName: \"kubernetes.io/projected/0d770eb8-244a-4238-a4c4-b0ed9a3d7b84-kube-api-access-whq2z\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\"" Jun 11 15:14:57.287559 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:14:57.287560 2569 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0d770eb8-244a-4238-a4c4-b0ed9a3d7b84-tls-cert\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\"" Jun 11 15:14:57.836328 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:14:57.836299 2569 generic.go:356] "Generic (PLEG): container finished" podID="0d770eb8-244a-4238-a4c4-b0ed9a3d7b84" containerID="0ab0cbbe4e792332a62b74639f53988c572f54555b8ca3817546fd9d853791de" exitCode=0 Jun 11 15:14:57.836728 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:14:57.836340 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d7485b6c5-6x5qm" Jun 11 15:14:57.836728 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:14:57.836383 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6d7485b6c5-6x5qm" event={"ID":"0d770eb8-244a-4238-a4c4-b0ed9a3d7b84","Type":"ContainerDied","Data":"0ab0cbbe4e792332a62b74639f53988c572f54555b8ca3817546fd9d853791de"} Jun 11 15:14:57.836728 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:14:57.836427 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6d7485b6c5-6x5qm" event={"ID":"0d770eb8-244a-4238-a4c4-b0ed9a3d7b84","Type":"ContainerDied","Data":"39c1aa54e742ea63b6a771df732ce962d4fcc6917f1bab4f2354dca510ba3594"} Jun 11 15:14:57.836728 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:14:57.836450 2569 scope.go:117] "RemoveContainer" containerID="0ab0cbbe4e792332a62b74639f53988c572f54555b8ca3817546fd9d853791de" Jun 11 15:14:57.844558 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:14:57.844540 2569 scope.go:117] "RemoveContainer" containerID="0ab0cbbe4e792332a62b74639f53988c572f54555b8ca3817546fd9d853791de" Jun 11 15:14:57.844823 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:14:57.844804 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0ab0cbbe4e792332a62b74639f53988c572f54555b8ca3817546fd9d853791de\": container with ID starting with 0ab0cbbe4e792332a62b74639f53988c572f54555b8ca3817546fd9d853791de not found: ID does not exist" containerID="0ab0cbbe4e792332a62b74639f53988c572f54555b8ca3817546fd9d853791de" Jun 11 15:14:57.844876 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:14:57.844832 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ab0cbbe4e792332a62b74639f53988c572f54555b8ca3817546fd9d853791de"} err="failed to get container status \"0ab0cbbe4e792332a62b74639f53988c572f54555b8ca3817546fd9d853791de\": rpc error: code = NotFound desc = could not find container \"0ab0cbbe4e792332a62b74639f53988c572f54555b8ca3817546fd9d853791de\": container with ID starting with 0ab0cbbe4e792332a62b74639f53988c572f54555b8ca3817546fd9d853791de not found: ID does not exist" Jun 11 15:14:57.860945 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:14:57.860920 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d7485b6c5-6x5qm"] Jun 11 15:14:57.865029 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:14:57.865009 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6d7485b6c5-6x5qm"] Jun 11 15:14:59.480292 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:14:59.480261 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d770eb8-244a-4238-a4c4-b0ed9a3d7b84" path="/var/lib/kubelet/pods/0d770eb8-244a-4238-a4c4-b0ed9a3d7b84/volumes" Jun 11 15:17:16.482991 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:17:16.482955 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7df6694cdb-jqkjj"] Jun 11 15:17:16.483429 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:17:16.483316 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d770eb8-244a-4238-a4c4-b0ed9a3d7b84" containerName="authorino" Jun 11 15:17:16.483429 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:17:16.483328 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d770eb8-244a-4238-a4c4-b0ed9a3d7b84" containerName="authorino" Jun 11 15:17:16.483429 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:17:16.483394 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d770eb8-244a-4238-a4c4-b0ed9a3d7b84" containerName="authorino" Jun 11 15:17:16.485150 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:17:16.485134 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7df6694cdb-jqkjj" Jun 11 15:17:16.495071 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:17:16.495047 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7df6694cdb-jqkjj"] Jun 11 15:17:16.536212 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:17:16.536186 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/60855915-facd-431d-b479-163af9746894-tls-cert\") pod \"authorino-7df6694cdb-jqkjj\" (UID: \"60855915-facd-431d-b479-163af9746894\") " pod="kuadrant-system/authorino-7df6694cdb-jqkjj" Jun 11 15:17:16.536367 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:17:16.536239 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65kg7\" (UniqueName: \"kubernetes.io/projected/60855915-facd-431d-b479-163af9746894-kube-api-access-65kg7\") pod \"authorino-7df6694cdb-jqkjj\" (UID: \"60855915-facd-431d-b479-163af9746894\") " pod="kuadrant-system/authorino-7df6694cdb-jqkjj" Jun 11 15:17:16.536367 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:17:16.536266 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/60855915-facd-431d-b479-163af9746894-oidc-ca\") pod \"authorino-7df6694cdb-jqkjj\" (UID: \"60855915-facd-431d-b479-163af9746894\") " pod="kuadrant-system/authorino-7df6694cdb-jqkjj" Jun 11 15:17:16.637563 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:17:16.637528 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65kg7\" (UniqueName: \"kubernetes.io/projected/60855915-facd-431d-b479-163af9746894-kube-api-access-65kg7\") pod \"authorino-7df6694cdb-jqkjj\" (UID: \"60855915-facd-431d-b479-163af9746894\") " pod="kuadrant-system/authorino-7df6694cdb-jqkjj" Jun 11 15:17:16.637723 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:17:16.637577 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/60855915-facd-431d-b479-163af9746894-oidc-ca\") pod \"authorino-7df6694cdb-jqkjj\" (UID: \"60855915-facd-431d-b479-163af9746894\") " pod="kuadrant-system/authorino-7df6694cdb-jqkjj" Jun 11 15:17:16.637723 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:17:16.637635 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/60855915-facd-431d-b479-163af9746894-tls-cert\") pod \"authorino-7df6694cdb-jqkjj\" (UID: \"60855915-facd-431d-b479-163af9746894\") " pod="kuadrant-system/authorino-7df6694cdb-jqkjj" Jun 11 15:17:16.638223 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:17:16.638205 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/60855915-facd-431d-b479-163af9746894-oidc-ca\") pod \"authorino-7df6694cdb-jqkjj\" (UID: \"60855915-facd-431d-b479-163af9746894\") " pod="kuadrant-system/authorino-7df6694cdb-jqkjj" Jun 11 15:17:16.640057 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:17:16.640037 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/60855915-facd-431d-b479-163af9746894-tls-cert\") pod \"authorino-7df6694cdb-jqkjj\" (UID: \"60855915-facd-431d-b479-163af9746894\") " pod="kuadrant-system/authorino-7df6694cdb-jqkjj" Jun 11 15:17:16.649199 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:17:16.649176 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-65kg7\" (UniqueName: \"kubernetes.io/projected/60855915-facd-431d-b479-163af9746894-kube-api-access-65kg7\") pod \"authorino-7df6694cdb-jqkjj\" (UID: \"60855915-facd-431d-b479-163af9746894\") " pod="kuadrant-system/authorino-7df6694cdb-jqkjj" Jun 11 15:17:16.794140 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:17:16.794112 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7df6694cdb-jqkjj" Jun 11 15:17:16.940172 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:17:16.939999 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7df6694cdb-jqkjj"] Jun 11 15:17:16.942652 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:17:16.942617 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod60855915_facd_431d_b479_163af9746894.slice/crio-02d649c580fcaebce656d6aa2a81fead0adbb8bfdacd07a5826998adcdd5d249 WatchSource:0}: Error finding container 02d649c580fcaebce656d6aa2a81fead0adbb8bfdacd07a5826998adcdd5d249: Status 404 returned error can't find the container with id 02d649c580fcaebce656d6aa2a81fead0adbb8bfdacd07a5826998adcdd5d249 Jun 11 15:17:17.469044 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:17:17.469005 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7df6694cdb-jqkjj" event={"ID":"60855915-facd-431d-b479-163af9746894","Type":"ContainerStarted","Data":"090391951dc60b4bd2af3361f5dace920ff4be80751c172d44c13ff801e7b7df"} Jun 11 15:17:17.469044 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:17:17.469055 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7df6694cdb-jqkjj" event={"ID":"60855915-facd-431d-b479-163af9746894","Type":"ContainerStarted","Data":"02d649c580fcaebce656d6aa2a81fead0adbb8bfdacd07a5826998adcdd5d249"} Jun 11 15:17:17.490855 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:17:17.490780 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7df6694cdb-jqkjj" podStartSLOduration=1.165570823 podStartE2EDuration="1.490745689s" totalImagesPullingTime="325.174866ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:17:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:17:17.490075743 +0000 UTC m=+872.438700006" watchObservedRunningTime="2026-06-11 15:17:17.490745689 +0000 UTC m=+872.439369954" Jun 11 15:17:17.569741 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:17:17.569663 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5bff58d999-24qdf"] Jun 11 15:17:17.569924 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:17:17.569871 2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5bff58d999-24qdf" podUID="fb2407dc-5fd0-4d7d-83ee-15c3b8172942" containerName="authorino" containerID="cri-o://6cee8b4cf1cf9a10966220eeb6b77e639dfd3723923de6443dfff115f06ec78a" gracePeriod=30 Jun 11 15:17:17.840549 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:17:17.840524 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5bff58d999-24qdf" Jun 11 15:17:17.961665 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:17:17.961631 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/fb2407dc-5fd0-4d7d-83ee-15c3b8172942-oidc-ca\") pod \"fb2407dc-5fd0-4d7d-83ee-15c3b8172942\" (UID: \"fb2407dc-5fd0-4d7d-83ee-15c3b8172942\") " Jun 11 15:17:17.961665 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:17:17.961673 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v68gq\" (UniqueName: \"kubernetes.io/projected/fb2407dc-5fd0-4d7d-83ee-15c3b8172942-kube-api-access-v68gq\") pod \"fb2407dc-5fd0-4d7d-83ee-15c3b8172942\" (UID: \"fb2407dc-5fd0-4d7d-83ee-15c3b8172942\") " Jun 11 15:17:17.961912 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:17:17.961712 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fb2407dc-5fd0-4d7d-83ee-15c3b8172942-tls-cert\") pod \"fb2407dc-5fd0-4d7d-83ee-15c3b8172942\" (UID: \"fb2407dc-5fd0-4d7d-83ee-15c3b8172942\") " Jun 11 15:17:17.963834 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:17:17.963804 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb2407dc-5fd0-4d7d-83ee-15c3b8172942-kube-api-access-v68gq" (OuterVolumeSpecName: "kube-api-access-v68gq") pod "fb2407dc-5fd0-4d7d-83ee-15c3b8172942" (UID: "fb2407dc-5fd0-4d7d-83ee-15c3b8172942"). InnerVolumeSpecName "kube-api-access-v68gq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 15:17:17.966502 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:17:17.966472 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb2407dc-5fd0-4d7d-83ee-15c3b8172942-oidc-ca" (OuterVolumeSpecName: "oidc-ca") pod "fb2407dc-5fd0-4d7d-83ee-15c3b8172942" (UID: "fb2407dc-5fd0-4d7d-83ee-15c3b8172942"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 15:17:17.971213 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:17:17.971189 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb2407dc-5fd0-4d7d-83ee-15c3b8172942-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "fb2407dc-5fd0-4d7d-83ee-15c3b8172942" (UID: "fb2407dc-5fd0-4d7d-83ee-15c3b8172942"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:17:18.062662 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:17:18.062627 2569 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/fb2407dc-5fd0-4d7d-83ee-15c3b8172942-oidc-ca\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\"" Jun 11 15:17:18.062662 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:17:18.062656 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v68gq\" (UniqueName: \"kubernetes.io/projected/fb2407dc-5fd0-4d7d-83ee-15c3b8172942-kube-api-access-v68gq\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\"" Jun 11 15:17:18.062662 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:17:18.062665 2569 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fb2407dc-5fd0-4d7d-83ee-15c3b8172942-tls-cert\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\"" Jun 11 15:17:18.475922 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:17:18.475889 2569 generic.go:356] "Generic (PLEG): container finished" podID="fb2407dc-5fd0-4d7d-83ee-15c3b8172942" containerID="6cee8b4cf1cf9a10966220eeb6b77e639dfd3723923de6443dfff115f06ec78a" exitCode=0 Jun 11 15:17:18.476120 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:17:18.475946 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5bff58d999-24qdf" Jun 11 15:17:18.476120 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:17:18.475988 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5bff58d999-24qdf" event={"ID":"fb2407dc-5fd0-4d7d-83ee-15c3b8172942","Type":"ContainerDied","Data":"6cee8b4cf1cf9a10966220eeb6b77e639dfd3723923de6443dfff115f06ec78a"} Jun 11 15:17:18.476120 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:17:18.476018 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5bff58d999-24qdf" event={"ID":"fb2407dc-5fd0-4d7d-83ee-15c3b8172942","Type":"ContainerDied","Data":"255130d5c83336f1601250a1b058ee77d309a0f9fdb585062146d0286b80b0a8"} Jun 11 15:17:18.476120 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:17:18.476036 2569 scope.go:117] "RemoveContainer" containerID="6cee8b4cf1cf9a10966220eeb6b77e639dfd3723923de6443dfff115f06ec78a" Jun 11 15:17:18.485702 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:17:18.485681 2569 scope.go:117] "RemoveContainer" containerID="6cee8b4cf1cf9a10966220eeb6b77e639dfd3723923de6443dfff115f06ec78a" Jun 11 15:17:18.486001 ip-10-0-128-147 kubenswrapper[2569]: E0611 15:17:18.485982 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6cee8b4cf1cf9a10966220eeb6b77e639dfd3723923de6443dfff115f06ec78a\": container with ID starting with 6cee8b4cf1cf9a10966220eeb6b77e639dfd3723923de6443dfff115f06ec78a not found: ID does not exist" containerID="6cee8b4cf1cf9a10966220eeb6b77e639dfd3723923de6443dfff115f06ec78a" Jun 11 15:17:18.486061 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:17:18.486009 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6cee8b4cf1cf9a10966220eeb6b77e639dfd3723923de6443dfff115f06ec78a"} err="failed to get container status \"6cee8b4cf1cf9a10966220eeb6b77e639dfd3723923de6443dfff115f06ec78a\": rpc error: code = NotFound desc = could not find container \"6cee8b4cf1cf9a10966220eeb6b77e639dfd3723923de6443dfff115f06ec78a\": container with ID starting with 6cee8b4cf1cf9a10966220eeb6b77e639dfd3723923de6443dfff115f06ec78a not found: ID does not exist" Jun 11 15:17:18.506097 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:17:18.506070 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5bff58d999-24qdf"] Jun 11 15:17:18.526819 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:17:18.526790 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5bff58d999-24qdf"] Jun 11 15:17:19.481310 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:17:19.481269 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fb2407dc-5fd0-4d7d-83ee-15c3b8172942" path="/var/lib/kubelet/pods/fb2407dc-5fd0-4d7d-83ee-15c3b8172942/volumes" Jun 11 15:17:45.482265 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:17:45.482195 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5lcln_77786904-9829-4966-9657-c97854cb6555/ovn-acl-logging/0.log" Jun 11 15:17:45.484860 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:17:45.484833 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5lcln_77786904-9829-4966-9657-c97854cb6555/ovn-acl-logging/0.log" Jun 11 15:17:55.432628 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:17:55.432597 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7df6694cdb-jqkjj_60855915-facd-431d-b479-163af9746894/authorino/0.log" Jun 11 15:18:00.010891 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:18:00.010866 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-c8c54bcfc-jfdv6_8257c987-ae99-4a1d-982c-e3f2a8666265/nginx/0.log" Jun 11 15:18:01.039037 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:18:01.039010 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5bfd7967cc-dgxzk_46017a52-fd7d-4d05-b330-89b5f4dcb1b7/copy-manifests/0.log" Jun 11 15:18:01.052275 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:18:01.052252 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5bfd7967cc-dgxzk_46017a52-fd7d-4d05-b330-89b5f4dcb1b7/manager/0.log" Jun 11 15:18:01.397814 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:18:01.397710 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-ckj4z_3cc0ec60-4c6b-4457-8d8f-71c19a237e80/postgres/0.log" Jun 11 15:18:02.670718 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:18:02.670674 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7df6694cdb-jqkjj_60855915-facd-431d-b479-163af9746894/authorino/0.log" Jun 11 15:18:03.019660 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:18:03.019635 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-9zl8f_876abaf9-19fd-44d2-ad55-713707bf2df8/kuadrant-console-plugin/0.log" Jun 11 15:18:04.140032 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:18:04.140005 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-946684896-nsl9n_04e6f5d1-8f42-40f5-ac1e-c8733c10dd66/kube-auth-proxy/0.log" Jun 11 15:18:09.457307 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:18:09.457272 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-gztsj/must-gather-8kc5k"] Jun 11 15:18:09.457664 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:18:09.457603 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb2407dc-5fd0-4d7d-83ee-15c3b8172942" containerName="authorino" Jun 11 15:18:09.457664 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:18:09.457614 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb2407dc-5fd0-4d7d-83ee-15c3b8172942" containerName="authorino" Jun 11 15:18:09.457742 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:18:09.457690 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb2407dc-5fd0-4d7d-83ee-15c3b8172942" containerName="authorino" Jun 11 15:18:09.459525 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:18:09.459504 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gztsj/must-gather-8kc5k" Jun 11 15:18:09.462210 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:18:09.462188 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-gztsj\"/\"default-dockercfg-525n9\"" Jun 11 15:18:09.462303 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:18:09.462193 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gztsj\"/\"openshift-service-ca.crt\"" Jun 11 15:18:09.462920 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:18:09.462907 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gztsj\"/\"kube-root-ca.crt\"" Jun 11 15:18:09.471614 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:18:09.471587 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gztsj/must-gather-8kc5k"] Jun 11 15:18:09.614184 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:18:09.614155 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/268b8c0b-5433-4570-a415-869b40ed8dae-must-gather-output\") pod \"must-gather-8kc5k\" (UID: \"268b8c0b-5433-4570-a415-869b40ed8dae\") " pod="openshift-must-gather-gztsj/must-gather-8kc5k" Jun 11 15:18:09.614379 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:18:09.614318 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmc4m\" (UniqueName: \"kubernetes.io/projected/268b8c0b-5433-4570-a415-869b40ed8dae-kube-api-access-dmc4m\") pod \"must-gather-8kc5k\" (UID: \"268b8c0b-5433-4570-a415-869b40ed8dae\") " pod="openshift-must-gather-gztsj/must-gather-8kc5k" Jun 11 15:18:09.715194 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:18:09.715115 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/268b8c0b-5433-4570-a415-869b40ed8dae-must-gather-output\") pod \"must-gather-8kc5k\" (UID: \"268b8c0b-5433-4570-a415-869b40ed8dae\") " pod="openshift-must-gather-gztsj/must-gather-8kc5k" Jun 11 15:18:09.715361 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:18:09.715203 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmc4m\" (UniqueName: \"kubernetes.io/projected/268b8c0b-5433-4570-a415-869b40ed8dae-kube-api-access-dmc4m\") pod \"must-gather-8kc5k\" (UID: \"268b8c0b-5433-4570-a415-869b40ed8dae\") " pod="openshift-must-gather-gztsj/must-gather-8kc5k" Jun 11 15:18:09.715458 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:18:09.715439 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/268b8c0b-5433-4570-a415-869b40ed8dae-must-gather-output\") pod \"must-gather-8kc5k\" (UID: \"268b8c0b-5433-4570-a415-869b40ed8dae\") " pod="openshift-must-gather-gztsj/must-gather-8kc5k" Jun 11 15:18:09.725237 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:18:09.725207 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmc4m\" (UniqueName: \"kubernetes.io/projected/268b8c0b-5433-4570-a415-869b40ed8dae-kube-api-access-dmc4m\") pod \"must-gather-8kc5k\" (UID: \"268b8c0b-5433-4570-a415-869b40ed8dae\") " pod="openshift-must-gather-gztsj/must-gather-8kc5k" Jun 11 15:18:09.769942 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:18:09.769919 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gztsj/must-gather-8kc5k" Jun 11 15:18:09.899907 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:18:09.899881 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gztsj/must-gather-8kc5k"] Jun 11 15:18:09.901975 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:18:09.901948 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod268b8c0b_5433_4570_a415_869b40ed8dae.slice/crio-06dd1b362e1ad0d65928ffd6141d31434db773c907106f2ebdca464b53dc38d3 WatchSource:0}: Error finding container 06dd1b362e1ad0d65928ffd6141d31434db773c907106f2ebdca464b53dc38d3: Status 404 returned error can't find the container with id 06dd1b362e1ad0d65928ffd6141d31434db773c907106f2ebdca464b53dc38d3 Jun 11 15:18:10.721260 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:18:10.721223 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gztsj/must-gather-8kc5k" event={"ID":"268b8c0b-5433-4570-a415-869b40ed8dae","Type":"ContainerStarted","Data":"199086c65ee8288f7206fd5dce2319991eeb31891e2521ff6d4bced39044bfdd"} Jun 11 15:18:10.721632 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:18:10.721282 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gztsj/must-gather-8kc5k" event={"ID":"268b8c0b-5433-4570-a415-869b40ed8dae","Type":"ContainerStarted","Data":"06dd1b362e1ad0d65928ffd6141d31434db773c907106f2ebdca464b53dc38d3"} Jun 11 15:18:11.729831 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:18:11.729790 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gztsj/must-gather-8kc5k" event={"ID":"268b8c0b-5433-4570-a415-869b40ed8dae","Type":"ContainerStarted","Data":"f64a63f3f1c0091a25d318f918a2239b2dca1d9f42607823966fae16b086f9ba"} Jun 11 15:18:11.746911 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:18:11.746824 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-gztsj/must-gather-8kc5k" podStartSLOduration=2.084970613 podStartE2EDuration="2.746802466s" totalImagesPullingTime="661.831853ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:18:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:18:11.746687525 +0000 UTC m=+926.695311787" watchObservedRunningTime="2026-06-11 15:18:11.746802466 +0000 UTC m=+926.695426742" Jun 11 15:18:12.453776 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:18:12.451210 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-9xq6t_f5813fd7-de59-42f7-b4ee-de396547742d/global-pull-secret-syncer/0.log" Jun 11 15:18:12.685323 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:18:12.685297 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-gjwn5_a5ddf0c9-e1fc-49b7-9adb-80504c04c71b/konnectivity-agent/0.log" Jun 11 15:18:12.804078 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:18:12.804046 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-147.ec2.internal_40e5bb6ad17f9c3a0001225289b11e90/haproxy/0.log" Jun 11 15:18:17.966056 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:18:17.965972 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7df6694cdb-jqkjj_60855915-facd-431d-b479-163af9746894/authorino/0.log" Jun 11 15:18:18.080546 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:18:18.080511 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-9zl8f_876abaf9-19fd-44d2-ad55-713707bf2df8/kuadrant-console-plugin/0.log" Jun 11 15:18:20.295308 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:18:20.295268 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-rq2bp_032eda1b-5d44-4124-81d8-bba06fda9990/kube-state-metrics/0.log" Jun 11 15:18:20.320350 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:18:20.320281 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-rq2bp_032eda1b-5d44-4124-81d8-bba06fda9990/kube-rbac-proxy-main/0.log" Jun 11 15:18:20.349078 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:18:20.349052 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-rq2bp_032eda1b-5d44-4124-81d8-bba06fda9990/kube-rbac-proxy-self/0.log" Jun 11 15:18:20.381915 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:18:20.381890 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-64fbbc7dc8-87vt6_df14e275-a2d3-4f4b-ba2d-58a4fbe60491/metrics-server/0.log" Jun 11 15:18:20.418475 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:18:20.418406 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-689px_32ac3102-d5ad-46b3-b166-7b5cd4a9725b/monitoring-plugin/0.log" Jun 11 15:18:20.563179 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:18:20.563150 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kscd8_813b240a-c0b4-4344-b3ed-84eaff07a99d/node-exporter/0.log" Jun 11 15:18:20.598393 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:18:20.598357 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kscd8_813b240a-c0b4-4344-b3ed-84eaff07a99d/kube-rbac-proxy/0.log" Jun 11 15:18:20.635576 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:18:20.635535 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kscd8_813b240a-c0b4-4344-b3ed-84eaff07a99d/init-textfile/0.log" Jun 11 15:18:20.783903 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:18:20.783868 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-sqqds_90726557-a154-421b-b150-b042c021f9ab/kube-rbac-proxy-main/0.log" Jun 11 15:18:20.827120 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:18:20.827087 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-sqqds_90726557-a154-421b-b150-b042c021f9ab/kube-rbac-proxy-self/0.log" Jun 11 15:18:20.879660 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:18:20.879638 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-sqqds_90726557-a154-421b-b150-b042c021f9ab/openshift-state-metrics/0.log" Jun 11 15:18:20.932687 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:18:20.932624 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2/prometheus/0.log" Jun 11 15:18:20.961932 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:18:20.961901 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2/config-reloader/0.log" Jun 11 15:18:20.991686 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:18:20.991656 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2/thanos-sidecar/0.log" Jun 11 15:18:21.025869 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:18:21.025839 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2/kube-rbac-proxy-web/0.log" Jun 11 15:18:21.063634 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:18:21.063537 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2/kube-rbac-proxy/0.log" Jun 11 15:18:21.110733 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:18:21.110704 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2/kube-rbac-proxy-thanos/0.log" Jun 11 15:18:21.146532 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:18:21.146504 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3ce1bc41-9c5d-4a62-9d0b-c4703d2f44e2/init-config-reloader/0.log" Jun 11 15:18:21.303326 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:18:21.303292 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-75f77978d7-976x9_2430e48b-c1f3-4346-b284-8404e13a45e7/telemeter-client/0.log" Jun 11 15:18:21.340622 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:18:21.340551 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-75f77978d7-976x9_2430e48b-c1f3-4346-b284-8404e13a45e7/reload/0.log" Jun 11 15:18:21.374298 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:18:21.374260 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-75f77978d7-976x9_2430e48b-c1f3-4346-b284-8404e13a45e7/kube-rbac-proxy/0.log" Jun 11 15:18:21.414498 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:18:21.414464 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7898878f7c-d5srf_b9206504-36c2-4856-93ef-e37ae24c9db6/thanos-query/0.log" Jun 11 15:18:21.452925 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:18:21.452894 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7898878f7c-d5srf_b9206504-36c2-4856-93ef-e37ae24c9db6/kube-rbac-proxy-web/0.log" Jun 11 15:18:21.489910 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:18:21.489884 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7898878f7c-d5srf_b9206504-36c2-4856-93ef-e37ae24c9db6/kube-rbac-proxy/0.log" Jun 11 15:18:21.531315 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:18:21.531283 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7898878f7c-d5srf_b9206504-36c2-4856-93ef-e37ae24c9db6/prom-label-proxy/0.log" Jun 11 15:18:21.561128 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:18:21.561096 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7898878f7c-d5srf_b9206504-36c2-4856-93ef-e37ae24c9db6/kube-rbac-proxy-rules/0.log" Jun 11 15:18:21.597081 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:18:21.597003 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7898878f7c-d5srf_b9206504-36c2-4856-93ef-e37ae24c9db6/kube-rbac-proxy-metrics/0.log" Jun 11 15:18:22.718622 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:18:22.718580 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-gztsj/perf-node-gather-daemonset-v7jn5"] Jun 11 15:18:22.725439 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:18:22.725414 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gztsj/perf-node-gather-daemonset-v7jn5" Jun 11 15:18:22.738738 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:18:22.738706 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gztsj/perf-node-gather-daemonset-v7jn5"] Jun 11 15:18:22.756828 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:18:22.756796 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/da84b8e3-0c64-4ac6-b014-340fb4044994-lib-modules\") pod \"perf-node-gather-daemonset-v7jn5\" (UID: \"da84b8e3-0c64-4ac6-b014-340fb4044994\") " pod="openshift-must-gather-gztsj/perf-node-gather-daemonset-v7jn5" Jun 11 15:18:22.757070 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:18:22.757045 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4swl8\" (UniqueName: \"kubernetes.io/projected/da84b8e3-0c64-4ac6-b014-340fb4044994-kube-api-access-4swl8\") pod \"perf-node-gather-daemonset-v7jn5\" (UID: \"da84b8e3-0c64-4ac6-b014-340fb4044994\") " pod="openshift-must-gather-gztsj/perf-node-gather-daemonset-v7jn5" Jun 11 15:18:22.757208 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:18:22.757114 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/da84b8e3-0c64-4ac6-b014-340fb4044994-podres\") pod \"perf-node-gather-daemonset-v7jn5\" (UID: \"da84b8e3-0c64-4ac6-b014-340fb4044994\") " pod="openshift-must-gather-gztsj/perf-node-gather-daemonset-v7jn5" Jun 11 15:18:22.757208 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:18:22.757143 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/da84b8e3-0c64-4ac6-b014-340fb4044994-proc\") pod \"perf-node-gather-daemonset-v7jn5\" (UID: \"da84b8e3-0c64-4ac6-b014-340fb4044994\") " pod="openshift-must-gather-gztsj/perf-node-gather-daemonset-v7jn5" Jun 11 15:18:22.757208 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:18:22.757172 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/da84b8e3-0c64-4ac6-b014-340fb4044994-sys\") pod \"perf-node-gather-daemonset-v7jn5\" (UID: \"da84b8e3-0c64-4ac6-b014-340fb4044994\") " pod="openshift-must-gather-gztsj/perf-node-gather-daemonset-v7jn5" Jun 11 15:18:22.857700 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:18:22.857668 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/da84b8e3-0c64-4ac6-b014-340fb4044994-lib-modules\") pod \"perf-node-gather-daemonset-v7jn5\" (UID: \"da84b8e3-0c64-4ac6-b014-340fb4044994\") " pod="openshift-must-gather-gztsj/perf-node-gather-daemonset-v7jn5" Jun 11 15:18:22.857911 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:18:22.857717 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4swl8\" (UniqueName: \"kubernetes.io/projected/da84b8e3-0c64-4ac6-b014-340fb4044994-kube-api-access-4swl8\") pod \"perf-node-gather-daemonset-v7jn5\" (UID: \"da84b8e3-0c64-4ac6-b014-340fb4044994\") " pod="openshift-must-gather-gztsj/perf-node-gather-daemonset-v7jn5" Jun 11 15:18:22.857911 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:18:22.857796 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/da84b8e3-0c64-4ac6-b014-340fb4044994-podres\") pod \"perf-node-gather-daemonset-v7jn5\" (UID: \"da84b8e3-0c64-4ac6-b014-340fb4044994\") " pod="openshift-must-gather-gztsj/perf-node-gather-daemonset-v7jn5" Jun 11 15:18:22.857911 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:18:22.857827 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/da84b8e3-0c64-4ac6-b014-340fb4044994-proc\") pod \"perf-node-gather-daemonset-v7jn5\" (UID: \"da84b8e3-0c64-4ac6-b014-340fb4044994\") " pod="openshift-must-gather-gztsj/perf-node-gather-daemonset-v7jn5" Jun 11 15:18:22.857911 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:18:22.857855 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/da84b8e3-0c64-4ac6-b014-340fb4044994-sys\") pod \"perf-node-gather-daemonset-v7jn5\" (UID: \"da84b8e3-0c64-4ac6-b014-340fb4044994\") " pod="openshift-must-gather-gztsj/perf-node-gather-daemonset-v7jn5" Jun 11 15:18:22.857911 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:18:22.857861 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/da84b8e3-0c64-4ac6-b014-340fb4044994-lib-modules\") pod \"perf-node-gather-daemonset-v7jn5\" (UID: \"da84b8e3-0c64-4ac6-b014-340fb4044994\") " pod="openshift-must-gather-gztsj/perf-node-gather-daemonset-v7jn5" Jun 11 15:18:22.857911 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:18:22.857910 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/da84b8e3-0c64-4ac6-b014-340fb4044994-proc\") pod \"perf-node-gather-daemonset-v7jn5\" (UID: \"da84b8e3-0c64-4ac6-b014-340fb4044994\") " pod="openshift-must-gather-gztsj/perf-node-gather-daemonset-v7jn5" Jun 11 15:18:22.858163 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:18:22.857921 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/da84b8e3-0c64-4ac6-b014-340fb4044994-sys\") pod \"perf-node-gather-daemonset-v7jn5\" (UID: \"da84b8e3-0c64-4ac6-b014-340fb4044994\") " pod="openshift-must-gather-gztsj/perf-node-gather-daemonset-v7jn5" Jun 11 15:18:22.858163 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:18:22.857924 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/da84b8e3-0c64-4ac6-b014-340fb4044994-podres\") pod \"perf-node-gather-daemonset-v7jn5\" (UID: \"da84b8e3-0c64-4ac6-b014-340fb4044994\") " pod="openshift-must-gather-gztsj/perf-node-gather-daemonset-v7jn5" Jun 11 15:18:22.867621 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:18:22.867590 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4swl8\" (UniqueName: \"kubernetes.io/projected/da84b8e3-0c64-4ac6-b014-340fb4044994-kube-api-access-4swl8\") pod \"perf-node-gather-daemonset-v7jn5\" (UID: \"da84b8e3-0c64-4ac6-b014-340fb4044994\") " pod="openshift-must-gather-gztsj/perf-node-gather-daemonset-v7jn5" Jun 11 15:18:23.039080 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:18:23.039041 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gztsj/perf-node-gather-daemonset-v7jn5" Jun 11 15:18:23.235417 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:18:23.235388 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gztsj/perf-node-gather-daemonset-v7jn5"] Jun 11 15:18:23.238276 ip-10-0-128-147 kubenswrapper[2569]: W0611 15:18:23.238242 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podda84b8e3_0c64_4ac6_b014_340fb4044994.slice/crio-7b44fc5a62bb914ef96c158cc28d5e0ca010bc92013bf9e0444d643bc8199fbf WatchSource:0}: Error finding container 7b44fc5a62bb914ef96c158cc28d5e0ca010bc92013bf9e0444d643bc8199fbf: Status 404 returned error can't find the container with id 7b44fc5a62bb914ef96c158cc28d5e0ca010bc92013bf9e0444d643bc8199fbf Jun 11 15:18:23.826924 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:18:23.826884 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gztsj/perf-node-gather-daemonset-v7jn5" event={"ID":"da84b8e3-0c64-4ac6-b014-340fb4044994","Type":"ContainerStarted","Data":"3868a0f6d1427337484ac2239d9113af5cfe61f0e76ac1b573167ecf080cd4f0"} Jun 11 15:18:23.827381 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:18:23.826989 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gztsj/perf-node-gather-daemonset-v7jn5" event={"ID":"da84b8e3-0c64-4ac6-b014-340fb4044994","Type":"ContainerStarted","Data":"7b44fc5a62bb914ef96c158cc28d5e0ca010bc92013bf9e0444d643bc8199fbf"} Jun 11 15:18:23.827381 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:18:23.827040 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-gztsj/perf-node-gather-daemonset-v7jn5" Jun 11 15:18:23.854894 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:18:23.854839 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-gztsj/perf-node-gather-daemonset-v7jn5" podStartSLOduration=1.854822783 podStartE2EDuration="1.854822783s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 15:18:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:18:23.853914358 +0000 UTC m=+938.802538620" watchObservedRunningTime="2026-06-11 15:18:23.854822783 +0000 UTC m=+938.803447044" Jun 11 15:18:24.251217 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:18:24.251124 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7c9b86df-rfmzk_230f05d8-e5d4-4d8c-95f0-0cfdd84aa045/console/0.log" Jun 11 15:18:26.340837 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:18:26.340777 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-24qb9_7ab0932f-0e62-4a6d-96aa-03730640b94f/dns/0.log" Jun 11 15:18:26.372112 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:18:26.372085 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-24qb9_7ab0932f-0e62-4a6d-96aa-03730640b94f/kube-rbac-proxy/0.log" Jun 11 15:18:26.585634 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:18:26.585606 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fzhq9_c1a1d2ac-69d9-4fd9-a430-4392613b148f/dns-node-resolver/0.log" Jun 11 15:18:27.208988 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:18:27.208957 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7678565674-mglc9_2080c350-9dd7-464a-a6d1-ae454d44c4a0/registry/0.log" Jun 11 15:18:27.242175 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:18:27.242145 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9fgfz_9329cd7d-8d39-4a1a-b7da-d6604e6274bb/node-ca/0.log" Jun 11 15:18:28.469834 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:18:28.469806 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-946684896-nsl9n_04e6f5d1-8f42-40f5-ac1e-c8733c10dd66/kube-auth-proxy/0.log" Jun 11 15:18:29.321523 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:18:29.321494 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-t8gh8_fb07ba89-003b-4871-bf42-c63ff69b6d3a/serve-healthcheck-canary/0.log" Jun 11 15:18:29.848257 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:18:29.848227 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-gztsj/perf-node-gather-daemonset-v7jn5" Jun 11 15:18:29.918061 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:18:29.918032 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8p88n_9af3479b-46bb-4f61-ba00-f98c42f7be10/kube-rbac-proxy/0.log" Jun 11 15:18:29.944969 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:18:29.944944 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8p88n_9af3479b-46bb-4f61-ba00-f98c42f7be10/exporter/0.log" Jun 11 15:18:29.974853 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:18:29.974824 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8p88n_9af3479b-46bb-4f61-ba00-f98c42f7be10/extractor/0.log" Jun 11 15:18:32.765211 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:18:32.765174 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-c8c54bcfc-jfdv6_8257c987-ae99-4a1d-982c-e3f2a8666265/nginx/0.log" Jun 11 15:18:33.105687 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:18:33.105656 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5bfd7967cc-dgxzk_46017a52-fd7d-4d05-b330-89b5f4dcb1b7/manager/0.log" Jun 11 15:18:33.126650 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:18:33.126627 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5bfd7967cc-dgxzk_46017a52-fd7d-4d05-b330-89b5f4dcb1b7/copy-manifests/0.log" Jun 11 15:18:33.301998 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:18:33.301969 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-ckj4z_3cc0ec60-4c6b-4457-8d8f-71c19a237e80/postgres/0.log" Jun 11 15:18:34.982306 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:18:34.982219 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-697bc84576-pv5pg_06c5c045-3e1a-46aa-962c-50756a701b4e/manager/0.log" Jun 11 15:18:36.872574 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:18:36.872541 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-946684896-nsl9n_04e6f5d1-8f42-40f5-ac1e-c8733c10dd66/kube-auth-proxy/0.log" Jun 11 15:18:38.133708 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:18:38.133682 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-946684896-nsl9n_04e6f5d1-8f42-40f5-ac1e-c8733c10dd66/kube-auth-proxy/0.log" Jun 11 15:18:40.090125 ip-10-0-128-147 kubenswrapper[2569]: I0611 15:18:40.090098 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-946684896-nsl9n_04e6f5d1-8f42-40f5-ac1e-c8733c10dd66/kube-auth-proxy/0.log"