Jun 08 08:18:42.637877 ip-10-0-143-101 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 08 08:18:42.637891 ip-10-0-143-101 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 08 08:18:42.637900 ip-10-0-143-101 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 08 08:18:42.638104 ip-10-0-143-101 systemd[1]: Failed to start Kubernetes Kubelet. Jun 08 08:18:52.851155 ip-10-0-143-101 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 08 08:18:52.851171 ip-10-0-143-101 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 6cfcabb20fe04c668f9c2cccd7c90d08 -- Jun 08 08:21:28.618990 ip-10-0-143-101 systemd[1]: Starting Kubernetes Kubelet... Jun 08 08:21:29.051848 ip-10-0-143-101 kubenswrapper[2570]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 08 08:21:29.051848 ip-10-0-143-101 kubenswrapper[2570]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 08 08:21:29.051848 ip-10-0-143-101 kubenswrapper[2570]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 08 08:21:29.051848 ip-10-0-143-101 kubenswrapper[2570]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 08 08:21:29.052861 ip-10-0-143-101 kubenswrapper[2570]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 08 08:21:29.053024 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.052952 2570 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 08 08:21:29.058994 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.058980 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 08:21:29.058994 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.058994 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 08:21:29.059057 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.058998 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 08:21:29.059057 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.059001 2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 08:21:29.059057 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.059004 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 08:21:29.059057 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.059006 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 08:21:29.059057 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.059010 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 08:21:29.059057 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.059013 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 08:21:29.059057 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.059015 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 08:21:29.059057 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.059018 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 08:21:29.059057 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.059021 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 08:21:29.059057 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.059023 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 08:21:29.059057 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.059027 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 08:21:29.059057 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.059030 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 08:21:29.059057 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.059032 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 08:21:29.059057 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.059035 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 08:21:29.059057 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.059037 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 08:21:29.059057 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.059040 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 08:21:29.059057 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.059043 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 08:21:29.059057 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.059045 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 08:21:29.059057 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.059052 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 08:21:29.059057 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.059054 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 08:21:29.059530 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.059057 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 08:21:29.059530 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.059060 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 08:21:29.059530 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.059063 2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 08:21:29.059530 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.059065 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 08:21:29.059530 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.059068 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 08:21:29.059530 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.059071 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 08:21:29.059530 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.059073 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 08:21:29.059530 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.059076 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 08:21:29.059530 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.059079 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 08:21:29.059530 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.059081 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 08:21:29.059530 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.059083 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 08:21:29.059530 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.059086 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 08:21:29.059530 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.059088 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 08:21:29.059530 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.059091 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 08:21:29.059530 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.059093 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 08:21:29.059530 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.059096 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 08:21:29.059530 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.059098 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 08:21:29.059530 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.059101 2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 08:21:29.059530 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.059103 2570 feature_gate.go:328] unrecognized feature gate: Example Jun 08 08:21:29.059530 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.059106 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 08:21:29.060266 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.059108 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 08:21:29.060266 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.059111 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 08:21:29.060266 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.059113 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 08:21:29.060266 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.059116 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 08:21:29.060266 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.059118 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 08:21:29.060266 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.059121 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 08:21:29.060266 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.059123 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 08:21:29.060266 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.059125 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 08:21:29.060266 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.059128 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 08:21:29.060266 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.059130 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 08:21:29.060266 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.059133 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 08:21:29.060266 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.059136 2570 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 08:21:29.060266 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.059139 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 08:21:29.060266 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.059142 2570 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 08:21:29.060266 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.059145 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 08:21:29.060266 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.059147 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 08:21:29.060266 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.059150 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 08:21:29.060266 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.059152 2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 08:21:29.060266 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.059154 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 08:21:29.060266 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.059157 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 08:21:29.060973 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.059160 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 08:21:29.060973 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.059162 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 08:21:29.060973 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.059165 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 08:21:29.060973 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.059167 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 08:21:29.060973 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.059170 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 08:21:29.060973 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.059172 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 08:21:29.060973 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.059175 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 08:21:29.060973 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.059177 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 08:21:29.060973 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.059181 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 08:21:29.060973 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.059183 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 08:21:29.060973 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.059186 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 08:21:29.060973 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.059188 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 08:21:29.060973 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.059191 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 08:21:29.060973 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.059193 2570 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 08:21:29.060973 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.059196 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 08:21:29.060973 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.059198 2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 08:21:29.060973 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.059201 2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 08:21:29.060973 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.059204 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 08:21:29.060973 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.059206 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 08:21:29.060973 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.059209 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 08:21:29.061503 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.059211 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 08:21:29.061503 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.059216 2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 08:21:29.061503 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.059220 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 08:21:29.061503 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.059223 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 08:21:29.061503 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.059226 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 08:21:29.061503 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.059231 2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 08:21:29.061503 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.059234 2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 08:21:29.061503 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.059238 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 08:21:29.061503 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.059241 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 08:21:29.061503 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.059243 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 08:21:29.061503 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.059246 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 08:21:29.061503 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.059250 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 08:21:29.061503 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.059254 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 08:21:29.061503 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.059258 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 08:21:29.061503 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.059261 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 08:21:29.061503 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.059264 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 08:21:29.061503 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.059267 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 08:21:29.061979 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.061963 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 08:21:29.061979 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.061977 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 08:21:29.062035 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.061981 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 08:21:29.062035 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.061984 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 08:21:29.062035 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.061987 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 08:21:29.062035 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.061989 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 08:21:29.062035 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.061992 2570 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 08:21:29.062035 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.061995 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 08:21:29.062035 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.061997 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 08:21:29.062035 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062000 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 08:21:29.062035 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062003 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 08:21:29.062035 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062006 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 08:21:29.062035 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062008 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 08:21:29.062035 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062011 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 08:21:29.062035 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062014 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 08:21:29.062035 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062017 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 08:21:29.062035 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062020 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 08:21:29.062035 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062022 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 08:21:29.062035 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062025 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 08:21:29.062035 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062027 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 08:21:29.062035 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062030 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 08:21:29.062035 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062032 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 08:21:29.062532 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062035 2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 08:21:29.062532 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062037 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 08:21:29.062532 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062040 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 08:21:29.062532 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062044 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 08:21:29.062532 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062046 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 08:21:29.062532 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062050 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 08:21:29.062532 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062052 2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 08:21:29.062532 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062055 2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 08:21:29.062532 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062057 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 08:21:29.062532 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062060 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 08:21:29.062532 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062063 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 08:21:29.062532 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062065 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 08:21:29.062532 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062068 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 08:21:29.062532 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062070 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 08:21:29.062532 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062073 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 08:21:29.062532 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062075 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 08:21:29.062532 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062078 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 08:21:29.062532 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062080 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 08:21:29.062532 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062083 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 08:21:29.062532 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062085 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 08:21:29.063041 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062088 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 08:21:29.063041 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062090 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 08:21:29.063041 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062093 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 08:21:29.063041 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062095 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 08:21:29.063041 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062098 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 08:21:29.063041 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062100 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 08:21:29.063041 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062103 2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 08:21:29.063041 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062105 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 08:21:29.063041 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062108 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 08:21:29.063041 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062111 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 08:21:29.063041 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062113 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 08:21:29.063041 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062116 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 08:21:29.063041 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062118 2570 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 08:21:29.063041 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062122 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 08:21:29.063041 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062125 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 08:21:29.063041 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062127 2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 08:21:29.063041 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062130 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 08:21:29.063041 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062134 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 08:21:29.063041 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062138 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 08:21:29.063504 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062140 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 08:21:29.063504 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062143 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 08:21:29.063504 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062147 2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 08:21:29.063504 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062151 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 08:21:29.063504 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062154 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 08:21:29.063504 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062157 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 08:21:29.063504 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062159 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 08:21:29.063504 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062163 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 08:21:29.063504 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062166 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 08:21:29.063504 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062169 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 08:21:29.063504 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062171 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 08:21:29.063504 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062174 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 08:21:29.063504 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062177 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 08:21:29.063504 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062180 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 08:21:29.063504 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062182 2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 08:21:29.063504 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062185 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 08:21:29.063504 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062188 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 08:21:29.063504 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062191 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 08:21:29.063504 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062195 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 08:21:29.063995 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062199 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 08:21:29.063995 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062202 2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 08:21:29.063995 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062205 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 08:21:29.063995 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062209 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 08:21:29.063995 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062211 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 08:21:29.063995 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062215 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 08:21:29.063995 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062218 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 08:21:29.063995 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062222 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 08:21:29.063995 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062224 2570 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 08:21:29.063995 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062227 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 08:21:29.063995 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062230 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 08:21:29.063995 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062233 2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 08:21:29.063995 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062235 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 08:21:29.063995 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062238 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 08:21:29.063995 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062241 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 08:21:29.063995 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062244 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 08:21:29.063995 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062246 2570 feature_gate.go:328] unrecognized feature gate: Example Jun 08 08:21:29.063995 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062249 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 08:21:29.063995 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062252 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 08:21:29.063995 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062630 2570 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 08:21:29.064473 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062635 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 08:21:29.064473 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062639 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 08:21:29.064473 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062641 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 08:21:29.064473 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062644 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 08:21:29.064473 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062647 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 08:21:29.064473 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062650 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 08:21:29.064473 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062653 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 08:21:29.064473 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062656 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 08:21:29.064473 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062658 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 08:21:29.064473 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062661 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 08:21:29.064473 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062663 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 08:21:29.064473 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062666 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 08:21:29.064473 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062668 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 08:21:29.064473 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062671 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 08:21:29.064473 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062673 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 08:21:29.064473 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062676 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 08:21:29.064473 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062679 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 08:21:29.064473 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062682 2570 feature_gate.go:328] unrecognized feature gate: Example Jun 08 08:21:29.064473 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062684 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 08:21:29.064473 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062690 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 08:21:29.064963 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062692 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 08:21:29.064963 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062695 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 08:21:29.064963 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062698 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 08:21:29.064963 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062700 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 08:21:29.064963 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062703 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 08:21:29.064963 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062706 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 08:21:29.064963 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062723 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 08:21:29.064963 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062726 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 08:21:29.064963 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062728 2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 08:21:29.064963 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062732 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 08:21:29.064963 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062735 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 08:21:29.064963 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062739 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 08:21:29.064963 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062742 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 08:21:29.064963 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062745 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 08:21:29.064963 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062748 2570 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 08:21:29.064963 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062750 2570 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 08:21:29.064963 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062753 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 08:21:29.064963 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062756 2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 08:21:29.064963 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062758 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 08:21:29.064963 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062761 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 08:21:29.065534 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062763 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 08:21:29.065534 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062766 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 08:21:29.065534 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062768 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 08:21:29.065534 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062771 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 08:21:29.065534 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062775 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 08:21:29.065534 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062778 2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 08:21:29.065534 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062782 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 08:21:29.065534 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062785 2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 08:21:29.065534 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062789 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 08:21:29.065534 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062792 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 08:21:29.065534 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062795 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 08:21:29.065534 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062800 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 08:21:29.065534 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062802 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 08:21:29.065534 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062805 2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 08:21:29.065534 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062808 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 08:21:29.065534 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062811 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 08:21:29.065534 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062814 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 08:21:29.065534 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062817 2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 08:21:29.065534 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062820 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 08:21:29.066037 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062823 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 08:21:29.066037 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062825 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 08:21:29.066037 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062828 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 08:21:29.066037 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062830 2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 08:21:29.066037 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062833 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 08:21:29.066037 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062835 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 08:21:29.066037 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062838 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 08:21:29.066037 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062841 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 08:21:29.066037 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062843 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 08:21:29.066037 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062846 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 08:21:29.066037 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062848 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 08:21:29.066037 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062851 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 08:21:29.066037 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062854 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 08:21:29.066037 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062857 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 08:21:29.066037 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062859 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 08:21:29.066037 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062862 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 08:21:29.066037 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062865 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 08:21:29.066037 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062867 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 08:21:29.066037 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062870 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 08:21:29.066502 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062872 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 08:21:29.066502 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062875 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 08:21:29.066502 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062877 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 08:21:29.066502 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062881 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 08:21:29.066502 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062883 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 08:21:29.066502 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062887 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 08:21:29.066502 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062890 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 08:21:29.066502 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062892 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 08:21:29.066502 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062895 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 08:21:29.066502 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062898 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 08:21:29.066502 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062900 2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 08:21:29.066502 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062902 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 08:21:29.066502 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062905 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 08:21:29.066502 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062907 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 08:21:29.066502 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062910 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 08:21:29.066502 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062912 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 08:21:29.066502 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062915 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 08:21:29.066502 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062917 2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 08:21:29.066502 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062920 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 08:21:29.066502 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.062923 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 08:21:29.066997 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.062989 2570 flags.go:64] FLAG: --address="0.0.0.0" Jun 08 08:21:29.066997 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.062996 2570 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 08 08:21:29.066997 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063002 2570 flags.go:64] FLAG: --anonymous-auth="true" Jun 08 08:21:29.066997 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063007 2570 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 08 08:21:29.066997 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063011 2570 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 08 08:21:29.066997 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063014 2570 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 08 08:21:29.066997 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063017 2570 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 08 08:21:29.066997 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063022 2570 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 08 08:21:29.066997 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063025 2570 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 08 08:21:29.066997 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063028 2570 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 08 08:21:29.066997 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063032 2570 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 08 08:21:29.066997 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063035 2570 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 08 08:21:29.066997 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063038 2570 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 08 08:21:29.066997 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063041 2570 flags.go:64] FLAG: --cgroup-root="" Jun 08 08:21:29.066997 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063044 2570 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 08 08:21:29.066997 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063047 2570 flags.go:64] FLAG: --client-ca-file="" Jun 08 08:21:29.066997 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063051 2570 flags.go:64] FLAG: --cloud-provider="external" Jun 08 08:21:29.066997 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063055 2570 flags.go:64] FLAG: --cluster-dns="[]" Jun 08 08:21:29.066997 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063059 2570 flags.go:64] FLAG: --cluster-domain="" Jun 08 08:21:29.066997 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063062 2570 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 08 08:21:29.066997 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063065 2570 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 08 08:21:29.066997 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063068 2570 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 08 08:21:29.066997 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063072 2570 flags.go:64] FLAG: --container-log-max-files="5" Jun 08 08:21:29.066997 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063075 2570 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 08 08:21:29.067592 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063078 2570 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 08 08:21:29.067592 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063081 2570 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 08 08:21:29.067592 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063084 2570 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 08 08:21:29.067592 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063087 2570 flags.go:64] FLAG: --contention-profiling="false" Jun 08 08:21:29.067592 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063089 2570 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 08 08:21:29.067592 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063092 2570 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 08 08:21:29.067592 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063095 2570 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 08 08:21:29.067592 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063098 2570 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 08 08:21:29.067592 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063102 2570 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 08 08:21:29.067592 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063105 2570 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 08 08:21:29.067592 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063107 2570 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 08 08:21:29.067592 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063110 2570 flags.go:64] FLAG: --enable-load-reader="false" Jun 08 08:21:29.067592 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063113 2570 flags.go:64] FLAG: --enable-server="true" Jun 08 08:21:29.067592 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063116 2570 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 08 08:21:29.067592 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063120 2570 flags.go:64] FLAG: --event-burst="100" Jun 08 08:21:29.067592 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063123 2570 flags.go:64] FLAG: --event-qps="50" Jun 08 08:21:29.067592 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063126 2570 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 08 08:21:29.067592 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063129 2570 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 08 08:21:29.067592 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063132 2570 flags.go:64] FLAG: --eviction-hard="" Jun 08 08:21:29.067592 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063136 2570 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 08 08:21:29.067592 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063139 2570 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 08 08:21:29.067592 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063141 2570 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 08 08:21:29.067592 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063144 2570 flags.go:64] FLAG: --eviction-soft="" Jun 08 08:21:29.067592 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063148 2570 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 08 08:21:29.067592 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063150 2570 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 08 08:21:29.068247 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063154 2570 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 08 08:21:29.068247 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063157 2570 flags.go:64] FLAG: --experimental-mounter-path="" Jun 08 08:21:29.068247 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063160 2570 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 08 08:21:29.068247 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063163 2570 flags.go:64] FLAG: --fail-swap-on="true" Jun 08 08:21:29.068247 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063166 2570 flags.go:64] FLAG: --feature-gates="" Jun 08 08:21:29.068247 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063170 2570 flags.go:64] FLAG: --file-check-frequency="20s" Jun 08 08:21:29.068247 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063173 2570 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 08 08:21:29.068247 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063176 2570 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 08 08:21:29.068247 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063179 2570 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 08 08:21:29.068247 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063182 2570 flags.go:64] FLAG: --healthz-port="10248" Jun 08 08:21:29.068247 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063185 2570 flags.go:64] FLAG: --help="false" Jun 08 08:21:29.068247 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063187 2570 flags.go:64] FLAG: --hostname-override="ip-10-0-143-101.ec2.internal" Jun 08 08:21:29.068247 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063190 2570 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 08 08:21:29.068247 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063193 2570 flags.go:64] FLAG: --http-check-frequency="20s" Jun 08 08:21:29.068247 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063196 2570 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 08 08:21:29.068247 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063199 2570 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 08 08:21:29.068247 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063202 2570 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 08 08:21:29.068247 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063205 2570 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 08 08:21:29.068247 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063208 2570 flags.go:64] FLAG: --image-service-endpoint="" Jun 08 08:21:29.068247 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063211 2570 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 08 08:21:29.068247 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063214 2570 flags.go:64] FLAG: --kube-api-burst="100" Jun 08 08:21:29.068247 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063217 2570 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 08 08:21:29.068247 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063220 2570 flags.go:64] FLAG: --kube-api-qps="50" Jun 08 08:21:29.068247 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063225 2570 flags.go:64] FLAG: --kube-reserved="" Jun 08 08:21:29.068844 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063227 2570 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 08 08:21:29.068844 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063230 2570 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 08 08:21:29.068844 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063233 2570 flags.go:64] FLAG: --kubelet-cgroups="" Jun 08 08:21:29.068844 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063236 2570 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 08 08:21:29.068844 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063238 2570 flags.go:64] FLAG: --lock-file="" Jun 08 08:21:29.068844 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063241 2570 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 08 08:21:29.068844 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063244 2570 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 08 08:21:29.068844 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063247 2570 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 08 08:21:29.068844 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063252 2570 flags.go:64] FLAG: --log-json-split-stream="false" Jun 08 08:21:29.068844 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063256 2570 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 08 08:21:29.068844 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063258 2570 flags.go:64] FLAG: --log-text-split-stream="false" Jun 08 08:21:29.068844 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063261 2570 flags.go:64] FLAG: --logging-format="text" Jun 08 08:21:29.068844 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063264 2570 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 08 08:21:29.068844 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063267 2570 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 08 08:21:29.068844 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063270 2570 flags.go:64] FLAG: --manifest-url="" Jun 08 08:21:29.068844 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063273 2570 flags.go:64] FLAG: --manifest-url-header="" Jun 08 08:21:29.068844 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063277 2570 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 08 08:21:29.068844 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063280 2570 flags.go:64] FLAG: --max-open-files="1000000" Jun 08 08:21:29.068844 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063283 2570 flags.go:64] FLAG: --max-pods="110" Jun 08 08:21:29.068844 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063286 2570 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 08 08:21:29.068844 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063289 2570 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 08 08:21:29.068844 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063292 2570 flags.go:64] FLAG: --memory-manager-policy="None" Jun 08 08:21:29.068844 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063295 2570 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 08 08:21:29.068844 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063298 2570 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 08 08:21:29.068844 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063301 2570 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 08 08:21:29.069466 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063304 2570 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 08 08:21:29.069466 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063311 2570 flags.go:64] FLAG: --node-status-max-images="50" Jun 08 08:21:29.069466 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063314 2570 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 08 08:21:29.069466 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063317 2570 flags.go:64] FLAG: --oom-score-adj="-999" Jun 08 08:21:29.069466 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063320 2570 flags.go:64] FLAG: --pod-cidr="" Jun 08 08:21:29.069466 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063322 2570 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 08 08:21:29.069466 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063329 2570 flags.go:64] FLAG: --pod-manifest-path="" Jun 08 08:21:29.069466 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063332 2570 flags.go:64] FLAG: --pod-max-pids="-1" Jun 08 08:21:29.069466 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063335 2570 flags.go:64] FLAG: --pods-per-core="0" Jun 08 08:21:29.069466 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063338 2570 flags.go:64] FLAG: --port="10250" Jun 08 08:21:29.069466 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063341 2570 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 08 08:21:29.069466 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063344 2570 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-02595008f191be26e" Jun 08 08:21:29.069466 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063347 2570 flags.go:64] FLAG: --qos-reserved="" Jun 08 08:21:29.069466 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063350 2570 flags.go:64] FLAG: --read-only-port="10255" Jun 08 08:21:29.069466 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063353 2570 flags.go:64] FLAG: --register-node="true" Jun 08 08:21:29.069466 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063356 2570 flags.go:64] FLAG: --register-with-taints="" Jun 08 08:21:29.069466 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063359 2570 flags.go:64] FLAG: --registry-burst="10" Jun 08 08:21:29.069466 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063362 2570 flags.go:64] FLAG: --registry-qps="5" Jun 08 08:21:29.069466 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063365 2570 flags.go:64] FLAG: --reserved-cpus="" Jun 08 08:21:29.069466 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063368 2570 flags.go:64] FLAG: --reserved-memory="" Jun 08 08:21:29.069466 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063371 2570 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 08 08:21:29.069466 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063374 2570 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 08 08:21:29.069466 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063377 2570 flags.go:64] FLAG: --rotate-certificates="false" Jun 08 08:21:29.069466 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063380 2570 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 08 08:21:29.069466 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063382 2570 flags.go:64] FLAG: --runonce="false" Jun 08 08:21:29.070097 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063385 2570 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 08 08:21:29.070097 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063388 2570 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 08 08:21:29.070097 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063391 2570 flags.go:64] FLAG: --seccomp-default="false" Jun 08 08:21:29.070097 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063394 2570 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 08 08:21:29.070097 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063396 2570 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 08 08:21:29.070097 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063399 2570 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 08 08:21:29.070097 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063403 2570 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 08 08:21:29.070097 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063406 2570 flags.go:64] FLAG: --storage-driver-password="root" Jun 08 08:21:29.070097 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063409 2570 flags.go:64] FLAG: --storage-driver-secure="false" Jun 08 08:21:29.070097 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063412 2570 flags.go:64] FLAG: --storage-driver-table="stats" Jun 08 08:21:29.070097 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063415 2570 flags.go:64] FLAG: --storage-driver-user="root" Jun 08 08:21:29.070097 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063417 2570 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 08 08:21:29.070097 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063420 2570 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 08 08:21:29.070097 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063424 2570 flags.go:64] FLAG: --system-cgroups="" Jun 08 08:21:29.070097 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063440 2570 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 08 08:21:29.070097 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063446 2570 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 08 08:21:29.070097 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063450 2570 flags.go:64] FLAG: --tls-cert-file="" Jun 08 08:21:29.070097 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063453 2570 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 08 08:21:29.070097 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063457 2570 flags.go:64] FLAG: --tls-min-version="" Jun 08 08:21:29.070097 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063460 2570 flags.go:64] FLAG: --tls-private-key-file="" Jun 08 08:21:29.070097 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063463 2570 flags.go:64] FLAG: --topology-manager-policy="none" Jun 08 08:21:29.070097 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063466 2570 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 08 08:21:29.070097 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063468 2570 flags.go:64] FLAG: --topology-manager-scope="container" Jun 08 08:21:29.070097 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063473 2570 flags.go:64] FLAG: --v="2" Jun 08 08:21:29.070097 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063476 2570 flags.go:64] FLAG: --version="false" Jun 08 08:21:29.070726 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063481 2570 flags.go:64] FLAG: --vmodule="" Jun 08 08:21:29.070726 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063484 2570 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 08 08:21:29.070726 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.063488 2570 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 08 08:21:29.070726 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.063608 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 08:21:29.070726 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.063612 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 08:21:29.070726 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.063615 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 08:21:29.070726 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.063618 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 08:21:29.070726 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.063621 2570 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 08:21:29.070726 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.063624 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 08:21:29.070726 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.063627 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 08:21:29.070726 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.063629 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 08:21:29.070726 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.063632 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 08:21:29.070726 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.063635 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 08:21:29.070726 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.063638 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 08:21:29.070726 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.063640 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 08:21:29.070726 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.063642 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 08:21:29.070726 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.063645 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 08:21:29.070726 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.063648 2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 08:21:29.070726 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.063650 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 08:21:29.070726 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.063653 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 08:21:29.071226 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.063657 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 08:21:29.071226 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.063660 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 08:21:29.071226 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.063662 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 08:21:29.071226 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.063665 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 08:21:29.071226 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.063667 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 08:21:29.071226 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.063670 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 08:21:29.071226 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.063672 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 08:21:29.071226 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.063675 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 08:21:29.071226 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.063678 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 08:21:29.071226 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.063680 2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 08:21:29.071226 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.063684 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 08:21:29.071226 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.063686 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 08:21:29.071226 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.063689 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 08:21:29.071226 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.063692 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 08:21:29.071226 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.063695 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 08:21:29.071226 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.063698 2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 08:21:29.071226 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.063700 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 08:21:29.071226 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.063703 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 08:21:29.071226 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.063706 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 08:21:29.071702 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.063723 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 08:21:29.071702 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.063727 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 08:21:29.071702 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.063731 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 08:21:29.071702 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.063733 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 08:21:29.071702 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.063736 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 08:21:29.071702 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.063739 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 08:21:29.071702 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.063741 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 08:21:29.071702 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.063744 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 08:21:29.071702 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.063747 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 08:21:29.071702 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.063749 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 08:21:29.071702 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.063752 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 08:21:29.071702 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.063754 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 08:21:29.071702 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.063757 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 08:21:29.071702 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.063761 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 08:21:29.071702 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.063764 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 08:21:29.071702 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.063766 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 08:21:29.071702 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.063769 2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 08:21:29.071702 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.063771 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 08:21:29.071702 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.063774 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 08:21:29.072188 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.063778 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 08:21:29.072188 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.063781 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 08:21:29.072188 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.063784 2570 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 08:21:29.072188 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.063787 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 08:21:29.072188 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.063792 2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 08:21:29.072188 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.063795 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 08:21:29.072188 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.063798 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 08:21:29.072188 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.063801 2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 08:21:29.072188 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.063804 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 08:21:29.072188 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.063806 2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 08:21:29.072188 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.063809 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 08:21:29.072188 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.063812 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 08:21:29.072188 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.063814 2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 08:21:29.072188 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.063817 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 08:21:29.072188 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.063819 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 08:21:29.072188 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.063822 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 08:21:29.072188 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.063824 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 08:21:29.072188 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.063827 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 08:21:29.072188 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.063830 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 08:21:29.072687 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.063832 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 08:21:29.072687 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.063835 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 08:21:29.072687 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.063837 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 08:21:29.072687 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.063840 2570 feature_gate.go:328] unrecognized feature gate: Example Jun 08 08:21:29.072687 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.063843 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 08:21:29.072687 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.063845 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 08:21:29.072687 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.063848 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 08:21:29.072687 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.063852 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 08:21:29.072687 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.063854 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 08:21:29.072687 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.063857 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 08:21:29.072687 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.063859 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 08:21:29.072687 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.063862 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 08:21:29.072687 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.063865 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 08:21:29.072687 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.063867 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 08:21:29.072687 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.063870 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 08:21:29.072687 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.063872 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 08:21:29.072687 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.063875 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 08:21:29.072687 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.063879 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 08:21:29.072687 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.063881 2570 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 08:21:29.072687 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.063884 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 08:21:29.073182 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.063887 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 08:21:29.073182 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.063889 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 08:21:29.073182 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.063892 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 08:21:29.073182 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.063895 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 08:21:29.073182 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.063898 2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 08:21:29.073182 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.064592 2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 08 08:21:29.073182 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.070777 2570 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 08 08:21:29.073182 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.070793 2570 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 08 08:21:29.073182 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.070811 2570 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 08 08:21:29.073182 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.070817 2570 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 08 08:21:29.073182 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.070872 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 08:21:29.073182 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.070877 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 08:21:29.073182 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.070881 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 08:21:29.073182 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.070884 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 08:21:29.073530 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.070887 2570 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 08:21:29.073530 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.070890 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 08:21:29.073530 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.070893 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 08:21:29.073530 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.070896 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 08:21:29.073530 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.070899 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 08:21:29.073530 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.070902 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 08:21:29.073530 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.070904 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 08:21:29.073530 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.070907 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 08:21:29.073530 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.070910 2570 feature_gate.go:328] unrecognized feature gate: Example Jun 08 08:21:29.073530 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.070912 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 08:21:29.073530 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.070915 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 08:21:29.073530 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.070918 2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 08:21:29.073530 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.070920 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 08:21:29.073530 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.070923 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 08:21:29.073530 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.070926 2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 08:21:29.073530 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.070928 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 08:21:29.073530 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.070931 2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 08:21:29.073530 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.070934 2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 08:21:29.073530 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.070936 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 08:21:29.073530 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.070939 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 08:21:29.074084 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.070941 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 08:21:29.074084 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.070944 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 08:21:29.074084 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.070948 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 08:21:29.074084 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.070952 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 08:21:29.074084 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.070955 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 08:21:29.074084 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.070959 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 08:21:29.074084 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.070962 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 08:21:29.074084 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.070965 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 08:21:29.074084 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.070968 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 08:21:29.074084 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.070970 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 08:21:29.074084 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.070973 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 08:21:29.074084 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.070975 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 08:21:29.074084 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.070978 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 08:21:29.074084 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.070981 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 08:21:29.074084 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.070985 2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 08:21:29.074084 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.070988 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 08:21:29.074084 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.070991 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 08:21:29.074084 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.070993 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 08:21:29.074520 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.070996 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 08:21:29.074520 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.070999 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 08:21:29.074520 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071001 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 08:21:29.074520 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071004 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 08:21:29.074520 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071007 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 08:21:29.074520 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071010 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 08:21:29.074520 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071013 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 08:21:29.074520 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071016 2570 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 08:21:29.074520 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071019 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 08:21:29.074520 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071021 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 08:21:29.074520 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071024 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 08:21:29.074520 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071026 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 08:21:29.074520 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071029 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 08:21:29.074520 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071031 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 08:21:29.074520 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071033 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 08:21:29.074520 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071036 2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 08:21:29.074520 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071039 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 08:21:29.074520 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071041 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 08:21:29.074520 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071043 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 08:21:29.074520 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071047 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 08:21:29.075010 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071050 2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 08:21:29.075010 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071053 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 08:21:29.075010 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071056 2570 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 08:21:29.075010 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071058 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 08:21:29.075010 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071061 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 08:21:29.075010 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071064 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 08:21:29.075010 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071066 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 08:21:29.075010 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071069 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 08:21:29.075010 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071071 2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 08:21:29.075010 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071074 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 08:21:29.075010 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071076 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 08:21:29.075010 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071079 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 08:21:29.075010 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071082 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 08:21:29.075010 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071084 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 08:21:29.075010 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071087 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 08:21:29.075010 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071089 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 08:21:29.075010 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071092 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 08:21:29.075010 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071094 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 08:21:29.075010 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071097 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 08:21:29.075010 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071099 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 08:21:29.075489 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071102 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 08:21:29.075489 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071105 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 08:21:29.075489 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071107 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 08:21:29.075489 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071109 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 08:21:29.075489 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071112 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 08:21:29.075489 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071115 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 08:21:29.075489 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071117 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 08:21:29.075489 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071120 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 08:21:29.075489 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071122 2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 08:21:29.075489 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071125 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 08:21:29.075489 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071128 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 08:21:29.075489 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071131 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 08:21:29.075489 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071133 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 08:21:29.075489 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071136 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 08:21:29.075489 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071139 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 08:21:29.075489 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071143 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 08:21:29.075489 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071145 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 08:21:29.075926 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.071150 2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 08 08:21:29.075926 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071257 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 08:21:29.075926 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071262 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 08:21:29.075926 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071266 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 08:21:29.075926 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071269 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 08:21:29.075926 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071272 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 08:21:29.075926 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071275 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 08:21:29.075926 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071278 2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 08:21:29.075926 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071281 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 08:21:29.075926 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071283 2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 08:21:29.075926 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071286 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 08:21:29.075926 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071289 2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 08:21:29.075926 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071291 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 08:21:29.075926 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071294 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 08:21:29.076258 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071297 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 08:21:29.076258 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071300 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 08:21:29.076258 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071302 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 08:21:29.076258 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071305 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 08:21:29.076258 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071307 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 08:21:29.076258 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071310 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 08:21:29.076258 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071312 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 08:21:29.076258 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071315 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 08:21:29.076258 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071317 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 08:21:29.076258 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071320 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 08:21:29.076258 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071322 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 08:21:29.076258 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071325 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 08:21:29.076258 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071328 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 08:21:29.076258 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071331 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 08:21:29.076258 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071333 2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 08:21:29.076258 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071336 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 08:21:29.076258 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071339 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 08:21:29.076258 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071341 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 08:21:29.076258 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071344 2570 feature_gate.go:328] unrecognized feature gate: Example Jun 08 08:21:29.076258 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071347 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 08:21:29.076755 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071349 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 08:21:29.076755 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071352 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 08:21:29.076755 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071354 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 08:21:29.076755 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071357 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 08:21:29.076755 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071361 2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 08:21:29.076755 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071364 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 08:21:29.076755 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071367 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 08:21:29.076755 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071370 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 08:21:29.076755 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071372 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 08:21:29.076755 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071375 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 08:21:29.076755 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071378 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 08:21:29.076755 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071381 2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 08:21:29.076755 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071383 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 08:21:29.076755 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071386 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 08:21:29.076755 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071389 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 08:21:29.076755 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071392 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 08:21:29.076755 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071395 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 08:21:29.076755 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071397 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 08:21:29.076755 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071400 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 08:21:29.076755 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071402 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 08:21:29.077239 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071405 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 08:21:29.077239 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071407 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 08:21:29.077239 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071410 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 08:21:29.077239 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071412 2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 08:21:29.077239 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071415 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 08:21:29.077239 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071418 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 08:21:29.077239 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071420 2570 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 08:21:29.077239 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071423 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 08:21:29.077239 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071426 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 08:21:29.077239 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071429 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 08:21:29.077239 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071431 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 08:21:29.077239 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071433 2570 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 08:21:29.077239 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071436 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 08:21:29.077239 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071438 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 08:21:29.077239 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071441 2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 08:21:29.077239 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071443 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 08:21:29.077239 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071446 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 08:21:29.077239 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071448 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 08:21:29.077239 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071451 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 08:21:29.077239 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071453 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 08:21:29.077719 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071456 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 08:21:29.077719 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071458 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 08:21:29.077719 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071461 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 08:21:29.077719 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071464 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 08:21:29.077719 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071466 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 08:21:29.077719 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071469 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 08:21:29.077719 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071471 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 08:21:29.077719 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071474 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 08:21:29.077719 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071477 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 08:21:29.077719 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071479 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 08:21:29.077719 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071481 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 08:21:29.077719 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071484 2570 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 08:21:29.077719 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071487 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 08:21:29.077719 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071489 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 08:21:29.077719 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071492 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 08:21:29.077719 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071494 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 08:21:29.077719 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071497 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 08:21:29.077719 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071500 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 08:21:29.077719 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071503 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 08:21:29.077719 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071506 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 08:21:29.078238 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071509 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 08:21:29.078238 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071512 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 08:21:29.078238 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071521 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 08:21:29.078238 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071524 2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 08:21:29.078238 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071527 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 08:21:29.078238 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:29.071530 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 08:21:29.078238 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.071535 2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 08 08:21:29.078238 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.071633 2570 server.go:962] "Client rotation is on, will bootstrap in background" Jun 08 08:21:29.078238 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.073844 2570 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 08 08:21:29.078238 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.075435 2570 server.go:1019] "Starting client certificate rotation" Jun 08 08:21:29.078238 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.075538 2570 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 08 08:21:29.078238 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.075577 2570 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 08 08:21:29.078847 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.078835 2570 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 08 08:21:29.081746 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.081732 2570 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 08 08:21:29.093510 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.093492 2570 log.go:25] "Validated CRI v1 runtime API" Jun 08 08:21:29.095934 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.095922 2570 log.go:25] "Validated CRI v1 image API" Jun 08 08:21:29.096655 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.096638 2570 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 08 08:21:29.099636 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.099615 2570 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 ae3654f0-feec-41d6-b204-bf2d990c27c1:/dev/nvme0n1p3 e5ea8122-fa3c-4880-b3e4-6ea76fd896fd:/dev/nvme0n1p4] Jun 08 08:21:29.099734 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.099636 2570 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 08 08:21:29.104639 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.104526 2570 manager.go:216] Machine: {Timestamp:2026-06-08 08:21:29.103142655 +0000 UTC m=+0.357354096 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3104387 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2d25bde127aef344e8510359c79a12 SystemUUID:ec2d25bd-e127-aef3-44e8-510359c79a12 BootID:6cfcabb2-0fe0-4c66-8f9c-2cccd7c90d08 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:5d:da:44:70:69 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:5d:da:44:70:69 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:5a:5a:41:ec:1d:2a Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 08 08:21:29.104639 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.104628 2570 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 08 08:21:29.104808 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.104756 2570 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 08 08:21:29.108663 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.108549 2570 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 08 08:21:29.108816 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.108666 2570 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-101.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 08 08:21:29.109350 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.109341 2570 topology_manager.go:138] "Creating topology manager with none policy" Jun 08 08:21:29.109384 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.109352 2570 container_manager_linux.go:309] "Creating device plugin manager" Jun 08 08:21:29.109384 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.109360 2570 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 08 08:21:29.110346 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.110335 2570 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 08 08:21:29.111172 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.111162 2570 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 08 08:21:29.113808 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.113794 2570 state_mem.go:36] "Initialized new in-memory state store" Jun 08 08:21:29.114040 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.114030 2570 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 08 08:21:29.114081 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.114059 2570 kubelet.go:486] "Attempting to sync node with API server" Jun 08 08:21:29.114081 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.114068 2570 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 08 08:21:29.114081 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.114077 2570 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 08 08:21:29.114174 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.114089 2570 kubelet.go:398] "Adding apiserver pod source" Jun 08 08:21:29.114174 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.114098 2570 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 08 08:21:29.114392 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.114378 2570 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 08 08:21:29.114451 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.114396 2570 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 08 08:21:29.116312 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.116295 2570 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 08 08:21:29.116967 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.116953 2570 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 08 08:21:29.118472 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.118459 2570 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 08 08:21:29.118523 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.118488 2570 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 08 08:21:29.119641 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.119630 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 08 08:21:29.119680 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.119646 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 08 08:21:29.119680 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.119652 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 08 08:21:29.119680 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.119658 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 08 08:21:29.119680 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.119667 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 08 08:21:29.119680 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.119674 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 08 08:21:29.119680 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.119682 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 08 08:21:29.119958 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.119687 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 08 08:21:29.119958 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.119704 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 08 08:21:29.119958 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.119725 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 08 08:21:29.119958 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.119736 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 08 08:21:29.119958 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.119742 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 08 08:21:29.119958 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.119761 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 08 08:21:29.119958 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.119767 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 08 08:21:29.123150 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.123136 2570 server.go:1268] "Started kubelet" Jun 08 08:21:29.123416 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.123261 2570 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 08 08:21:29.123501 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.123281 2570 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 08 08:21:29.123501 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.123446 2570 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 08 08:21:29.123975 ip-10-0-143-101 systemd[1]: Started Kubernetes Kubelet. Jun 08 08:21:29.127508 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.127485 2570 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 08 08:21:29.127595 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.127564 2570 server.go:310] "Adding debug handlers to kubelet server" Jun 08 08:21:29.132857 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:29.132838 2570 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 08 08:21:29.133464 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.133445 2570 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 08 08:21:29.133551 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.133517 2570 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 08 08:21:29.133551 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:29.133532 2570 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 08 08:21:29.134136 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:29.134033 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-101.ec2.internal\" not found" Jun 08 08:21:29.134136 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.134055 2570 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 08 08:21:29.134136 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.134076 2570 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 08 08:21:29.134136 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.134086 2570 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 08 08:21:29.134344 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.134219 2570 reconstruct.go:97] "Volume reconstruction finished" Jun 08 08:21:29.134344 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.134227 2570 reconciler.go:29] "Reconciler: start to sync state" Jun 08 08:21:29.134522 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:29.134340 2570 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-101.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 08 08:21:29.134757 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.134698 2570 factory.go:153] Registering CRI-O factory Jun 08 08:21:29.134833 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.134767 2570 factory.go:223] Registration of the crio container factory successfully Jun 08 08:21:29.134833 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.134828 2570 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 08 08:21:29.134929 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.134837 2570 factory.go:55] Registering systemd factory Jun 08 08:21:29.134929 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.134845 2570 factory.go:223] Registration of the systemd container factory successfully Jun 08 08:21:29.134929 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.134865 2570 factory.go:103] Registering Raw factory Jun 08 08:21:29.134929 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.134877 2570 manager.go:1196] Started watching for new ooms in manager Jun 08 08:21:29.134929 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:29.133517 2570 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-101.ec2.internal.18b70d61483a9fdf default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-101.ec2.internal,UID:ip-10-0-143-101.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-101.ec2.internal,},FirstTimestamp:2026-06-08 08:21:29.123110879 +0000 UTC m=+0.377322323,LastTimestamp:2026-06-08 08:21:29.123110879 +0000 UTC m=+0.377322323,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-101.ec2.internal,}" Jun 08 08:21:29.137245 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.137229 2570 manager.go:349] Starting recovery of all containers Jun 08 08:21:29.141811 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:29.141785 2570 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-143-101.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 08 08:21:29.141898 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.141816 2570 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-101.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 08 08:21:29.142080 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:29.142059 2570 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 08 08:21:29.146875 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.146859 2570 manager.go:354] Recovery completed Jun 08 08:21:29.151003 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.150991 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 08:21:29.152893 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.152878 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-101.ec2.internal" event="NodeHasSufficientMemory" Jun 08 08:21:29.152941 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.152916 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-101.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 08:21:29.152941 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.152926 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-101.ec2.internal" event="NodeHasSufficientPID" Jun 08 08:21:29.153435 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.153419 2570 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 08 08:21:29.153435 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.153433 2570 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 08 08:21:29.153541 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.153447 2570 state_mem.go:36] "Initialized new in-memory state store" Jun 08 08:21:29.153541 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.153428 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 08:21:29.154130 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.154116 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-101.ec2.internal" event="NodeHasSufficientMemory" Jun 08 08:21:29.154187 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.154142 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-101.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 08:21:29.154187 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.154151 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-101.ec2.internal" event="NodeHasSufficientPID" Jun 08 08:21:29.154445 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.154433 2570 policy_none.go:49] "None policy: Start" Jun 08 08:21:29.154473 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.154450 2570 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 08 08:21:29.154473 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.154461 2570 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 08 08:21:29.155361 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.155351 2570 policy_none.go:47] "Start" Jun 08 08:21:29.155688 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:29.155629 2570 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-101.ec2.internal.18b70d614a010f14 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-101.ec2.internal,UID:ip-10-0-143-101.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-143-101.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-143-101.ec2.internal,},FirstTimestamp:2026-06-08 08:21:29.152892692 +0000 UTC m=+0.407104136,LastTimestamp:2026-06-08 08:21:29.152892692 +0000 UTC m=+0.407104136,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-101.ec2.internal,}" Jun 08 08:21:29.165869 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:29.165810 2570 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-101.ec2.internal.18b70d614a017e35 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-101.ec2.internal,UID:ip-10-0-143-101.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-143-101.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-143-101.ec2.internal,},FirstTimestamp:2026-06-08 08:21:29.152921141 +0000 UTC m=+0.407132582,LastTimestamp:2026-06-08 08:21:29.152921141 +0000 UTC m=+0.407132582,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-101.ec2.internal,}" Jun 08 08:21:29.178093 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:29.178023 2570 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-101.ec2.internal.18b70d614a01a2bf default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-101.ec2.internal,UID:ip-10-0-143-101.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-143-101.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-143-101.ec2.internal,},FirstTimestamp:2026-06-08 08:21:29.152930495 +0000 UTC m=+0.407141938,LastTimestamp:2026-06-08 08:21:29.152930495 +0000 UTC m=+0.407141938,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-101.ec2.internal,}" Jun 08 08:21:29.188526 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:29.187448 2570 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-143-101.ec2.internal.18b70d614a010f14\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-101.ec2.internal.18b70d614a010f14 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-101.ec2.internal,UID:ip-10-0-143-101.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-143-101.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-143-101.ec2.internal,},FirstTimestamp:2026-06-08 08:21:29.152892692 +0000 UTC m=+0.407104136,LastTimestamp:2026-06-08 08:21:29.154129159 +0000 UTC m=+0.408340603,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-101.ec2.internal,}" Jun 08 08:21:29.190271 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.190256 2570 manager.go:337] "Starting Device Plugin manager" Jun 08 08:21:29.203976 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:29.190318 2570 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 08 08:21:29.203976 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.190328 2570 server.go:87] "Starting device plugin registration server" Jun 08 08:21:29.203976 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.190549 2570 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 08 08:21:29.203976 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.190560 2570 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 08 08:21:29.203976 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.190661 2570 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 08 08:21:29.203976 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.190756 2570 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 08 08:21:29.203976 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.190764 2570 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 08 08:21:29.203976 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:29.191305 2570 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 08 08:21:29.203976 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:29.191351 2570 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-101.ec2.internal\" not found" Jun 08 08:21:29.203976 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.202611 2570 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 08 08:21:29.203976 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.203779 2570 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 08 08:21:29.203976 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.203823 2570 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 08 08:21:29.203976 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.203845 2570 kubelet.go:2448] "Starting kubelet main sync loop" Jun 08 08:21:29.203976 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:29.203882 2570 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 08 08:21:29.208089 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:29.208031 2570 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-143-101.ec2.internal.18b70d614a017e35\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-101.ec2.internal.18b70d614a017e35 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-101.ec2.internal,UID:ip-10-0-143-101.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-143-101.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-143-101.ec2.internal,},FirstTimestamp:2026-06-08 08:21:29.152921141 +0000 UTC m=+0.407132582,LastTimestamp:2026-06-08 08:21:29.154146088 +0000 UTC m=+0.408357528,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-101.ec2.internal,}" Jun 08 08:21:29.216350 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.216331 2570 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nh9xk" Jun 08 08:21:29.221667 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:29.221603 2570 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-143-101.ec2.internal.18b70d614a01a2bf\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-101.ec2.internal.18b70d614a01a2bf default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-101.ec2.internal,UID:ip-10-0-143-101.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-143-101.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-143-101.ec2.internal,},FirstTimestamp:2026-06-08 08:21:29.152930495 +0000 UTC m=+0.407141938,LastTimestamp:2026-06-08 08:21:29.154155572 +0000 UTC m=+0.408367013,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-101.ec2.internal,}" Jun 08 08:21:29.221776 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:29.221688 2570 reflector.go:205] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" Jun 08 08:21:29.231541 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.231524 2570 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nh9xk" Jun 08 08:21:29.232651 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:29.232591 2570 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-101.ec2.internal.18b70d614cf05519 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-101.ec2.internal,UID:ip-10-0-143-101.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeAllocatableEnforced,Message:Updated Node Allocatable limit across pods,Source:EventSource{Component:kubelet,Host:ip-10-0-143-101.ec2.internal,},FirstTimestamp:2026-06-08 08:21:29.202128153 +0000 UTC m=+0.456339581,LastTimestamp:2026-06-08 08:21:29.202128153 +0000 UTC m=+0.456339581,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-101.ec2.internal,}" Jun 08 08:21:29.291357 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.291341 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 08:21:29.292084 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.292069 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-101.ec2.internal" event="NodeHasSufficientMemory" Jun 08 08:21:29.292163 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.292102 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-101.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 08:21:29.292163 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.292118 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-101.ec2.internal" event="NodeHasSufficientPID" Jun 08 08:21:29.292163 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.292145 2570 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-101.ec2.internal" Jun 08 08:21:29.304445 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.304405 2570 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-101.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-101.ec2.internal"] Jun 08 08:21:29.304525 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.304458 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 08:21:29.305137 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.305122 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-101.ec2.internal" event="NodeHasSufficientMemory" Jun 08 08:21:29.305137 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.305147 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-101.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 08:21:29.305283 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.305161 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-101.ec2.internal" event="NodeHasSufficientPID" Jun 08 08:21:29.306467 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.306453 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 08:21:29.306616 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.306601 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-101.ec2.internal" Jun 08 08:21:29.306661 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.306631 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 08:21:29.307186 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.307170 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-101.ec2.internal" event="NodeHasSufficientMemory" Jun 08 08:21:29.307267 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.307175 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-101.ec2.internal" event="NodeHasSufficientMemory" Jun 08 08:21:29.307267 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.307197 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-101.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 08:21:29.307267 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.307205 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-101.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 08:21:29.307267 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.307212 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-101.ec2.internal" event="NodeHasSufficientPID" Jun 08 08:21:29.307267 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.307219 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-101.ec2.internal" event="NodeHasSufficientPID" Jun 08 08:21:29.308267 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.308251 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-101.ec2.internal" Jun 08 08:21:29.308347 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.308276 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 08:21:29.308851 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.308839 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-101.ec2.internal" event="NodeHasSufficientMemory" Jun 08 08:21:29.308924 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.308863 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-101.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 08:21:29.308924 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.308877 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-101.ec2.internal" event="NodeHasSufficientPID" Jun 08 08:21:29.314638 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.314623 2570 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-101.ec2.internal" Jun 08 08:21:29.314740 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:29.314641 2570 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-101.ec2.internal\": node \"ip-10-0-143-101.ec2.internal\" not found" Jun 08 08:21:29.335512 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.335491 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7feb1da85ccfa5f9616fc9385587c410-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-101.ec2.internal\" (UID: \"7feb1da85ccfa5f9616fc9385587c410\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-101.ec2.internal" Jun 08 08:21:29.335598 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.335513 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7feb1da85ccfa5f9616fc9385587c410-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-101.ec2.internal\" (UID: \"7feb1da85ccfa5f9616fc9385587c410\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-101.ec2.internal" Jun 08 08:21:29.335598 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.335538 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/690c9e7947c5aecc188863a395b640fd-config\") pod \"kube-apiserver-proxy-ip-10-0-143-101.ec2.internal\" (UID: \"690c9e7947c5aecc188863a395b640fd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-101.ec2.internal" Jun 08 08:21:29.343287 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:29.343271 2570 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-101.ec2.internal\" not found" node="ip-10-0-143-101.ec2.internal" Jun 08 08:21:29.347593 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:29.347577 2570 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-101.ec2.internal\" not found" node="ip-10-0-143-101.ec2.internal" Jun 08 08:21:29.362808 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:29.362788 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-101.ec2.internal\" not found" Jun 08 08:21:29.435972 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.435951 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7feb1da85ccfa5f9616fc9385587c410-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-101.ec2.internal\" (UID: \"7feb1da85ccfa5f9616fc9385587c410\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-101.ec2.internal" Jun 08 08:21:29.436038 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.435978 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7feb1da85ccfa5f9616fc9385587c410-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-101.ec2.internal\" (UID: \"7feb1da85ccfa5f9616fc9385587c410\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-101.ec2.internal" Jun 08 08:21:29.436038 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.435994 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/690c9e7947c5aecc188863a395b640fd-config\") pod \"kube-apiserver-proxy-ip-10-0-143-101.ec2.internal\" (UID: \"690c9e7947c5aecc188863a395b640fd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-101.ec2.internal" Jun 08 08:21:29.436038 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.436028 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/690c9e7947c5aecc188863a395b640fd-config\") pod \"kube-apiserver-proxy-ip-10-0-143-101.ec2.internal\" (UID: \"690c9e7947c5aecc188863a395b640fd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-101.ec2.internal" Jun 08 08:21:29.436140 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.436057 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7feb1da85ccfa5f9616fc9385587c410-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-101.ec2.internal\" (UID: \"7feb1da85ccfa5f9616fc9385587c410\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-101.ec2.internal" Jun 08 08:21:29.436140 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.436057 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7feb1da85ccfa5f9616fc9385587c410-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-101.ec2.internal\" (UID: \"7feb1da85ccfa5f9616fc9385587c410\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-101.ec2.internal" Jun 08 08:21:29.463362 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:29.463336 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-101.ec2.internal\" not found" Jun 08 08:21:29.564439 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:29.564395 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-101.ec2.internal\" not found" Jun 08 08:21:29.647279 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.647252 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-101.ec2.internal" Jun 08 08:21:29.651961 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:29.651946 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-101.ec2.internal" Jun 08 08:21:29.665420 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:29.665403 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-101.ec2.internal\" not found" Jun 08 08:21:29.765904 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:29.765876 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-101.ec2.internal\" not found" Jun 08 08:21:29.866437 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:29.866393 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-101.ec2.internal\" not found" Jun 08 08:21:29.966875 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:29.966859 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-101.ec2.internal\" not found" Jun 08 08:21:30.067422 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:30.067395 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-101.ec2.internal\" not found" Jun 08 08:21:30.074559 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:30.074540 2570 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 08 08:21:30.101577 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:30.101538 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod690c9e7947c5aecc188863a395b640fd.slice/crio-0fb471cf36e4b7a81bb79a04cd3e2ef9236c7d7ddbcc6e5ceeb52c017d30738c WatchSource:0}: Error finding container 0fb471cf36e4b7a81bb79a04cd3e2ef9236c7d7ddbcc6e5ceeb52c017d30738c: Status 404 returned error can't find the container with id 0fb471cf36e4b7a81bb79a04cd3e2ef9236c7d7ddbcc6e5ceeb52c017d30738c Jun 08 08:21:30.101818 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:30.101797 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7feb1da85ccfa5f9616fc9385587c410.slice/crio-1c44351430f02394bfe26558d40b7a5f41c068247f677248d7db418e6b00518b WatchSource:0}: Error finding container 1c44351430f02394bfe26558d40b7a5f41c068247f677248d7db418e6b00518b: Status 404 returned error can't find the container with id 1c44351430f02394bfe26558d40b7a5f41c068247f677248d7db418e6b00518b Jun 08 08:21:30.106512 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:30.106495 2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 08:21:30.119609 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:30.119555 2570 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 08:21:30.168121 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:30.168096 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-101.ec2.internal\" not found" Jun 08 08:21:30.193295 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:30.193276 2570 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 08:21:30.209118 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:30.209069 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-101.ec2.internal" event={"ID":"7feb1da85ccfa5f9616fc9385587c410","Type":"ContainerStarted","Data":"1c44351430f02394bfe26558d40b7a5f41c068247f677248d7db418e6b00518b"} Jun 08 08:21:30.210698 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:30.210681 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-101.ec2.internal" event={"ID":"690c9e7947c5aecc188863a395b640fd","Type":"ContainerStarted","Data":"0fb471cf36e4b7a81bb79a04cd3e2ef9236c7d7ddbcc6e5ceeb52c017d30738c"} Jun 08 08:21:30.221270 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:30.221256 2570 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 08:21:30.233758 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:30.233728 2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-07 08:16:29 +0000 UTC" deadline="2028-01-10 22:22:14.535864277 +0000 UTC" Jun 08 08:21:30.233758 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:30.233755 2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13958h0m44.302112697s" Jun 08 08:21:30.234561 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:30.234546 2570 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-101.ec2.internal" Jun 08 08:21:30.267086 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:30.267071 2570 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 08 08:21:30.267961 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:30.267950 2570 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-101.ec2.internal" Jun 08 08:21:30.308378 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:30.308359 2570 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 08 08:21:30.637038 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:30.637013 2570 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 08:21:31.115381 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.115356 2570 apiserver.go:52] "Watching apiserver" Jun 08 08:21:31.126956 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.126560 2570 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 08 08:21:31.127697 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.127661 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-fjhnr","openshift-dns/node-resolver-f845l","openshift-image-registry/node-ca-hp6pw","openshift-multus/multus-7bjsd","openshift-multus/multus-additional-cni-plugins-7np8s","openshift-multus/network-metrics-daemon-zx26n","kube-system/konnectivity-agent-jqgqd","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4jgz","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-101.ec2.internal","openshift-network-diagnostics/network-check-target-cchg2","openshift-network-operator/iptables-alerter-bxq5l","openshift-ovn-kubernetes/ovnkube-node-5s57z","kube-system/global-pull-secret-syncer-6gvcs","kube-system/kube-apiserver-proxy-ip-10-0-143-101.ec2.internal"] Jun 08 08:21:31.129037 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.129005 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jqgqd" Jun 08 08:21:31.130197 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.130179 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gvcs" Jun 08 08:21:31.130307 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:31.130250 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gvcs" podUID="4281d80d-e366-4f22-a397-e17c9be0e9f4" Jun 08 08:21:31.131244 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.131205 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-hp6pw" Jun 08 08:21:31.132600 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.132580 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7bjsd" Jun 08 08:21:31.133809 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.133789 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7np8s" Jun 08 08:21:31.134154 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.134134 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 08 08:21:31.134521 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.134503 2570 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 08 08:21:31.134999 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.134981 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-rnv67\"" Jun 08 08:21:31.135142 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.135121 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zx26n" Jun 08 08:21:31.135217 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.135194 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 08 08:21:31.135217 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:31.135199 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zx26n" podUID="e0c87538-422c-4356-8983-84c33320ca33" Jun 08 08:21:31.136439 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.136340 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4jgz" Jun 08 08:21:31.137899 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.137880 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-fjhnr" Jun 08 08:21:31.139506 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.139486 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-f845l" Jun 08 08:21:31.140648 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.140632 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cchg2" Jun 08 08:21:31.140759 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:31.140730 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cchg2" podUID="e308208d-115f-41f0-81f3-65e534a90356" Jun 08 08:21:31.142245 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.142227 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-bqvlc\"" Jun 08 08:21:31.142334 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.142252 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 08 08:21:31.143002 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.142984 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 08 08:21:31.143137 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.143117 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 08 08:21:31.143137 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.143116 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/202c9657-3a36-43ef-88ad-8fdaaba546c0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7np8s\" (UID: \"202c9657-3a36-43ef-88ad-8fdaaba546c0\") " pod="openshift-multus/multus-additional-cni-plugins-7np8s" Jun 08 08:21:31.143289 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.143138 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-bxq5l" Jun 08 08:21:31.143289 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.143163 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b817d520-ebd3-4bd7-9490-90751bd573aa-serviceca\") pod \"node-ca-hp6pw\" (UID: \"b817d520-ebd3-4bd7-9490-90751bd573aa\") " pod="openshift-image-registry/node-ca-hp6pw" Jun 08 08:21:31.143289 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.143186 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f7aa67e2-0ae6-402d-9cab-b798c21b9390-host-var-lib-cni-bin\") pod \"multus-7bjsd\" (UID: \"f7aa67e2-0ae6-402d-9cab-b798c21b9390\") " pod="openshift-multus/multus-7bjsd" Jun 08 08:21:31.143289 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.143202 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f7aa67e2-0ae6-402d-9cab-b798c21b9390-host-var-lib-kubelet\") pod \"multus-7bjsd\" (UID: \"f7aa67e2-0ae6-402d-9cab-b798c21b9390\") " pod="openshift-multus/multus-7bjsd" Jun 08 08:21:31.143289 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.143218 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/202c9657-3a36-43ef-88ad-8fdaaba546c0-cnibin\") pod \"multus-additional-cni-plugins-7np8s\" (UID: \"202c9657-3a36-43ef-88ad-8fdaaba546c0\") " pod="openshift-multus/multus-additional-cni-plugins-7np8s" Jun 08 08:21:31.143289 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.143233 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/202c9657-3a36-43ef-88ad-8fdaaba546c0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7np8s\" (UID: \"202c9657-3a36-43ef-88ad-8fdaaba546c0\") " pod="openshift-multus/multus-additional-cni-plugins-7np8s" Jun 08 08:21:31.143289 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.143271 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f7aa67e2-0ae6-402d-9cab-b798c21b9390-system-cni-dir\") pod \"multus-7bjsd\" (UID: \"f7aa67e2-0ae6-402d-9cab-b798c21b9390\") " pod="openshift-multus/multus-7bjsd" Jun 08 08:21:31.143626 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.143307 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f7aa67e2-0ae6-402d-9cab-b798c21b9390-multus-cni-dir\") pod \"multus-7bjsd\" (UID: \"f7aa67e2-0ae6-402d-9cab-b798c21b9390\") " pod="openshift-multus/multus-7bjsd" Jun 08 08:21:31.143626 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.143337 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f7aa67e2-0ae6-402d-9cab-b798c21b9390-host-run-k8s-cni-cncf-io\") pod \"multus-7bjsd\" (UID: \"f7aa67e2-0ae6-402d-9cab-b798c21b9390\") " pod="openshift-multus/multus-7bjsd" Jun 08 08:21:31.143626 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.143380 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f7aa67e2-0ae6-402d-9cab-b798c21b9390-hostroot\") pod \"multus-7bjsd\" (UID: \"f7aa67e2-0ae6-402d-9cab-b798c21b9390\") " pod="openshift-multus/multus-7bjsd" Jun 08 08:21:31.143626 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.143406 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f7aa67e2-0ae6-402d-9cab-b798c21b9390-multus-daemon-config\") pod \"multus-7bjsd\" (UID: \"f7aa67e2-0ae6-402d-9cab-b798c21b9390\") " pod="openshift-multus/multus-7bjsd" Jun 08 08:21:31.143626 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.143429 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/202c9657-3a36-43ef-88ad-8fdaaba546c0-os-release\") pod \"multus-additional-cni-plugins-7np8s\" (UID: \"202c9657-3a36-43ef-88ad-8fdaaba546c0\") " pod="openshift-multus/multus-additional-cni-plugins-7np8s" Jun 08 08:21:31.143626 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.143453 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzmh8\" (UniqueName: \"kubernetes.io/projected/202c9657-3a36-43ef-88ad-8fdaaba546c0-kube-api-access-lzmh8\") pod \"multus-additional-cni-plugins-7np8s\" (UID: \"202c9657-3a36-43ef-88ad-8fdaaba546c0\") " pod="openshift-multus/multus-additional-cni-plugins-7np8s" Jun 08 08:21:31.143626 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.143486 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e0c87538-422c-4356-8983-84c33320ca33-metrics-certs\") pod \"network-metrics-daemon-zx26n\" (UID: \"e0c87538-422c-4356-8983-84c33320ca33\") " pod="openshift-multus/network-metrics-daemon-zx26n" Jun 08 08:21:31.143626 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.143508 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f7aa67e2-0ae6-402d-9cab-b798c21b9390-host-run-netns\") pod \"multus-7bjsd\" (UID: \"f7aa67e2-0ae6-402d-9cab-b798c21b9390\") " pod="openshift-multus/multus-7bjsd" Jun 08 08:21:31.143626 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.143537 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f7aa67e2-0ae6-402d-9cab-b798c21b9390-multus-conf-dir\") pod \"multus-7bjsd\" (UID: \"f7aa67e2-0ae6-402d-9cab-b798c21b9390\") " pod="openshift-multus/multus-7bjsd" Jun 08 08:21:31.143626 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.143560 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4281d80d-e366-4f22-a397-e17c9be0e9f4-dbus\") pod \"global-pull-secret-syncer-6gvcs\" (UID: \"4281d80d-e366-4f22-a397-e17c9be0e9f4\") " pod="kube-system/global-pull-secret-syncer-6gvcs" Jun 08 08:21:31.143626 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.143580 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b817d520-ebd3-4bd7-9490-90751bd573aa-host\") pod \"node-ca-hp6pw\" (UID: \"b817d520-ebd3-4bd7-9490-90751bd573aa\") " pod="openshift-image-registry/node-ca-hp6pw" Jun 08 08:21:31.143626 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.143603 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/87ee6f5d-c749-452a-9574-287d8a6913cc-agent-certs\") pod \"konnectivity-agent-jqgqd\" (UID: \"87ee6f5d-c749-452a-9574-287d8a6913cc\") " pod="kube-system/konnectivity-agent-jqgqd" Jun 08 08:21:31.144191 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.143644 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/87ee6f5d-c749-452a-9574-287d8a6913cc-konnectivity-ca\") pod \"konnectivity-agent-jqgqd\" (UID: \"87ee6f5d-c749-452a-9574-287d8a6913cc\") " pod="kube-system/konnectivity-agent-jqgqd" Jun 08 08:21:31.144191 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.143681 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/202c9657-3a36-43ef-88ad-8fdaaba546c0-cni-binary-copy\") pod \"multus-additional-cni-plugins-7np8s\" (UID: \"202c9657-3a36-43ef-88ad-8fdaaba546c0\") " pod="openshift-multus/multus-additional-cni-plugins-7np8s" Jun 08 08:21:31.144191 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.143731 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f7aa67e2-0ae6-402d-9cab-b798c21b9390-os-release\") pod \"multus-7bjsd\" (UID: \"f7aa67e2-0ae6-402d-9cab-b798c21b9390\") " pod="openshift-multus/multus-7bjsd" Jun 08 08:21:31.144191 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.143757 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f7aa67e2-0ae6-402d-9cab-b798c21b9390-cni-binary-copy\") pod \"multus-7bjsd\" (UID: \"f7aa67e2-0ae6-402d-9cab-b798c21b9390\") " pod="openshift-multus/multus-7bjsd" Jun 08 08:21:31.144191 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.143782 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8mwp\" (UniqueName: \"kubernetes.io/projected/e0c87538-422c-4356-8983-84c33320ca33-kube-api-access-d8mwp\") pod \"network-metrics-daemon-zx26n\" (UID: \"e0c87538-422c-4356-8983-84c33320ca33\") " pod="openshift-multus/network-metrics-daemon-zx26n" Jun 08 08:21:31.144191 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.143817 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jc5cs\" (UniqueName: \"kubernetes.io/projected/b817d520-ebd3-4bd7-9490-90751bd573aa-kube-api-access-jc5cs\") pod \"node-ca-hp6pw\" (UID: \"b817d520-ebd3-4bd7-9490-90751bd573aa\") " pod="openshift-image-registry/node-ca-hp6pw" Jun 08 08:21:31.144191 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.143845 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f7aa67e2-0ae6-402d-9cab-b798c21b9390-etc-kubernetes\") pod \"multus-7bjsd\" (UID: \"f7aa67e2-0ae6-402d-9cab-b798c21b9390\") " pod="openshift-multus/multus-7bjsd" Jun 08 08:21:31.144191 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.143870 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f7aa67e2-0ae6-402d-9cab-b798c21b9390-host-var-lib-cni-multus\") pod \"multus-7bjsd\" (UID: \"f7aa67e2-0ae6-402d-9cab-b798c21b9390\") " pod="openshift-multus/multus-7bjsd" Jun 08 08:21:31.144191 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.143909 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/202c9657-3a36-43ef-88ad-8fdaaba546c0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7np8s\" (UID: \"202c9657-3a36-43ef-88ad-8fdaaba546c0\") " pod="openshift-multus/multus-additional-cni-plugins-7np8s" Jun 08 08:21:31.144191 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.143948 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4281d80d-e366-4f22-a397-e17c9be0e9f4-original-pull-secret\") pod \"global-pull-secret-syncer-6gvcs\" (UID: \"4281d80d-e366-4f22-a397-e17c9be0e9f4\") " pod="kube-system/global-pull-secret-syncer-6gvcs" Jun 08 08:21:31.144191 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.143980 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f7aa67e2-0ae6-402d-9cab-b798c21b9390-cnibin\") pod \"multus-7bjsd\" (UID: \"f7aa67e2-0ae6-402d-9cab-b798c21b9390\") " pod="openshift-multus/multus-7bjsd" Jun 08 08:21:31.144191 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.144004 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f7aa67e2-0ae6-402d-9cab-b798c21b9390-multus-socket-dir-parent\") pod \"multus-7bjsd\" (UID: \"f7aa67e2-0ae6-402d-9cab-b798c21b9390\") " pod="openshift-multus/multus-7bjsd" Jun 08 08:21:31.144191 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.144026 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f7aa67e2-0ae6-402d-9cab-b798c21b9390-host-run-multus-certs\") pod \"multus-7bjsd\" (UID: \"f7aa67e2-0ae6-402d-9cab-b798c21b9390\") " pod="openshift-multus/multus-7bjsd" Jun 08 08:21:31.144191 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.144051 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmwf6\" (UniqueName: \"kubernetes.io/projected/f7aa67e2-0ae6-402d-9cab-b798c21b9390-kube-api-access-wmwf6\") pod \"multus-7bjsd\" (UID: \"f7aa67e2-0ae6-402d-9cab-b798c21b9390\") " pod="openshift-multus/multus-7bjsd" Jun 08 08:21:31.144191 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.144075 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/202c9657-3a36-43ef-88ad-8fdaaba546c0-system-cni-dir\") pod \"multus-additional-cni-plugins-7np8s\" (UID: \"202c9657-3a36-43ef-88ad-8fdaaba546c0\") " pod="openshift-multus/multus-additional-cni-plugins-7np8s" Jun 08 08:21:31.144191 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.144103 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4281d80d-e366-4f22-a397-e17c9be0e9f4-kubelet-config\") pod \"global-pull-secret-syncer-6gvcs\" (UID: \"4281d80d-e366-4f22-a397-e17c9be0e9f4\") " pod="kube-system/global-pull-secret-syncer-6gvcs" Jun 08 08:21:31.144947 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.144369 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5s57z" Jun 08 08:21:31.145065 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.145046 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 08 08:21:31.145485 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.145467 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 08 08:21:31.148508 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.148487 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 08 08:21:31.149190 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.149141 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-qhfcb\"" Jun 08 08:21:31.149425 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.149401 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 08 08:21:31.149629 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.149615 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 08 08:21:31.149753 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.149736 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 08 08:21:31.150769 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.150753 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 08 08:21:31.171160 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.171141 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 08 08:21:31.171973 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.171956 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 08 08:21:31.173225 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.173191 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 08 08:21:31.200218 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.199383 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-vdx8n\"" Jun 08 08:21:31.200218 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.199465 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 08 08:21:31.200218 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.199646 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-s29wc\"" Jun 08 08:21:31.200218 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.199742 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 08 08:21:31.200218 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.199864 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 08 08:21:31.200218 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.199873 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 08 08:21:31.200218 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.199890 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 08 08:21:31.200218 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.199864 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-w5v5h\"" Jun 08 08:21:31.200218 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.200001 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 08 08:21:31.200218 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.200086 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 08 08:21:31.200218 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.200134 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-6wnmz\"" Jun 08 08:21:31.200847 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.200831 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 08 08:21:31.201164 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.201145 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-vh4d2\"" Jun 08 08:21:31.201327 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.201311 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 08 08:21:31.201618 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.201596 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 08 08:21:31.201730 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.201630 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-7q5m7\"" Jun 08 08:21:31.202788 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.202002 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 08 08:21:31.203806 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.203444 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 08 08:21:31.214662 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.214643 2570 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 08 08:21:31.220237 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.220219 2570 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-vd5p9" Jun 08 08:21:31.230466 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.230447 2570 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-vd5p9" Jun 08 08:21:31.235956 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.235913 2570 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 08 08:21:31.245262 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.245238 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f7aa67e2-0ae6-402d-9cab-b798c21b9390-host-var-lib-cni-multus\") pod \"multus-7bjsd\" (UID: \"f7aa67e2-0ae6-402d-9cab-b798c21b9390\") " pod="openshift-multus/multus-7bjsd" Jun 08 08:21:31.245353 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.245280 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/202c9657-3a36-43ef-88ad-8fdaaba546c0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7np8s\" (UID: \"202c9657-3a36-43ef-88ad-8fdaaba546c0\") " pod="openshift-multus/multus-additional-cni-plugins-7np8s" Jun 08 08:21:31.245353 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.245304 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4281d80d-e366-4f22-a397-e17c9be0e9f4-original-pull-secret\") pod \"global-pull-secret-syncer-6gvcs\" (UID: \"4281d80d-e366-4f22-a397-e17c9be0e9f4\") " pod="kube-system/global-pull-secret-syncer-6gvcs" Jun 08 08:21:31.245353 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.245312 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f7aa67e2-0ae6-402d-9cab-b798c21b9390-host-var-lib-cni-multus\") pod \"multus-7bjsd\" (UID: \"f7aa67e2-0ae6-402d-9cab-b798c21b9390\") " pod="openshift-multus/multus-7bjsd" Jun 08 08:21:31.245353 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.245335 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f5ba4fab-6782-4e56-8c83-c66b3457650e-registration-dir\") pod \"aws-ebs-csi-driver-node-t4jgz\" (UID: \"f5ba4fab-6782-4e56-8c83-c66b3457650e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4jgz" Jun 08 08:21:31.245557 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.245360 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8fed09c4-f238-4205-b258-0b0486bf019d-host-slash\") pod \"iptables-alerter-bxq5l\" (UID: \"8fed09c4-f238-4205-b258-0b0486bf019d\") " pod="openshift-network-operator/iptables-alerter-bxq5l" Jun 08 08:21:31.245557 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.245384 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ea083ae5-52f5-4b1a-a730-7690bee17d80-host-run-ovn-kubernetes\") pod \"ovnkube-node-5s57z\" (UID: \"ea083ae5-52f5-4b1a-a730-7690bee17d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s57z" Jun 08 08:21:31.245557 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.245411 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmwf6\" (UniqueName: \"kubernetes.io/projected/f7aa67e2-0ae6-402d-9cab-b798c21b9390-kube-api-access-wmwf6\") pod \"multus-7bjsd\" (UID: \"f7aa67e2-0ae6-402d-9cab-b798c21b9390\") " pod="openshift-multus/multus-7bjsd" Jun 08 08:21:31.245557 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.245434 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/202c9657-3a36-43ef-88ad-8fdaaba546c0-system-cni-dir\") pod \"multus-additional-cni-plugins-7np8s\" (UID: \"202c9657-3a36-43ef-88ad-8fdaaba546c0\") " pod="openshift-multus/multus-additional-cni-plugins-7np8s" Jun 08 08:21:31.245557 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:31.245443 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 08:21:31.245557 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.245458 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4281d80d-e366-4f22-a397-e17c9be0e9f4-kubelet-config\") pod \"global-pull-secret-syncer-6gvcs\" (UID: \"4281d80d-e366-4f22-a397-e17c9be0e9f4\") " pod="kube-system/global-pull-secret-syncer-6gvcs" Jun 08 08:21:31.245557 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.245481 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ea083ae5-52f5-4b1a-a730-7690bee17d80-ovnkube-script-lib\") pod \"ovnkube-node-5s57z\" (UID: \"ea083ae5-52f5-4b1a-a730-7690bee17d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s57z" Jun 08 08:21:31.245557 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:31.245532 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4281d80d-e366-4f22-a397-e17c9be0e9f4-original-pull-secret podName:4281d80d-e366-4f22-a397-e17c9be0e9f4 nodeName:}" failed. No retries permitted until 2026-06-08 08:21:31.745493964 +0000 UTC m=+2.999705409 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4281d80d-e366-4f22-a397-e17c9be0e9f4-original-pull-secret") pod "global-pull-secret-syncer-6gvcs" (UID: "4281d80d-e366-4f22-a397-e17c9be0e9f4") : object "kube-system"/"original-pull-secret" not registered Jun 08 08:21:31.245948 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.245572 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/202c9657-3a36-43ef-88ad-8fdaaba546c0-system-cni-dir\") pod \"multus-additional-cni-plugins-7np8s\" (UID: \"202c9657-3a36-43ef-88ad-8fdaaba546c0\") " pod="openshift-multus/multus-additional-cni-plugins-7np8s" Jun 08 08:21:31.245948 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.245571 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b817d520-ebd3-4bd7-9490-90751bd573aa-serviceca\") pod \"node-ca-hp6pw\" (UID: \"b817d520-ebd3-4bd7-9490-90751bd573aa\") " pod="openshift-image-registry/node-ca-hp6pw" Jun 08 08:21:31.245948 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.245617 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f7aa67e2-0ae6-402d-9cab-b798c21b9390-host-var-lib-kubelet\") pod \"multus-7bjsd\" (UID: \"f7aa67e2-0ae6-402d-9cab-b798c21b9390\") " pod="openshift-multus/multus-7bjsd" Jun 08 08:21:31.245948 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.245642 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/87ee6f5d-c749-452a-9574-287d8a6913cc-agent-certs\") pod \"konnectivity-agent-jqgqd\" (UID: \"87ee6f5d-c749-452a-9574-287d8a6913cc\") " pod="kube-system/konnectivity-agent-jqgqd" Jun 08 08:21:31.245948 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.245656 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f7aa67e2-0ae6-402d-9cab-b798c21b9390-host-var-lib-kubelet\") pod \"multus-7bjsd\" (UID: \"f7aa67e2-0ae6-402d-9cab-b798c21b9390\") " pod="openshift-multus/multus-7bjsd" Jun 08 08:21:31.245948 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.245616 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4281d80d-e366-4f22-a397-e17c9be0e9f4-kubelet-config\") pod \"global-pull-secret-syncer-6gvcs\" (UID: \"4281d80d-e366-4f22-a397-e17c9be0e9f4\") " pod="kube-system/global-pull-secret-syncer-6gvcs" Jun 08 08:21:31.245948 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.245667 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/28880cc4-90dd-4d3f-8bf7-df18edcdd096-hosts-file\") pod \"node-resolver-f845l\" (UID: \"28880cc4-90dd-4d3f-8bf7-df18edcdd096\") " pod="openshift-dns/node-resolver-f845l" Jun 08 08:21:31.245948 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.245745 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ea083ae5-52f5-4b1a-a730-7690bee17d80-host-slash\") pod \"ovnkube-node-5s57z\" (UID: \"ea083ae5-52f5-4b1a-a730-7690bee17d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s57z" Jun 08 08:21:31.245948 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.245787 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f7aa67e2-0ae6-402d-9cab-b798c21b9390-system-cni-dir\") pod \"multus-7bjsd\" (UID: \"f7aa67e2-0ae6-402d-9cab-b798c21b9390\") " pod="openshift-multus/multus-7bjsd" Jun 08 08:21:31.245948 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.245820 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f7aa67e2-0ae6-402d-9cab-b798c21b9390-host-run-k8s-cni-cncf-io\") pod \"multus-7bjsd\" (UID: \"f7aa67e2-0ae6-402d-9cab-b798c21b9390\") " pod="openshift-multus/multus-7bjsd" Jun 08 08:21:31.245948 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.245845 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f7aa67e2-0ae6-402d-9cab-b798c21b9390-hostroot\") pod \"multus-7bjsd\" (UID: \"f7aa67e2-0ae6-402d-9cab-b798c21b9390\") " pod="openshift-multus/multus-7bjsd" Jun 08 08:21:31.245948 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.245846 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f7aa67e2-0ae6-402d-9cab-b798c21b9390-system-cni-dir\") pod \"multus-7bjsd\" (UID: \"f7aa67e2-0ae6-402d-9cab-b798c21b9390\") " pod="openshift-multus/multus-7bjsd" Jun 08 08:21:31.245948 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.245893 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f7aa67e2-0ae6-402d-9cab-b798c21b9390-host-run-k8s-cni-cncf-io\") pod \"multus-7bjsd\" (UID: \"f7aa67e2-0ae6-402d-9cab-b798c21b9390\") " pod="openshift-multus/multus-7bjsd" Jun 08 08:21:31.245948 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.245901 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f7aa67e2-0ae6-402d-9cab-b798c21b9390-hostroot\") pod \"multus-7bjsd\" (UID: \"f7aa67e2-0ae6-402d-9cab-b798c21b9390\") " pod="openshift-multus/multus-7bjsd" Jun 08 08:21:31.245948 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.245920 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f7aa67e2-0ae6-402d-9cab-b798c21b9390-multus-daemon-config\") pod \"multus-7bjsd\" (UID: \"f7aa67e2-0ae6-402d-9cab-b798c21b9390\") " pod="openshift-multus/multus-7bjsd" Jun 08 08:21:31.245948 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.245948 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f833d2e7-472b-473f-a0c0-42c61a42f524-etc-modprobe-d\") pod \"tuned-fjhnr\" (UID: \"f833d2e7-472b-473f-a0c0-42c61a42f524\") " pod="openshift-cluster-node-tuning-operator/tuned-fjhnr" Jun 08 08:21:31.245948 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.245954 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b817d520-ebd3-4bd7-9490-90751bd573aa-serviceca\") pod \"node-ca-hp6pw\" (UID: \"b817d520-ebd3-4bd7-9490-90751bd573aa\") " pod="openshift-image-registry/node-ca-hp6pw" Jun 08 08:21:31.246864 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.245947 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/202c9657-3a36-43ef-88ad-8fdaaba546c0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7np8s\" (UID: \"202c9657-3a36-43ef-88ad-8fdaaba546c0\") " pod="openshift-multus/multus-additional-cni-plugins-7np8s" Jun 08 08:21:31.246864 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.245970 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f833d2e7-472b-473f-a0c0-42c61a42f524-etc-sysctl-d\") pod \"tuned-fjhnr\" (UID: \"f833d2e7-472b-473f-a0c0-42c61a42f524\") " pod="openshift-cluster-node-tuning-operator/tuned-fjhnr" Jun 08 08:21:31.246864 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.245997 2570 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 08 08:21:31.246864 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.246010 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28880cc4-90dd-4d3f-8bf7-df18edcdd096-tmp-dir\") pod \"node-resolver-f845l\" (UID: \"28880cc4-90dd-4d3f-8bf7-df18edcdd096\") " pod="openshift-dns/node-resolver-f845l" Jun 08 08:21:31.246864 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.246032 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f833d2e7-472b-473f-a0c0-42c61a42f524-etc-tuned\") pod \"tuned-fjhnr\" (UID: \"f833d2e7-472b-473f-a0c0-42c61a42f524\") " pod="openshift-cluster-node-tuning-operator/tuned-fjhnr" Jun 08 08:21:31.246864 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.246055 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhmdd\" (UniqueName: \"kubernetes.io/projected/f833d2e7-472b-473f-a0c0-42c61a42f524-kube-api-access-vhmdd\") pod \"tuned-fjhnr\" (UID: \"f833d2e7-472b-473f-a0c0-42c61a42f524\") " pod="openshift-cluster-node-tuning-operator/tuned-fjhnr" Jun 08 08:21:31.246864 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.246114 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ea083ae5-52f5-4b1a-a730-7690bee17d80-run-ovn\") pod \"ovnkube-node-5s57z\" (UID: \"ea083ae5-52f5-4b1a-a730-7690bee17d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s57z" Jun 08 08:21:31.246864 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.246142 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/87ee6f5d-c749-452a-9574-287d8a6913cc-konnectivity-ca\") pod \"konnectivity-agent-jqgqd\" (UID: \"87ee6f5d-c749-452a-9574-287d8a6913cc\") " pod="kube-system/konnectivity-agent-jqgqd" Jun 08 08:21:31.246864 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.246166 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f833d2e7-472b-473f-a0c0-42c61a42f524-etc-kubernetes\") pod \"tuned-fjhnr\" (UID: \"f833d2e7-472b-473f-a0c0-42c61a42f524\") " pod="openshift-cluster-node-tuning-operator/tuned-fjhnr" Jun 08 08:21:31.246864 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.246211 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f833d2e7-472b-473f-a0c0-42c61a42f524-etc-systemd\") pod \"tuned-fjhnr\" (UID: \"f833d2e7-472b-473f-a0c0-42c61a42f524\") " pod="openshift-cluster-node-tuning-operator/tuned-fjhnr" Jun 08 08:21:31.246864 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.246291 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ea083ae5-52f5-4b1a-a730-7690bee17d80-systemd-units\") pod \"ovnkube-node-5s57z\" (UID: \"ea083ae5-52f5-4b1a-a730-7690bee17d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s57z" Jun 08 08:21:31.246864 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.246326 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ea083ae5-52f5-4b1a-a730-7690bee17d80-run-openvswitch\") pod \"ovnkube-node-5s57z\" (UID: \"ea083ae5-52f5-4b1a-a730-7690bee17d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s57z" Jun 08 08:21:31.246864 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.246353 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/202c9657-3a36-43ef-88ad-8fdaaba546c0-cni-binary-copy\") pod \"multus-additional-cni-plugins-7np8s\" (UID: \"202c9657-3a36-43ef-88ad-8fdaaba546c0\") " pod="openshift-multus/multus-additional-cni-plugins-7np8s" Jun 08 08:21:31.246864 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.246399 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f7aa67e2-0ae6-402d-9cab-b798c21b9390-os-release\") pod \"multus-7bjsd\" (UID: \"f7aa67e2-0ae6-402d-9cab-b798c21b9390\") " pod="openshift-multus/multus-7bjsd" Jun 08 08:21:31.246864 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.246424 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8mwp\" (UniqueName: \"kubernetes.io/projected/e0c87538-422c-4356-8983-84c33320ca33-kube-api-access-d8mwp\") pod \"network-metrics-daemon-zx26n\" (UID: \"e0c87538-422c-4356-8983-84c33320ca33\") " pod="openshift-multus/network-metrics-daemon-zx26n" Jun 08 08:21:31.246864 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.246425 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f7aa67e2-0ae6-402d-9cab-b798c21b9390-multus-daemon-config\") pod \"multus-7bjsd\" (UID: \"f7aa67e2-0ae6-402d-9cab-b798c21b9390\") " pod="openshift-multus/multus-7bjsd" Jun 08 08:21:31.246864 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.246494 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f5ba4fab-6782-4e56-8c83-c66b3457650e-etc-selinux\") pod \"aws-ebs-csi-driver-node-t4jgz\" (UID: \"f5ba4fab-6782-4e56-8c83-c66b3457650e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4jgz" Jun 08 08:21:31.247693 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.246521 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f5ba4fab-6782-4e56-8c83-c66b3457650e-sys-fs\") pod \"aws-ebs-csi-driver-node-t4jgz\" (UID: \"f5ba4fab-6782-4e56-8c83-c66b3457650e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4jgz" Jun 08 08:21:31.247693 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.246559 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jc5cs\" (UniqueName: \"kubernetes.io/projected/b817d520-ebd3-4bd7-9490-90751bd573aa-kube-api-access-jc5cs\") pod \"node-ca-hp6pw\" (UID: \"b817d520-ebd3-4bd7-9490-90751bd573aa\") " pod="openshift-image-registry/node-ca-hp6pw" Jun 08 08:21:31.247693 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.246572 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f7aa67e2-0ae6-402d-9cab-b798c21b9390-os-release\") pod \"multus-7bjsd\" (UID: \"f7aa67e2-0ae6-402d-9cab-b798c21b9390\") " pod="openshift-multus/multus-7bjsd" Jun 08 08:21:31.247693 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.246584 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f5ba4fab-6782-4e56-8c83-c66b3457650e-device-dir\") pod \"aws-ebs-csi-driver-node-t4jgz\" (UID: \"f5ba4fab-6782-4e56-8c83-c66b3457650e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4jgz" Jun 08 08:21:31.247693 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.246611 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f833d2e7-472b-473f-a0c0-42c61a42f524-var-lib-kubelet\") pod \"tuned-fjhnr\" (UID: \"f833d2e7-472b-473f-a0c0-42c61a42f524\") " pod="openshift-cluster-node-tuning-operator/tuned-fjhnr" Jun 08 08:21:31.247693 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.246657 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f833d2e7-472b-473f-a0c0-42c61a42f524-tmp\") pod \"tuned-fjhnr\" (UID: \"f833d2e7-472b-473f-a0c0-42c61a42f524\") " pod="openshift-cluster-node-tuning-operator/tuned-fjhnr" Jun 08 08:21:31.247693 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.246679 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f833d2e7-472b-473f-a0c0-42c61a42f524-run\") pod \"tuned-fjhnr\" (UID: \"f833d2e7-472b-473f-a0c0-42c61a42f524\") " pod="openshift-cluster-node-tuning-operator/tuned-fjhnr" Jun 08 08:21:31.247693 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.246737 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ea083ae5-52f5-4b1a-a730-7690bee17d80-host-kubelet\") pod \"ovnkube-node-5s57z\" (UID: \"ea083ae5-52f5-4b1a-a730-7690bee17d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s57z" Jun 08 08:21:31.247693 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.246765 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f7aa67e2-0ae6-402d-9cab-b798c21b9390-cnibin\") pod \"multus-7bjsd\" (UID: \"f7aa67e2-0ae6-402d-9cab-b798c21b9390\") " pod="openshift-multus/multus-7bjsd" Jun 08 08:21:31.247693 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.246773 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/87ee6f5d-c749-452a-9574-287d8a6913cc-konnectivity-ca\") pod \"konnectivity-agent-jqgqd\" (UID: \"87ee6f5d-c749-452a-9574-287d8a6913cc\") " pod="kube-system/konnectivity-agent-jqgqd" Jun 08 08:21:31.247693 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.246791 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f7aa67e2-0ae6-402d-9cab-b798c21b9390-multus-socket-dir-parent\") pod \"multus-7bjsd\" (UID: \"f7aa67e2-0ae6-402d-9cab-b798c21b9390\") " pod="openshift-multus/multus-7bjsd" Jun 08 08:21:31.247693 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.246817 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f7aa67e2-0ae6-402d-9cab-b798c21b9390-host-run-multus-certs\") pod \"multus-7bjsd\" (UID: \"f7aa67e2-0ae6-402d-9cab-b798c21b9390\") " pod="openshift-multus/multus-7bjsd" Jun 08 08:21:31.247693 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.246872 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/202c9657-3a36-43ef-88ad-8fdaaba546c0-cni-binary-copy\") pod \"multus-additional-cni-plugins-7np8s\" (UID: \"202c9657-3a36-43ef-88ad-8fdaaba546c0\") " pod="openshift-multus/multus-additional-cni-plugins-7np8s" Jun 08 08:21:31.247693 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.246938 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f833d2e7-472b-473f-a0c0-42c61a42f524-etc-sysconfig\") pod \"tuned-fjhnr\" (UID: \"f833d2e7-472b-473f-a0c0-42c61a42f524\") " pod="openshift-cluster-node-tuning-operator/tuned-fjhnr" Jun 08 08:21:31.247693 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.246956 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f7aa67e2-0ae6-402d-9cab-b798c21b9390-multus-socket-dir-parent\") pod \"multus-7bjsd\" (UID: \"f7aa67e2-0ae6-402d-9cab-b798c21b9390\") " pod="openshift-multus/multus-7bjsd" Jun 08 08:21:31.247693 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.246973 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krwcv\" (UniqueName: \"kubernetes.io/projected/8fed09c4-f238-4205-b258-0b0486bf019d-kube-api-access-krwcv\") pod \"iptables-alerter-bxq5l\" (UID: \"8fed09c4-f238-4205-b258-0b0486bf019d\") " pod="openshift-network-operator/iptables-alerter-bxq5l" Jun 08 08:21:31.247693 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.246980 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f7aa67e2-0ae6-402d-9cab-b798c21b9390-cnibin\") pod \"multus-7bjsd\" (UID: \"f7aa67e2-0ae6-402d-9cab-b798c21b9390\") " pod="openshift-multus/multus-7bjsd" Jun 08 08:21:31.248397 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.246993 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f7aa67e2-0ae6-402d-9cab-b798c21b9390-host-run-multus-certs\") pod \"multus-7bjsd\" (UID: \"f7aa67e2-0ae6-402d-9cab-b798c21b9390\") " pod="openshift-multus/multus-7bjsd" Jun 08 08:21:31.248397 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.247015 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ea083ae5-52f5-4b1a-a730-7690bee17d80-run-systemd\") pod \"ovnkube-node-5s57z\" (UID: \"ea083ae5-52f5-4b1a-a730-7690bee17d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s57z" Jun 08 08:21:31.248397 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.247045 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ea083ae5-52f5-4b1a-a730-7690bee17d80-host-cni-netd\") pod \"ovnkube-node-5s57z\" (UID: \"ea083ae5-52f5-4b1a-a730-7690bee17d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s57z" Jun 08 08:21:31.248397 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.247078 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ea083ae5-52f5-4b1a-a730-7690bee17d80-ovnkube-config\") pod \"ovnkube-node-5s57z\" (UID: \"ea083ae5-52f5-4b1a-a730-7690bee17d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s57z" Jun 08 08:21:31.248397 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.247107 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/202c9657-3a36-43ef-88ad-8fdaaba546c0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7np8s\" (UID: \"202c9657-3a36-43ef-88ad-8fdaaba546c0\") " pod="openshift-multus/multus-additional-cni-plugins-7np8s" Jun 08 08:21:31.248397 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.247179 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f7aa67e2-0ae6-402d-9cab-b798c21b9390-host-var-lib-cni-bin\") pod \"multus-7bjsd\" (UID: \"f7aa67e2-0ae6-402d-9cab-b798c21b9390\") " pod="openshift-multus/multus-7bjsd" Jun 08 08:21:31.248397 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.247218 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/202c9657-3a36-43ef-88ad-8fdaaba546c0-cnibin\") pod \"multus-additional-cni-plugins-7np8s\" (UID: \"202c9657-3a36-43ef-88ad-8fdaaba546c0\") " pod="openshift-multus/multus-additional-cni-plugins-7np8s" Jun 08 08:21:31.248397 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.247248 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/202c9657-3a36-43ef-88ad-8fdaaba546c0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7np8s\" (UID: \"202c9657-3a36-43ef-88ad-8fdaaba546c0\") " pod="openshift-multus/multus-additional-cni-plugins-7np8s" Jun 08 08:21:31.248397 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.247270 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/202c9657-3a36-43ef-88ad-8fdaaba546c0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7np8s\" (UID: \"202c9657-3a36-43ef-88ad-8fdaaba546c0\") " pod="openshift-multus/multus-additional-cni-plugins-7np8s" Jun 08 08:21:31.248397 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.247307 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzmh8\" (UniqueName: \"kubernetes.io/projected/202c9657-3a36-43ef-88ad-8fdaaba546c0-kube-api-access-lzmh8\") pod \"multus-additional-cni-plugins-7np8s\" (UID: \"202c9657-3a36-43ef-88ad-8fdaaba546c0\") " pod="openshift-multus/multus-additional-cni-plugins-7np8s" Jun 08 08:21:31.248397 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.247335 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e0c87538-422c-4356-8983-84c33320ca33-metrics-certs\") pod \"network-metrics-daemon-zx26n\" (UID: \"e0c87538-422c-4356-8983-84c33320ca33\") " pod="openshift-multus/network-metrics-daemon-zx26n" Jun 08 08:21:31.248397 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.247310 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f7aa67e2-0ae6-402d-9cab-b798c21b9390-host-var-lib-cni-bin\") pod \"multus-7bjsd\" (UID: \"f7aa67e2-0ae6-402d-9cab-b798c21b9390\") " pod="openshift-multus/multus-7bjsd" Jun 08 08:21:31.248397 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.247392 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f7aa67e2-0ae6-402d-9cab-b798c21b9390-multus-cni-dir\") pod \"multus-7bjsd\" (UID: \"f7aa67e2-0ae6-402d-9cab-b798c21b9390\") " pod="openshift-multus/multus-7bjsd" Jun 08 08:21:31.248397 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.247419 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/202c9657-3a36-43ef-88ad-8fdaaba546c0-os-release\") pod \"multus-additional-cni-plugins-7np8s\" (UID: \"202c9657-3a36-43ef-88ad-8fdaaba546c0\") " pod="openshift-multus/multus-additional-cni-plugins-7np8s" Jun 08 08:21:31.248397 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.247444 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4281d80d-e366-4f22-a397-e17c9be0e9f4-dbus\") pod \"global-pull-secret-syncer-6gvcs\" (UID: \"4281d80d-e366-4f22-a397-e17c9be0e9f4\") " pod="kube-system/global-pull-secret-syncer-6gvcs" Jun 08 08:21:31.248397 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.247449 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/202c9657-3a36-43ef-88ad-8fdaaba546c0-cnibin\") pod \"multus-additional-cni-plugins-7np8s\" (UID: \"202c9657-3a36-43ef-88ad-8fdaaba546c0\") " pod="openshift-multus/multus-additional-cni-plugins-7np8s" Jun 08 08:21:31.248397 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.247580 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4281d80d-e366-4f22-a397-e17c9be0e9f4-dbus\") pod \"global-pull-secret-syncer-6gvcs\" (UID: \"4281d80d-e366-4f22-a397-e17c9be0e9f4\") " pod="kube-system/global-pull-secret-syncer-6gvcs" Jun 08 08:21:31.249179 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.247616 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ea083ae5-52f5-4b1a-a730-7690bee17d80-env-overrides\") pod \"ovnkube-node-5s57z\" (UID: \"ea083ae5-52f5-4b1a-a730-7690bee17d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s57z" Jun 08 08:21:31.249179 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.247646 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f7aa67e2-0ae6-402d-9cab-b798c21b9390-host-run-netns\") pod \"multus-7bjsd\" (UID: \"f7aa67e2-0ae6-402d-9cab-b798c21b9390\") " pod="openshift-multus/multus-7bjsd" Jun 08 08:21:31.249179 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.247673 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f7aa67e2-0ae6-402d-9cab-b798c21b9390-multus-conf-dir\") pod \"multus-7bjsd\" (UID: \"f7aa67e2-0ae6-402d-9cab-b798c21b9390\") " pod="openshift-multus/multus-7bjsd" Jun 08 08:21:31.249179 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.247728 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f7aa67e2-0ae6-402d-9cab-b798c21b9390-multus-cni-dir\") pod \"multus-7bjsd\" (UID: \"f7aa67e2-0ae6-402d-9cab-b798c21b9390\") " pod="openshift-multus/multus-7bjsd" Jun 08 08:21:31.249179 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.247738 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/202c9657-3a36-43ef-88ad-8fdaaba546c0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7np8s\" (UID: \"202c9657-3a36-43ef-88ad-8fdaaba546c0\") " pod="openshift-multus/multus-additional-cni-plugins-7np8s" Jun 08 08:21:31.249179 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.247785 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f7aa67e2-0ae6-402d-9cab-b798c21b9390-host-run-netns\") pod \"multus-7bjsd\" (UID: \"f7aa67e2-0ae6-402d-9cab-b798c21b9390\") " pod="openshift-multus/multus-7bjsd" Jun 08 08:21:31.249179 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.247810 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f833d2e7-472b-473f-a0c0-42c61a42f524-host\") pod \"tuned-fjhnr\" (UID: \"f833d2e7-472b-473f-a0c0-42c61a42f524\") " pod="openshift-cluster-node-tuning-operator/tuned-fjhnr" Jun 08 08:21:31.249179 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.247836 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b817d520-ebd3-4bd7-9490-90751bd573aa-host\") pod \"node-ca-hp6pw\" (UID: \"b817d520-ebd3-4bd7-9490-90751bd573aa\") " pod="openshift-image-registry/node-ca-hp6pw" Jun 08 08:21:31.249179 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.247860 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f5ba4fab-6782-4e56-8c83-c66b3457650e-socket-dir\") pod \"aws-ebs-csi-driver-node-t4jgz\" (UID: \"f5ba4fab-6782-4e56-8c83-c66b3457650e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4jgz" Jun 08 08:21:31.249179 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:31.247867 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 08:21:31.249179 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.247803 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/202c9657-3a36-43ef-88ad-8fdaaba546c0-os-release\") pod \"multus-additional-cni-plugins-7np8s\" (UID: \"202c9657-3a36-43ef-88ad-8fdaaba546c0\") " pod="openshift-multus/multus-additional-cni-plugins-7np8s" Jun 08 08:21:31.249179 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.247909 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f7aa67e2-0ae6-402d-9cab-b798c21b9390-multus-conf-dir\") pod \"multus-7bjsd\" (UID: \"f7aa67e2-0ae6-402d-9cab-b798c21b9390\") " pod="openshift-multus/multus-7bjsd" Jun 08 08:21:31.249179 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:31.247923 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0c87538-422c-4356-8983-84c33320ca33-metrics-certs podName:e0c87538-422c-4356-8983-84c33320ca33 nodeName:}" failed. No retries permitted until 2026-06-08 08:21:31.747909524 +0000 UTC m=+3.002120961 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e0c87538-422c-4356-8983-84c33320ca33-metrics-certs") pod "network-metrics-daemon-zx26n" (UID: "e0c87538-422c-4356-8983-84c33320ca33") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 08:21:31.249179 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.247940 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjth4\" (UniqueName: \"kubernetes.io/projected/f5ba4fab-6782-4e56-8c83-c66b3457650e-kube-api-access-gjth4\") pod \"aws-ebs-csi-driver-node-t4jgz\" (UID: \"f5ba4fab-6782-4e56-8c83-c66b3457650e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4jgz" Jun 08 08:21:31.249179 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.247946 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b817d520-ebd3-4bd7-9490-90751bd573aa-host\") pod \"node-ca-hp6pw\" (UID: \"b817d520-ebd3-4bd7-9490-90751bd573aa\") " pod="openshift-image-registry/node-ca-hp6pw" Jun 08 08:21:31.249179 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.247979 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8fed09c4-f238-4205-b258-0b0486bf019d-iptables-alerter-script\") pod \"iptables-alerter-bxq5l\" (UID: \"8fed09c4-f238-4205-b258-0b0486bf019d\") " pod="openshift-network-operator/iptables-alerter-bxq5l" Jun 08 08:21:31.249179 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.248010 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kfq6\" (UniqueName: \"kubernetes.io/projected/28880cc4-90dd-4d3f-8bf7-df18edcdd096-kube-api-access-5kfq6\") pod \"node-resolver-f845l\" (UID: \"28880cc4-90dd-4d3f-8bf7-df18edcdd096\") " pod="openshift-dns/node-resolver-f845l" Jun 08 08:21:31.249797 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.248046 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ea083ae5-52f5-4b1a-a730-7690bee17d80-host-run-netns\") pod \"ovnkube-node-5s57z\" (UID: \"ea083ae5-52f5-4b1a-a730-7690bee17d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s57z" Jun 08 08:21:31.249797 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.248090 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ea083ae5-52f5-4b1a-a730-7690bee17d80-var-lib-openvswitch\") pod \"ovnkube-node-5s57z\" (UID: \"ea083ae5-52f5-4b1a-a730-7690bee17d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s57z" Jun 08 08:21:31.249797 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.248135 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ea083ae5-52f5-4b1a-a730-7690bee17d80-etc-openvswitch\") pod \"ovnkube-node-5s57z\" (UID: \"ea083ae5-52f5-4b1a-a730-7690bee17d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s57z" Jun 08 08:21:31.249797 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.248184 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f7aa67e2-0ae6-402d-9cab-b798c21b9390-cni-binary-copy\") pod \"multus-7bjsd\" (UID: \"f7aa67e2-0ae6-402d-9cab-b798c21b9390\") " pod="openshift-multus/multus-7bjsd" Jun 08 08:21:31.249797 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.248216 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f833d2e7-472b-473f-a0c0-42c61a42f524-etc-sysctl-conf\") pod \"tuned-fjhnr\" (UID: \"f833d2e7-472b-473f-a0c0-42c61a42f524\") " pod="openshift-cluster-node-tuning-operator/tuned-fjhnr" Jun 08 08:21:31.249797 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.248317 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f833d2e7-472b-473f-a0c0-42c61a42f524-sys\") pod \"tuned-fjhnr\" (UID: \"f833d2e7-472b-473f-a0c0-42c61a42f524\") " pod="openshift-cluster-node-tuning-operator/tuned-fjhnr" Jun 08 08:21:31.249797 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.248344 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f833d2e7-472b-473f-a0c0-42c61a42f524-lib-modules\") pod \"tuned-fjhnr\" (UID: \"f833d2e7-472b-473f-a0c0-42c61a42f524\") " pod="openshift-cluster-node-tuning-operator/tuned-fjhnr" Jun 08 08:21:31.249797 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.248368 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kq59n\" (UniqueName: \"kubernetes.io/projected/e308208d-115f-41f0-81f3-65e534a90356-kube-api-access-kq59n\") pod \"network-check-target-cchg2\" (UID: \"e308208d-115f-41f0-81f3-65e534a90356\") " pod="openshift-network-diagnostics/network-check-target-cchg2" Jun 08 08:21:31.249797 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.248394 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ea083ae5-52f5-4b1a-a730-7690bee17d80-node-log\") pod \"ovnkube-node-5s57z\" (UID: \"ea083ae5-52f5-4b1a-a730-7690bee17d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s57z" Jun 08 08:21:31.249797 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.248416 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ea083ae5-52f5-4b1a-a730-7690bee17d80-log-socket\") pod \"ovnkube-node-5s57z\" (UID: \"ea083ae5-52f5-4b1a-a730-7690bee17d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s57z" Jun 08 08:21:31.249797 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.248590 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f7aa67e2-0ae6-402d-9cab-b798c21b9390-etc-kubernetes\") pod \"multus-7bjsd\" (UID: \"f7aa67e2-0ae6-402d-9cab-b798c21b9390\") " pod="openshift-multus/multus-7bjsd" Jun 08 08:21:31.249797 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.248605 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f5ba4fab-6782-4e56-8c83-c66b3457650e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-t4jgz\" (UID: \"f5ba4fab-6782-4e56-8c83-c66b3457650e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4jgz" Jun 08 08:21:31.249797 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.248620 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f7aa67e2-0ae6-402d-9cab-b798c21b9390-cni-binary-copy\") pod \"multus-7bjsd\" (UID: \"f7aa67e2-0ae6-402d-9cab-b798c21b9390\") " pod="openshift-multus/multus-7bjsd" Jun 08 08:21:31.249797 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.248623 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ea083ae5-52f5-4b1a-a730-7690bee17d80-host-cni-bin\") pod \"ovnkube-node-5s57z\" (UID: \"ea083ae5-52f5-4b1a-a730-7690bee17d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s57z" Jun 08 08:21:31.249797 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.248665 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ea083ae5-52f5-4b1a-a730-7690bee17d80-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5s57z\" (UID: \"ea083ae5-52f5-4b1a-a730-7690bee17d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s57z" Jun 08 08:21:31.249797 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.248690 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ea083ae5-52f5-4b1a-a730-7690bee17d80-ovn-node-metrics-cert\") pod \"ovnkube-node-5s57z\" (UID: \"ea083ae5-52f5-4b1a-a730-7690bee17d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s57z" Jun 08 08:21:31.249797 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.248677 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f7aa67e2-0ae6-402d-9cab-b798c21b9390-etc-kubernetes\") pod \"multus-7bjsd\" (UID: \"f7aa67e2-0ae6-402d-9cab-b798c21b9390\") " pod="openshift-multus/multus-7bjsd" Jun 08 08:21:31.250356 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.248744 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkh9c\" (UniqueName: \"kubernetes.io/projected/ea083ae5-52f5-4b1a-a730-7690bee17d80-kube-api-access-qkh9c\") pod \"ovnkube-node-5s57z\" (UID: \"ea083ae5-52f5-4b1a-a730-7690bee17d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s57z" Jun 08 08:21:31.250356 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.250105 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/87ee6f5d-c749-452a-9574-287d8a6913cc-agent-certs\") pod \"konnectivity-agent-jqgqd\" (UID: \"87ee6f5d-c749-452a-9574-287d8a6913cc\") " pod="kube-system/konnectivity-agent-jqgqd" Jun 08 08:21:31.256803 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.256780 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmwf6\" (UniqueName: \"kubernetes.io/projected/f7aa67e2-0ae6-402d-9cab-b798c21b9390-kube-api-access-wmwf6\") pod \"multus-7bjsd\" (UID: \"f7aa67e2-0ae6-402d-9cab-b798c21b9390\") " pod="openshift-multus/multus-7bjsd" Jun 08 08:21:31.258990 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.258974 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8mwp\" (UniqueName: \"kubernetes.io/projected/e0c87538-422c-4356-8983-84c33320ca33-kube-api-access-d8mwp\") pod \"network-metrics-daemon-zx26n\" (UID: \"e0c87538-422c-4356-8983-84c33320ca33\") " pod="openshift-multus/network-metrics-daemon-zx26n" Jun 08 08:21:31.263122 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.263104 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzmh8\" (UniqueName: \"kubernetes.io/projected/202c9657-3a36-43ef-88ad-8fdaaba546c0-kube-api-access-lzmh8\") pod \"multus-additional-cni-plugins-7np8s\" (UID: \"202c9657-3a36-43ef-88ad-8fdaaba546c0\") " pod="openshift-multus/multus-additional-cni-plugins-7np8s" Jun 08 08:21:31.268490 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.268471 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jc5cs\" (UniqueName: \"kubernetes.io/projected/b817d520-ebd3-4bd7-9490-90751bd573aa-kube-api-access-jc5cs\") pod \"node-ca-hp6pw\" (UID: \"b817d520-ebd3-4bd7-9490-90751bd573aa\") " pod="openshift-image-registry/node-ca-hp6pw" Jun 08 08:21:31.349415 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.349370 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ea083ae5-52f5-4b1a-a730-7690bee17d80-ovnkube-script-lib\") pod \"ovnkube-node-5s57z\" (UID: \"ea083ae5-52f5-4b1a-a730-7690bee17d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s57z" Jun 08 08:21:31.349576 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.349426 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/28880cc4-90dd-4d3f-8bf7-df18edcdd096-hosts-file\") pod \"node-resolver-f845l\" (UID: \"28880cc4-90dd-4d3f-8bf7-df18edcdd096\") " pod="openshift-dns/node-resolver-f845l" Jun 08 08:21:31.349576 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.349465 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ea083ae5-52f5-4b1a-a730-7690bee17d80-host-slash\") pod \"ovnkube-node-5s57z\" (UID: \"ea083ae5-52f5-4b1a-a730-7690bee17d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s57z" Jun 08 08:21:31.349576 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.349490 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f833d2e7-472b-473f-a0c0-42c61a42f524-etc-modprobe-d\") pod \"tuned-fjhnr\" (UID: \"f833d2e7-472b-473f-a0c0-42c61a42f524\") " pod="openshift-cluster-node-tuning-operator/tuned-fjhnr" Jun 08 08:21:31.349576 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.349513 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f833d2e7-472b-473f-a0c0-42c61a42f524-etc-sysctl-d\") pod \"tuned-fjhnr\" (UID: \"f833d2e7-472b-473f-a0c0-42c61a42f524\") " pod="openshift-cluster-node-tuning-operator/tuned-fjhnr" Jun 08 08:21:31.349576 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.349538 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28880cc4-90dd-4d3f-8bf7-df18edcdd096-tmp-dir\") pod \"node-resolver-f845l\" (UID: \"28880cc4-90dd-4d3f-8bf7-df18edcdd096\") " pod="openshift-dns/node-resolver-f845l" Jun 08 08:21:31.349576 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.349559 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ea083ae5-52f5-4b1a-a730-7690bee17d80-host-slash\") pod \"ovnkube-node-5s57z\" (UID: \"ea083ae5-52f5-4b1a-a730-7690bee17d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s57z" Jun 08 08:21:31.349893 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.349561 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f833d2e7-472b-473f-a0c0-42c61a42f524-etc-tuned\") pod \"tuned-fjhnr\" (UID: \"f833d2e7-472b-473f-a0c0-42c61a42f524\") " pod="openshift-cluster-node-tuning-operator/tuned-fjhnr" Jun 08 08:21:31.349893 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.349612 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhmdd\" (UniqueName: \"kubernetes.io/projected/f833d2e7-472b-473f-a0c0-42c61a42f524-kube-api-access-vhmdd\") pod \"tuned-fjhnr\" (UID: \"f833d2e7-472b-473f-a0c0-42c61a42f524\") " pod="openshift-cluster-node-tuning-operator/tuned-fjhnr" Jun 08 08:21:31.349893 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.349637 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ea083ae5-52f5-4b1a-a730-7690bee17d80-run-ovn\") pod \"ovnkube-node-5s57z\" (UID: \"ea083ae5-52f5-4b1a-a730-7690bee17d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s57z" Jun 08 08:21:31.349893 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.349642 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f833d2e7-472b-473f-a0c0-42c61a42f524-etc-sysctl-d\") pod \"tuned-fjhnr\" (UID: \"f833d2e7-472b-473f-a0c0-42c61a42f524\") " pod="openshift-cluster-node-tuning-operator/tuned-fjhnr" Jun 08 08:21:31.349893 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.349645 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f833d2e7-472b-473f-a0c0-42c61a42f524-etc-modprobe-d\") pod \"tuned-fjhnr\" (UID: \"f833d2e7-472b-473f-a0c0-42c61a42f524\") " pod="openshift-cluster-node-tuning-operator/tuned-fjhnr" Jun 08 08:21:31.349893 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.349661 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f833d2e7-472b-473f-a0c0-42c61a42f524-etc-kubernetes\") pod \"tuned-fjhnr\" (UID: \"f833d2e7-472b-473f-a0c0-42c61a42f524\") " pod="openshift-cluster-node-tuning-operator/tuned-fjhnr" Jun 08 08:21:31.349893 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.349695 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/28880cc4-90dd-4d3f-8bf7-df18edcdd096-hosts-file\") pod \"node-resolver-f845l\" (UID: \"28880cc4-90dd-4d3f-8bf7-df18edcdd096\") " pod="openshift-dns/node-resolver-f845l" Jun 08 08:21:31.349893 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.349725 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f833d2e7-472b-473f-a0c0-42c61a42f524-etc-kubernetes\") pod \"tuned-fjhnr\" (UID: \"f833d2e7-472b-473f-a0c0-42c61a42f524\") " pod="openshift-cluster-node-tuning-operator/tuned-fjhnr" Jun 08 08:21:31.349893 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.349763 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ea083ae5-52f5-4b1a-a730-7690bee17d80-run-ovn\") pod \"ovnkube-node-5s57z\" (UID: \"ea083ae5-52f5-4b1a-a730-7690bee17d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s57z" Jun 08 08:21:31.349893 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.349779 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f833d2e7-472b-473f-a0c0-42c61a42f524-etc-systemd\") pod \"tuned-fjhnr\" (UID: \"f833d2e7-472b-473f-a0c0-42c61a42f524\") " pod="openshift-cluster-node-tuning-operator/tuned-fjhnr" Jun 08 08:21:31.349893 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.349814 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ea083ae5-52f5-4b1a-a730-7690bee17d80-systemd-units\") pod \"ovnkube-node-5s57z\" (UID: \"ea083ae5-52f5-4b1a-a730-7690bee17d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s57z" Jun 08 08:21:31.349893 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.349838 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ea083ae5-52f5-4b1a-a730-7690bee17d80-run-openvswitch\") pod \"ovnkube-node-5s57z\" (UID: \"ea083ae5-52f5-4b1a-a730-7690bee17d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s57z" Jun 08 08:21:31.349893 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.349869 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28880cc4-90dd-4d3f-8bf7-df18edcdd096-tmp-dir\") pod \"node-resolver-f845l\" (UID: \"28880cc4-90dd-4d3f-8bf7-df18edcdd096\") " pod="openshift-dns/node-resolver-f845l" Jun 08 08:21:31.349893 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.349880 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f833d2e7-472b-473f-a0c0-42c61a42f524-etc-systemd\") pod \"tuned-fjhnr\" (UID: \"f833d2e7-472b-473f-a0c0-42c61a42f524\") " pod="openshift-cluster-node-tuning-operator/tuned-fjhnr" Jun 08 08:21:31.349893 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.349865 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f5ba4fab-6782-4e56-8c83-c66b3457650e-etc-selinux\") pod \"aws-ebs-csi-driver-node-t4jgz\" (UID: \"f5ba4fab-6782-4e56-8c83-c66b3457650e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4jgz" Jun 08 08:21:31.350585 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.349924 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ea083ae5-52f5-4b1a-a730-7690bee17d80-systemd-units\") pod \"ovnkube-node-5s57z\" (UID: \"ea083ae5-52f5-4b1a-a730-7690bee17d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s57z" Jun 08 08:21:31.350585 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.349929 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ea083ae5-52f5-4b1a-a730-7690bee17d80-run-openvswitch\") pod \"ovnkube-node-5s57z\" (UID: \"ea083ae5-52f5-4b1a-a730-7690bee17d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s57z" Jun 08 08:21:31.350585 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.349936 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f5ba4fab-6782-4e56-8c83-c66b3457650e-sys-fs\") pod \"aws-ebs-csi-driver-node-t4jgz\" (UID: \"f5ba4fab-6782-4e56-8c83-c66b3457650e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4jgz" Jun 08 08:21:31.350585 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.349966 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f5ba4fab-6782-4e56-8c83-c66b3457650e-device-dir\") pod \"aws-ebs-csi-driver-node-t4jgz\" (UID: \"f5ba4fab-6782-4e56-8c83-c66b3457650e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4jgz" Jun 08 08:21:31.350585 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.349977 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f5ba4fab-6782-4e56-8c83-c66b3457650e-etc-selinux\") pod \"aws-ebs-csi-driver-node-t4jgz\" (UID: \"f5ba4fab-6782-4e56-8c83-c66b3457650e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4jgz" Jun 08 08:21:31.350585 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.349989 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f833d2e7-472b-473f-a0c0-42c61a42f524-var-lib-kubelet\") pod \"tuned-fjhnr\" (UID: \"f833d2e7-472b-473f-a0c0-42c61a42f524\") " pod="openshift-cluster-node-tuning-operator/tuned-fjhnr" Jun 08 08:21:31.350585 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.350012 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f833d2e7-472b-473f-a0c0-42c61a42f524-tmp\") pod \"tuned-fjhnr\" (UID: \"f833d2e7-472b-473f-a0c0-42c61a42f524\") " pod="openshift-cluster-node-tuning-operator/tuned-fjhnr" Jun 08 08:21:31.350585 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.350034 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f833d2e7-472b-473f-a0c0-42c61a42f524-run\") pod \"tuned-fjhnr\" (UID: \"f833d2e7-472b-473f-a0c0-42c61a42f524\") " pod="openshift-cluster-node-tuning-operator/tuned-fjhnr" Jun 08 08:21:31.350585 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.350035 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f5ba4fab-6782-4e56-8c83-c66b3457650e-device-dir\") pod \"aws-ebs-csi-driver-node-t4jgz\" (UID: \"f5ba4fab-6782-4e56-8c83-c66b3457650e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4jgz" Jun 08 08:21:31.350585 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.350011 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f5ba4fab-6782-4e56-8c83-c66b3457650e-sys-fs\") pod \"aws-ebs-csi-driver-node-t4jgz\" (UID: \"f5ba4fab-6782-4e56-8c83-c66b3457650e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4jgz" Jun 08 08:21:31.350585 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.350055 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ea083ae5-52f5-4b1a-a730-7690bee17d80-host-kubelet\") pod \"ovnkube-node-5s57z\" (UID: \"ea083ae5-52f5-4b1a-a730-7690bee17d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s57z" Jun 08 08:21:31.350585 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.350063 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f833d2e7-472b-473f-a0c0-42c61a42f524-var-lib-kubelet\") pod \"tuned-fjhnr\" (UID: \"f833d2e7-472b-473f-a0c0-42c61a42f524\") " pod="openshift-cluster-node-tuning-operator/tuned-fjhnr" Jun 08 08:21:31.350585 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.350084 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f833d2e7-472b-473f-a0c0-42c61a42f524-etc-sysconfig\") pod \"tuned-fjhnr\" (UID: \"f833d2e7-472b-473f-a0c0-42c61a42f524\") " pod="openshift-cluster-node-tuning-operator/tuned-fjhnr" Jun 08 08:21:31.350585 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.350096 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ea083ae5-52f5-4b1a-a730-7690bee17d80-ovnkube-script-lib\") pod \"ovnkube-node-5s57z\" (UID: \"ea083ae5-52f5-4b1a-a730-7690bee17d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s57z" Jun 08 08:21:31.350585 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.350109 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krwcv\" (UniqueName: \"kubernetes.io/projected/8fed09c4-f238-4205-b258-0b0486bf019d-kube-api-access-krwcv\") pod \"iptables-alerter-bxq5l\" (UID: \"8fed09c4-f238-4205-b258-0b0486bf019d\") " pod="openshift-network-operator/iptables-alerter-bxq5l" Jun 08 08:21:31.350585 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.350111 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f833d2e7-472b-473f-a0c0-42c61a42f524-run\") pod \"tuned-fjhnr\" (UID: \"f833d2e7-472b-473f-a0c0-42c61a42f524\") " pod="openshift-cluster-node-tuning-operator/tuned-fjhnr" Jun 08 08:21:31.350585 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.350085 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ea083ae5-52f5-4b1a-a730-7690bee17d80-host-kubelet\") pod \"ovnkube-node-5s57z\" (UID: \"ea083ae5-52f5-4b1a-a730-7690bee17d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s57z" Jun 08 08:21:31.351377 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.350124 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f833d2e7-472b-473f-a0c0-42c61a42f524-etc-sysconfig\") pod \"tuned-fjhnr\" (UID: \"f833d2e7-472b-473f-a0c0-42c61a42f524\") " pod="openshift-cluster-node-tuning-operator/tuned-fjhnr" Jun 08 08:21:31.351377 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.350134 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ea083ae5-52f5-4b1a-a730-7690bee17d80-run-systemd\") pod \"ovnkube-node-5s57z\" (UID: \"ea083ae5-52f5-4b1a-a730-7690bee17d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s57z" Jun 08 08:21:31.351377 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.350158 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ea083ae5-52f5-4b1a-a730-7690bee17d80-host-cni-netd\") pod \"ovnkube-node-5s57z\" (UID: \"ea083ae5-52f5-4b1a-a730-7690bee17d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s57z" Jun 08 08:21:31.351377 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.350172 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ea083ae5-52f5-4b1a-a730-7690bee17d80-run-systemd\") pod \"ovnkube-node-5s57z\" (UID: \"ea083ae5-52f5-4b1a-a730-7690bee17d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s57z" Jun 08 08:21:31.351377 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.350181 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ea083ae5-52f5-4b1a-a730-7690bee17d80-ovnkube-config\") pod \"ovnkube-node-5s57z\" (UID: \"ea083ae5-52f5-4b1a-a730-7690bee17d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s57z" Jun 08 08:21:31.351377 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.350191 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ea083ae5-52f5-4b1a-a730-7690bee17d80-host-cni-netd\") pod \"ovnkube-node-5s57z\" (UID: \"ea083ae5-52f5-4b1a-a730-7690bee17d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s57z" Jun 08 08:21:31.351377 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.350236 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ea083ae5-52f5-4b1a-a730-7690bee17d80-env-overrides\") pod \"ovnkube-node-5s57z\" (UID: \"ea083ae5-52f5-4b1a-a730-7690bee17d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s57z" Jun 08 08:21:31.351377 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.350264 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f833d2e7-472b-473f-a0c0-42c61a42f524-host\") pod \"tuned-fjhnr\" (UID: \"f833d2e7-472b-473f-a0c0-42c61a42f524\") " pod="openshift-cluster-node-tuning-operator/tuned-fjhnr" Jun 08 08:21:31.351377 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.350290 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f5ba4fab-6782-4e56-8c83-c66b3457650e-socket-dir\") pod \"aws-ebs-csi-driver-node-t4jgz\" (UID: \"f5ba4fab-6782-4e56-8c83-c66b3457650e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4jgz" Jun 08 08:21:31.351377 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.350316 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjth4\" (UniqueName: \"kubernetes.io/projected/f5ba4fab-6782-4e56-8c83-c66b3457650e-kube-api-access-gjth4\") pod \"aws-ebs-csi-driver-node-t4jgz\" (UID: \"f5ba4fab-6782-4e56-8c83-c66b3457650e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4jgz" Jun 08 08:21:31.351377 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.350343 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8fed09c4-f238-4205-b258-0b0486bf019d-iptables-alerter-script\") pod \"iptables-alerter-bxq5l\" (UID: \"8fed09c4-f238-4205-b258-0b0486bf019d\") " pod="openshift-network-operator/iptables-alerter-bxq5l" Jun 08 08:21:31.351377 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.350369 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5kfq6\" (UniqueName: \"kubernetes.io/projected/28880cc4-90dd-4d3f-8bf7-df18edcdd096-kube-api-access-5kfq6\") pod \"node-resolver-f845l\" (UID: \"28880cc4-90dd-4d3f-8bf7-df18edcdd096\") " pod="openshift-dns/node-resolver-f845l" Jun 08 08:21:31.351377 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.350394 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ea083ae5-52f5-4b1a-a730-7690bee17d80-host-run-netns\") pod \"ovnkube-node-5s57z\" (UID: \"ea083ae5-52f5-4b1a-a730-7690bee17d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s57z" Jun 08 08:21:31.351377 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.350417 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ea083ae5-52f5-4b1a-a730-7690bee17d80-var-lib-openvswitch\") pod \"ovnkube-node-5s57z\" (UID: \"ea083ae5-52f5-4b1a-a730-7690bee17d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s57z" Jun 08 08:21:31.351377 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.350442 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ea083ae5-52f5-4b1a-a730-7690bee17d80-etc-openvswitch\") pod \"ovnkube-node-5s57z\" (UID: \"ea083ae5-52f5-4b1a-a730-7690bee17d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s57z" Jun 08 08:21:31.351377 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.350458 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f5ba4fab-6782-4e56-8c83-c66b3457650e-socket-dir\") pod \"aws-ebs-csi-driver-node-t4jgz\" (UID: \"f5ba4fab-6782-4e56-8c83-c66b3457650e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4jgz" Jun 08 08:21:31.351377 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.350468 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f833d2e7-472b-473f-a0c0-42c61a42f524-etc-sysctl-conf\") pod \"tuned-fjhnr\" (UID: \"f833d2e7-472b-473f-a0c0-42c61a42f524\") " pod="openshift-cluster-node-tuning-operator/tuned-fjhnr" Jun 08 08:21:31.352219 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.350510 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f833d2e7-472b-473f-a0c0-42c61a42f524-sys\") pod \"tuned-fjhnr\" (UID: \"f833d2e7-472b-473f-a0c0-42c61a42f524\") " pod="openshift-cluster-node-tuning-operator/tuned-fjhnr" Jun 08 08:21:31.352219 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.350515 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f833d2e7-472b-473f-a0c0-42c61a42f524-host\") pod \"tuned-fjhnr\" (UID: \"f833d2e7-472b-473f-a0c0-42c61a42f524\") " pod="openshift-cluster-node-tuning-operator/tuned-fjhnr" Jun 08 08:21:31.352219 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.350543 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f833d2e7-472b-473f-a0c0-42c61a42f524-lib-modules\") pod \"tuned-fjhnr\" (UID: \"f833d2e7-472b-473f-a0c0-42c61a42f524\") " pod="openshift-cluster-node-tuning-operator/tuned-fjhnr" Jun 08 08:21:31.352219 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.350571 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f833d2e7-472b-473f-a0c0-42c61a42f524-sys\") pod \"tuned-fjhnr\" (UID: \"f833d2e7-472b-473f-a0c0-42c61a42f524\") " pod="openshift-cluster-node-tuning-operator/tuned-fjhnr" Jun 08 08:21:31.352219 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.350626 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ea083ae5-52f5-4b1a-a730-7690bee17d80-host-run-netns\") pod \"ovnkube-node-5s57z\" (UID: \"ea083ae5-52f5-4b1a-a730-7690bee17d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s57z" Jun 08 08:21:31.352219 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.350652 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f833d2e7-472b-473f-a0c0-42c61a42f524-lib-modules\") pod \"tuned-fjhnr\" (UID: \"f833d2e7-472b-473f-a0c0-42c61a42f524\") " pod="openshift-cluster-node-tuning-operator/tuned-fjhnr" Jun 08 08:21:31.352219 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.350654 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ea083ae5-52f5-4b1a-a730-7690bee17d80-ovnkube-config\") pod \"ovnkube-node-5s57z\" (UID: \"ea083ae5-52f5-4b1a-a730-7690bee17d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s57z" Jun 08 08:21:31.352219 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.350664 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ea083ae5-52f5-4b1a-a730-7690bee17d80-var-lib-openvswitch\") pod \"ovnkube-node-5s57z\" (UID: \"ea083ae5-52f5-4b1a-a730-7690bee17d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s57z" Jun 08 08:21:31.352219 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.350668 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ea083ae5-52f5-4b1a-a730-7690bee17d80-env-overrides\") pod \"ovnkube-node-5s57z\" (UID: \"ea083ae5-52f5-4b1a-a730-7690bee17d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s57z" Jun 08 08:21:31.352219 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.350571 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kq59n\" (UniqueName: \"kubernetes.io/projected/e308208d-115f-41f0-81f3-65e534a90356-kube-api-access-kq59n\") pod \"network-check-target-cchg2\" (UID: \"e308208d-115f-41f0-81f3-65e534a90356\") " pod="openshift-network-diagnostics/network-check-target-cchg2" Jun 08 08:21:31.352219 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.350701 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ea083ae5-52f5-4b1a-a730-7690bee17d80-etc-openvswitch\") pod \"ovnkube-node-5s57z\" (UID: \"ea083ae5-52f5-4b1a-a730-7690bee17d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s57z" Jun 08 08:21:31.352219 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.350742 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ea083ae5-52f5-4b1a-a730-7690bee17d80-node-log\") pod \"ovnkube-node-5s57z\" (UID: \"ea083ae5-52f5-4b1a-a730-7690bee17d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s57z" Jun 08 08:21:31.352219 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.350768 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ea083ae5-52f5-4b1a-a730-7690bee17d80-log-socket\") pod \"ovnkube-node-5s57z\" (UID: \"ea083ae5-52f5-4b1a-a730-7690bee17d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s57z" Jun 08 08:21:31.352219 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.350794 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f5ba4fab-6782-4e56-8c83-c66b3457650e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-t4jgz\" (UID: \"f5ba4fab-6782-4e56-8c83-c66b3457650e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4jgz" Jun 08 08:21:31.352219 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.350817 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ea083ae5-52f5-4b1a-a730-7690bee17d80-host-cni-bin\") pod \"ovnkube-node-5s57z\" (UID: \"ea083ae5-52f5-4b1a-a730-7690bee17d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s57z" Jun 08 08:21:31.352219 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.350833 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f833d2e7-472b-473f-a0c0-42c61a42f524-etc-sysctl-conf\") pod \"tuned-fjhnr\" (UID: \"f833d2e7-472b-473f-a0c0-42c61a42f524\") " pod="openshift-cluster-node-tuning-operator/tuned-fjhnr" Jun 08 08:21:31.352219 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.350838 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ea083ae5-52f5-4b1a-a730-7690bee17d80-node-log\") pod \"ovnkube-node-5s57z\" (UID: \"ea083ae5-52f5-4b1a-a730-7690bee17d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s57z" Jun 08 08:21:31.352219 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.350844 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ea083ae5-52f5-4b1a-a730-7690bee17d80-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5s57z\" (UID: \"ea083ae5-52f5-4b1a-a730-7690bee17d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s57z" Jun 08 08:21:31.353108 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.350880 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ea083ae5-52f5-4b1a-a730-7690bee17d80-ovn-node-metrics-cert\") pod \"ovnkube-node-5s57z\" (UID: \"ea083ae5-52f5-4b1a-a730-7690bee17d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s57z" Jun 08 08:21:31.353108 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.350893 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ea083ae5-52f5-4b1a-a730-7690bee17d80-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5s57z\" (UID: \"ea083ae5-52f5-4b1a-a730-7690bee17d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s57z" Jun 08 08:21:31.353108 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.350909 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkh9c\" (UniqueName: \"kubernetes.io/projected/ea083ae5-52f5-4b1a-a730-7690bee17d80-kube-api-access-qkh9c\") pod \"ovnkube-node-5s57z\" (UID: \"ea083ae5-52f5-4b1a-a730-7690bee17d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s57z" Jun 08 08:21:31.353108 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.350940 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f5ba4fab-6782-4e56-8c83-c66b3457650e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-t4jgz\" (UID: \"f5ba4fab-6782-4e56-8c83-c66b3457650e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4jgz" Jun 08 08:21:31.353108 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.350950 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f5ba4fab-6782-4e56-8c83-c66b3457650e-registration-dir\") pod \"aws-ebs-csi-driver-node-t4jgz\" (UID: \"f5ba4fab-6782-4e56-8c83-c66b3457650e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4jgz" Jun 08 08:21:31.353108 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.350976 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8fed09c4-f238-4205-b258-0b0486bf019d-host-slash\") pod \"iptables-alerter-bxq5l\" (UID: \"8fed09c4-f238-4205-b258-0b0486bf019d\") " pod="openshift-network-operator/iptables-alerter-bxq5l" Jun 08 08:21:31.353108 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.350978 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ea083ae5-52f5-4b1a-a730-7690bee17d80-log-socket\") pod \"ovnkube-node-5s57z\" (UID: \"ea083ae5-52f5-4b1a-a730-7690bee17d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s57z" Jun 08 08:21:31.353108 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.350884 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ea083ae5-52f5-4b1a-a730-7690bee17d80-host-cni-bin\") pod \"ovnkube-node-5s57z\" (UID: \"ea083ae5-52f5-4b1a-a730-7690bee17d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s57z" Jun 08 08:21:31.353108 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.351002 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ea083ae5-52f5-4b1a-a730-7690bee17d80-host-run-ovn-kubernetes\") pod \"ovnkube-node-5s57z\" (UID: \"ea083ae5-52f5-4b1a-a730-7690bee17d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s57z" Jun 08 08:21:31.353108 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.351026 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f5ba4fab-6782-4e56-8c83-c66b3457650e-registration-dir\") pod \"aws-ebs-csi-driver-node-t4jgz\" (UID: \"f5ba4fab-6782-4e56-8c83-c66b3457650e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4jgz" Jun 08 08:21:31.353108 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.351072 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8fed09c4-f238-4205-b258-0b0486bf019d-host-slash\") pod \"iptables-alerter-bxq5l\" (UID: \"8fed09c4-f238-4205-b258-0b0486bf019d\") " pod="openshift-network-operator/iptables-alerter-bxq5l" Jun 08 08:21:31.353108 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.351073 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ea083ae5-52f5-4b1a-a730-7690bee17d80-host-run-ovn-kubernetes\") pod \"ovnkube-node-5s57z\" (UID: \"ea083ae5-52f5-4b1a-a730-7690bee17d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s57z" Jun 08 08:21:31.353108 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.351184 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8fed09c4-f238-4205-b258-0b0486bf019d-iptables-alerter-script\") pod \"iptables-alerter-bxq5l\" (UID: \"8fed09c4-f238-4205-b258-0b0486bf019d\") " pod="openshift-network-operator/iptables-alerter-bxq5l" Jun 08 08:21:31.353108 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.352175 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f833d2e7-472b-473f-a0c0-42c61a42f524-etc-tuned\") pod \"tuned-fjhnr\" (UID: \"f833d2e7-472b-473f-a0c0-42c61a42f524\") " pod="openshift-cluster-node-tuning-operator/tuned-fjhnr" Jun 08 08:21:31.353108 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.352264 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f833d2e7-472b-473f-a0c0-42c61a42f524-tmp\") pod \"tuned-fjhnr\" (UID: \"f833d2e7-472b-473f-a0c0-42c61a42f524\") " pod="openshift-cluster-node-tuning-operator/tuned-fjhnr" Jun 08 08:21:31.353870 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.353138 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ea083ae5-52f5-4b1a-a730-7690bee17d80-ovn-node-metrics-cert\") pod \"ovnkube-node-5s57z\" (UID: \"ea083ae5-52f5-4b1a-a730-7690bee17d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s57z" Jun 08 08:21:31.370365 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.370309 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kfq6\" (UniqueName: \"kubernetes.io/projected/28880cc4-90dd-4d3f-8bf7-df18edcdd096-kube-api-access-5kfq6\") pod \"node-resolver-f845l\" (UID: \"28880cc4-90dd-4d3f-8bf7-df18edcdd096\") " pod="openshift-dns/node-resolver-f845l" Jun 08 08:21:31.370805 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:31.370785 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 08:21:31.370805 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:31.370808 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 08:21:31.370966 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:31.370820 2570 projected.go:196] Error preparing data for projected volume kube-api-access-kq59n for pod openshift-network-diagnostics/network-check-target-cchg2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 08:21:31.370966 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:31.370880 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e308208d-115f-41f0-81f3-65e534a90356-kube-api-access-kq59n podName:e308208d-115f-41f0-81f3-65e534a90356 nodeName:}" failed. No retries permitted until 2026-06-08 08:21:31.870862578 +0000 UTC m=+3.125074022 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-kq59n" (UniqueName: "kubernetes.io/projected/e308208d-115f-41f0-81f3-65e534a90356-kube-api-access-kq59n") pod "network-check-target-cchg2" (UID: "e308208d-115f-41f0-81f3-65e534a90356") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 08:21:31.371062 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.371046 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjth4\" (UniqueName: \"kubernetes.io/projected/f5ba4fab-6782-4e56-8c83-c66b3457650e-kube-api-access-gjth4\") pod \"aws-ebs-csi-driver-node-t4jgz\" (UID: \"f5ba4fab-6782-4e56-8c83-c66b3457650e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4jgz" Jun 08 08:21:31.371481 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.371461 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-krwcv\" (UniqueName: \"kubernetes.io/projected/8fed09c4-f238-4205-b258-0b0486bf019d-kube-api-access-krwcv\") pod \"iptables-alerter-bxq5l\" (UID: \"8fed09c4-f238-4205-b258-0b0486bf019d\") " pod="openshift-network-operator/iptables-alerter-bxq5l" Jun 08 08:21:31.371723 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.371688 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkh9c\" (UniqueName: \"kubernetes.io/projected/ea083ae5-52f5-4b1a-a730-7690bee17d80-kube-api-access-qkh9c\") pod \"ovnkube-node-5s57z\" (UID: \"ea083ae5-52f5-4b1a-a730-7690bee17d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-5s57z" Jun 08 08:21:31.373238 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.373220 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhmdd\" (UniqueName: \"kubernetes.io/projected/f833d2e7-472b-473f-a0c0-42c61a42f524-kube-api-access-vhmdd\") pod \"tuned-fjhnr\" (UID: \"f833d2e7-472b-473f-a0c0-42c61a42f524\") " pod="openshift-cluster-node-tuning-operator/tuned-fjhnr" Jun 08 08:21:31.441501 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.441470 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jqgqd" Jun 08 08:21:31.450263 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.450237 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7np8s" Jun 08 08:21:31.458021 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.458002 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-hp6pw" Jun 08 08:21:31.463557 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.463538 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7bjsd" Jun 08 08:21:31.470060 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.470043 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4jgz" Jun 08 08:21:31.475925 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.475906 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-fjhnr" Jun 08 08:21:31.482804 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.482787 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-f845l" Jun 08 08:21:31.491852 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.491833 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-bxq5l" Jun 08 08:21:31.496429 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.496412 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5s57z" Jun 08 08:21:31.753837 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.753769 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4281d80d-e366-4f22-a397-e17c9be0e9f4-original-pull-secret\") pod \"global-pull-secret-syncer-6gvcs\" (UID: \"4281d80d-e366-4f22-a397-e17c9be0e9f4\") " pod="kube-system/global-pull-secret-syncer-6gvcs" Jun 08 08:21:31.753837 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.753821 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e0c87538-422c-4356-8983-84c33320ca33-metrics-certs\") pod \"network-metrics-daemon-zx26n\" (UID: \"e0c87538-422c-4356-8983-84c33320ca33\") " pod="openshift-multus/network-metrics-daemon-zx26n" Jun 08 08:21:31.753999 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:31.753914 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 08:21:31.753999 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:31.753918 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 08:21:31.753999 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:31.753973 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0c87538-422c-4356-8983-84c33320ca33-metrics-certs podName:e0c87538-422c-4356-8983-84c33320ca33 nodeName:}" failed. No retries permitted until 2026-06-08 08:21:32.753949323 +0000 UTC m=+4.008160751 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e0c87538-422c-4356-8983-84c33320ca33-metrics-certs") pod "network-metrics-daemon-zx26n" (UID: "e0c87538-422c-4356-8983-84c33320ca33") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 08:21:31.753999 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:31.753986 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4281d80d-e366-4f22-a397-e17c9be0e9f4-original-pull-secret podName:4281d80d-e366-4f22-a397-e17c9be0e9f4 nodeName:}" failed. No retries permitted until 2026-06-08 08:21:32.75398023 +0000 UTC m=+4.008191658 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4281d80d-e366-4f22-a397-e17c9be0e9f4-original-pull-secret") pod "global-pull-secret-syncer-6gvcs" (UID: "4281d80d-e366-4f22-a397-e17c9be0e9f4") : object "kube-system"/"original-pull-secret" not registered Jun 08 08:21:31.955383 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:31.955350 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kq59n\" (UniqueName: \"kubernetes.io/projected/e308208d-115f-41f0-81f3-65e534a90356-kube-api-access-kq59n\") pod \"network-check-target-cchg2\" (UID: \"e308208d-115f-41f0-81f3-65e534a90356\") " pod="openshift-network-diagnostics/network-check-target-cchg2" Jun 08 08:21:31.955572 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:31.955535 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 08:21:31.955572 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:31.955558 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 08:21:31.955572 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:31.955571 2570 projected.go:196] Error preparing data for projected volume kube-api-access-kq59n for pod openshift-network-diagnostics/network-check-target-cchg2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 08:21:31.955750 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:31.955651 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e308208d-115f-41f0-81f3-65e534a90356-kube-api-access-kq59n podName:e308208d-115f-41f0-81f3-65e534a90356 nodeName:}" failed. No retries permitted until 2026-06-08 08:21:32.955617108 +0000 UTC m=+4.209828556 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-kq59n" (UniqueName: "kubernetes.io/projected/e308208d-115f-41f0-81f3-65e534a90356-kube-api-access-kq59n") pod "network-check-target-cchg2" (UID: "e308208d-115f-41f0-81f3-65e534a90356") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 08:21:32.053702 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:32.053677 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87ee6f5d_c749_452a_9574_287d8a6913cc.slice/crio-f53115b7869249b1d3653d6f04de1ae431643f20f3948cf6efec0c423213f3d8 WatchSource:0}: Error finding container f53115b7869249b1d3653d6f04de1ae431643f20f3948cf6efec0c423213f3d8: Status 404 returned error can't find the container with id f53115b7869249b1d3653d6f04de1ae431643f20f3948cf6efec0c423213f3d8 Jun 08 08:21:32.055879 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:32.055852 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fed09c4_f238_4205_b258_0b0486bf019d.slice/crio-f9a6443030c324a91d430ce7312a8d6eaa8308a803e9a65e61e190a44d14a9e1 WatchSource:0}: Error finding container f9a6443030c324a91d430ce7312a8d6eaa8308a803e9a65e61e190a44d14a9e1: Status 404 returned error can't find the container with id f9a6443030c324a91d430ce7312a8d6eaa8308a803e9a65e61e190a44d14a9e1 Jun 08 08:21:32.057018 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:32.056989 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb817d520_ebd3_4bd7_9490_90751bd573aa.slice/crio-1a93bf4b3b989280db2b080bc6728f4f8fb7c6ff67ff7828c81c00fa4164b000 WatchSource:0}: Error finding container 1a93bf4b3b989280db2b080bc6728f4f8fb7c6ff67ff7828c81c00fa4164b000: Status 404 returned error can't find the container with id 1a93bf4b3b989280db2b080bc6728f4f8fb7c6ff67ff7828c81c00fa4164b000 Jun 08 08:21:32.079307 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:32.079286 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7aa67e2_0ae6_402d_9cab_b798c21b9390.slice/crio-958bb84e171e59a32912a5dc49c87ed88caf139906cddc779a12b569168db667 WatchSource:0}: Error finding container 958bb84e171e59a32912a5dc49c87ed88caf139906cddc779a12b569168db667: Status 404 returned error can't find the container with id 958bb84e171e59a32912a5dc49c87ed88caf139906cddc779a12b569168db667 Jun 08 08:21:32.080752 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:32.080738 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod202c9657_3a36_43ef_88ad_8fdaaba546c0.slice/crio-33b7385cb88806ea69bc3596517e5b0465cc2a2a7ceaa70cec7045cfa170d864 WatchSource:0}: Error finding container 33b7385cb88806ea69bc3596517e5b0465cc2a2a7ceaa70cec7045cfa170d864: Status 404 returned error can't find the container with id 33b7385cb88806ea69bc3596517e5b0465cc2a2a7ceaa70cec7045cfa170d864 Jun 08 08:21:32.082416 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:32.082386 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28880cc4_90dd_4d3f_8bf7_df18edcdd096.slice/crio-05462c870362c4e095875ae82ab4e2d69cfcb923eb2f703c5bb875b2ba58e2cf WatchSource:0}: Error finding container 05462c870362c4e095875ae82ab4e2d69cfcb923eb2f703c5bb875b2ba58e2cf: Status 404 returned error can't find the container with id 05462c870362c4e095875ae82ab4e2d69cfcb923eb2f703c5bb875b2ba58e2cf Jun 08 08:21:32.083729 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:32.083692 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5ba4fab_6782_4e56_8c83_c66b3457650e.slice/crio-052e72f94ea70d53208fac84d9474324f6957039a8d644d9467fc42f681675ee WatchSource:0}: Error finding container 052e72f94ea70d53208fac84d9474324f6957039a8d644d9467fc42f681675ee: Status 404 returned error can't find the container with id 052e72f94ea70d53208fac84d9474324f6957039a8d644d9467fc42f681675ee Jun 08 08:21:32.086095 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:32.085560 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea083ae5_52f5_4b1a_a730_7690bee17d80.slice/crio-aa1ff0498d2d82f4baa8be0054a8ad2c2759cd8fabff0b0b0cef883b2c63d79c WatchSource:0}: Error finding container aa1ff0498d2d82f4baa8be0054a8ad2c2759cd8fabff0b0b0cef883b2c63d79c: Status 404 returned error can't find the container with id aa1ff0498d2d82f4baa8be0054a8ad2c2759cd8fabff0b0b0cef883b2c63d79c Jun 08 08:21:32.087591 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:21:32.087562 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf833d2e7_472b_473f_a0c0_42c61a42f524.slice/crio-e7da13083eb99861e379e9eaed63d758c30b1d3de91cb71aa7bdda1b49c19515 WatchSource:0}: Error finding container e7da13083eb99861e379e9eaed63d758c30b1d3de91cb71aa7bdda1b49c19515: Status 404 returned error can't find the container with id e7da13083eb99861e379e9eaed63d758c30b1d3de91cb71aa7bdda1b49c19515 Jun 08 08:21:32.216120 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:32.216090 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-f845l" event={"ID":"28880cc4-90dd-4d3f-8bf7-df18edcdd096","Type":"ContainerStarted","Data":"05462c870362c4e095875ae82ab4e2d69cfcb923eb2f703c5bb875b2ba58e2cf"} Jun 08 08:21:32.217088 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:32.217062 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7np8s" event={"ID":"202c9657-3a36-43ef-88ad-8fdaaba546c0","Type":"ContainerStarted","Data":"33b7385cb88806ea69bc3596517e5b0465cc2a2a7ceaa70cec7045cfa170d864"} Jun 08 08:21:32.218087 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:32.218061 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-hp6pw" event={"ID":"b817d520-ebd3-4bd7-9490-90751bd573aa","Type":"ContainerStarted","Data":"1a93bf4b3b989280db2b080bc6728f4f8fb7c6ff67ff7828c81c00fa4164b000"} Jun 08 08:21:32.219607 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:32.219587 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-bxq5l" event={"ID":"8fed09c4-f238-4205-b258-0b0486bf019d","Type":"ContainerStarted","Data":"f9a6443030c324a91d430ce7312a8d6eaa8308a803e9a65e61e190a44d14a9e1"} Jun 08 08:21:32.222893 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:32.222873 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5s57z" event={"ID":"ea083ae5-52f5-4b1a-a730-7690bee17d80","Type":"ContainerStarted","Data":"aa1ff0498d2d82f4baa8be0054a8ad2c2759cd8fabff0b0b0cef883b2c63d79c"} Jun 08 08:21:32.225112 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:32.225090 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7bjsd" event={"ID":"f7aa67e2-0ae6-402d-9cab-b798c21b9390","Type":"ContainerStarted","Data":"958bb84e171e59a32912a5dc49c87ed88caf139906cddc779a12b569168db667"} Jun 08 08:21:32.226044 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:32.226026 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jqgqd" event={"ID":"87ee6f5d-c749-452a-9574-287d8a6913cc","Type":"ContainerStarted","Data":"f53115b7869249b1d3653d6f04de1ae431643f20f3948cf6efec0c423213f3d8"} Jun 08 08:21:32.230305 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:32.230281 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-101.ec2.internal" event={"ID":"690c9e7947c5aecc188863a395b640fd","Type":"ContainerStarted","Data":"4950b2e0ae132061145c187c41977ab66350775d51610fe8b9d8edca1f235b0f"} Jun 08 08:21:32.231391 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:32.231367 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-fjhnr" event={"ID":"f833d2e7-472b-473f-a0c0-42c61a42f524","Type":"ContainerStarted","Data":"e7da13083eb99861e379e9eaed63d758c30b1d3de91cb71aa7bdda1b49c19515"} Jun 08 08:21:32.232697 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:32.232674 2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-07 08:16:31 +0000 UTC" deadline="2027-12-19 07:05:22.005474819 +0000 UTC" Jun 08 08:21:32.232697 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:32.232696 2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13414h43m49.772781678s" Jun 08 08:21:32.235744 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:32.235725 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4jgz" event={"ID":"f5ba4fab-6782-4e56-8c83-c66b3457650e","Type":"ContainerStarted","Data":"052e72f94ea70d53208fac84d9474324f6957039a8d644d9467fc42f681675ee"} Jun 08 08:21:32.761884 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:32.761797 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e0c87538-422c-4356-8983-84c33320ca33-metrics-certs\") pod \"network-metrics-daemon-zx26n\" (UID: \"e0c87538-422c-4356-8983-84c33320ca33\") " pod="openshift-multus/network-metrics-daemon-zx26n" Jun 08 08:21:32.761884 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:32.761880 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4281d80d-e366-4f22-a397-e17c9be0e9f4-original-pull-secret\") pod \"global-pull-secret-syncer-6gvcs\" (UID: \"4281d80d-e366-4f22-a397-e17c9be0e9f4\") " pod="kube-system/global-pull-secret-syncer-6gvcs" Jun 08 08:21:32.762099 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:32.762004 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 08:21:32.762099 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:32.762059 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4281d80d-e366-4f22-a397-e17c9be0e9f4-original-pull-secret podName:4281d80d-e366-4f22-a397-e17c9be0e9f4 nodeName:}" failed. No retries permitted until 2026-06-08 08:21:34.762041993 +0000 UTC m=+6.016253439 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4281d80d-e366-4f22-a397-e17c9be0e9f4-original-pull-secret") pod "global-pull-secret-syncer-6gvcs" (UID: "4281d80d-e366-4f22-a397-e17c9be0e9f4") : object "kube-system"/"original-pull-secret" not registered Jun 08 08:21:32.762539 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:32.762426 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 08:21:32.762539 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:32.762476 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0c87538-422c-4356-8983-84c33320ca33-metrics-certs podName:e0c87538-422c-4356-8983-84c33320ca33 nodeName:}" failed. No retries permitted until 2026-06-08 08:21:34.762462567 +0000 UTC m=+6.016674010 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e0c87538-422c-4356-8983-84c33320ca33-metrics-certs") pod "network-metrics-daemon-zx26n" (UID: "e0c87538-422c-4356-8983-84c33320ca33") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 08:21:32.964128 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:32.963482 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kq59n\" (UniqueName: \"kubernetes.io/projected/e308208d-115f-41f0-81f3-65e534a90356-kube-api-access-kq59n\") pod \"network-check-target-cchg2\" (UID: \"e308208d-115f-41f0-81f3-65e534a90356\") " pod="openshift-network-diagnostics/network-check-target-cchg2" Jun 08 08:21:32.964128 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:32.963698 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 08:21:32.964128 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:32.963737 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 08:21:32.964128 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:32.963750 2570 projected.go:196] Error preparing data for projected volume kube-api-access-kq59n for pod openshift-network-diagnostics/network-check-target-cchg2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 08:21:32.964128 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:32.963807 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e308208d-115f-41f0-81f3-65e534a90356-kube-api-access-kq59n podName:e308208d-115f-41f0-81f3-65e534a90356 nodeName:}" failed. No retries permitted until 2026-06-08 08:21:34.963787918 +0000 UTC m=+6.217999364 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-kq59n" (UniqueName: "kubernetes.io/projected/e308208d-115f-41f0-81f3-65e534a90356-kube-api-access-kq59n") pod "network-check-target-cchg2" (UID: "e308208d-115f-41f0-81f3-65e534a90356") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 08:21:33.204902 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:33.204831 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zx26n" Jun 08 08:21:33.205052 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:33.205000 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gvcs" Jun 08 08:21:33.205052 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:33.205014 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zx26n" podUID="e0c87538-422c-4356-8983-84c33320ca33" Jun 08 08:21:33.205169 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:33.205115 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gvcs" podUID="4281d80d-e366-4f22-a397-e17c9be0e9f4" Jun 08 08:21:33.205219 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:33.205178 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cchg2" Jun 08 08:21:33.205275 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:33.205245 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cchg2" podUID="e308208d-115f-41f0-81f3-65e534a90356" Jun 08 08:21:33.233687 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:33.233630 2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-07 08:16:31 +0000 UTC" deadline="2028-03-05 17:51:46.204133998 +0000 UTC" Jun 08 08:21:33.233687 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:33.233686 2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15273h30m12.970452954s" Jun 08 08:21:33.298304 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:33.298268 2570 generic.go:356] "Generic (PLEG): container finished" podID="7feb1da85ccfa5f9616fc9385587c410" containerID="a62f23f1a1d0d46fcd79dc42ebebe55c33867cf4502e0099c0d35ebf497a1a26" exitCode=0 Jun 08 08:21:33.299259 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:33.299231 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-101.ec2.internal" event={"ID":"7feb1da85ccfa5f9616fc9385587c410","Type":"ContainerDied","Data":"a62f23f1a1d0d46fcd79dc42ebebe55c33867cf4502e0099c0d35ebf497a1a26"} Jun 08 08:21:33.338081 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:33.337987 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-101.ec2.internal" podStartSLOduration=3.337968271 podStartE2EDuration="3.337968271s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 08:21:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 08:21:32.263920224 +0000 UTC m=+3.518131673" watchObservedRunningTime="2026-06-08 08:21:33.337968271 +0000 UTC m=+4.592179729" Jun 08 08:21:34.353041 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:34.353004 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-101.ec2.internal" event={"ID":"7feb1da85ccfa5f9616fc9385587c410","Type":"ContainerStarted","Data":"ad97ac3163ce9bd7d5e8f5363b6b1e239e17439c7a647f3b59105a5b66b1e905"} Jun 08 08:21:34.779393 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:34.779358 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e0c87538-422c-4356-8983-84c33320ca33-metrics-certs\") pod \"network-metrics-daemon-zx26n\" (UID: \"e0c87538-422c-4356-8983-84c33320ca33\") " pod="openshift-multus/network-metrics-daemon-zx26n" Jun 08 08:21:34.779576 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:34.779433 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4281d80d-e366-4f22-a397-e17c9be0e9f4-original-pull-secret\") pod \"global-pull-secret-syncer-6gvcs\" (UID: \"4281d80d-e366-4f22-a397-e17c9be0e9f4\") " pod="kube-system/global-pull-secret-syncer-6gvcs" Jun 08 08:21:34.779576 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:34.779519 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 08:21:34.779576 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:34.779547 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 08:21:34.779756 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:34.779586 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0c87538-422c-4356-8983-84c33320ca33-metrics-certs podName:e0c87538-422c-4356-8983-84c33320ca33 nodeName:}" failed. No retries permitted until 2026-06-08 08:21:38.779564171 +0000 UTC m=+10.033775619 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e0c87538-422c-4356-8983-84c33320ca33-metrics-certs") pod "network-metrics-daemon-zx26n" (UID: "e0c87538-422c-4356-8983-84c33320ca33") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 08:21:34.779756 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:34.779605 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4281d80d-e366-4f22-a397-e17c9be0e9f4-original-pull-secret podName:4281d80d-e366-4f22-a397-e17c9be0e9f4 nodeName:}" failed. No retries permitted until 2026-06-08 08:21:38.779595587 +0000 UTC m=+10.033807018 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4281d80d-e366-4f22-a397-e17c9be0e9f4-original-pull-secret") pod "global-pull-secret-syncer-6gvcs" (UID: "4281d80d-e366-4f22-a397-e17c9be0e9f4") : object "kube-system"/"original-pull-secret" not registered Jun 08 08:21:34.981070 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:34.980858 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kq59n\" (UniqueName: \"kubernetes.io/projected/e308208d-115f-41f0-81f3-65e534a90356-kube-api-access-kq59n\") pod \"network-check-target-cchg2\" (UID: \"e308208d-115f-41f0-81f3-65e534a90356\") " pod="openshift-network-diagnostics/network-check-target-cchg2" Jun 08 08:21:34.981070 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:34.981013 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 08:21:34.981070 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:34.981033 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 08:21:34.981070 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:34.981045 2570 projected.go:196] Error preparing data for projected volume kube-api-access-kq59n for pod openshift-network-diagnostics/network-check-target-cchg2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 08:21:34.981388 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:34.981101 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e308208d-115f-41f0-81f3-65e534a90356-kube-api-access-kq59n podName:e308208d-115f-41f0-81f3-65e534a90356 nodeName:}" failed. No retries permitted until 2026-06-08 08:21:38.981083116 +0000 UTC m=+10.235294547 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-kq59n" (UniqueName: "kubernetes.io/projected/e308208d-115f-41f0-81f3-65e534a90356-kube-api-access-kq59n") pod "network-check-target-cchg2" (UID: "e308208d-115f-41f0-81f3-65e534a90356") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 08:21:35.204928 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:35.204400 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gvcs" Jun 08 08:21:35.204928 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:35.204529 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gvcs" podUID="4281d80d-e366-4f22-a397-e17c9be0e9f4" Jun 08 08:21:35.204928 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:35.204593 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zx26n" Jun 08 08:21:35.204928 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:35.204746 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zx26n" podUID="e0c87538-422c-4356-8983-84c33320ca33" Jun 08 08:21:35.204928 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:35.204400 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cchg2" Jun 08 08:21:35.204928 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:35.204843 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cchg2" podUID="e308208d-115f-41f0-81f3-65e534a90356" Jun 08 08:21:37.204277 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:37.204235 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cchg2" Jun 08 08:21:37.204277 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:37.204266 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zx26n" Jun 08 08:21:37.204277 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:37.204280 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gvcs" Jun 08 08:21:37.204841 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:37.204381 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cchg2" podUID="e308208d-115f-41f0-81f3-65e534a90356" Jun 08 08:21:37.204841 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:37.204501 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zx26n" podUID="e0c87538-422c-4356-8983-84c33320ca33" Jun 08 08:21:37.204841 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:37.204575 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gvcs" podUID="4281d80d-e366-4f22-a397-e17c9be0e9f4" Jun 08 08:21:38.812222 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:38.812182 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e0c87538-422c-4356-8983-84c33320ca33-metrics-certs\") pod \"network-metrics-daemon-zx26n\" (UID: \"e0c87538-422c-4356-8983-84c33320ca33\") " pod="openshift-multus/network-metrics-daemon-zx26n" Jun 08 08:21:38.812690 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:38.812264 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4281d80d-e366-4f22-a397-e17c9be0e9f4-original-pull-secret\") pod \"global-pull-secret-syncer-6gvcs\" (UID: \"4281d80d-e366-4f22-a397-e17c9be0e9f4\") " pod="kube-system/global-pull-secret-syncer-6gvcs" Jun 08 08:21:38.812690 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:38.812387 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 08:21:38.812690 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:38.812453 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4281d80d-e366-4f22-a397-e17c9be0e9f4-original-pull-secret podName:4281d80d-e366-4f22-a397-e17c9be0e9f4 nodeName:}" failed. No retries permitted until 2026-06-08 08:21:46.812432826 +0000 UTC m=+18.066644257 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4281d80d-e366-4f22-a397-e17c9be0e9f4-original-pull-secret") pod "global-pull-secret-syncer-6gvcs" (UID: "4281d80d-e366-4f22-a397-e17c9be0e9f4") : object "kube-system"/"original-pull-secret" not registered Jun 08 08:21:38.812853 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:38.812840 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 08:21:38.812976 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:38.812930 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0c87538-422c-4356-8983-84c33320ca33-metrics-certs podName:e0c87538-422c-4356-8983-84c33320ca33 nodeName:}" failed. No retries permitted until 2026-06-08 08:21:46.812879395 +0000 UTC m=+18.067090826 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e0c87538-422c-4356-8983-84c33320ca33-metrics-certs") pod "network-metrics-daemon-zx26n" (UID: "e0c87538-422c-4356-8983-84c33320ca33") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 08:21:39.014484 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:39.014370 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kq59n\" (UniqueName: \"kubernetes.io/projected/e308208d-115f-41f0-81f3-65e534a90356-kube-api-access-kq59n\") pod \"network-check-target-cchg2\" (UID: \"e308208d-115f-41f0-81f3-65e534a90356\") " pod="openshift-network-diagnostics/network-check-target-cchg2" Jun 08 08:21:39.014656 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:39.014562 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 08:21:39.014656 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:39.014587 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 08:21:39.014656 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:39.014599 2570 projected.go:196] Error preparing data for projected volume kube-api-access-kq59n for pod openshift-network-diagnostics/network-check-target-cchg2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 08:21:39.014656 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:39.014656 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e308208d-115f-41f0-81f3-65e534a90356-kube-api-access-kq59n podName:e308208d-115f-41f0-81f3-65e534a90356 nodeName:}" failed. No retries permitted until 2026-06-08 08:21:47.014638005 +0000 UTC m=+18.268849436 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-kq59n" (UniqueName: "kubernetes.io/projected/e308208d-115f-41f0-81f3-65e534a90356-kube-api-access-kq59n") pod "network-check-target-cchg2" (UID: "e308208d-115f-41f0-81f3-65e534a90356") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 08:21:39.206136 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:39.204935 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gvcs" Jun 08 08:21:39.206136 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:39.205053 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gvcs" podUID="4281d80d-e366-4f22-a397-e17c9be0e9f4" Jun 08 08:21:39.206136 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:39.205231 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cchg2" Jun 08 08:21:39.206574 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:39.206383 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cchg2" podUID="e308208d-115f-41f0-81f3-65e534a90356" Jun 08 08:21:39.206574 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:39.206463 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zx26n" Jun 08 08:21:39.206574 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:39.206547 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zx26n" podUID="e0c87538-422c-4356-8983-84c33320ca33" Jun 08 08:21:41.204825 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:41.204793 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cchg2" Jun 08 08:21:41.205239 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:41.204793 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gvcs" Jun 08 08:21:41.205239 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:41.204900 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cchg2" podUID="e308208d-115f-41f0-81f3-65e534a90356" Jun 08 08:21:41.205239 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:41.204941 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gvcs" podUID="4281d80d-e366-4f22-a397-e17c9be0e9f4" Jun 08 08:21:41.205239 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:41.204978 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zx26n" Jun 08 08:21:41.205239 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:41.205055 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zx26n" podUID="e0c87538-422c-4356-8983-84c33320ca33" Jun 08 08:21:43.204921 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:43.204882 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gvcs" Jun 08 08:21:43.205348 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:43.204882 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zx26n" Jun 08 08:21:43.205348 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:43.205024 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gvcs" podUID="4281d80d-e366-4f22-a397-e17c9be0e9f4" Jun 08 08:21:43.205348 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:43.204887 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cchg2" Jun 08 08:21:43.205348 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:43.205110 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zx26n" podUID="e0c87538-422c-4356-8983-84c33320ca33" Jun 08 08:21:43.205348 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:43.205146 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cchg2" podUID="e308208d-115f-41f0-81f3-65e534a90356" Jun 08 08:21:45.204898 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:45.204864 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gvcs" Jun 08 08:21:45.204898 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:45.204885 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zx26n" Jun 08 08:21:45.205344 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:45.204876 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cchg2" Jun 08 08:21:45.205344 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:45.204987 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gvcs" podUID="4281d80d-e366-4f22-a397-e17c9be0e9f4" Jun 08 08:21:45.205344 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:45.205118 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zx26n" podUID="e0c87538-422c-4356-8983-84c33320ca33" Jun 08 08:21:45.205344 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:45.205210 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cchg2" podUID="e308208d-115f-41f0-81f3-65e534a90356" Jun 08 08:21:46.878026 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:46.877986 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e0c87538-422c-4356-8983-84c33320ca33-metrics-certs\") pod \"network-metrics-daemon-zx26n\" (UID: \"e0c87538-422c-4356-8983-84c33320ca33\") " pod="openshift-multus/network-metrics-daemon-zx26n" Jun 08 08:21:46.878445 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:46.878057 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4281d80d-e366-4f22-a397-e17c9be0e9f4-original-pull-secret\") pod \"global-pull-secret-syncer-6gvcs\" (UID: \"4281d80d-e366-4f22-a397-e17c9be0e9f4\") " pod="kube-system/global-pull-secret-syncer-6gvcs" Jun 08 08:21:46.878445 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:46.878160 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 08:21:46.878445 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:46.878184 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 08:21:46.878445 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:46.878238 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0c87538-422c-4356-8983-84c33320ca33-metrics-certs podName:e0c87538-422c-4356-8983-84c33320ca33 nodeName:}" failed. No retries permitted until 2026-06-08 08:22:02.878216751 +0000 UTC m=+34.132428184 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e0c87538-422c-4356-8983-84c33320ca33-metrics-certs") pod "network-metrics-daemon-zx26n" (UID: "e0c87538-422c-4356-8983-84c33320ca33") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 08:21:46.878445 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:46.878259 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4281d80d-e366-4f22-a397-e17c9be0e9f4-original-pull-secret podName:4281d80d-e366-4f22-a397-e17c9be0e9f4 nodeName:}" failed. No retries permitted until 2026-06-08 08:22:02.87824892 +0000 UTC m=+34.132460353 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4281d80d-e366-4f22-a397-e17c9be0e9f4-original-pull-secret") pod "global-pull-secret-syncer-6gvcs" (UID: "4281d80d-e366-4f22-a397-e17c9be0e9f4") : object "kube-system"/"original-pull-secret" not registered Jun 08 08:21:47.079661 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:47.079621 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kq59n\" (UniqueName: \"kubernetes.io/projected/e308208d-115f-41f0-81f3-65e534a90356-kube-api-access-kq59n\") pod \"network-check-target-cchg2\" (UID: \"e308208d-115f-41f0-81f3-65e534a90356\") " pod="openshift-network-diagnostics/network-check-target-cchg2" Jun 08 08:21:47.079848 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:47.079809 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 08:21:47.079848 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:47.079837 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 08:21:47.079937 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:47.079850 2570 projected.go:196] Error preparing data for projected volume kube-api-access-kq59n for pod openshift-network-diagnostics/network-check-target-cchg2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 08:21:47.079937 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:47.079909 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e308208d-115f-41f0-81f3-65e534a90356-kube-api-access-kq59n podName:e308208d-115f-41f0-81f3-65e534a90356 nodeName:}" failed. No retries permitted until 2026-06-08 08:22:03.079887701 +0000 UTC m=+34.334099131 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-kq59n" (UniqueName: "kubernetes.io/projected/e308208d-115f-41f0-81f3-65e534a90356-kube-api-access-kq59n") pod "network-check-target-cchg2" (UID: "e308208d-115f-41f0-81f3-65e534a90356") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 08:21:47.205241 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:47.205124 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cchg2" Jun 08 08:21:47.205241 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:47.205133 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zx26n" Jun 08 08:21:47.205450 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:47.205238 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cchg2" podUID="e308208d-115f-41f0-81f3-65e534a90356" Jun 08 08:21:47.205450 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:47.205258 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gvcs" Jun 08 08:21:47.205450 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:47.205368 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zx26n" podUID="e0c87538-422c-4356-8983-84c33320ca33" Jun 08 08:21:47.205565 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:47.205479 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gvcs" podUID="4281d80d-e366-4f22-a397-e17c9be0e9f4" Jun 08 08:21:49.204865 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:49.204837 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zx26n" Jun 08 08:21:49.205276 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:49.204941 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zx26n" podUID="e0c87538-422c-4356-8983-84c33320ca33" Jun 08 08:21:49.205276 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:49.205029 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gvcs" Jun 08 08:21:49.205276 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:49.205134 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gvcs" podUID="4281d80d-e366-4f22-a397-e17c9be0e9f4" Jun 08 08:21:49.205276 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:49.205183 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cchg2" Jun 08 08:21:49.205276 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:49.205246 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cchg2" podUID="e308208d-115f-41f0-81f3-65e534a90356" Jun 08 08:21:51.204581 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:51.204365 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gvcs" Jun 08 08:21:51.205243 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:51.204365 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cchg2" Jun 08 08:21:51.205243 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:51.204677 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gvcs" podUID="4281d80d-e366-4f22-a397-e17c9be0e9f4" Jun 08 08:21:51.205243 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:51.204761 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cchg2" podUID="e308208d-115f-41f0-81f3-65e534a90356" Jun 08 08:21:51.205243 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:51.204453 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zx26n" Jun 08 08:21:51.205243 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:51.204845 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zx26n" podUID="e0c87538-422c-4356-8983-84c33320ca33" Jun 08 08:21:51.387989 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:51.387902 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4jgz" event={"ID":"f5ba4fab-6782-4e56-8c83-c66b3457650e","Type":"ContainerStarted","Data":"9a62a91a6658e096e04fab45be65943581693710e13b0ea54d8e4935133e7d25"} Jun 08 08:21:51.390360 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:51.390335 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-f845l" event={"ID":"28880cc4-90dd-4d3f-8bf7-df18edcdd096","Type":"ContainerStarted","Data":"51ad7003587379dfbd53e4d186adbdfc78949e361fc100cfd94b747ad82b1642"} Jun 08 08:21:51.391989 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:51.391968 2570 generic.go:356] "Generic (PLEG): container finished" podID="202c9657-3a36-43ef-88ad-8fdaaba546c0" containerID="8b463c3e7a4d5631bb16cf4ba05310b3a35951f99a45e6b7e05266baa06516be" exitCode=0 Jun 08 08:21:51.392062 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:51.392009 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7np8s" event={"ID":"202c9657-3a36-43ef-88ad-8fdaaba546c0","Type":"ContainerDied","Data":"8b463c3e7a4d5631bb16cf4ba05310b3a35951f99a45e6b7e05266baa06516be"} Jun 08 08:21:51.393316 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:51.393294 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-hp6pw" event={"ID":"b817d520-ebd3-4bd7-9490-90751bd573aa","Type":"ContainerStarted","Data":"cf3013cf3bfc943ef017160970c1bbf4dd775a5f50dd0d00c5355cab53d31da2"} Jun 08 08:21:51.398510 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:51.398487 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5s57z" event={"ID":"ea083ae5-52f5-4b1a-a730-7690bee17d80","Type":"ContainerStarted","Data":"e39c0464e2cc1ec1b1661d248bd3070dd88682bcd7ef18a1de194920838e3b23"} Jun 08 08:21:51.398607 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:51.398591 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5s57z" event={"ID":"ea083ae5-52f5-4b1a-a730-7690bee17d80","Type":"ContainerStarted","Data":"9007a0c69fee2e1766f9b851573e1d39c531c92d5a8ead81a13a09d9164dd595"} Jun 08 08:21:51.398663 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:51.398650 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5s57z" event={"ID":"ea083ae5-52f5-4b1a-a730-7690bee17d80","Type":"ContainerStarted","Data":"ace3029ec1b5517ded3a5f97173f7326abb817dad958ae1d676408981b4dc5e6"} Jun 08 08:21:51.398726 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:51.398694 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5s57z" event={"ID":"ea083ae5-52f5-4b1a-a730-7690bee17d80","Type":"ContainerStarted","Data":"753052febf27060b8141e26f848d52dcef6b907f795b4460ac706505fa1f3c61"} Jun 08 08:21:51.398783 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:51.398771 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5s57z" event={"ID":"ea083ae5-52f5-4b1a-a730-7690bee17d80","Type":"ContainerStarted","Data":"ad8e0144c29521b932cd1471eb49c061781041fcd84e01996b941d19aba0d9b5"} Jun 08 08:21:51.398824 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:51.398809 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5s57z" event={"ID":"ea083ae5-52f5-4b1a-a730-7690bee17d80","Type":"ContainerStarted","Data":"4b93a7233bd93733bc20eb14d0f09518827124dea55ea6a6fcc3766643131462"} Jun 08 08:21:51.399794 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:51.399769 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7bjsd" event={"ID":"f7aa67e2-0ae6-402d-9cab-b798c21b9390","Type":"ContainerStarted","Data":"28ab2ff2bf0b1fc368135c08b521448c1c160c57dfdeb4c4ea7517af2611966e"} Jun 08 08:21:51.401068 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:51.401049 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jqgqd" event={"ID":"87ee6f5d-c749-452a-9574-287d8a6913cc","Type":"ContainerStarted","Data":"827e9dc1328ea9d3c8a82951139658b9caa4f67e56232b7f41760cae1e16445b"} Jun 08 08:21:51.402315 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:51.402297 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-fjhnr" event={"ID":"f833d2e7-472b-473f-a0c0-42c61a42f524","Type":"ContainerStarted","Data":"e4aa26bcd63391af2660458769065c55703247453598d25deb709168fff32dc8"} Jun 08 08:21:51.409558 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:51.409523 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-f845l" podStartSLOduration=4.017585783 podStartE2EDuration="22.409512397s" totalImagesPullingTime="18.391926614s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 08:21:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 08:21:51.409370034 +0000 UTC m=+22.663581485" watchObservedRunningTime="2026-06-08 08:21:51.409512397 +0000 UTC m=+22.663723847" Jun 08 08:21:51.409876 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:51.409856 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-101.ec2.internal" podStartSLOduration=21.409850716 podStartE2EDuration="21.409850716s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 08:21:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 08:21:34.381140988 +0000 UTC m=+5.635352453" watchObservedRunningTime="2026-06-08 08:21:51.409850716 +0000 UTC m=+22.664062165" Jun 08 08:21:51.425671 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:51.425634 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-hp6pw" podStartSLOduration=4.027691282 podStartE2EDuration="22.425622732s" totalImagesPullingTime="18.39793145s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 08:21:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 08:21:51.425611385 +0000 UTC m=+22.679822825" watchObservedRunningTime="2026-06-08 08:21:51.425622732 +0000 UTC m=+22.679834181" Jun 08 08:21:51.446734 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:51.446687 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-7bjsd" podStartSLOduration=3.9992377770000003 podStartE2EDuration="22.446676838s" totalImagesPullingTime="18.447439061s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 08:21:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 08:21:51.446460607 +0000 UTC m=+22.700672057" watchObservedRunningTime="2026-06-08 08:21:51.446676838 +0000 UTC m=+22.700888287" Jun 08 08:21:51.469824 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:51.469769 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-fjhnr" podStartSLOduration=4.057751747 podStartE2EDuration="22.469752739s" totalImagesPullingTime="18.412000992s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 08:21:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 08:21:51.469434004 +0000 UTC m=+22.723645453" watchObservedRunningTime="2026-06-08 08:21:51.469752739 +0000 UTC m=+22.723964190" Jun 08 08:21:51.508549 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:51.508506 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-jqgqd" podStartSLOduration=4.090181195 podStartE2EDuration="22.508488918s" totalImagesPullingTime="18.418307723s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 08:21:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 08:21:51.507936115 +0000 UTC m=+22.762147597" watchObservedRunningTime="2026-06-08 08:21:51.508488918 +0000 UTC m=+22.762700369" Jun 08 08:21:52.012306 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:52.012104 2570 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 08 08:21:52.202965 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:52.202773 2570 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-08T08:21:52.012305888Z","UUID":"40ae09fe-c9cc-4a95-af74-bdf7ae3d173f","Handler":null,"Name":"","Endpoint":""} Jun 08 08:21:52.204278 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:52.204258 2570 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 08 08:21:52.204416 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:52.204291 2570 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 08 08:21:52.407666 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:52.407628 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4jgz" event={"ID":"f5ba4fab-6782-4e56-8c83-c66b3457650e","Type":"ContainerStarted","Data":"419d2497d8b03d16e0bec0466565ed6f8691ee990ec3ddfb7c3c0469a5bb5b32"} Jun 08 08:21:52.409738 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:52.409684 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-bxq5l" event={"ID":"8fed09c4-f238-4205-b258-0b0486bf019d","Type":"ContainerStarted","Data":"647fee51227838983d14c0a62390826854c8ae3a65e7d1d27634d731f2c13425"} Jun 08 08:21:52.436180 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:52.436132 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-bxq5l" podStartSLOduration=5.039454735 podStartE2EDuration="23.436113012s" totalImagesPullingTime="18.396658277s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 08:21:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 08:21:52.435887654 +0000 UTC m=+23.690099104" watchObservedRunningTime="2026-06-08 08:21:52.436113012 +0000 UTC m=+23.690324463" Jun 08 08:21:53.204280 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:53.204257 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zx26n" Jun 08 08:21:53.204280 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:53.204270 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cchg2" Jun 08 08:21:53.204428 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:53.204270 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gvcs" Jun 08 08:21:53.204428 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:53.204354 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zx26n" podUID="e0c87538-422c-4356-8983-84c33320ca33" Jun 08 08:21:53.204506 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:53.204454 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cchg2" podUID="e308208d-115f-41f0-81f3-65e534a90356" Jun 08 08:21:53.204558 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:53.204541 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gvcs" podUID="4281d80d-e366-4f22-a397-e17c9be0e9f4" Jun 08 08:21:53.414977 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:53.414939 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4jgz" event={"ID":"f5ba4fab-6782-4e56-8c83-c66b3457650e","Type":"ContainerStarted","Data":"b3bab5121e62e2407f4e9cab60393a28553f4c1bda73895cc5ca27bef2834486"} Jun 08 08:21:53.419262 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:53.419238 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5s57z" event={"ID":"ea083ae5-52f5-4b1a-a730-7690bee17d80","Type":"ContainerStarted","Data":"9631fc001daa524643968f0ac4d663e0e6345cfc5436278971abbbcfe810bffe"} Jun 08 08:21:53.439653 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:53.439606 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4jgz" podStartSLOduration=3.862011501 podStartE2EDuration="24.439590309s" totalImagesPullingTime="20.577578808s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 08:21:29 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 08:21:53.438894504 +0000 UTC m=+24.693105957" watchObservedRunningTime="2026-06-08 08:21:53.439590309 +0000 UTC m=+24.693801758" Jun 08 08:21:55.204310 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:55.204272 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gvcs" Jun 08 08:21:55.204960 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:55.204273 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zx26n" Jun 08 08:21:55.204960 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:55.204408 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gvcs" podUID="4281d80d-e366-4f22-a397-e17c9be0e9f4" Jun 08 08:21:55.204960 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:55.204421 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cchg2" Jun 08 08:21:55.204960 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:55.204501 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zx26n" podUID="e0c87538-422c-4356-8983-84c33320ca33" Jun 08 08:21:55.204960 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:55.204573 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cchg2" podUID="e308208d-115f-41f0-81f3-65e534a90356" Jun 08 08:21:55.929322 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:55.929289 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-jqgqd" Jun 08 08:21:55.929888 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:55.929871 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-jqgqd" Jun 08 08:21:56.428324 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:56.428145 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5s57z" event={"ID":"ea083ae5-52f5-4b1a-a730-7690bee17d80","Type":"ContainerStarted","Data":"2d82e9cdfa2abd5a0f8e4486aaab710ef99b4d29ef83013d1541c728b4832838"} Jun 08 08:21:56.428728 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:56.428423 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-jqgqd" Jun 08 08:21:56.431943 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:56.430068 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-jqgqd" Jun 08 08:21:56.466237 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:56.466143 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-5s57z" podStartSLOduration=8.993698524 podStartE2EDuration="27.466130509s" totalImagesPullingTime="18.472431985s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 08:21:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 08:21:56.465696385 +0000 UTC m=+27.719907861" watchObservedRunningTime="2026-06-08 08:21:56.466130509 +0000 UTC m=+27.720341959" Jun 08 08:21:57.204444 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:57.204412 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gvcs" Jun 08 08:21:57.204672 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:57.204412 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zx26n" Jun 08 08:21:57.204672 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:57.204512 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gvcs" podUID="4281d80d-e366-4f22-a397-e17c9be0e9f4" Jun 08 08:21:57.204672 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:57.204422 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cchg2" Jun 08 08:21:57.204672 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:57.204585 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zx26n" podUID="e0c87538-422c-4356-8983-84c33320ca33" Jun 08 08:21:57.204672 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:57.204645 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cchg2" podUID="e308208d-115f-41f0-81f3-65e534a90356" Jun 08 08:21:57.431547 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:57.431518 2570 generic.go:356] "Generic (PLEG): container finished" podID="202c9657-3a36-43ef-88ad-8fdaaba546c0" containerID="f029a9f7341019e5a9e8ed473a491b3a5afdbc721b5a28d7aa2ae79d676a156a" exitCode=0 Jun 08 08:21:57.432042 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:57.431581 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7np8s" event={"ID":"202c9657-3a36-43ef-88ad-8fdaaba546c0","Type":"ContainerDied","Data":"f029a9f7341019e5a9e8ed473a491b3a5afdbc721b5a28d7aa2ae79d676a156a"} Jun 08 08:21:57.432042 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:57.432023 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5s57z" Jun 08 08:21:57.432155 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:57.432085 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5s57z" Jun 08 08:21:57.432155 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:57.432133 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5s57z" Jun 08 08:21:57.449317 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:57.449287 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5s57z" Jun 08 08:21:57.449435 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:57.449426 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5s57z" Jun 08 08:21:58.524970 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:58.524822 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-cchg2"] Jun 08 08:21:58.525286 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:58.525078 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cchg2" Jun 08 08:21:58.525286 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:58.525162 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cchg2" podUID="e308208d-115f-41f0-81f3-65e534a90356" Jun 08 08:21:58.528927 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:58.528895 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6gvcs"] Jun 08 08:21:58.529030 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:58.529000 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gvcs" Jun 08 08:21:58.529091 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:58.529078 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gvcs" podUID="4281d80d-e366-4f22-a397-e17c9be0e9f4" Jun 08 08:21:58.529471 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:58.529454 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zx26n"] Jun 08 08:21:58.529554 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:58.529540 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zx26n" Jun 08 08:21:58.529652 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:21:58.529631 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zx26n" podUID="e0c87538-422c-4356-8983-84c33320ca33" Jun 08 08:21:59.437605 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:59.437580 2570 generic.go:356] "Generic (PLEG): container finished" podID="202c9657-3a36-43ef-88ad-8fdaaba546c0" containerID="abfd15af0eb4d2f5e7f4955ae097b601da3a89349e48bf1574c01c5e8830b1ec" exitCode=0 Jun 08 08:21:59.437735 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:21:59.437670 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7np8s" event={"ID":"202c9657-3a36-43ef-88ad-8fdaaba546c0","Type":"ContainerDied","Data":"abfd15af0eb4d2f5e7f4955ae097b601da3a89349e48bf1574c01c5e8830b1ec"} Jun 08 08:22:00.205014 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:00.204984 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zx26n" Jun 08 08:22:00.205559 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:00.204988 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gvcs" Jun 08 08:22:00.205559 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:22:00.205078 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zx26n" podUID="e0c87538-422c-4356-8983-84c33320ca33" Jun 08 08:22:00.205559 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:22:00.205176 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gvcs" podUID="4281d80d-e366-4f22-a397-e17c9be0e9f4" Jun 08 08:22:00.205559 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:00.204990 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cchg2" Jun 08 08:22:00.205559 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:22:00.205274 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cchg2" podUID="e308208d-115f-41f0-81f3-65e534a90356" Jun 08 08:22:01.445005 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:01.444970 2570 generic.go:356] "Generic (PLEG): container finished" podID="202c9657-3a36-43ef-88ad-8fdaaba546c0" containerID="12bd407c33e463fba04bbf5d06c62129e64a379e597d5e0b00aa22b9160d023b" exitCode=0 Jun 08 08:22:01.445544 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:01.445028 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7np8s" event={"ID":"202c9657-3a36-43ef-88ad-8fdaaba546c0","Type":"ContainerDied","Data":"12bd407c33e463fba04bbf5d06c62129e64a379e597d5e0b00aa22b9160d023b"} Jun 08 08:22:02.204892 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:02.204807 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cchg2" Jun 08 08:22:02.204892 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:02.204817 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zx26n" Jun 08 08:22:02.205072 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:22:02.204916 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cchg2" podUID="e308208d-115f-41f0-81f3-65e534a90356" Jun 08 08:22:02.205072 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:22:02.204976 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zx26n" podUID="e0c87538-422c-4356-8983-84c33320ca33" Jun 08 08:22:02.205072 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:02.205026 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gvcs" Jun 08 08:22:02.205197 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:22:02.205101 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gvcs" podUID="4281d80d-e366-4f22-a397-e17c9be0e9f4" Jun 08 08:22:02.906246 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:02.906210 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4281d80d-e366-4f22-a397-e17c9be0e9f4-original-pull-secret\") pod \"global-pull-secret-syncer-6gvcs\" (UID: \"4281d80d-e366-4f22-a397-e17c9be0e9f4\") " pod="kube-system/global-pull-secret-syncer-6gvcs" Jun 08 08:22:02.906646 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:02.906291 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e0c87538-422c-4356-8983-84c33320ca33-metrics-certs\") pod \"network-metrics-daemon-zx26n\" (UID: \"e0c87538-422c-4356-8983-84c33320ca33\") " pod="openshift-multus/network-metrics-daemon-zx26n" Jun 08 08:22:02.906646 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:22:02.906369 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 08:22:02.906646 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:22:02.906398 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 08:22:02.906646 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:22:02.906445 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4281d80d-e366-4f22-a397-e17c9be0e9f4-original-pull-secret podName:4281d80d-e366-4f22-a397-e17c9be0e9f4 nodeName:}" failed. No retries permitted until 2026-06-08 08:22:34.906424071 +0000 UTC m=+66.160635513 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4281d80d-e366-4f22-a397-e17c9be0e9f4-original-pull-secret") pod "global-pull-secret-syncer-6gvcs" (UID: "4281d80d-e366-4f22-a397-e17c9be0e9f4") : object "kube-system"/"original-pull-secret" not registered Jun 08 08:22:02.906646 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:22:02.906464 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0c87538-422c-4356-8983-84c33320ca33-metrics-certs podName:e0c87538-422c-4356-8983-84c33320ca33 nodeName:}" failed. No retries permitted until 2026-06-08 08:22:34.906453407 +0000 UTC m=+66.160664843 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e0c87538-422c-4356-8983-84c33320ca33-metrics-certs") pod "network-metrics-daemon-zx26n" (UID: "e0c87538-422c-4356-8983-84c33320ca33") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 08:22:03.107442 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:03.107408 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kq59n\" (UniqueName: \"kubernetes.io/projected/e308208d-115f-41f0-81f3-65e534a90356-kube-api-access-kq59n\") pod \"network-check-target-cchg2\" (UID: \"e308208d-115f-41f0-81f3-65e534a90356\") " pod="openshift-network-diagnostics/network-check-target-cchg2" Jun 08 08:22:03.107599 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:22:03.107542 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 08:22:03.107599 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:22:03.107556 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 08:22:03.107599 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:22:03.107564 2570 projected.go:196] Error preparing data for projected volume kube-api-access-kq59n for pod openshift-network-diagnostics/network-check-target-cchg2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 08:22:03.107695 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:22:03.107607 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e308208d-115f-41f0-81f3-65e534a90356-kube-api-access-kq59n podName:e308208d-115f-41f0-81f3-65e534a90356 nodeName:}" failed. No retries permitted until 2026-06-08 08:22:35.107595117 +0000 UTC m=+66.361806546 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-kq59n" (UniqueName: "kubernetes.io/projected/e308208d-115f-41f0-81f3-65e534a90356-kube-api-access-kq59n") pod "network-check-target-cchg2" (UID: "e308208d-115f-41f0-81f3-65e534a90356") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 08:22:04.035032 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:04.034732 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-101.ec2.internal" event="NodeReady" Jun 08 08:22:04.035424 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:04.035046 2570 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 08 08:22:04.068706 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:04.068678 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6bf85bcd7b-6fpjd"] Jun 08 08:22:04.070545 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:04.070518 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bf85bcd7b-6fpjd" Jun 08 08:22:04.073368 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:04.073344 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 08 08:22:04.073490 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:04.073433 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 08 08:22:04.073556 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:04.073492 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 08 08:22:04.073829 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:04.073658 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-kqnwh\"" Jun 08 08:22:04.080242 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:04.080074 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 08 08:22:04.083665 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:04.083646 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-pmppv"] Jun 08 08:22:04.085303 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:04.085286 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-pmppv" Jun 08 08:22:04.087179 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:04.087161 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6bf85bcd7b-6fpjd"] Jun 08 08:22:04.088620 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:04.088600 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 08 08:22:04.088704 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:04.088687 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 08 08:22:04.088889 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:04.088874 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 08 08:22:04.089162 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:04.089141 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-mbqnc\"" Jun 08 08:22:04.090686 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:04.090668 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-jtcbc"] Jun 08 08:22:04.093645 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:04.093625 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jtcbc" Jun 08 08:22:04.096909 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:04.096499 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 08 08:22:04.096909 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:04.096600 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xs7cn\"" Jun 08 08:22:04.096909 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:04.096646 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-pmppv"] Jun 08 08:22:04.096909 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:04.096752 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 08 08:22:04.107576 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:04.107558 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-jtcbc"] Jun 08 08:22:04.204671 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:04.204641 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cchg2" Jun 08 08:22:04.204850 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:04.204696 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gvcs" Jun 08 08:22:04.204850 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:04.204761 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zx26n" Jun 08 08:22:04.207886 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:04.207854 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 08 08:22:04.208028 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:04.207950 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 08 08:22:04.208028 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:04.207960 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8bqxt\"" Jun 08 08:22:04.208028 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:04.207971 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 08 08:22:04.208188 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:04.208071 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-tl5qj\"" Jun 08 08:22:04.208188 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:04.208092 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 08 08:22:04.214626 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:04.214603 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/92b7d091-5608-4e0c-a616-714cf3dcab1f-installation-pull-secrets\") pod \"image-registry-6bf85bcd7b-6fpjd\" (UID: \"92b7d091-5608-4e0c-a616-714cf3dcab1f\") " pod="openshift-image-registry/image-registry-6bf85bcd7b-6fpjd" Jun 08 08:22:04.214752 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:04.214642 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5dedcff5-b47c-4bd8-8684-25930d49cb60-config-volume\") pod \"dns-default-jtcbc\" (UID: \"5dedcff5-b47c-4bd8-8684-25930d49cb60\") " pod="openshift-dns/dns-default-jtcbc" Jun 08 08:22:04.214752 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:04.214666 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5dedcff5-b47c-4bd8-8684-25930d49cb60-tmp-dir\") pod \"dns-default-jtcbc\" (UID: \"5dedcff5-b47c-4bd8-8684-25930d49cb60\") " pod="openshift-dns/dns-default-jtcbc" Jun 08 08:22:04.214752 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:04.214692 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/92b7d091-5608-4e0c-a616-714cf3dcab1f-bound-sa-token\") pod \"image-registry-6bf85bcd7b-6fpjd\" (UID: \"92b7d091-5608-4e0c-a616-714cf3dcab1f\") " pod="openshift-image-registry/image-registry-6bf85bcd7b-6fpjd" Jun 08 08:22:04.215109 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:04.214788 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/92b7d091-5608-4e0c-a616-714cf3dcab1f-registry-tls\") pod \"image-registry-6bf85bcd7b-6fpjd\" (UID: \"92b7d091-5608-4e0c-a616-714cf3dcab1f\") " pod="openshift-image-registry/image-registry-6bf85bcd7b-6fpjd" Jun 08 08:22:04.215109 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:04.214821 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/92b7d091-5608-4e0c-a616-714cf3dcab1f-ca-trust-extracted\") pod \"image-registry-6bf85bcd7b-6fpjd\" (UID: \"92b7d091-5608-4e0c-a616-714cf3dcab1f\") " pod="openshift-image-registry/image-registry-6bf85bcd7b-6fpjd" Jun 08 08:22:04.215109 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:04.214853 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/92b7d091-5608-4e0c-a616-714cf3dcab1f-registry-certificates\") pod \"image-registry-6bf85bcd7b-6fpjd\" (UID: \"92b7d091-5608-4e0c-a616-714cf3dcab1f\") " pod="openshift-image-registry/image-registry-6bf85bcd7b-6fpjd" Jun 08 08:22:04.215109 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:04.214894 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5dedcff5-b47c-4bd8-8684-25930d49cb60-metrics-tls\") pod \"dns-default-jtcbc\" (UID: \"5dedcff5-b47c-4bd8-8684-25930d49cb60\") " pod="openshift-dns/dns-default-jtcbc" Jun 08 08:22:04.215109 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:04.214920 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/92b7d091-5608-4e0c-a616-714cf3dcab1f-image-registry-private-configuration\") pod \"image-registry-6bf85bcd7b-6fpjd\" (UID: \"92b7d091-5608-4e0c-a616-714cf3dcab1f\") " pod="openshift-image-registry/image-registry-6bf85bcd7b-6fpjd" Jun 08 08:22:04.215109 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:04.214944 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/92b7d091-5608-4e0c-a616-714cf3dcab1f-trusted-ca\") pod \"image-registry-6bf85bcd7b-6fpjd\" (UID: \"92b7d091-5608-4e0c-a616-714cf3dcab1f\") " pod="openshift-image-registry/image-registry-6bf85bcd7b-6fpjd" Jun 08 08:22:04.215109 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:04.214968 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfdhx\" (UniqueName: \"kubernetes.io/projected/5dedcff5-b47c-4bd8-8684-25930d49cb60-kube-api-access-rfdhx\") pod \"dns-default-jtcbc\" (UID: \"5dedcff5-b47c-4bd8-8684-25930d49cb60\") " pod="openshift-dns/dns-default-jtcbc" Jun 08 08:22:04.215109 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:04.214990 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ad089e2e-24e2-432f-93d7-f24ac4c5bc99-cert\") pod \"ingress-canary-pmppv\" (UID: \"ad089e2e-24e2-432f-93d7-f24ac4c5bc99\") " pod="openshift-ingress-canary/ingress-canary-pmppv" Jun 08 08:22:04.215109 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:04.215025 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-998sp\" (UniqueName: \"kubernetes.io/projected/ad089e2e-24e2-432f-93d7-f24ac4c5bc99-kube-api-access-998sp\") pod \"ingress-canary-pmppv\" (UID: \"ad089e2e-24e2-432f-93d7-f24ac4c5bc99\") " pod="openshift-ingress-canary/ingress-canary-pmppv" Jun 08 08:22:04.215109 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:04.215063 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lw2f6\" (UniqueName: \"kubernetes.io/projected/92b7d091-5608-4e0c-a616-714cf3dcab1f-kube-api-access-lw2f6\") pod \"image-registry-6bf85bcd7b-6fpjd\" (UID: \"92b7d091-5608-4e0c-a616-714cf3dcab1f\") " pod="openshift-image-registry/image-registry-6bf85bcd7b-6fpjd" Jun 08 08:22:04.315780 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:04.315747 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/92b7d091-5608-4e0c-a616-714cf3dcab1f-installation-pull-secrets\") pod \"image-registry-6bf85bcd7b-6fpjd\" (UID: \"92b7d091-5608-4e0c-a616-714cf3dcab1f\") " pod="openshift-image-registry/image-registry-6bf85bcd7b-6fpjd" Jun 08 08:22:04.315905 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:04.315873 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5dedcff5-b47c-4bd8-8684-25930d49cb60-config-volume\") pod \"dns-default-jtcbc\" (UID: \"5dedcff5-b47c-4bd8-8684-25930d49cb60\") " pod="openshift-dns/dns-default-jtcbc" Jun 08 08:22:04.315988 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:04.315924 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5dedcff5-b47c-4bd8-8684-25930d49cb60-tmp-dir\") pod \"dns-default-jtcbc\" (UID: \"5dedcff5-b47c-4bd8-8684-25930d49cb60\") " pod="openshift-dns/dns-default-jtcbc" Jun 08 08:22:04.316050 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:04.316012 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/92b7d091-5608-4e0c-a616-714cf3dcab1f-bound-sa-token\") pod \"image-registry-6bf85bcd7b-6fpjd\" (UID: \"92b7d091-5608-4e0c-a616-714cf3dcab1f\") " pod="openshift-image-registry/image-registry-6bf85bcd7b-6fpjd" Jun 08 08:22:04.316105 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:04.316063 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/92b7d091-5608-4e0c-a616-714cf3dcab1f-registry-tls\") pod \"image-registry-6bf85bcd7b-6fpjd\" (UID: \"92b7d091-5608-4e0c-a616-714cf3dcab1f\") " pod="openshift-image-registry/image-registry-6bf85bcd7b-6fpjd" Jun 08 08:22:04.316105 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:04.316088 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/92b7d091-5608-4e0c-a616-714cf3dcab1f-ca-trust-extracted\") pod \"image-registry-6bf85bcd7b-6fpjd\" (UID: \"92b7d091-5608-4e0c-a616-714cf3dcab1f\") " pod="openshift-image-registry/image-registry-6bf85bcd7b-6fpjd" Jun 08 08:22:04.316195 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:04.316109 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/92b7d091-5608-4e0c-a616-714cf3dcab1f-registry-certificates\") pod \"image-registry-6bf85bcd7b-6fpjd\" (UID: \"92b7d091-5608-4e0c-a616-714cf3dcab1f\") " pod="openshift-image-registry/image-registry-6bf85bcd7b-6fpjd" Jun 08 08:22:04.316195 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:04.316142 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5dedcff5-b47c-4bd8-8684-25930d49cb60-metrics-tls\") pod \"dns-default-jtcbc\" (UID: \"5dedcff5-b47c-4bd8-8684-25930d49cb60\") " pod="openshift-dns/dns-default-jtcbc" Jun 08 08:22:04.316195 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:04.316182 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/92b7d091-5608-4e0c-a616-714cf3dcab1f-image-registry-private-configuration\") pod \"image-registry-6bf85bcd7b-6fpjd\" (UID: \"92b7d091-5608-4e0c-a616-714cf3dcab1f\") " pod="openshift-image-registry/image-registry-6bf85bcd7b-6fpjd" Jun 08 08:22:04.316341 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:04.316203 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/92b7d091-5608-4e0c-a616-714cf3dcab1f-trusted-ca\") pod \"image-registry-6bf85bcd7b-6fpjd\" (UID: \"92b7d091-5608-4e0c-a616-714cf3dcab1f\") " pod="openshift-image-registry/image-registry-6bf85bcd7b-6fpjd" Jun 08 08:22:04.316341 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:04.316206 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5dedcff5-b47c-4bd8-8684-25930d49cb60-tmp-dir\") pod \"dns-default-jtcbc\" (UID: \"5dedcff5-b47c-4bd8-8684-25930d49cb60\") " pod="openshift-dns/dns-default-jtcbc" Jun 08 08:22:04.316341 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:04.316225 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfdhx\" (UniqueName: \"kubernetes.io/projected/5dedcff5-b47c-4bd8-8684-25930d49cb60-kube-api-access-rfdhx\") pod \"dns-default-jtcbc\" (UID: \"5dedcff5-b47c-4bd8-8684-25930d49cb60\") " pod="openshift-dns/dns-default-jtcbc" Jun 08 08:22:04.316341 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:04.316248 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ad089e2e-24e2-432f-93d7-f24ac4c5bc99-cert\") pod \"ingress-canary-pmppv\" (UID: \"ad089e2e-24e2-432f-93d7-f24ac4c5bc99\") " pod="openshift-ingress-canary/ingress-canary-pmppv" Jun 08 08:22:04.316341 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:04.316278 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-998sp\" (UniqueName: \"kubernetes.io/projected/ad089e2e-24e2-432f-93d7-f24ac4c5bc99-kube-api-access-998sp\") pod \"ingress-canary-pmppv\" (UID: \"ad089e2e-24e2-432f-93d7-f24ac4c5bc99\") " pod="openshift-ingress-canary/ingress-canary-pmppv" Jun 08 08:22:04.316341 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:22:04.316298 2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 08:22:04.316341 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:22:04.316313 2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bf85bcd7b-6fpjd: secret "image-registry-tls" not found Jun 08 08:22:04.316341 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:04.316326 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lw2f6\" (UniqueName: \"kubernetes.io/projected/92b7d091-5608-4e0c-a616-714cf3dcab1f-kube-api-access-lw2f6\") pod \"image-registry-6bf85bcd7b-6fpjd\" (UID: \"92b7d091-5608-4e0c-a616-714cf3dcab1f\") " pod="openshift-image-registry/image-registry-6bf85bcd7b-6fpjd" Jun 08 08:22:04.316737 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:22:04.316371 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/92b7d091-5608-4e0c-a616-714cf3dcab1f-registry-tls podName:92b7d091-5608-4e0c-a616-714cf3dcab1f nodeName:}" failed. No retries permitted until 2026-06-08 08:22:04.816354184 +0000 UTC m=+36.070565612 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/92b7d091-5608-4e0c-a616-714cf3dcab1f-registry-tls") pod "image-registry-6bf85bcd7b-6fpjd" (UID: "92b7d091-5608-4e0c-a616-714cf3dcab1f") : secret "image-registry-tls" not found Jun 08 08:22:04.316737 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:04.316503 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/92b7d091-5608-4e0c-a616-714cf3dcab1f-ca-trust-extracted\") pod \"image-registry-6bf85bcd7b-6fpjd\" (UID: \"92b7d091-5608-4e0c-a616-714cf3dcab1f\") " pod="openshift-image-registry/image-registry-6bf85bcd7b-6fpjd" Jun 08 08:22:04.316737 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:04.316518 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5dedcff5-b47c-4bd8-8684-25930d49cb60-config-volume\") pod \"dns-default-jtcbc\" (UID: \"5dedcff5-b47c-4bd8-8684-25930d49cb60\") " pod="openshift-dns/dns-default-jtcbc" Jun 08 08:22:04.316737 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:22:04.316608 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 08:22:04.316737 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:22:04.316655 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5dedcff5-b47c-4bd8-8684-25930d49cb60-metrics-tls podName:5dedcff5-b47c-4bd8-8684-25930d49cb60 nodeName:}" failed. No retries permitted until 2026-06-08 08:22:04.816636924 +0000 UTC m=+36.070848355 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5dedcff5-b47c-4bd8-8684-25930d49cb60-metrics-tls") pod "dns-default-jtcbc" (UID: "5dedcff5-b47c-4bd8-8684-25930d49cb60") : secret "dns-default-metrics-tls" not found Jun 08 08:22:04.316974 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:04.316862 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/92b7d091-5608-4e0c-a616-714cf3dcab1f-registry-certificates\") pod \"image-registry-6bf85bcd7b-6fpjd\" (UID: \"92b7d091-5608-4e0c-a616-714cf3dcab1f\") " pod="openshift-image-registry/image-registry-6bf85bcd7b-6fpjd" Jun 08 08:22:04.317469 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:04.317451 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/92b7d091-5608-4e0c-a616-714cf3dcab1f-trusted-ca\") pod \"image-registry-6bf85bcd7b-6fpjd\" (UID: \"92b7d091-5608-4e0c-a616-714cf3dcab1f\") " pod="openshift-image-registry/image-registry-6bf85bcd7b-6fpjd" Jun 08 08:22:04.320679 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:04.320656 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/92b7d091-5608-4e0c-a616-714cf3dcab1f-image-registry-private-configuration\") pod \"image-registry-6bf85bcd7b-6fpjd\" (UID: \"92b7d091-5608-4e0c-a616-714cf3dcab1f\") " pod="openshift-image-registry/image-registry-6bf85bcd7b-6fpjd" Jun 08 08:22:04.320802 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:04.320751 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/92b7d091-5608-4e0c-a616-714cf3dcab1f-installation-pull-secrets\") pod \"image-registry-6bf85bcd7b-6fpjd\" (UID: \"92b7d091-5608-4e0c-a616-714cf3dcab1f\") " pod="openshift-image-registry/image-registry-6bf85bcd7b-6fpjd" Jun 08 08:22:04.320802 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:04.320776 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ad089e2e-24e2-432f-93d7-f24ac4c5bc99-cert\") pod \"ingress-canary-pmppv\" (UID: \"ad089e2e-24e2-432f-93d7-f24ac4c5bc99\") " pod="openshift-ingress-canary/ingress-canary-pmppv" Jun 08 08:22:04.328840 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:04.328820 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-998sp\" (UniqueName: \"kubernetes.io/projected/ad089e2e-24e2-432f-93d7-f24ac4c5bc99-kube-api-access-998sp\") pod \"ingress-canary-pmppv\" (UID: \"ad089e2e-24e2-432f-93d7-f24ac4c5bc99\") " pod="openshift-ingress-canary/ingress-canary-pmppv" Jun 08 08:22:04.329094 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:04.329074 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/92b7d091-5608-4e0c-a616-714cf3dcab1f-bound-sa-token\") pod \"image-registry-6bf85bcd7b-6fpjd\" (UID: \"92b7d091-5608-4e0c-a616-714cf3dcab1f\") " pod="openshift-image-registry/image-registry-6bf85bcd7b-6fpjd" Jun 08 08:22:04.329329 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:04.329309 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lw2f6\" (UniqueName: \"kubernetes.io/projected/92b7d091-5608-4e0c-a616-714cf3dcab1f-kube-api-access-lw2f6\") pod \"image-registry-6bf85bcd7b-6fpjd\" (UID: \"92b7d091-5608-4e0c-a616-714cf3dcab1f\") " pod="openshift-image-registry/image-registry-6bf85bcd7b-6fpjd" Jun 08 08:22:04.329498 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:04.329480 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfdhx\" (UniqueName: \"kubernetes.io/projected/5dedcff5-b47c-4bd8-8684-25930d49cb60-kube-api-access-rfdhx\") pod \"dns-default-jtcbc\" (UID: \"5dedcff5-b47c-4bd8-8684-25930d49cb60\") " pod="openshift-dns/dns-default-jtcbc" Jun 08 08:22:04.395410 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:04.395387 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-pmppv" Jun 08 08:22:04.557362 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:04.557332 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-pmppv"] Jun 08 08:22:04.560765 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:22:04.560735 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad089e2e_24e2_432f_93d7_f24ac4c5bc99.slice/crio-200aa1dab86dd3660772b2460e43ba7f217761756fe484e949d07de5a34c3fa9 WatchSource:0}: Error finding container 200aa1dab86dd3660772b2460e43ba7f217761756fe484e949d07de5a34c3fa9: Status 404 returned error can't find the container with id 200aa1dab86dd3660772b2460e43ba7f217761756fe484e949d07de5a34c3fa9 Jun 08 08:22:04.819766 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:04.819729 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5dedcff5-b47c-4bd8-8684-25930d49cb60-metrics-tls\") pod \"dns-default-jtcbc\" (UID: \"5dedcff5-b47c-4bd8-8684-25930d49cb60\") " pod="openshift-dns/dns-default-jtcbc" Jun 08 08:22:04.819920 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:04.819817 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/92b7d091-5608-4e0c-a616-714cf3dcab1f-registry-tls\") pod \"image-registry-6bf85bcd7b-6fpjd\" (UID: \"92b7d091-5608-4e0c-a616-714cf3dcab1f\") " pod="openshift-image-registry/image-registry-6bf85bcd7b-6fpjd" Jun 08 08:22:04.819920 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:22:04.819825 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 08:22:04.819920 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:22:04.819882 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5dedcff5-b47c-4bd8-8684-25930d49cb60-metrics-tls podName:5dedcff5-b47c-4bd8-8684-25930d49cb60 nodeName:}" failed. No retries permitted until 2026-06-08 08:22:05.819867465 +0000 UTC m=+37.074078893 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5dedcff5-b47c-4bd8-8684-25930d49cb60-metrics-tls") pod "dns-default-jtcbc" (UID: "5dedcff5-b47c-4bd8-8684-25930d49cb60") : secret "dns-default-metrics-tls" not found Jun 08 08:22:04.819920 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:22:04.819902 2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 08:22:04.819920 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:22:04.819912 2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bf85bcd7b-6fpjd: secret "image-registry-tls" not found Jun 08 08:22:04.820081 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:22:04.819954 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/92b7d091-5608-4e0c-a616-714cf3dcab1f-registry-tls podName:92b7d091-5608-4e0c-a616-714cf3dcab1f nodeName:}" failed. No retries permitted until 2026-06-08 08:22:05.819938969 +0000 UTC m=+37.074150410 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/92b7d091-5608-4e0c-a616-714cf3dcab1f-registry-tls") pod "image-registry-6bf85bcd7b-6fpjd" (UID: "92b7d091-5608-4e0c-a616-714cf3dcab1f") : secret "image-registry-tls" not found Jun 08 08:22:05.455816 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:05.455778 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-pmppv" event={"ID":"ad089e2e-24e2-432f-93d7-f24ac4c5bc99","Type":"ContainerStarted","Data":"200aa1dab86dd3660772b2460e43ba7f217761756fe484e949d07de5a34c3fa9"} Jun 08 08:22:05.827136 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:05.827103 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/92b7d091-5608-4e0c-a616-714cf3dcab1f-registry-tls\") pod \"image-registry-6bf85bcd7b-6fpjd\" (UID: \"92b7d091-5608-4e0c-a616-714cf3dcab1f\") " pod="openshift-image-registry/image-registry-6bf85bcd7b-6fpjd" Jun 08 08:22:05.827325 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:05.827166 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5dedcff5-b47c-4bd8-8684-25930d49cb60-metrics-tls\") pod \"dns-default-jtcbc\" (UID: \"5dedcff5-b47c-4bd8-8684-25930d49cb60\") " pod="openshift-dns/dns-default-jtcbc" Jun 08 08:22:05.827325 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:22:05.827279 2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 08:22:05.827325 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:22:05.827301 2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bf85bcd7b-6fpjd: secret "image-registry-tls" not found Jun 08 08:22:05.827547 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:22:05.827364 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/92b7d091-5608-4e0c-a616-714cf3dcab1f-registry-tls podName:92b7d091-5608-4e0c-a616-714cf3dcab1f nodeName:}" failed. No retries permitted until 2026-06-08 08:22:07.827344432 +0000 UTC m=+39.081555881 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/92b7d091-5608-4e0c-a616-714cf3dcab1f-registry-tls") pod "image-registry-6bf85bcd7b-6fpjd" (UID: "92b7d091-5608-4e0c-a616-714cf3dcab1f") : secret "image-registry-tls" not found Jun 08 08:22:05.827547 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:22:05.827302 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 08:22:05.827547 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:22:05.827427 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5dedcff5-b47c-4bd8-8684-25930d49cb60-metrics-tls podName:5dedcff5-b47c-4bd8-8684-25930d49cb60 nodeName:}" failed. No retries permitted until 2026-06-08 08:22:07.82741349 +0000 UTC m=+39.081624918 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5dedcff5-b47c-4bd8-8684-25930d49cb60-metrics-tls") pod "dns-default-jtcbc" (UID: "5dedcff5-b47c-4bd8-8684-25930d49cb60") : secret "dns-default-metrics-tls" not found Jun 08 08:22:07.462544 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:07.462328 2570 generic.go:356] "Generic (PLEG): container finished" podID="202c9657-3a36-43ef-88ad-8fdaaba546c0" containerID="1c89f2778f4926cd1f3120e1b8e237952e3b2c2f0a81768914ced0160b1818c3" exitCode=0 Jun 08 08:22:07.462958 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:07.462399 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7np8s" event={"ID":"202c9657-3a36-43ef-88ad-8fdaaba546c0","Type":"ContainerDied","Data":"1c89f2778f4926cd1f3120e1b8e237952e3b2c2f0a81768914ced0160b1818c3"} Jun 08 08:22:07.842953 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:07.842923 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5dedcff5-b47c-4bd8-8684-25930d49cb60-metrics-tls\") pod \"dns-default-jtcbc\" (UID: \"5dedcff5-b47c-4bd8-8684-25930d49cb60\") " pod="openshift-dns/dns-default-jtcbc" Jun 08 08:22:07.843149 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:07.843018 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/92b7d091-5608-4e0c-a616-714cf3dcab1f-registry-tls\") pod \"image-registry-6bf85bcd7b-6fpjd\" (UID: \"92b7d091-5608-4e0c-a616-714cf3dcab1f\") " pod="openshift-image-registry/image-registry-6bf85bcd7b-6fpjd" Jun 08 08:22:07.843149 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:22:07.843101 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 08:22:07.843149 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:22:07.843124 2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 08:22:07.843149 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:22:07.843140 2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bf85bcd7b-6fpjd: secret "image-registry-tls" not found Jun 08 08:22:07.843345 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:22:07.843179 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5dedcff5-b47c-4bd8-8684-25930d49cb60-metrics-tls podName:5dedcff5-b47c-4bd8-8684-25930d49cb60 nodeName:}" failed. No retries permitted until 2026-06-08 08:22:11.843158973 +0000 UTC m=+43.097370414 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5dedcff5-b47c-4bd8-8684-25930d49cb60-metrics-tls") pod "dns-default-jtcbc" (UID: "5dedcff5-b47c-4bd8-8684-25930d49cb60") : secret "dns-default-metrics-tls" not found Jun 08 08:22:07.843345 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:22:07.843204 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/92b7d091-5608-4e0c-a616-714cf3dcab1f-registry-tls podName:92b7d091-5608-4e0c-a616-714cf3dcab1f nodeName:}" failed. No retries permitted until 2026-06-08 08:22:11.843189974 +0000 UTC m=+43.097401405 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/92b7d091-5608-4e0c-a616-714cf3dcab1f-registry-tls") pod "image-registry-6bf85bcd7b-6fpjd" (UID: "92b7d091-5608-4e0c-a616-714cf3dcab1f") : secret "image-registry-tls" not found Jun 08 08:22:08.467261 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:08.467231 2570 generic.go:356] "Generic (PLEG): container finished" podID="202c9657-3a36-43ef-88ad-8fdaaba546c0" containerID="c87a4b01dc10218d41c65fc837f73990bf32fdb068ae8297f98caed64b1ba713" exitCode=0 Jun 08 08:22:08.467599 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:08.467284 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7np8s" event={"ID":"202c9657-3a36-43ef-88ad-8fdaaba546c0","Type":"ContainerDied","Data":"c87a4b01dc10218d41c65fc837f73990bf32fdb068ae8297f98caed64b1ba713"} Jun 08 08:22:09.471432 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:09.471399 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-pmppv" event={"ID":"ad089e2e-24e2-432f-93d7-f24ac4c5bc99","Type":"ContainerStarted","Data":"271a64a1a6f4f87b9691a1eb13944f3a3996ec2c091af25373786831f584fdda"} Jun 08 08:22:09.474686 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:09.474657 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7np8s" event={"ID":"202c9657-3a36-43ef-88ad-8fdaaba546c0","Type":"ContainerStarted","Data":"d53c537328f8eb9ec0d22e0816d42db203adb5fa0dc4af0bface2b0be02516ce"} Jun 08 08:22:09.487055 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:09.487016 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-pmppv" podStartSLOduration=1.490118917 podStartE2EDuration="5.487004569s" totalImagesPullingTime="3.996885652s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 08:22:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 08:22:09.48647047 +0000 UTC m=+40.740681919" watchObservedRunningTime="2026-06-08 08:22:09.487004569 +0000 UTC m=+40.741216027" Jun 08 08:22:09.510305 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:09.510258 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-7np8s" podStartSLOduration=10.2256467 podStartE2EDuration="40.510242218s" totalImagesPullingTime="30.284595518s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 08:21:29 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 08:22:09.508464606 +0000 UTC m=+40.762676079" watchObservedRunningTime="2026-06-08 08:22:09.510242218 +0000 UTC m=+40.764453669" Jun 08 08:22:11.871284 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:11.871251 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/92b7d091-5608-4e0c-a616-714cf3dcab1f-registry-tls\") pod \"image-registry-6bf85bcd7b-6fpjd\" (UID: \"92b7d091-5608-4e0c-a616-714cf3dcab1f\") " pod="openshift-image-registry/image-registry-6bf85bcd7b-6fpjd" Jun 08 08:22:11.871737 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:11.871308 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5dedcff5-b47c-4bd8-8684-25930d49cb60-metrics-tls\") pod \"dns-default-jtcbc\" (UID: \"5dedcff5-b47c-4bd8-8684-25930d49cb60\") " pod="openshift-dns/dns-default-jtcbc" Jun 08 08:22:11.871737 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:22:11.871404 2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 08:22:11.871737 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:22:11.871423 2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bf85bcd7b-6fpjd: secret "image-registry-tls" not found Jun 08 08:22:11.871737 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:22:11.871459 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 08:22:11.871737 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:22:11.871477 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/92b7d091-5608-4e0c-a616-714cf3dcab1f-registry-tls podName:92b7d091-5608-4e0c-a616-714cf3dcab1f nodeName:}" failed. No retries permitted until 2026-06-08 08:22:19.871463021 +0000 UTC m=+51.125674448 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/92b7d091-5608-4e0c-a616-714cf3dcab1f-registry-tls") pod "image-registry-6bf85bcd7b-6fpjd" (UID: "92b7d091-5608-4e0c-a616-714cf3dcab1f") : secret "image-registry-tls" not found Jun 08 08:22:11.871737 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:22:11.871518 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5dedcff5-b47c-4bd8-8684-25930d49cb60-metrics-tls podName:5dedcff5-b47c-4bd8-8684-25930d49cb60 nodeName:}" failed. No retries permitted until 2026-06-08 08:22:19.871495231 +0000 UTC m=+51.125706663 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5dedcff5-b47c-4bd8-8684-25930d49cb60-metrics-tls") pod "dns-default-jtcbc" (UID: "5dedcff5-b47c-4bd8-8684-25930d49cb60") : secret "dns-default-metrics-tls" not found Jun 08 08:22:14.413707 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:14.413673 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bdbf7c488-9sknb"] Jun 08 08:22:14.443367 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:14.443343 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bdbf7c488-9sknb"] Jun 08 08:22:14.443505 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:14.443423 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bdbf7c488-9sknb" Jun 08 08:22:14.447128 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:14.447104 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-jkmw2\"" Jun 08 08:22:14.447264 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:14.447131 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 08 08:22:14.447264 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:14.447140 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 08 08:22:14.447264 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:14.447108 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 08 08:22:14.447264 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:14.447111 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 08 08:22:14.590530 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:14.590510 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2b70d093-ed6b-4566-aebe-130f66603aec-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-bdbf7c488-9sknb\" (UID: \"2b70d093-ed6b-4566-aebe-130f66603aec\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bdbf7c488-9sknb" Jun 08 08:22:14.590652 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:14.590571 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtpd9\" (UniqueName: \"kubernetes.io/projected/2b70d093-ed6b-4566-aebe-130f66603aec-kube-api-access-xtpd9\") pod \"managed-serviceaccount-addon-agent-bdbf7c488-9sknb\" (UID: \"2b70d093-ed6b-4566-aebe-130f66603aec\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bdbf7c488-9sknb" Jun 08 08:22:14.691918 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:14.691866 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2b70d093-ed6b-4566-aebe-130f66603aec-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-bdbf7c488-9sknb\" (UID: \"2b70d093-ed6b-4566-aebe-130f66603aec\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bdbf7c488-9sknb" Jun 08 08:22:14.692008 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:14.691938 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtpd9\" (UniqueName: \"kubernetes.io/projected/2b70d093-ed6b-4566-aebe-130f66603aec-kube-api-access-xtpd9\") pod \"managed-serviceaccount-addon-agent-bdbf7c488-9sknb\" (UID: \"2b70d093-ed6b-4566-aebe-130f66603aec\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bdbf7c488-9sknb" Jun 08 08:22:14.695413 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:14.695398 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2b70d093-ed6b-4566-aebe-130f66603aec-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-bdbf7c488-9sknb\" (UID: \"2b70d093-ed6b-4566-aebe-130f66603aec\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bdbf7c488-9sknb" Jun 08 08:22:14.700194 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:14.700176 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtpd9\" (UniqueName: \"kubernetes.io/projected/2b70d093-ed6b-4566-aebe-130f66603aec-kube-api-access-xtpd9\") pod \"managed-serviceaccount-addon-agent-bdbf7c488-9sknb\" (UID: \"2b70d093-ed6b-4566-aebe-130f66603aec\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bdbf7c488-9sknb" Jun 08 08:22:14.761360 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:14.761339 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bdbf7c488-9sknb" Jun 08 08:22:14.909222 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:14.909193 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bdbf7c488-9sknb"] Jun 08 08:22:14.914409 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:22:14.914377 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2b70d093_ed6b_4566_aebe_130f66603aec.slice/crio-dbdecd784a8b837bfdc84f86373efa6282bd2838137e0fb0298842d9216ff79e WatchSource:0}: Error finding container dbdecd784a8b837bfdc84f86373efa6282bd2838137e0fb0298842d9216ff79e: Status 404 returned error can't find the container with id dbdecd784a8b837bfdc84f86373efa6282bd2838137e0fb0298842d9216ff79e Jun 08 08:22:15.488217 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:15.488184 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bdbf7c488-9sknb" event={"ID":"2b70d093-ed6b-4566-aebe-130f66603aec","Type":"ContainerStarted","Data":"dbdecd784a8b837bfdc84f86373efa6282bd2838137e0fb0298842d9216ff79e"} Jun 08 08:22:18.496702 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:18.496665 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bdbf7c488-9sknb" event={"ID":"2b70d093-ed6b-4566-aebe-130f66603aec","Type":"ContainerStarted","Data":"397fef281d38a1e009d44229fef0c148d4f5ea471aad8ed0318c6a90ed7f7da6"} Jun 08 08:22:18.511459 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:18.511418 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bdbf7c488-9sknb" podStartSLOduration=1.14423948 podStartE2EDuration="4.511403632s" totalImagesPullingTime="3.367164152s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 08:22:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 08:22:18.511326875 +0000 UTC m=+49.765538325" watchObservedRunningTime="2026-06-08 08:22:18.511403632 +0000 UTC m=+49.765615064" Jun 08 08:22:19.930172 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:19.930141 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/92b7d091-5608-4e0c-a616-714cf3dcab1f-registry-tls\") pod \"image-registry-6bf85bcd7b-6fpjd\" (UID: \"92b7d091-5608-4e0c-a616-714cf3dcab1f\") " pod="openshift-image-registry/image-registry-6bf85bcd7b-6fpjd" Jun 08 08:22:19.930534 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:19.930181 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5dedcff5-b47c-4bd8-8684-25930d49cb60-metrics-tls\") pod \"dns-default-jtcbc\" (UID: \"5dedcff5-b47c-4bd8-8684-25930d49cb60\") " pod="openshift-dns/dns-default-jtcbc" Jun 08 08:22:19.930534 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:22:19.930266 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 08:22:19.930534 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:22:19.930271 2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 08:22:19.930534 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:22:19.930286 2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bf85bcd7b-6fpjd: secret "image-registry-tls" not found Jun 08 08:22:19.930534 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:22:19.930320 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5dedcff5-b47c-4bd8-8684-25930d49cb60-metrics-tls podName:5dedcff5-b47c-4bd8-8684-25930d49cb60 nodeName:}" failed. No retries permitted until 2026-06-08 08:22:35.930307381 +0000 UTC m=+67.184518808 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5dedcff5-b47c-4bd8-8684-25930d49cb60-metrics-tls") pod "dns-default-jtcbc" (UID: "5dedcff5-b47c-4bd8-8684-25930d49cb60") : secret "dns-default-metrics-tls" not found Jun 08 08:22:19.930534 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:22:19.930333 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/92b7d091-5608-4e0c-a616-714cf3dcab1f-registry-tls podName:92b7d091-5608-4e0c-a616-714cf3dcab1f nodeName:}" failed. No retries permitted until 2026-06-08 08:22:35.930327345 +0000 UTC m=+67.184538772 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/92b7d091-5608-4e0c-a616-714cf3dcab1f-registry-tls") pod "image-registry-6bf85bcd7b-6fpjd" (UID: "92b7d091-5608-4e0c-a616-714cf3dcab1f") : secret "image-registry-tls" not found Jun 08 08:22:29.452518 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:29.452490 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5s57z" Jun 08 08:22:34.930109 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:34.930079 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4281d80d-e366-4f22-a397-e17c9be0e9f4-original-pull-secret\") pod \"global-pull-secret-syncer-6gvcs\" (UID: \"4281d80d-e366-4f22-a397-e17c9be0e9f4\") " pod="kube-system/global-pull-secret-syncer-6gvcs" Jun 08 08:22:34.930628 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:34.930151 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e0c87538-422c-4356-8983-84c33320ca33-metrics-certs\") pod \"network-metrics-daemon-zx26n\" (UID: \"e0c87538-422c-4356-8983-84c33320ca33\") " pod="openshift-multus/network-metrics-daemon-zx26n" Jun 08 08:22:34.933239 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:34.933216 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 08 08:22:34.933352 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:34.933251 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 08 08:22:34.940738 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:22:34.940703 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 08 08:22:34.940815 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:22:34.940798 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0c87538-422c-4356-8983-84c33320ca33-metrics-certs podName:e0c87538-422c-4356-8983-84c33320ca33 nodeName:}" failed. No retries permitted until 2026-06-08 08:23:38.940775581 +0000 UTC m=+130.194987010 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e0c87538-422c-4356-8983-84c33320ca33-metrics-certs") pod "network-metrics-daemon-zx26n" (UID: "e0c87538-422c-4356-8983-84c33320ca33") : secret "metrics-daemon-secret" not found Jun 08 08:22:34.942954 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:34.942933 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4281d80d-e366-4f22-a397-e17c9be0e9f4-original-pull-secret\") pod \"global-pull-secret-syncer-6gvcs\" (UID: \"4281d80d-e366-4f22-a397-e17c9be0e9f4\") " pod="kube-system/global-pull-secret-syncer-6gvcs" Jun 08 08:22:35.128162 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:35.128141 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gvcs" Jun 08 08:22:35.131946 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:35.131921 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kq59n\" (UniqueName: \"kubernetes.io/projected/e308208d-115f-41f0-81f3-65e534a90356-kube-api-access-kq59n\") pod \"network-check-target-cchg2\" (UID: \"e308208d-115f-41f0-81f3-65e534a90356\") " pod="openshift-network-diagnostics/network-check-target-cchg2" Jun 08 08:22:35.138134 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:35.138112 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 08 08:22:35.146580 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:35.146561 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 08 08:22:35.155202 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:35.155180 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kq59n\" (UniqueName: \"kubernetes.io/projected/e308208d-115f-41f0-81f3-65e534a90356-kube-api-access-kq59n\") pod \"network-check-target-cchg2\" (UID: \"e308208d-115f-41f0-81f3-65e534a90356\") " pod="openshift-network-diagnostics/network-check-target-cchg2" Jun 08 08:22:35.258510 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:35.258484 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6gvcs"] Jun 08 08:22:35.261625 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:22:35.261595 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4281d80d_e366_4f22_a397_e17c9be0e9f4.slice/crio-13d91193cf7ed172f6cc0478c1f1e1a51d72ed801fa82b5432b6d2b81930a6e7 WatchSource:0}: Error finding container 13d91193cf7ed172f6cc0478c1f1e1a51d72ed801fa82b5432b6d2b81930a6e7: Status 404 returned error can't find the container with id 13d91193cf7ed172f6cc0478c1f1e1a51d72ed801fa82b5432b6d2b81930a6e7 Jun 08 08:22:35.417926 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:35.417902 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-tl5qj\"" Jun 08 08:22:35.425433 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:35.425418 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cchg2" Jun 08 08:22:35.535652 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:35.535624 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6gvcs" event={"ID":"4281d80d-e366-4f22-a397-e17c9be0e9f4","Type":"ContainerStarted","Data":"13d91193cf7ed172f6cc0478c1f1e1a51d72ed801fa82b5432b6d2b81930a6e7"} Jun 08 08:22:35.542306 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:35.542268 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-cchg2"] Jun 08 08:22:35.545707 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:22:35.545684 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode308208d_115f_41f0_81f3_65e534a90356.slice/crio-7a4e6dd0f49a8cbdc99a30d90f55b5001878bf32b88d33e8f7de314acfa1bf66 WatchSource:0}: Error finding container 7a4e6dd0f49a8cbdc99a30d90f55b5001878bf32b88d33e8f7de314acfa1bf66: Status 404 returned error can't find the container with id 7a4e6dd0f49a8cbdc99a30d90f55b5001878bf32b88d33e8f7de314acfa1bf66 Jun 08 08:22:35.937701 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:35.937672 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5dedcff5-b47c-4bd8-8684-25930d49cb60-metrics-tls\") pod \"dns-default-jtcbc\" (UID: \"5dedcff5-b47c-4bd8-8684-25930d49cb60\") " pod="openshift-dns/dns-default-jtcbc" Jun 08 08:22:35.938089 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:35.937747 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/92b7d091-5608-4e0c-a616-714cf3dcab1f-registry-tls\") pod \"image-registry-6bf85bcd7b-6fpjd\" (UID: \"92b7d091-5608-4e0c-a616-714cf3dcab1f\") " pod="openshift-image-registry/image-registry-6bf85bcd7b-6fpjd" Jun 08 08:22:35.938089 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:22:35.937840 2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 08:22:35.938089 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:22:35.937856 2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bf85bcd7b-6fpjd: secret "image-registry-tls" not found Jun 08 08:22:35.938089 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:22:35.937858 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 08:22:35.938089 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:22:35.937906 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/92b7d091-5608-4e0c-a616-714cf3dcab1f-registry-tls podName:92b7d091-5608-4e0c-a616-714cf3dcab1f nodeName:}" failed. No retries permitted until 2026-06-08 08:23:07.937891663 +0000 UTC m=+99.192103091 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/92b7d091-5608-4e0c-a616-714cf3dcab1f-registry-tls") pod "image-registry-6bf85bcd7b-6fpjd" (UID: "92b7d091-5608-4e0c-a616-714cf3dcab1f") : secret "image-registry-tls" not found Jun 08 08:22:35.938089 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:22:35.937919 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5dedcff5-b47c-4bd8-8684-25930d49cb60-metrics-tls podName:5dedcff5-b47c-4bd8-8684-25930d49cb60 nodeName:}" failed. No retries permitted until 2026-06-08 08:23:07.937913287 +0000 UTC m=+99.192124715 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5dedcff5-b47c-4bd8-8684-25930d49cb60-metrics-tls") pod "dns-default-jtcbc" (UID: "5dedcff5-b47c-4bd8-8684-25930d49cb60") : secret "dns-default-metrics-tls" not found Jun 08 08:22:36.540186 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:36.540145 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-cchg2" event={"ID":"e308208d-115f-41f0-81f3-65e534a90356","Type":"ContainerStarted","Data":"7a4e6dd0f49a8cbdc99a30d90f55b5001878bf32b88d33e8f7de314acfa1bf66"} Jun 08 08:22:40.553167 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:40.553129 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6gvcs" event={"ID":"4281d80d-e366-4f22-a397-e17c9be0e9f4","Type":"ContainerStarted","Data":"7f6b854d95c1f11f605e6848021c337f8e1a9c0a104b0d25018be7f0ea470d28"} Jun 08 08:22:40.554615 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:40.554587 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-cchg2" event={"ID":"e308208d-115f-41f0-81f3-65e534a90356","Type":"ContainerStarted","Data":"c376e87c3a917c06f7cba327eaf59ac23bbbee46405f7702ed31f0d916a04392"} Jun 08 08:22:40.554732 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:40.554669 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-cchg2" Jun 08 08:22:40.568695 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:40.568646 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-6gvcs" podStartSLOduration=66.483344162 podStartE2EDuration="1m11.568629695s" totalImagesPullingTime="5.085285533s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 08:21:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 08:22:40.568337883 +0000 UTC m=+71.822549333" watchObservedRunningTime="2026-06-08 08:22:40.568629695 +0000 UTC m=+71.822841140" Jun 08 08:22:40.582830 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:22:40.582790 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-cchg2" podStartSLOduration=66.78456121400001 podStartE2EDuration="1m11.582776842s" totalImagesPullingTime="4.798215628s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 08:21:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 08:22:40.582258335 +0000 UTC m=+71.836469786" watchObservedRunningTime="2026-06-08 08:22:40.582776842 +0000 UTC m=+71.836988292" Jun 08 08:23:07.954016 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:23:07.953914 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/92b7d091-5608-4e0c-a616-714cf3dcab1f-registry-tls\") pod \"image-registry-6bf85bcd7b-6fpjd\" (UID: \"92b7d091-5608-4e0c-a616-714cf3dcab1f\") " pod="openshift-image-registry/image-registry-6bf85bcd7b-6fpjd" Jun 08 08:23:07.954016 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:23:07.953950 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5dedcff5-b47c-4bd8-8684-25930d49cb60-metrics-tls\") pod \"dns-default-jtcbc\" (UID: \"5dedcff5-b47c-4bd8-8684-25930d49cb60\") " pod="openshift-dns/dns-default-jtcbc" Jun 08 08:23:07.954402 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:23:07.954055 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 08:23:07.954402 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:23:07.954059 2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 08:23:07.954402 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:23:07.954074 2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bf85bcd7b-6fpjd: secret "image-registry-tls" not found Jun 08 08:23:07.954402 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:23:07.954127 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5dedcff5-b47c-4bd8-8684-25930d49cb60-metrics-tls podName:5dedcff5-b47c-4bd8-8684-25930d49cb60 nodeName:}" failed. No retries permitted until 2026-06-08 08:24:11.954109539 +0000 UTC m=+163.208320968 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5dedcff5-b47c-4bd8-8684-25930d49cb60-metrics-tls") pod "dns-default-jtcbc" (UID: "5dedcff5-b47c-4bd8-8684-25930d49cb60") : secret "dns-default-metrics-tls" not found Jun 08 08:23:07.954402 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:23:07.954140 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/92b7d091-5608-4e0c-a616-714cf3dcab1f-registry-tls podName:92b7d091-5608-4e0c-a616-714cf3dcab1f nodeName:}" failed. No retries permitted until 2026-06-08 08:24:11.954134097 +0000 UTC m=+163.208345525 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/92b7d091-5608-4e0c-a616-714cf3dcab1f-registry-tls") pod "image-registry-6bf85bcd7b-6fpjd" (UID: "92b7d091-5608-4e0c-a616-714cf3dcab1f") : secret "image-registry-tls" not found Jun 08 08:23:11.560072 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:23:11.560042 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-cchg2" Jun 08 08:23:38.953406 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:23:38.953364 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e0c87538-422c-4356-8983-84c33320ca33-metrics-certs\") pod \"network-metrics-daemon-zx26n\" (UID: \"e0c87538-422c-4356-8983-84c33320ca33\") " pod="openshift-multus/network-metrics-daemon-zx26n" Jun 08 08:23:38.953879 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:23:38.953506 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 08 08:23:38.953879 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:23:38.953565 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0c87538-422c-4356-8983-84c33320ca33-metrics-certs podName:e0c87538-422c-4356-8983-84c33320ca33 nodeName:}" failed. No retries permitted until 2026-06-08 08:25:40.953547113 +0000 UTC m=+252.207758546 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e0c87538-422c-4356-8983-84c33320ca33-metrics-certs") pod "network-metrics-daemon-zx26n" (UID: "e0c87538-422c-4356-8983-84c33320ca33") : secret "metrics-daemon-secret" not found Jun 08 08:24:07.082345 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:24:07.082306 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-6bf85bcd7b-6fpjd" podUID="92b7d091-5608-4e0c-a616-714cf3dcab1f" Jun 08 08:24:07.103199 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:24:07.103168 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-jtcbc" podUID="5dedcff5-b47c-4bd8-8684-25930d49cb60" Jun 08 08:24:07.222041 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:24:07.222019 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-zx26n" podUID="e0c87538-422c-4356-8983-84c33320ca33" Jun 08 08:24:07.749777 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:24:07.749747 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bf85bcd7b-6fpjd" Jun 08 08:24:07.749777 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:24:07.749783 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jtcbc" Jun 08 08:24:11.968483 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:24:11.968449 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/92b7d091-5608-4e0c-a616-714cf3dcab1f-registry-tls\") pod \"image-registry-6bf85bcd7b-6fpjd\" (UID: \"92b7d091-5608-4e0c-a616-714cf3dcab1f\") " pod="openshift-image-registry/image-registry-6bf85bcd7b-6fpjd" Jun 08 08:24:11.968483 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:24:11.968487 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5dedcff5-b47c-4bd8-8684-25930d49cb60-metrics-tls\") pod \"dns-default-jtcbc\" (UID: \"5dedcff5-b47c-4bd8-8684-25930d49cb60\") " pod="openshift-dns/dns-default-jtcbc" Jun 08 08:24:11.968990 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:24:11.968581 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 08:24:11.968990 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:24:11.968589 2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 08:24:11.968990 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:24:11.968604 2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bf85bcd7b-6fpjd: secret "image-registry-tls" not found Jun 08 08:24:11.968990 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:24:11.968641 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5dedcff5-b47c-4bd8-8684-25930d49cb60-metrics-tls podName:5dedcff5-b47c-4bd8-8684-25930d49cb60 nodeName:}" failed. No retries permitted until 2026-06-08 08:26:13.968627632 +0000 UTC m=+285.222839060 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5dedcff5-b47c-4bd8-8684-25930d49cb60-metrics-tls") pod "dns-default-jtcbc" (UID: "5dedcff5-b47c-4bd8-8684-25930d49cb60") : secret "dns-default-metrics-tls" not found Jun 08 08:24:11.968990 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:24:11.968654 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/92b7d091-5608-4e0c-a616-714cf3dcab1f-registry-tls podName:92b7d091-5608-4e0c-a616-714cf3dcab1f nodeName:}" failed. No retries permitted until 2026-06-08 08:26:13.968648209 +0000 UTC m=+285.222859637 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/92b7d091-5608-4e0c-a616-714cf3dcab1f-registry-tls") pod "image-registry-6bf85bcd7b-6fpjd" (UID: "92b7d091-5608-4e0c-a616-714cf3dcab1f") : secret "image-registry-tls" not found Jun 08 08:24:18.776223 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:24:18.776136 2570 generic.go:356] "Generic (PLEG): container finished" podID="2b70d093-ed6b-4566-aebe-130f66603aec" containerID="397fef281d38a1e009d44229fef0c148d4f5ea471aad8ed0318c6a90ed7f7da6" exitCode=255 Jun 08 08:24:18.776223 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:24:18.776182 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bdbf7c488-9sknb" event={"ID":"2b70d093-ed6b-4566-aebe-130f66603aec","Type":"ContainerDied","Data":"397fef281d38a1e009d44229fef0c148d4f5ea471aad8ed0318c6a90ed7f7da6"} Jun 08 08:24:18.781724 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:24:18.781696 2570 scope.go:117] "RemoveContainer" containerID="397fef281d38a1e009d44229fef0c148d4f5ea471aad8ed0318c6a90ed7f7da6" Jun 08 08:24:19.206127 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:24:19.206086 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zx26n" Jun 08 08:24:19.780472 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:24:19.780437 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bdbf7c488-9sknb" event={"ID":"2b70d093-ed6b-4566-aebe-130f66603aec","Type":"ContainerStarted","Data":"0d1bd41f0d0d522272684e970edf125d81f53f58525702dd00b4d9670dd4320e"} Jun 08 08:25:17.616930 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:17.616899 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5d6f988b67-lzl5t"] Jun 08 08:25:17.619507 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:17.619492 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5d6f988b67-lzl5t" Jun 08 08:25:17.623539 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:25:17.623514 2570 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"default-ingress-cert\" is forbidden: User \"system:node:ip-10-0-143-101.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-143-101.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" type="*v1.Secret" Jun 08 08:25:17.624126 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:25:17.624084 2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"router-default-5d6f988b67-lzl5t\" is forbidden: User \"system:node:ip-10-0-143-101.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-143-101.ec2.internal' and this object" podUID="47da3425-29f0-4210-94ce-c6dc07dc9834" pod="openshift-ingress/router-default-5d6f988b67-lzl5t" Jun 08 08:25:17.624126 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:25:17.624088 2570 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"router-dockercfg-hwjvn\" is forbidden: User \"system:node:ip-10-0-143-101.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-143-101.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"router-dockercfg-hwjvn\"" type="*v1.Secret" Jun 08 08:25:17.624321 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:25:17.624139 2570 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"router-stats-default\" is forbidden: User \"system:node:ip-10-0-143-101.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-143-101.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" type="*v1.Secret" Jun 08 08:25:17.624321 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:25:17.624156 2570 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-143-101.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-143-101.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" Jun 08 08:25:17.624429 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:25:17.624344 2570 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-143-101.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-143-101.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" Jun 08 08:25:17.624534 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:25:17.624515 2570 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"router-metrics-certs-default\" is forbidden: User \"system:node:ip-10-0-143-101.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-143-101.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" type="*v1.Secret" Jun 08 08:25:17.625124 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:25:17.625100 2570 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"service-ca-bundle\" is forbidden: User \"system:node:ip-10-0-143-101.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-143-101.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" type="*v1.ConfigMap" Jun 08 08:25:17.663055 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:17.663033 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5d6f988b67-lzl5t"] Jun 08 08:25:17.693188 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:17.693170 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/47da3425-29f0-4210-94ce-c6dc07dc9834-metrics-certs\") pod \"router-default-5d6f988b67-lzl5t\" (UID: \"47da3425-29f0-4210-94ce-c6dc07dc9834\") " pod="openshift-ingress/router-default-5d6f988b67-lzl5t" Jun 08 08:25:17.693297 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:17.693195 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/47da3425-29f0-4210-94ce-c6dc07dc9834-stats-auth\") pod \"router-default-5d6f988b67-lzl5t\" (UID: \"47da3425-29f0-4210-94ce-c6dc07dc9834\") " pod="openshift-ingress/router-default-5d6f988b67-lzl5t" Jun 08 08:25:17.693297 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:17.693211 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mmfz\" (UniqueName: \"kubernetes.io/projected/47da3425-29f0-4210-94ce-c6dc07dc9834-kube-api-access-8mmfz\") pod \"router-default-5d6f988b67-lzl5t\" (UID: \"47da3425-29f0-4210-94ce-c6dc07dc9834\") " pod="openshift-ingress/router-default-5d6f988b67-lzl5t" Jun 08 08:25:17.693297 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:17.693229 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47da3425-29f0-4210-94ce-c6dc07dc9834-service-ca-bundle\") pod \"router-default-5d6f988b67-lzl5t\" (UID: \"47da3425-29f0-4210-94ce-c6dc07dc9834\") " pod="openshift-ingress/router-default-5d6f988b67-lzl5t" Jun 08 08:25:17.693297 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:17.693278 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/47da3425-29f0-4210-94ce-c6dc07dc9834-default-certificate\") pod \"router-default-5d6f988b67-lzl5t\" (UID: \"47da3425-29f0-4210-94ce-c6dc07dc9834\") " pod="openshift-ingress/router-default-5d6f988b67-lzl5t" Jun 08 08:25:17.705082 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:17.705061 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-fd4g5"] Jun 08 08:25:17.708162 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:17.708146 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-fd4g5" Jun 08 08:25:17.711880 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:17.711352 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 08 08:25:17.711880 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:17.711380 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 08 08:25:17.711880 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:17.711561 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 08 08:25:17.712626 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:17.712421 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 08 08:25:17.712626 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:17.712573 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-lx67p\"" Jun 08 08:25:17.733600 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:17.733580 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-fd4g5"] Jun 08 08:25:17.788915 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:17.788895 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-896549976-7gdl7"] Jun 08 08:25:17.791597 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:17.791582 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-7gdl7" Jun 08 08:25:17.793532 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:17.793517 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/47da3425-29f0-4210-94ce-c6dc07dc9834-stats-auth\") pod \"router-default-5d6f988b67-lzl5t\" (UID: \"47da3425-29f0-4210-94ce-c6dc07dc9834\") " pod="openshift-ingress/router-default-5d6f988b67-lzl5t" Jun 08 08:25:17.793612 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:17.793540 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mmfz\" (UniqueName: \"kubernetes.io/projected/47da3425-29f0-4210-94ce-c6dc07dc9834-kube-api-access-8mmfz\") pod \"router-default-5d6f988b67-lzl5t\" (UID: \"47da3425-29f0-4210-94ce-c6dc07dc9834\") " pod="openshift-ingress/router-default-5d6f988b67-lzl5t" Jun 08 08:25:17.793612 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:17.793559 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/90965077-fc1d-44f1-b9e9-34e5f57c8e38-config\") pod \"service-ca-operator-6bc5ff68f5-fd4g5\" (UID: \"90965077-fc1d-44f1-b9e9-34e5f57c8e38\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-fd4g5" Jun 08 08:25:17.793612 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:17.793576 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2j5f\" (UniqueName: \"kubernetes.io/projected/90965077-fc1d-44f1-b9e9-34e5f57c8e38-kube-api-access-r2j5f\") pod \"service-ca-operator-6bc5ff68f5-fd4g5\" (UID: \"90965077-fc1d-44f1-b9e9-34e5f57c8e38\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-fd4g5" Jun 08 08:25:17.793612 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:17.793594 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47da3425-29f0-4210-94ce-c6dc07dc9834-service-ca-bundle\") pod \"router-default-5d6f988b67-lzl5t\" (UID: \"47da3425-29f0-4210-94ce-c6dc07dc9834\") " pod="openshift-ingress/router-default-5d6f988b67-lzl5t" Jun 08 08:25:17.793885 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:17.793768 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/47da3425-29f0-4210-94ce-c6dc07dc9834-default-certificate\") pod \"router-default-5d6f988b67-lzl5t\" (UID: \"47da3425-29f0-4210-94ce-c6dc07dc9834\") " pod="openshift-ingress/router-default-5d6f988b67-lzl5t" Jun 08 08:25:17.793885 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:17.793861 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/47da3425-29f0-4210-94ce-c6dc07dc9834-metrics-certs\") pod \"router-default-5d6f988b67-lzl5t\" (UID: \"47da3425-29f0-4210-94ce-c6dc07dc9834\") " pod="openshift-ingress/router-default-5d6f988b67-lzl5t" Jun 08 08:25:17.793966 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:17.793892 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/90965077-fc1d-44f1-b9e9-34e5f57c8e38-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-fd4g5\" (UID: \"90965077-fc1d-44f1-b9e9-34e5f57c8e38\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-fd4g5" Jun 08 08:25:17.795571 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:17.795554 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 08 08:25:17.795656 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:17.795638 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-t6zvf\"" Jun 08 08:25:17.796445 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:17.796398 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 08 08:25:17.796747 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:17.796707 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 08 08:25:17.796747 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:17.796739 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 08 08:25:17.800910 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:17.800893 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 08 08:25:17.803890 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:17.803869 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-7gdl7"] Jun 08 08:25:17.894137 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:17.894083 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzqrx\" (UniqueName: \"kubernetes.io/projected/90190966-f98a-4a95-8ac6-564ced75358f-kube-api-access-wzqrx\") pod \"insights-operator-896549976-7gdl7\" (UID: \"90190966-f98a-4a95-8ac6-564ced75358f\") " pod="openshift-insights/insights-operator-896549976-7gdl7" Jun 08 08:25:17.894137 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:17.894118 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/90965077-fc1d-44f1-b9e9-34e5f57c8e38-config\") pod \"service-ca-operator-6bc5ff68f5-fd4g5\" (UID: \"90965077-fc1d-44f1-b9e9-34e5f57c8e38\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-fd4g5" Jun 08 08:25:17.894249 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:17.894144 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90190966-f98a-4a95-8ac6-564ced75358f-trusted-ca-bundle\") pod \"insights-operator-896549976-7gdl7\" (UID: \"90190966-f98a-4a95-8ac6-564ced75358f\") " pod="openshift-insights/insights-operator-896549976-7gdl7" Jun 08 08:25:17.894249 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:17.894177 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/90190966-f98a-4a95-8ac6-564ced75358f-serving-cert\") pod \"insights-operator-896549976-7gdl7\" (UID: \"90190966-f98a-4a95-8ac6-564ced75358f\") " pod="openshift-insights/insights-operator-896549976-7gdl7" Jun 08 08:25:17.894326 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:17.894311 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/90965077-fc1d-44f1-b9e9-34e5f57c8e38-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-fd4g5\" (UID: \"90965077-fc1d-44f1-b9e9-34e5f57c8e38\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-fd4g5" Jun 08 08:25:17.894361 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:17.894344 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/90190966-f98a-4a95-8ac6-564ced75358f-snapshots\") pod \"insights-operator-896549976-7gdl7\" (UID: \"90190966-f98a-4a95-8ac6-564ced75358f\") " pod="openshift-insights/insights-operator-896549976-7gdl7" Jun 08 08:25:17.894396 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:17.894372 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/90190966-f98a-4a95-8ac6-564ced75358f-tmp\") pod \"insights-operator-896549976-7gdl7\" (UID: \"90190966-f98a-4a95-8ac6-564ced75358f\") " pod="openshift-insights/insights-operator-896549976-7gdl7" Jun 08 08:25:17.894429 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:17.894396 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90190966-f98a-4a95-8ac6-564ced75358f-service-ca-bundle\") pod \"insights-operator-896549976-7gdl7\" (UID: \"90190966-f98a-4a95-8ac6-564ced75358f\") " pod="openshift-insights/insights-operator-896549976-7gdl7" Jun 08 08:25:17.894461 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:17.894424 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2j5f\" (UniqueName: \"kubernetes.io/projected/90965077-fc1d-44f1-b9e9-34e5f57c8e38-kube-api-access-r2j5f\") pod \"service-ca-operator-6bc5ff68f5-fd4g5\" (UID: \"90965077-fc1d-44f1-b9e9-34e5f57c8e38\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-fd4g5" Jun 08 08:25:17.894596 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:17.894580 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/90965077-fc1d-44f1-b9e9-34e5f57c8e38-config\") pod \"service-ca-operator-6bc5ff68f5-fd4g5\" (UID: \"90965077-fc1d-44f1-b9e9-34e5f57c8e38\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-fd4g5" Jun 08 08:25:17.896391 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:17.896375 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/90965077-fc1d-44f1-b9e9-34e5f57c8e38-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-fd4g5\" (UID: \"90965077-fc1d-44f1-b9e9-34e5f57c8e38\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-fd4g5" Jun 08 08:25:17.905464 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:17.905440 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2j5f\" (UniqueName: \"kubernetes.io/projected/90965077-fc1d-44f1-b9e9-34e5f57c8e38-kube-api-access-r2j5f\") pod \"service-ca-operator-6bc5ff68f5-fd4g5\" (UID: \"90965077-fc1d-44f1-b9e9-34e5f57c8e38\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-fd4g5" Jun 08 08:25:17.995195 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:17.995173 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/90190966-f98a-4a95-8ac6-564ced75358f-tmp\") pod \"insights-operator-896549976-7gdl7\" (UID: \"90190966-f98a-4a95-8ac6-564ced75358f\") " pod="openshift-insights/insights-operator-896549976-7gdl7" Jun 08 08:25:17.995281 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:17.995197 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90190966-f98a-4a95-8ac6-564ced75358f-service-ca-bundle\") pod \"insights-operator-896549976-7gdl7\" (UID: \"90190966-f98a-4a95-8ac6-564ced75358f\") " pod="openshift-insights/insights-operator-896549976-7gdl7" Jun 08 08:25:17.995281 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:17.995238 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzqrx\" (UniqueName: \"kubernetes.io/projected/90190966-f98a-4a95-8ac6-564ced75358f-kube-api-access-wzqrx\") pod \"insights-operator-896549976-7gdl7\" (UID: \"90190966-f98a-4a95-8ac6-564ced75358f\") " pod="openshift-insights/insights-operator-896549976-7gdl7" Jun 08 08:25:17.995281 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:17.995262 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90190966-f98a-4a95-8ac6-564ced75358f-trusted-ca-bundle\") pod \"insights-operator-896549976-7gdl7\" (UID: \"90190966-f98a-4a95-8ac6-564ced75358f\") " pod="openshift-insights/insights-operator-896549976-7gdl7" Jun 08 08:25:17.995439 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:17.995283 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/90190966-f98a-4a95-8ac6-564ced75358f-serving-cert\") pod \"insights-operator-896549976-7gdl7\" (UID: \"90190966-f98a-4a95-8ac6-564ced75358f\") " pod="openshift-insights/insights-operator-896549976-7gdl7" Jun 08 08:25:17.995439 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:17.995339 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/90190966-f98a-4a95-8ac6-564ced75358f-snapshots\") pod \"insights-operator-896549976-7gdl7\" (UID: \"90190966-f98a-4a95-8ac6-564ced75358f\") " pod="openshift-insights/insights-operator-896549976-7gdl7" Jun 08 08:25:17.995554 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:17.995535 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/90190966-f98a-4a95-8ac6-564ced75358f-tmp\") pod \"insights-operator-896549976-7gdl7\" (UID: \"90190966-f98a-4a95-8ac6-564ced75358f\") " pod="openshift-insights/insights-operator-896549976-7gdl7" Jun 08 08:25:17.995768 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:17.995752 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90190966-f98a-4a95-8ac6-564ced75358f-service-ca-bundle\") pod \"insights-operator-896549976-7gdl7\" (UID: \"90190966-f98a-4a95-8ac6-564ced75358f\") " pod="openshift-insights/insights-operator-896549976-7gdl7" Jun 08 08:25:17.995932 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:17.995911 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/90190966-f98a-4a95-8ac6-564ced75358f-snapshots\") pod \"insights-operator-896549976-7gdl7\" (UID: \"90190966-f98a-4a95-8ac6-564ced75358f\") " pod="openshift-insights/insights-operator-896549976-7gdl7" Jun 08 08:25:17.996051 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:17.996037 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90190966-f98a-4a95-8ac6-564ced75358f-trusted-ca-bundle\") pod \"insights-operator-896549976-7gdl7\" (UID: \"90190966-f98a-4a95-8ac6-564ced75358f\") " pod="openshift-insights/insights-operator-896549976-7gdl7" Jun 08 08:25:17.997300 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:17.997286 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/90190966-f98a-4a95-8ac6-564ced75358f-serving-cert\") pod \"insights-operator-896549976-7gdl7\" (UID: \"90190966-f98a-4a95-8ac6-564ced75358f\") " pod="openshift-insights/insights-operator-896549976-7gdl7" Jun 08 08:25:18.003747 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:18.003729 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzqrx\" (UniqueName: \"kubernetes.io/projected/90190966-f98a-4a95-8ac6-564ced75358f-kube-api-access-wzqrx\") pod \"insights-operator-896549976-7gdl7\" (UID: \"90190966-f98a-4a95-8ac6-564ced75358f\") " pod="openshift-insights/insights-operator-896549976-7gdl7" Jun 08 08:25:18.020146 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:18.020117 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-fd4g5" Jun 08 08:25:18.100157 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:18.100128 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-7gdl7" Jun 08 08:25:18.139546 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:18.139512 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-fd4g5"] Jun 08 08:25:18.142243 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:25:18.142220 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90965077_fc1d_44f1_b9e9_34e5f57c8e38.slice/crio-15a635d656968a316492d4479a0917fe00d4d0bbb17faffd0fa7350d0592643c WatchSource:0}: Error finding container 15a635d656968a316492d4479a0917fe00d4d0bbb17faffd0fa7350d0592643c: Status 404 returned error can't find the container with id 15a635d656968a316492d4479a0917fe00d4d0bbb17faffd0fa7350d0592643c Jun 08 08:25:18.217269 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:18.217242 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-7gdl7"] Jun 08 08:25:18.220174 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:25:18.220153 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90190966_f98a_4a95_8ac6_564ced75358f.slice/crio-9f6ad24a7ff99dc866a99d3c062db2e02a29f423058317f034a553892f9e7d4c WatchSource:0}: Error finding container 9f6ad24a7ff99dc866a99d3c062db2e02a29f423058317f034a553892f9e7d4c: Status 404 returned error can't find the container with id 9f6ad24a7ff99dc866a99d3c062db2e02a29f423058317f034a553892f9e7d4c Jun 08 08:25:18.449955 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:18.449890 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 08 08:25:18.627901 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:18.627879 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 08 08:25:18.634388 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:25:18.634372 2570 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 08 08:25:18.634479 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:25:18.634427 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47da3425-29f0-4210-94ce-c6dc07dc9834-metrics-certs podName:47da3425-29f0-4210-94ce-c6dc07dc9834 nodeName:}" failed. No retries permitted until 2026-06-08 08:25:19.134411951 +0000 UTC m=+230.388623379 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/47da3425-29f0-4210-94ce-c6dc07dc9834-metrics-certs") pod "router-default-5d6f988b67-lzl5t" (UID: "47da3425-29f0-4210-94ce-c6dc07dc9834") : secret "router-metrics-certs-default" not found Jun 08 08:25:18.661728 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:18.661695 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 08 08:25:18.666082 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:18.666062 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/47da3425-29f0-4210-94ce-c6dc07dc9834-stats-auth\") pod \"router-default-5d6f988b67-lzl5t\" (UID: \"47da3425-29f0-4210-94ce-c6dc07dc9834\") " pod="openshift-ingress/router-default-5d6f988b67-lzl5t" Jun 08 08:25:18.794611 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:25:18.794536 2570 secret.go:189] Couldn't get secret openshift-ingress/default-ingress-cert: failed to sync secret cache: timed out waiting for the condition Jun 08 08:25:18.794611 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:25:18.794591 2570 configmap.go:193] Couldn't get configMap openshift-ingress/service-ca-bundle: failed to sync configmap cache: timed out waiting for the condition Jun 08 08:25:18.794818 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:25:18.794629 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47da3425-29f0-4210-94ce-c6dc07dc9834-default-certificate podName:47da3425-29f0-4210-94ce-c6dc07dc9834 nodeName:}" failed. No retries permitted until 2026-06-08 08:25:19.29460946 +0000 UTC m=+230.548820895 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "default-certificate" (UniqueName: "kubernetes.io/secret/47da3425-29f0-4210-94ce-c6dc07dc9834-default-certificate") pod "router-default-5d6f988b67-lzl5t" (UID: "47da3425-29f0-4210-94ce-c6dc07dc9834") : failed to sync secret cache: timed out waiting for the condition Jun 08 08:25:18.794818 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:25:18.794667 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/47da3425-29f0-4210-94ce-c6dc07dc9834-service-ca-bundle podName:47da3425-29f0-4210-94ce-c6dc07dc9834 nodeName:}" failed. No retries permitted until 2026-06-08 08:25:19.294646555 +0000 UTC m=+230.548857998 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/47da3425-29f0-4210-94ce-c6dc07dc9834-service-ca-bundle") pod "router-default-5d6f988b67-lzl5t" (UID: "47da3425-29f0-4210-94ce-c6dc07dc9834") : failed to sync configmap cache: timed out waiting for the condition Jun 08 08:25:18.916842 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:18.916811 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-7gdl7" event={"ID":"90190966-f98a-4a95-8ac6-564ced75358f","Type":"ContainerStarted","Data":"9f6ad24a7ff99dc866a99d3c062db2e02a29f423058317f034a553892f9e7d4c"} Jun 08 08:25:18.917900 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:18.917874 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-fd4g5" event={"ID":"90965077-fc1d-44f1-b9e9-34e5f57c8e38","Type":"ContainerStarted","Data":"15a635d656968a316492d4479a0917fe00d4d0bbb17faffd0fa7350d0592643c"} Jun 08 08:25:18.987894 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:18.987861 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 08 08:25:19.016751 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:19.016723 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 08 08:25:19.026642 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:19.026611 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-hwjvn\"" Jun 08 08:25:19.104091 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:19.104061 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 08 08:25:19.112241 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:19.112217 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mmfz\" (UniqueName: \"kubernetes.io/projected/47da3425-29f0-4210-94ce-c6dc07dc9834-kube-api-access-8mmfz\") pod \"router-default-5d6f988b67-lzl5t\" (UID: \"47da3425-29f0-4210-94ce-c6dc07dc9834\") " pod="openshift-ingress/router-default-5d6f988b67-lzl5t" Jun 08 08:25:19.205201 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:19.205035 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/47da3425-29f0-4210-94ce-c6dc07dc9834-metrics-certs\") pod \"router-default-5d6f988b67-lzl5t\" (UID: \"47da3425-29f0-4210-94ce-c6dc07dc9834\") " pod="openshift-ingress/router-default-5d6f988b67-lzl5t" Jun 08 08:25:19.205201 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:25:19.205181 2570 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 08 08:25:19.205420 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:25:19.205251 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47da3425-29f0-4210-94ce-c6dc07dc9834-metrics-certs podName:47da3425-29f0-4210-94ce-c6dc07dc9834 nodeName:}" failed. No retries permitted until 2026-06-08 08:25:20.205236794 +0000 UTC m=+231.459448223 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/47da3425-29f0-4210-94ce-c6dc07dc9834-metrics-certs") pod "router-default-5d6f988b67-lzl5t" (UID: "47da3425-29f0-4210-94ce-c6dc07dc9834") : secret "router-metrics-certs-default" not found Jun 08 08:25:19.306122 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:19.306083 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47da3425-29f0-4210-94ce-c6dc07dc9834-service-ca-bundle\") pod \"router-default-5d6f988b67-lzl5t\" (UID: \"47da3425-29f0-4210-94ce-c6dc07dc9834\") " pod="openshift-ingress/router-default-5d6f988b67-lzl5t" Jun 08 08:25:19.306299 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:19.306150 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/47da3425-29f0-4210-94ce-c6dc07dc9834-default-certificate\") pod \"router-default-5d6f988b67-lzl5t\" (UID: \"47da3425-29f0-4210-94ce-c6dc07dc9834\") " pod="openshift-ingress/router-default-5d6f988b67-lzl5t" Jun 08 08:25:19.306513 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:25:19.306487 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/47da3425-29f0-4210-94ce-c6dc07dc9834-service-ca-bundle podName:47da3425-29f0-4210-94ce-c6dc07dc9834 nodeName:}" failed. No retries permitted until 2026-06-08 08:25:20.306466696 +0000 UTC m=+231.560678128 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/47da3425-29f0-4210-94ce-c6dc07dc9834-service-ca-bundle") pod "router-default-5d6f988b67-lzl5t" (UID: "47da3425-29f0-4210-94ce-c6dc07dc9834") : configmap references non-existent config key: service-ca.crt Jun 08 08:25:19.309094 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:19.309069 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/47da3425-29f0-4210-94ce-c6dc07dc9834-default-certificate\") pod \"router-default-5d6f988b67-lzl5t\" (UID: \"47da3425-29f0-4210-94ce-c6dc07dc9834\") " pod="openshift-ingress/router-default-5d6f988b67-lzl5t" Jun 08 08:25:20.214233 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:20.214190 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/47da3425-29f0-4210-94ce-c6dc07dc9834-metrics-certs\") pod \"router-default-5d6f988b67-lzl5t\" (UID: \"47da3425-29f0-4210-94ce-c6dc07dc9834\") " pod="openshift-ingress/router-default-5d6f988b67-lzl5t" Jun 08 08:25:20.214738 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:25:20.214370 2570 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 08 08:25:20.214738 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:25:20.214446 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47da3425-29f0-4210-94ce-c6dc07dc9834-metrics-certs podName:47da3425-29f0-4210-94ce-c6dc07dc9834 nodeName:}" failed. No retries permitted until 2026-06-08 08:25:22.214426193 +0000 UTC m=+233.468637622 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/47da3425-29f0-4210-94ce-c6dc07dc9834-metrics-certs") pod "router-default-5d6f988b67-lzl5t" (UID: "47da3425-29f0-4210-94ce-c6dc07dc9834") : secret "router-metrics-certs-default" not found Jun 08 08:25:20.315584 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:20.315552 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47da3425-29f0-4210-94ce-c6dc07dc9834-service-ca-bundle\") pod \"router-default-5d6f988b67-lzl5t\" (UID: \"47da3425-29f0-4210-94ce-c6dc07dc9834\") " pod="openshift-ingress/router-default-5d6f988b67-lzl5t" Jun 08 08:25:20.319148 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:25:20.316223 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/47da3425-29f0-4210-94ce-c6dc07dc9834-service-ca-bundle podName:47da3425-29f0-4210-94ce-c6dc07dc9834 nodeName:}" failed. No retries permitted until 2026-06-08 08:25:22.316188087 +0000 UTC m=+233.570399530 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/47da3425-29f0-4210-94ce-c6dc07dc9834-service-ca-bundle") pod "router-default-5d6f988b67-lzl5t" (UID: "47da3425-29f0-4210-94ce-c6dc07dc9834") : configmap references non-existent config key: service-ca.crt Jun 08 08:25:20.925008 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:20.924968 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-7gdl7" event={"ID":"90190966-f98a-4a95-8ac6-564ced75358f","Type":"ContainerStarted","Data":"c923cd60eb418ea2ee1d72e384b3631633e377fd1febff65972d953f6b2fa72e"} Jun 08 08:25:20.926439 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:20.926414 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-fd4g5" event={"ID":"90965077-fc1d-44f1-b9e9-34e5f57c8e38","Type":"ContainerStarted","Data":"d82735859c3b3b97a5c4a0228a7203e907906fa2eb88b0512c711007c1798a33"} Jun 08 08:25:20.944814 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:20.944762 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-896549976-7gdl7" podStartSLOduration=1.411887568 podStartE2EDuration="3.944751086s" totalImagesPullingTime="2.532863518s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 08:25:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 08:25:20.944040244 +0000 UTC m=+232.198251693" watchObservedRunningTime="2026-06-08 08:25:20.944751086 +0000 UTC m=+232.198962537" Jun 08 08:25:20.974542 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:20.974493 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-fd4g5" podStartSLOduration=1.364889738 podStartE2EDuration="3.974476255s" totalImagesPullingTime="2.609586517s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 08:25:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 08:25:20.973397561 +0000 UTC m=+232.227609009" watchObservedRunningTime="2026-06-08 08:25:20.974476255 +0000 UTC m=+232.228687704" Jun 08 08:25:22.231032 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:22.230988 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/47da3425-29f0-4210-94ce-c6dc07dc9834-metrics-certs\") pod \"router-default-5d6f988b67-lzl5t\" (UID: \"47da3425-29f0-4210-94ce-c6dc07dc9834\") " pod="openshift-ingress/router-default-5d6f988b67-lzl5t" Jun 08 08:25:22.231469 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:25:22.231120 2570 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 08 08:25:22.231469 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:25:22.231340 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47da3425-29f0-4210-94ce-c6dc07dc9834-metrics-certs podName:47da3425-29f0-4210-94ce-c6dc07dc9834 nodeName:}" failed. No retries permitted until 2026-06-08 08:25:26.231317214 +0000 UTC m=+237.485528646 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/47da3425-29f0-4210-94ce-c6dc07dc9834-metrics-certs") pod "router-default-5d6f988b67-lzl5t" (UID: "47da3425-29f0-4210-94ce-c6dc07dc9834") : secret "router-metrics-certs-default" not found Jun 08 08:25:22.332380 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:22.332345 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47da3425-29f0-4210-94ce-c6dc07dc9834-service-ca-bundle\") pod \"router-default-5d6f988b67-lzl5t\" (UID: \"47da3425-29f0-4210-94ce-c6dc07dc9834\") " pod="openshift-ingress/router-default-5d6f988b67-lzl5t" Jun 08 08:25:22.332525 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:25:22.332497 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/47da3425-29f0-4210-94ce-c6dc07dc9834-service-ca-bundle podName:47da3425-29f0-4210-94ce-c6dc07dc9834 nodeName:}" failed. No retries permitted until 2026-06-08 08:25:26.332482359 +0000 UTC m=+237.586693790 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/47da3425-29f0-4210-94ce-c6dc07dc9834-service-ca-bundle") pod "router-default-5d6f988b67-lzl5t" (UID: "47da3425-29f0-4210-94ce-c6dc07dc9834") : configmap references non-existent config key: service-ca.crt Jun 08 08:25:24.858270 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:24.858235 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-f845l_28880cc4-90dd-4d3f-8bf7-df18edcdd096/dns-node-resolver/0.log" Jun 08 08:25:26.064831 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:26.064804 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-hp6pw_b817d520-ebd3-4bd7-9490-90751bd573aa/node-ca/0.log" Jun 08 08:25:26.260377 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:26.260346 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/47da3425-29f0-4210-94ce-c6dc07dc9834-metrics-certs\") pod \"router-default-5d6f988b67-lzl5t\" (UID: \"47da3425-29f0-4210-94ce-c6dc07dc9834\") " pod="openshift-ingress/router-default-5d6f988b67-lzl5t" Jun 08 08:25:26.260507 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:25:26.260484 2570 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 08 08:25:26.260562 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:25:26.260550 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47da3425-29f0-4210-94ce-c6dc07dc9834-metrics-certs podName:47da3425-29f0-4210-94ce-c6dc07dc9834 nodeName:}" failed. No retries permitted until 2026-06-08 08:25:34.260535373 +0000 UTC m=+245.514746801 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/47da3425-29f0-4210-94ce-c6dc07dc9834-metrics-certs") pod "router-default-5d6f988b67-lzl5t" (UID: "47da3425-29f0-4210-94ce-c6dc07dc9834") : secret "router-metrics-certs-default" not found Jun 08 08:25:26.360873 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:26.360809 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47da3425-29f0-4210-94ce-c6dc07dc9834-service-ca-bundle\") pod \"router-default-5d6f988b67-lzl5t\" (UID: \"47da3425-29f0-4210-94ce-c6dc07dc9834\") " pod="openshift-ingress/router-default-5d6f988b67-lzl5t" Jun 08 08:25:26.360978 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:25:26.360961 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/47da3425-29f0-4210-94ce-c6dc07dc9834-service-ca-bundle podName:47da3425-29f0-4210-94ce-c6dc07dc9834 nodeName:}" failed. No retries permitted until 2026-06-08 08:25:34.360946877 +0000 UTC m=+245.615158304 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/47da3425-29f0-4210-94ce-c6dc07dc9834-service-ca-bundle") pod "router-default-5d6f988b67-lzl5t" (UID: "47da3425-29f0-4210-94ce-c6dc07dc9834") : configmap references non-existent config key: service-ca.crt Jun 08 08:25:27.067516 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:27.067488 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-pmppv_ad089e2e-24e2-432f-93d7-f24ac4c5bc99/serve-healthcheck-canary/0.log" Jun 08 08:25:34.315178 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:34.315145 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/47da3425-29f0-4210-94ce-c6dc07dc9834-metrics-certs\") pod \"router-default-5d6f988b67-lzl5t\" (UID: \"47da3425-29f0-4210-94ce-c6dc07dc9834\") " pod="openshift-ingress/router-default-5d6f988b67-lzl5t" Jun 08 08:25:34.317343 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:34.317324 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/47da3425-29f0-4210-94ce-c6dc07dc9834-metrics-certs\") pod \"router-default-5d6f988b67-lzl5t\" (UID: \"47da3425-29f0-4210-94ce-c6dc07dc9834\") " pod="openshift-ingress/router-default-5d6f988b67-lzl5t" Jun 08 08:25:34.415900 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:34.415872 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47da3425-29f0-4210-94ce-c6dc07dc9834-service-ca-bundle\") pod \"router-default-5d6f988b67-lzl5t\" (UID: \"47da3425-29f0-4210-94ce-c6dc07dc9834\") " pod="openshift-ingress/router-default-5d6f988b67-lzl5t" Jun 08 08:25:34.416561 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:34.416545 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47da3425-29f0-4210-94ce-c6dc07dc9834-service-ca-bundle\") pod \"router-default-5d6f988b67-lzl5t\" (UID: \"47da3425-29f0-4210-94ce-c6dc07dc9834\") " pod="openshift-ingress/router-default-5d6f988b67-lzl5t" Jun 08 08:25:34.430473 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:34.430455 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-hwjvn\"" Jun 08 08:25:34.438583 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:34.438567 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5d6f988b67-lzl5t" Jun 08 08:25:34.591809 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:34.591741 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5d6f988b67-lzl5t"] Jun 08 08:25:34.594680 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:25:34.594654 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47da3425_29f0_4210_94ce_c6dc07dc9834.slice/crio-98ccf16bcf339a0d7f2e441b6cd2c3e2d57b28b2ee07a5c2fb4a3c94309fa16f WatchSource:0}: Error finding container 98ccf16bcf339a0d7f2e441b6cd2c3e2d57b28b2ee07a5c2fb4a3c94309fa16f: Status 404 returned error can't find the container with id 98ccf16bcf339a0d7f2e441b6cd2c3e2d57b28b2ee07a5c2fb4a3c94309fa16f Jun 08 08:25:34.968909 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:34.968829 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5d6f988b67-lzl5t" event={"ID":"47da3425-29f0-4210-94ce-c6dc07dc9834","Type":"ContainerStarted","Data":"c44e613af2a5e2dac8273ea01ece854c50509923340b6c4ce632f397df6fb2da"} Jun 08 08:25:34.968909 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:34.968878 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5d6f988b67-lzl5t" event={"ID":"47da3425-29f0-4210-94ce-c6dc07dc9834","Type":"ContainerStarted","Data":"98ccf16bcf339a0d7f2e441b6cd2c3e2d57b28b2ee07a5c2fb4a3c94309fa16f"} Jun 08 08:25:34.987980 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:34.987935 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-5d6f988b67-lzl5t" podStartSLOduration=17.987921214 podStartE2EDuration="17.987921214s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 08:25:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 08:25:34.986774642 +0000 UTC m=+246.240986089" watchObservedRunningTime="2026-06-08 08:25:34.987921214 +0000 UTC m=+246.242132662" Jun 08 08:25:35.439596 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:35.439567 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5d6f988b67-lzl5t" Jun 08 08:25:35.442063 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:35.442041 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5d6f988b67-lzl5t" Jun 08 08:25:35.971566 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:35.971539 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5d6f988b67-lzl5t" Jun 08 08:25:35.972667 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:35.972650 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5d6f988b67-lzl5t" Jun 08 08:25:40.964822 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:40.964790 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e0c87538-422c-4356-8983-84c33320ca33-metrics-certs\") pod \"network-metrics-daemon-zx26n\" (UID: \"e0c87538-422c-4356-8983-84c33320ca33\") " pod="openshift-multus/network-metrics-daemon-zx26n" Jun 08 08:25:40.966879 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:40.966851 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e0c87538-422c-4356-8983-84c33320ca33-metrics-certs\") pod \"network-metrics-daemon-zx26n\" (UID: \"e0c87538-422c-4356-8983-84c33320ca33\") " pod="openshift-multus/network-metrics-daemon-zx26n" Jun 08 08:25:41.109574 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:41.109550 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8bqxt\"" Jun 08 08:25:41.117655 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:41.117642 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zx26n" Jun 08 08:25:41.233338 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:41.233265 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zx26n"] Jun 08 08:25:41.236040 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:25:41.236015 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0c87538_422c_4356_8983_84c33320ca33.slice/crio-fec0ad429b42eca20874d38b540b0240283fd6d661e680ca9cb10c263901ad31 WatchSource:0}: Error finding container fec0ad429b42eca20874d38b540b0240283fd6d661e680ca9cb10c263901ad31: Status 404 returned error can't find the container with id fec0ad429b42eca20874d38b540b0240283fd6d661e680ca9cb10c263901ad31 Jun 08 08:25:41.990001 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:41.989964 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zx26n" event={"ID":"e0c87538-422c-4356-8983-84c33320ca33","Type":"ContainerStarted","Data":"fec0ad429b42eca20874d38b540b0240283fd6d661e680ca9cb10c263901ad31"} Jun 08 08:25:42.994339 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:42.994301 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zx26n" event={"ID":"e0c87538-422c-4356-8983-84c33320ca33","Type":"ContainerStarted","Data":"0a0a0eda55a4bbe709c8cfa72805474d4be92278c1f1d9c826d6255f8e18920c"} Jun 08 08:25:42.994779 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:42.994383 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zx26n" event={"ID":"e0c87538-422c-4356-8983-84c33320ca33","Type":"ContainerStarted","Data":"9d8fdbf6487cce11d210c349dce05ebb88d26fb263a949e76a463eb70eb32480"} Jun 08 08:25:43.010748 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:43.010688 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-zx26n" podStartSLOduration=253.200557831 podStartE2EDuration="4m14.010675705s" totalImagesPullingTime="810.117874ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 08:21:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 08:25:43.009431476 +0000 UTC m=+254.263642950" watchObservedRunningTime="2026-06-08 08:25:43.010675705 +0000 UTC m=+254.264887153" Jun 08 08:25:44.202087 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:44.202053 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-v59t5"] Jun 08 08:25:44.205352 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:44.205332 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-v59t5" Jun 08 08:25:44.209624 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:44.209602 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 08 08:25:44.209624 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:44.209585 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-cnnw8\"" Jun 08 08:25:44.209840 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:44.209602 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 08 08:25:44.214824 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:44.214794 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-v59t5"] Jun 08 08:25:44.287402 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:44.287377 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/44e7e45c-b61b-4afd-a19e-048bca27595e-crio-socket\") pod \"insights-runtime-extractor-v59t5\" (UID: \"44e7e45c-b61b-4afd-a19e-048bca27595e\") " pod="openshift-insights/insights-runtime-extractor-v59t5" Jun 08 08:25:44.287533 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:44.287415 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/44e7e45c-b61b-4afd-a19e-048bca27595e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v59t5\" (UID: \"44e7e45c-b61b-4afd-a19e-048bca27595e\") " pod="openshift-insights/insights-runtime-extractor-v59t5" Jun 08 08:25:44.287533 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:44.287437 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/44e7e45c-b61b-4afd-a19e-048bca27595e-data-volume\") pod \"insights-runtime-extractor-v59t5\" (UID: \"44e7e45c-b61b-4afd-a19e-048bca27595e\") " pod="openshift-insights/insights-runtime-extractor-v59t5" Jun 08 08:25:44.287533 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:44.287454 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/44e7e45c-b61b-4afd-a19e-048bca27595e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v59t5\" (UID: \"44e7e45c-b61b-4afd-a19e-048bca27595e\") " pod="openshift-insights/insights-runtime-extractor-v59t5" Jun 08 08:25:44.287533 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:44.287520 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w62q8\" (UniqueName: \"kubernetes.io/projected/44e7e45c-b61b-4afd-a19e-048bca27595e-kube-api-access-w62q8\") pod \"insights-runtime-extractor-v59t5\" (UID: \"44e7e45c-b61b-4afd-a19e-048bca27595e\") " pod="openshift-insights/insights-runtime-extractor-v59t5" Jun 08 08:25:44.388002 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:44.387972 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/44e7e45c-b61b-4afd-a19e-048bca27595e-crio-socket\") pod \"insights-runtime-extractor-v59t5\" (UID: \"44e7e45c-b61b-4afd-a19e-048bca27595e\") " pod="openshift-insights/insights-runtime-extractor-v59t5" Jun 08 08:25:44.388147 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:44.388010 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/44e7e45c-b61b-4afd-a19e-048bca27595e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v59t5\" (UID: \"44e7e45c-b61b-4afd-a19e-048bca27595e\") " pod="openshift-insights/insights-runtime-extractor-v59t5" Jun 08 08:25:44.388147 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:44.388031 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/44e7e45c-b61b-4afd-a19e-048bca27595e-data-volume\") pod \"insights-runtime-extractor-v59t5\" (UID: \"44e7e45c-b61b-4afd-a19e-048bca27595e\") " pod="openshift-insights/insights-runtime-extractor-v59t5" Jun 08 08:25:44.388147 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:44.388096 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/44e7e45c-b61b-4afd-a19e-048bca27595e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v59t5\" (UID: \"44e7e45c-b61b-4afd-a19e-048bca27595e\") " pod="openshift-insights/insights-runtime-extractor-v59t5" Jun 08 08:25:44.388147 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:44.388135 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w62q8\" (UniqueName: \"kubernetes.io/projected/44e7e45c-b61b-4afd-a19e-048bca27595e-kube-api-access-w62q8\") pod \"insights-runtime-extractor-v59t5\" (UID: \"44e7e45c-b61b-4afd-a19e-048bca27595e\") " pod="openshift-insights/insights-runtime-extractor-v59t5" Jun 08 08:25:44.388340 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:44.388101 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/44e7e45c-b61b-4afd-a19e-048bca27595e-crio-socket\") pod \"insights-runtime-extractor-v59t5\" (UID: \"44e7e45c-b61b-4afd-a19e-048bca27595e\") " pod="openshift-insights/insights-runtime-extractor-v59t5" Jun 08 08:25:44.388398 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:44.388365 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/44e7e45c-b61b-4afd-a19e-048bca27595e-data-volume\") pod \"insights-runtime-extractor-v59t5\" (UID: \"44e7e45c-b61b-4afd-a19e-048bca27595e\") " pod="openshift-insights/insights-runtime-extractor-v59t5" Jun 08 08:25:44.388625 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:44.388604 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/44e7e45c-b61b-4afd-a19e-048bca27595e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v59t5\" (UID: \"44e7e45c-b61b-4afd-a19e-048bca27595e\") " pod="openshift-insights/insights-runtime-extractor-v59t5" Jun 08 08:25:44.390163 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:44.390148 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/44e7e45c-b61b-4afd-a19e-048bca27595e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v59t5\" (UID: \"44e7e45c-b61b-4afd-a19e-048bca27595e\") " pod="openshift-insights/insights-runtime-extractor-v59t5" Jun 08 08:25:44.399262 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:44.399241 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w62q8\" (UniqueName: \"kubernetes.io/projected/44e7e45c-b61b-4afd-a19e-048bca27595e-kube-api-access-w62q8\") pod \"insights-runtime-extractor-v59t5\" (UID: \"44e7e45c-b61b-4afd-a19e-048bca27595e\") " pod="openshift-insights/insights-runtime-extractor-v59t5" Jun 08 08:25:44.516172 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:44.516117 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-v59t5" Jun 08 08:25:44.640810 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:44.640776 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-v59t5"] Jun 08 08:25:44.643702 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:25:44.643678 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44e7e45c_b61b_4afd_a19e_048bca27595e.slice/crio-99b3d5fbba6d995796b18f0a5af612ffdabe8e61c25b53439e5d5970f335298d WatchSource:0}: Error finding container 99b3d5fbba6d995796b18f0a5af612ffdabe8e61c25b53439e5d5970f335298d: Status 404 returned error can't find the container with id 99b3d5fbba6d995796b18f0a5af612ffdabe8e61c25b53439e5d5970f335298d Jun 08 08:25:45.003185 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:45.003159 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-v59t5" event={"ID":"44e7e45c-b61b-4afd-a19e-048bca27595e","Type":"ContainerStarted","Data":"0d6b583635dac53f920f9f2980eafd13e2b2a7726609408b1f4e9ac969dc88dd"} Jun 08 08:25:45.003327 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:45.003216 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-v59t5" event={"ID":"44e7e45c-b61b-4afd-a19e-048bca27595e","Type":"ContainerStarted","Data":"99b3d5fbba6d995796b18f0a5af612ffdabe8e61c25b53439e5d5970f335298d"} Jun 08 08:25:46.008520 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:46.008484 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-v59t5" event={"ID":"44e7e45c-b61b-4afd-a19e-048bca27595e","Type":"ContainerStarted","Data":"f39e7257761b3a3002c1a3a57c33776f552224499e33037e67a0108ae10c1bd4"} Jun 08 08:25:47.012843 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:47.012771 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-v59t5" event={"ID":"44e7e45c-b61b-4afd-a19e-048bca27595e","Type":"ContainerStarted","Data":"80384a3392f118131d21c7f9ffc0050752dd274ac724d92ef161152b2ff10e5a"} Jun 08 08:25:47.050558 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:47.050514 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-v59t5" podStartSLOduration=1.036813269 podStartE2EDuration="3.050499387s" totalImagesPullingTime="2.013686118s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 08:25:44 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 08:25:47.049996032 +0000 UTC m=+258.304207490" watchObservedRunningTime="2026-06-08 08:25:47.050499387 +0000 UTC m=+258.304710836" Jun 08 08:25:52.558454 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:52.558380 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-xl9sb"] Jun 08 08:25:52.561442 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:52.561426 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-xl9sb" Jun 08 08:25:52.564341 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:52.564323 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 08 08:25:52.564827 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:52.564813 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-jk5xl\"" Jun 08 08:25:52.571167 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:52.571147 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-xl9sb"] Jun 08 08:25:52.647216 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:52.647191 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8fc38247-6a93-4d19-af10-1fe008db28f1-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-xl9sb\" (UID: \"8fc38247-6a93-4d19-af10-1fe008db28f1\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-xl9sb" Jun 08 08:25:52.747589 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:52.747569 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8fc38247-6a93-4d19-af10-1fe008db28f1-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-xl9sb\" (UID: \"8fc38247-6a93-4d19-af10-1fe008db28f1\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-xl9sb" Jun 08 08:25:52.747692 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:25:52.747678 2570 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jun 08 08:25:52.747754 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:25:52.747745 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8fc38247-6a93-4d19-af10-1fe008db28f1-tls-certificates podName:8fc38247-6a93-4d19-af10-1fe008db28f1 nodeName:}" failed. No retries permitted until 2026-06-08 08:25:53.247729004 +0000 UTC m=+264.501940434 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/8fc38247-6a93-4d19-af10-1fe008db28f1-tls-certificates") pod "prometheus-operator-admission-webhook-5b6b8f594-xl9sb" (UID: "8fc38247-6a93-4d19-af10-1fe008db28f1") : secret "prometheus-operator-admission-webhook-tls" not found Jun 08 08:25:53.251703 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:53.251677 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8fc38247-6a93-4d19-af10-1fe008db28f1-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-xl9sb\" (UID: \"8fc38247-6a93-4d19-af10-1fe008db28f1\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-xl9sb" Jun 08 08:25:53.253914 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:53.253897 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8fc38247-6a93-4d19-af10-1fe008db28f1-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-xl9sb\" (UID: \"8fc38247-6a93-4d19-af10-1fe008db28f1\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-xl9sb" Jun 08 08:25:53.469156 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:53.469128 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-xl9sb" Jun 08 08:25:53.582971 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:53.582904 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-xl9sb"] Jun 08 08:25:53.586355 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:25:53.586329 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fc38247_6a93_4d19_af10_1fe008db28f1.slice/crio-c884ca6b3b2dfad2d1edf31015ce3b1f2916c425f3d5f07a92d239ee3e89921d WatchSource:0}: Error finding container c884ca6b3b2dfad2d1edf31015ce3b1f2916c425f3d5f07a92d239ee3e89921d: Status 404 returned error can't find the container with id c884ca6b3b2dfad2d1edf31015ce3b1f2916c425f3d5f07a92d239ee3e89921d Jun 08 08:25:54.035357 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:54.035323 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-xl9sb" event={"ID":"8fc38247-6a93-4d19-af10-1fe008db28f1","Type":"ContainerStarted","Data":"c884ca6b3b2dfad2d1edf31015ce3b1f2916c425f3d5f07a92d239ee3e89921d"} Jun 08 08:25:55.039758 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:55.039725 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-xl9sb" event={"ID":"8fc38247-6a93-4d19-af10-1fe008db28f1","Type":"ContainerStarted","Data":"04263d587188625493582fd129fb201033331f3d0999c6ab33d26a6905d86ae5"} Jun 08 08:25:55.040098 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:55.039943 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-xl9sb" Jun 08 08:25:55.044539 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:55.044522 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-xl9sb" Jun 08 08:25:55.057917 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:55.057880 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-xl9sb" podStartSLOduration=2.163518866 podStartE2EDuration="3.057867171s" totalImagesPullingTime="894.348305ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 08:25:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 08:25:55.056908875 +0000 UTC m=+266.311120337" watchObservedRunningTime="2026-06-08 08:25:55.057867171 +0000 UTC m=+266.312078619" Jun 08 08:25:55.636701 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:55.636671 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-cl5jh"] Jun 08 08:25:55.638516 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:55.638501 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-cl5jh" Jun 08 08:25:55.642860 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:55.642838 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 08 08:25:55.643002 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:55.642881 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 08 08:25:55.643002 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:55.642884 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 08 08:25:55.643002 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:55.642992 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 08 08:25:55.643235 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:55.643119 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-7fwv5\"" Jun 08 08:25:55.643332 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:55.643301 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 08 08:25:55.657155 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:55.657133 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-cl5jh"] Jun 08 08:25:55.771200 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:55.771148 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9391e286-fc1c-4693-9ef7-5d2e1151b2ad-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-cl5jh\" (UID: \"9391e286-fc1c-4693-9ef7-5d2e1151b2ad\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-cl5jh" Jun 08 08:25:55.771384 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:55.771209 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8wml\" (UniqueName: \"kubernetes.io/projected/9391e286-fc1c-4693-9ef7-5d2e1151b2ad-kube-api-access-m8wml\") pod \"prometheus-operator-7f7d445d84-cl5jh\" (UID: \"9391e286-fc1c-4693-9ef7-5d2e1151b2ad\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-cl5jh" Jun 08 08:25:55.771384 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:55.771240 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9391e286-fc1c-4693-9ef7-5d2e1151b2ad-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-cl5jh\" (UID: \"9391e286-fc1c-4693-9ef7-5d2e1151b2ad\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-cl5jh" Jun 08 08:25:55.771384 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:55.771301 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/9391e286-fc1c-4693-9ef7-5d2e1151b2ad-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-cl5jh\" (UID: \"9391e286-fc1c-4693-9ef7-5d2e1151b2ad\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-cl5jh" Jun 08 08:25:55.872377 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:55.872343 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/9391e286-fc1c-4693-9ef7-5d2e1151b2ad-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-cl5jh\" (UID: \"9391e286-fc1c-4693-9ef7-5d2e1151b2ad\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-cl5jh" Jun 08 08:25:55.872534 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:55.872394 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9391e286-fc1c-4693-9ef7-5d2e1151b2ad-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-cl5jh\" (UID: \"9391e286-fc1c-4693-9ef7-5d2e1151b2ad\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-cl5jh" Jun 08 08:25:55.872534 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:25:55.872493 2570 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jun 08 08:25:55.872534 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:55.872503 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8wml\" (UniqueName: \"kubernetes.io/projected/9391e286-fc1c-4693-9ef7-5d2e1151b2ad-kube-api-access-m8wml\") pod \"prometheus-operator-7f7d445d84-cl5jh\" (UID: \"9391e286-fc1c-4693-9ef7-5d2e1151b2ad\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-cl5jh" Jun 08 08:25:55.872681 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:55.872534 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9391e286-fc1c-4693-9ef7-5d2e1151b2ad-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-cl5jh\" (UID: \"9391e286-fc1c-4693-9ef7-5d2e1151b2ad\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-cl5jh" Jun 08 08:25:55.872681 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:25:55.872560 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9391e286-fc1c-4693-9ef7-5d2e1151b2ad-prometheus-operator-tls podName:9391e286-fc1c-4693-9ef7-5d2e1151b2ad nodeName:}" failed. No retries permitted until 2026-06-08 08:25:56.372537466 +0000 UTC m=+267.626748896 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/9391e286-fc1c-4693-9ef7-5d2e1151b2ad-prometheus-operator-tls") pod "prometheus-operator-7f7d445d84-cl5jh" (UID: "9391e286-fc1c-4693-9ef7-5d2e1151b2ad") : secret "prometheus-operator-tls" not found Jun 08 08:25:55.873001 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:55.872986 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9391e286-fc1c-4693-9ef7-5d2e1151b2ad-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-cl5jh\" (UID: \"9391e286-fc1c-4693-9ef7-5d2e1151b2ad\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-cl5jh" Jun 08 08:25:55.874824 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:55.874805 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9391e286-fc1c-4693-9ef7-5d2e1151b2ad-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-cl5jh\" (UID: \"9391e286-fc1c-4693-9ef7-5d2e1151b2ad\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-cl5jh" Jun 08 08:25:55.886184 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:55.886158 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8wml\" (UniqueName: \"kubernetes.io/projected/9391e286-fc1c-4693-9ef7-5d2e1151b2ad-kube-api-access-m8wml\") pod \"prometheus-operator-7f7d445d84-cl5jh\" (UID: \"9391e286-fc1c-4693-9ef7-5d2e1151b2ad\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-cl5jh" Jun 08 08:25:56.376154 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:56.376123 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/9391e286-fc1c-4693-9ef7-5d2e1151b2ad-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-cl5jh\" (UID: \"9391e286-fc1c-4693-9ef7-5d2e1151b2ad\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-cl5jh" Jun 08 08:25:56.378220 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:56.378202 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/9391e286-fc1c-4693-9ef7-5d2e1151b2ad-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-cl5jh\" (UID: \"9391e286-fc1c-4693-9ef7-5d2e1151b2ad\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-cl5jh" Jun 08 08:25:56.547247 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:56.547224 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-cl5jh" Jun 08 08:25:56.663247 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:56.663170 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-cl5jh"] Jun 08 08:25:56.665564 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:25:56.665540 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9391e286_fc1c_4693_9ef7_5d2e1151b2ad.slice/crio-5c313dd2414a2247a9426d8dcfd1f60c63b4e966139a6f102d2f789c6d56b653 WatchSource:0}: Error finding container 5c313dd2414a2247a9426d8dcfd1f60c63b4e966139a6f102d2f789c6d56b653: Status 404 returned error can't find the container with id 5c313dd2414a2247a9426d8dcfd1f60c63b4e966139a6f102d2f789c6d56b653 Jun 08 08:25:57.046222 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:57.046136 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-cl5jh" event={"ID":"9391e286-fc1c-4693-9ef7-5d2e1151b2ad","Type":"ContainerStarted","Data":"5c313dd2414a2247a9426d8dcfd1f60c63b4e966139a6f102d2f789c6d56b653"} Jun 08 08:25:58.051441 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:58.051408 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-cl5jh" event={"ID":"9391e286-fc1c-4693-9ef7-5d2e1151b2ad","Type":"ContainerStarted","Data":"2327a7537ea73721c8f378de451ddc8b34307a4af0a224b6703795827b756b0f"} Jun 08 08:25:58.051918 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:58.051463 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-cl5jh" event={"ID":"9391e286-fc1c-4693-9ef7-5d2e1151b2ad","Type":"ContainerStarted","Data":"ca100d5d1c065ff51d692b2f586016a47a67b20cdbca8d18ae5a09d293d807c4"} Jun 08 08:25:58.070255 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:58.070206 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7f7d445d84-cl5jh" podStartSLOduration=2.002360461 podStartE2EDuration="3.070190892s" totalImagesPullingTime="1.067830431s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 08:25:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 08:25:58.068209041 +0000 UTC m=+269.322420491" watchObservedRunningTime="2026-06-08 08:25:58.070190892 +0000 UTC m=+269.324402341" Jun 08 08:25:59.973122 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:59.973088 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-fhhdl"] Jun 08 08:25:59.976445 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:59.976428 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-fhhdl" Jun 08 08:25:59.979439 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:59.979415 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 08 08:25:59.980165 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:59.980148 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-gsvkn\"" Jun 08 08:25:59.980258 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:59.980202 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 08 08:25:59.988511 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:59.988484 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-fhhdl"] Jun 08 08:25:59.995201 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:59.995178 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-qpsdk"] Jun 08 08:25:59.998145 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:25:59.998128 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-qpsdk" Jun 08 08:26:00.001394 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:00.001377 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-25th5\"" Jun 08 08:26:00.001607 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:00.001587 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 08 08:26:00.001740 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:00.001632 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 08 08:26:00.001740 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:00.001635 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 08 08:26:00.005220 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:00.005202 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-c8kdm"] Jun 08 08:26:00.008221 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:00.008203 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-qpsdk"] Jun 08 08:26:00.008308 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:00.008209 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-c8kdm" Jun 08 08:26:00.011048 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:00.011030 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 08 08:26:00.011145 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:00.011095 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 08 08:26:00.011379 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:00.011341 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 08 08:26:00.011462 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:00.011446 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-hgwhz\"" Jun 08 08:26:00.102771 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:00.102729 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4ad642ed-bf50-4646-b788-6f4a143a556e-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-qpsdk\" (UID: \"4ad642ed-bf50-4646-b788-6f4a143a556e\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-qpsdk" Jun 08 08:26:00.102771 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:00.102773 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8ebca971-0e2a-4f4c-b193-be807a351825-root\") pod \"node-exporter-c8kdm\" (UID: \"8ebca971-0e2a-4f4c-b193-be807a351825\") " pod="openshift-monitoring/node-exporter-c8kdm" Jun 08 08:26:00.102978 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:00.102791 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8ebca971-0e2a-4f4c-b193-be807a351825-node-exporter-accelerators-collector-config\") pod \"node-exporter-c8kdm\" (UID: \"8ebca971-0e2a-4f4c-b193-be807a351825\") " pod="openshift-monitoring/node-exporter-c8kdm" Jun 08 08:26:00.102978 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:00.102815 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d79d0e24-b2d3-4224-85ce-4faf5bf603c7-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-fhhdl\" (UID: \"d79d0e24-b2d3-4224-85ce-4faf5bf603c7\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-fhhdl" Jun 08 08:26:00.102978 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:00.102901 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8ebca971-0e2a-4f4c-b193-be807a351825-metrics-client-ca\") pod \"node-exporter-c8kdm\" (UID: \"8ebca971-0e2a-4f4c-b193-be807a351825\") " pod="openshift-monitoring/node-exporter-c8kdm" Jun 08 08:26:00.102978 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:00.102935 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8c2s\" (UniqueName: \"kubernetes.io/projected/4ad642ed-bf50-4646-b788-6f4a143a556e-kube-api-access-s8c2s\") pod \"kube-state-metrics-57bbf8bfb5-qpsdk\" (UID: \"4ad642ed-bf50-4646-b788-6f4a143a556e\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-qpsdk" Jun 08 08:26:00.102978 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:00.102966 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8ebca971-0e2a-4f4c-b193-be807a351825-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-c8kdm\" (UID: \"8ebca971-0e2a-4f4c-b193-be807a351825\") " pod="openshift-monitoring/node-exporter-c8kdm" Jun 08 08:26:00.103149 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:00.102994 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d79d0e24-b2d3-4224-85ce-4faf5bf603c7-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-fhhdl\" (UID: \"d79d0e24-b2d3-4224-85ce-4faf5bf603c7\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-fhhdl" Jun 08 08:26:00.103149 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:00.103031 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-968tr\" (UniqueName: \"kubernetes.io/projected/d79d0e24-b2d3-4224-85ce-4faf5bf603c7-kube-api-access-968tr\") pod \"openshift-state-metrics-65f78d5c66-fhhdl\" (UID: \"d79d0e24-b2d3-4224-85ce-4faf5bf603c7\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-fhhdl" Jun 08 08:26:00.103149 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:00.103062 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/4ad642ed-bf50-4646-b788-6f4a143a556e-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-qpsdk\" (UID: \"4ad642ed-bf50-4646-b788-6f4a143a556e\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-qpsdk" Jun 08 08:26:00.103149 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:00.103077 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8ebca971-0e2a-4f4c-b193-be807a351825-node-exporter-textfile\") pod \"node-exporter-c8kdm\" (UID: \"8ebca971-0e2a-4f4c-b193-be807a351825\") " pod="openshift-monitoring/node-exporter-c8kdm" Jun 08 08:26:00.103149 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:00.103115 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8ebca971-0e2a-4f4c-b193-be807a351825-sys\") pod \"node-exporter-c8kdm\" (UID: \"8ebca971-0e2a-4f4c-b193-be807a351825\") " pod="openshift-monitoring/node-exporter-c8kdm" Jun 08 08:26:00.103149 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:00.103138 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jb9m\" (UniqueName: \"kubernetes.io/projected/8ebca971-0e2a-4f4c-b193-be807a351825-kube-api-access-9jb9m\") pod \"node-exporter-c8kdm\" (UID: \"8ebca971-0e2a-4f4c-b193-be807a351825\") " pod="openshift-monitoring/node-exporter-c8kdm" Jun 08 08:26:00.103344 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:00.103163 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d79d0e24-b2d3-4224-85ce-4faf5bf603c7-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-fhhdl\" (UID: \"d79d0e24-b2d3-4224-85ce-4faf5bf603c7\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-fhhdl" Jun 08 08:26:00.103344 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:00.103187 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4ad642ed-bf50-4646-b788-6f4a143a556e-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-qpsdk\" (UID: \"4ad642ed-bf50-4646-b788-6f4a143a556e\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-qpsdk" Jun 08 08:26:00.103344 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:00.103202 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8ebca971-0e2a-4f4c-b193-be807a351825-node-exporter-tls\") pod \"node-exporter-c8kdm\" (UID: \"8ebca971-0e2a-4f4c-b193-be807a351825\") " pod="openshift-monitoring/node-exporter-c8kdm" Jun 08 08:26:00.103344 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:00.103227 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4ad642ed-bf50-4646-b788-6f4a143a556e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-qpsdk\" (UID: \"4ad642ed-bf50-4646-b788-6f4a143a556e\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-qpsdk" Jun 08 08:26:00.103344 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:00.103250 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/4ad642ed-bf50-4646-b788-6f4a143a556e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-qpsdk\" (UID: \"4ad642ed-bf50-4646-b788-6f4a143a556e\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-qpsdk" Jun 08 08:26:00.103344 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:00.103268 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8ebca971-0e2a-4f4c-b193-be807a351825-node-exporter-wtmp\") pod \"node-exporter-c8kdm\" (UID: \"8ebca971-0e2a-4f4c-b193-be807a351825\") " pod="openshift-monitoring/node-exporter-c8kdm" Jun 08 08:26:00.203693 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:00.203663 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-968tr\" (UniqueName: \"kubernetes.io/projected/d79d0e24-b2d3-4224-85ce-4faf5bf603c7-kube-api-access-968tr\") pod \"openshift-state-metrics-65f78d5c66-fhhdl\" (UID: \"d79d0e24-b2d3-4224-85ce-4faf5bf603c7\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-fhhdl" Jun 08 08:26:00.203897 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:00.203699 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/4ad642ed-bf50-4646-b788-6f4a143a556e-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-qpsdk\" (UID: \"4ad642ed-bf50-4646-b788-6f4a143a556e\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-qpsdk" Jun 08 08:26:00.203897 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:00.203733 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8ebca971-0e2a-4f4c-b193-be807a351825-node-exporter-textfile\") pod \"node-exporter-c8kdm\" (UID: \"8ebca971-0e2a-4f4c-b193-be807a351825\") " pod="openshift-monitoring/node-exporter-c8kdm" Jun 08 08:26:00.203897 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:00.203753 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8ebca971-0e2a-4f4c-b193-be807a351825-sys\") pod \"node-exporter-c8kdm\" (UID: \"8ebca971-0e2a-4f4c-b193-be807a351825\") " pod="openshift-monitoring/node-exporter-c8kdm" Jun 08 08:26:00.203897 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:00.203770 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jb9m\" (UniqueName: \"kubernetes.io/projected/8ebca971-0e2a-4f4c-b193-be807a351825-kube-api-access-9jb9m\") pod \"node-exporter-c8kdm\" (UID: \"8ebca971-0e2a-4f4c-b193-be807a351825\") " pod="openshift-monitoring/node-exporter-c8kdm" Jun 08 08:26:00.203897 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:00.203787 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d79d0e24-b2d3-4224-85ce-4faf5bf603c7-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-fhhdl\" (UID: \"d79d0e24-b2d3-4224-85ce-4faf5bf603c7\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-fhhdl" Jun 08 08:26:00.203897 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:00.203817 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4ad642ed-bf50-4646-b788-6f4a143a556e-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-qpsdk\" (UID: \"4ad642ed-bf50-4646-b788-6f4a143a556e\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-qpsdk" Jun 08 08:26:00.203897 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:00.203827 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8ebca971-0e2a-4f4c-b193-be807a351825-sys\") pod \"node-exporter-c8kdm\" (UID: \"8ebca971-0e2a-4f4c-b193-be807a351825\") " pod="openshift-monitoring/node-exporter-c8kdm" Jun 08 08:26:00.203897 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:00.203835 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8ebca971-0e2a-4f4c-b193-be807a351825-node-exporter-tls\") pod \"node-exporter-c8kdm\" (UID: \"8ebca971-0e2a-4f4c-b193-be807a351825\") " pod="openshift-monitoring/node-exporter-c8kdm" Jun 08 08:26:00.203897 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:00.203889 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4ad642ed-bf50-4646-b788-6f4a143a556e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-qpsdk\" (UID: \"4ad642ed-bf50-4646-b788-6f4a143a556e\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-qpsdk" Jun 08 08:26:00.204349 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:00.203920 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/4ad642ed-bf50-4646-b788-6f4a143a556e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-qpsdk\" (UID: \"4ad642ed-bf50-4646-b788-6f4a143a556e\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-qpsdk" Jun 08 08:26:00.204349 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:00.203953 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8ebca971-0e2a-4f4c-b193-be807a351825-node-exporter-wtmp\") pod \"node-exporter-c8kdm\" (UID: \"8ebca971-0e2a-4f4c-b193-be807a351825\") " pod="openshift-monitoring/node-exporter-c8kdm" Jun 08 08:26:00.204349 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:26:00.203971 2570 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jun 08 08:26:00.204349 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:00.203980 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4ad642ed-bf50-4646-b788-6f4a143a556e-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-qpsdk\" (UID: \"4ad642ed-bf50-4646-b788-6f4a143a556e\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-qpsdk" Jun 08 08:26:00.204349 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:00.204003 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8ebca971-0e2a-4f4c-b193-be807a351825-root\") pod \"node-exporter-c8kdm\" (UID: \"8ebca971-0e2a-4f4c-b193-be807a351825\") " pod="openshift-monitoring/node-exporter-c8kdm" Jun 08 08:26:00.204349 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:00.204028 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8ebca971-0e2a-4f4c-b193-be807a351825-node-exporter-accelerators-collector-config\") pod \"node-exporter-c8kdm\" (UID: \"8ebca971-0e2a-4f4c-b193-be807a351825\") " pod="openshift-monitoring/node-exporter-c8kdm" Jun 08 08:26:00.204349 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:26:00.204045 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d79d0e24-b2d3-4224-85ce-4faf5bf603c7-openshift-state-metrics-tls podName:d79d0e24-b2d3-4224-85ce-4faf5bf603c7 nodeName:}" failed. No retries permitted until 2026-06-08 08:26:00.704024286 +0000 UTC m=+271.958235726 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/d79d0e24-b2d3-4224-85ce-4faf5bf603c7-openshift-state-metrics-tls") pod "openshift-state-metrics-65f78d5c66-fhhdl" (UID: "d79d0e24-b2d3-4224-85ce-4faf5bf603c7") : secret "openshift-state-metrics-tls" not found Jun 08 08:26:00.204349 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:00.204171 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8ebca971-0e2a-4f4c-b193-be807a351825-node-exporter-textfile\") pod \"node-exporter-c8kdm\" (UID: \"8ebca971-0e2a-4f4c-b193-be807a351825\") " pod="openshift-monitoring/node-exporter-c8kdm" Jun 08 08:26:00.204349 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:00.204191 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/4ad642ed-bf50-4646-b788-6f4a143a556e-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-qpsdk\" (UID: \"4ad642ed-bf50-4646-b788-6f4a143a556e\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-qpsdk" Jun 08 08:26:00.204349 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:00.204172 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8ebca971-0e2a-4f4c-b193-be807a351825-node-exporter-wtmp\") pod \"node-exporter-c8kdm\" (UID: \"8ebca971-0e2a-4f4c-b193-be807a351825\") " pod="openshift-monitoring/node-exporter-c8kdm" Jun 08 08:26:00.204349 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:00.204279 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d79d0e24-b2d3-4224-85ce-4faf5bf603c7-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-fhhdl\" (UID: \"d79d0e24-b2d3-4224-85ce-4faf5bf603c7\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-fhhdl" Jun 08 08:26:00.204927 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:00.204365 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8ebca971-0e2a-4f4c-b193-be807a351825-metrics-client-ca\") pod \"node-exporter-c8kdm\" (UID: \"8ebca971-0e2a-4f4c-b193-be807a351825\") " pod="openshift-monitoring/node-exporter-c8kdm" Jun 08 08:26:00.204927 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:00.204405 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8c2s\" (UniqueName: \"kubernetes.io/projected/4ad642ed-bf50-4646-b788-6f4a143a556e-kube-api-access-s8c2s\") pod \"kube-state-metrics-57bbf8bfb5-qpsdk\" (UID: \"4ad642ed-bf50-4646-b788-6f4a143a556e\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-qpsdk" Jun 08 08:26:00.204927 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:00.204434 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8ebca971-0e2a-4f4c-b193-be807a351825-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-c8kdm\" (UID: \"8ebca971-0e2a-4f4c-b193-be807a351825\") " pod="openshift-monitoring/node-exporter-c8kdm" Jun 08 08:26:00.204927 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:00.204459 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d79d0e24-b2d3-4224-85ce-4faf5bf603c7-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-fhhdl\" (UID: \"d79d0e24-b2d3-4224-85ce-4faf5bf603c7\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-fhhdl" Jun 08 08:26:00.204927 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:00.204619 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8ebca971-0e2a-4f4c-b193-be807a351825-node-exporter-accelerators-collector-config\") pod \"node-exporter-c8kdm\" (UID: \"8ebca971-0e2a-4f4c-b193-be807a351825\") " pod="openshift-monitoring/node-exporter-c8kdm" Jun 08 08:26:00.204927 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:00.204682 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8ebca971-0e2a-4f4c-b193-be807a351825-root\") pod \"node-exporter-c8kdm\" (UID: \"8ebca971-0e2a-4f4c-b193-be807a351825\") " pod="openshift-monitoring/node-exporter-c8kdm" Jun 08 08:26:00.205305 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:00.204954 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4ad642ed-bf50-4646-b788-6f4a143a556e-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-qpsdk\" (UID: \"4ad642ed-bf50-4646-b788-6f4a143a556e\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-qpsdk" Jun 08 08:26:00.205305 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:00.205144 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d79d0e24-b2d3-4224-85ce-4faf5bf603c7-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-fhhdl\" (UID: \"d79d0e24-b2d3-4224-85ce-4faf5bf603c7\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-fhhdl" Jun 08 08:26:00.205404 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:00.205371 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8ebca971-0e2a-4f4c-b193-be807a351825-metrics-client-ca\") pod \"node-exporter-c8kdm\" (UID: \"8ebca971-0e2a-4f4c-b193-be807a351825\") " pod="openshift-monitoring/node-exporter-c8kdm" Jun 08 08:26:00.205684 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:00.205662 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/4ad642ed-bf50-4646-b788-6f4a143a556e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-qpsdk\" (UID: \"4ad642ed-bf50-4646-b788-6f4a143a556e\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-qpsdk" Jun 08 08:26:00.206856 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:00.206829 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d79d0e24-b2d3-4224-85ce-4faf5bf603c7-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-fhhdl\" (UID: \"d79d0e24-b2d3-4224-85ce-4faf5bf603c7\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-fhhdl" Jun 08 08:26:00.206954 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:00.206865 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8ebca971-0e2a-4f4c-b193-be807a351825-node-exporter-tls\") pod \"node-exporter-c8kdm\" (UID: \"8ebca971-0e2a-4f4c-b193-be807a351825\") " pod="openshift-monitoring/node-exporter-c8kdm" Jun 08 08:26:00.206954 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:00.206872 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4ad642ed-bf50-4646-b788-6f4a143a556e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-qpsdk\" (UID: \"4ad642ed-bf50-4646-b788-6f4a143a556e\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-qpsdk" Jun 08 08:26:00.206954 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:00.206924 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4ad642ed-bf50-4646-b788-6f4a143a556e-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-qpsdk\" (UID: \"4ad642ed-bf50-4646-b788-6f4a143a556e\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-qpsdk" Jun 08 08:26:00.207236 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:00.207217 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8ebca971-0e2a-4f4c-b193-be807a351825-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-c8kdm\" (UID: \"8ebca971-0e2a-4f4c-b193-be807a351825\") " pod="openshift-monitoring/node-exporter-c8kdm" Jun 08 08:26:00.214359 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:00.214338 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jb9m\" (UniqueName: \"kubernetes.io/projected/8ebca971-0e2a-4f4c-b193-be807a351825-kube-api-access-9jb9m\") pod \"node-exporter-c8kdm\" (UID: \"8ebca971-0e2a-4f4c-b193-be807a351825\") " pod="openshift-monitoring/node-exporter-c8kdm" Jun 08 08:26:00.214863 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:00.214839 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-968tr\" (UniqueName: \"kubernetes.io/projected/d79d0e24-b2d3-4224-85ce-4faf5bf603c7-kube-api-access-968tr\") pod \"openshift-state-metrics-65f78d5c66-fhhdl\" (UID: \"d79d0e24-b2d3-4224-85ce-4faf5bf603c7\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-fhhdl" Jun 08 08:26:00.214974 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:00.214957 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8c2s\" (UniqueName: \"kubernetes.io/projected/4ad642ed-bf50-4646-b788-6f4a143a556e-kube-api-access-s8c2s\") pod \"kube-state-metrics-57bbf8bfb5-qpsdk\" (UID: \"4ad642ed-bf50-4646-b788-6f4a143a556e\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-qpsdk" Jun 08 08:26:00.306340 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:00.306317 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-qpsdk" Jun 08 08:26:00.316578 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:00.316558 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-c8kdm" Jun 08 08:26:00.331132 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:26:00.331103 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ebca971_0e2a_4f4c_b193_be807a351825.slice/crio-cd3fc68ce67cfc753bb79ff3ecda329c4c90bebef12e923eca0bdd33e0670ceb WatchSource:0}: Error finding container cd3fc68ce67cfc753bb79ff3ecda329c4c90bebef12e923eca0bdd33e0670ceb: Status 404 returned error can't find the container with id cd3fc68ce67cfc753bb79ff3ecda329c4c90bebef12e923eca0bdd33e0670ceb Jun 08 08:26:00.431191 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:00.431164 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-qpsdk"] Jun 08 08:26:00.433931 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:26:00.433906 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ad642ed_bf50_4646_b788_6f4a143a556e.slice/crio-8da318e17e706ac0eb54f265bf0834b14de84f82c275977c4e67105522efbc4d WatchSource:0}: Error finding container 8da318e17e706ac0eb54f265bf0834b14de84f82c275977c4e67105522efbc4d: Status 404 returned error can't find the container with id 8da318e17e706ac0eb54f265bf0834b14de84f82c275977c4e67105522efbc4d Jun 08 08:26:00.709066 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:00.709002 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d79d0e24-b2d3-4224-85ce-4faf5bf603c7-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-fhhdl\" (UID: \"d79d0e24-b2d3-4224-85ce-4faf5bf603c7\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-fhhdl" Jun 08 08:26:00.711094 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:00.711077 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d79d0e24-b2d3-4224-85ce-4faf5bf603c7-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-fhhdl\" (UID: \"d79d0e24-b2d3-4224-85ce-4faf5bf603c7\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-fhhdl" Jun 08 08:26:00.885610 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:00.885579 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-fhhdl" Jun 08 08:26:01.053252 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:01.053130 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 08:26:01.057438 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:01.057413 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 08 08:26:01.065420 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:26:01.064999 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd79d0e24_b2d3_4224_85ce_4faf5bf603c7.slice/crio-e8013c2bb10733ce3c9035cbbf2cd2a8e38fda4832dc8fb25750f7a8ccdea9ed WatchSource:0}: Error finding container e8013c2bb10733ce3c9035cbbf2cd2a8e38fda4832dc8fb25750f7a8ccdea9ed: Status 404 returned error can't find the container with id e8013c2bb10733ce3c9035cbbf2cd2a8e38fda4832dc8fb25750f7a8ccdea9ed Jun 08 08:26:01.065420 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:01.065192 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-qpsdk" event={"ID":"4ad642ed-bf50-4646-b788-6f4a143a556e","Type":"ContainerStarted","Data":"8da318e17e706ac0eb54f265bf0834b14de84f82c275977c4e67105522efbc4d"} Jun 08 08:26:01.066764 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:01.066571 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-c8kdm" event={"ID":"8ebca971-0e2a-4f4c-b193-be807a351825","Type":"ContainerStarted","Data":"cd3fc68ce67cfc753bb79ff3ecda329c4c90bebef12e923eca0bdd33e0670ceb"} Jun 08 08:26:01.074627 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:01.074600 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-fhhdl"] Jun 08 08:26:01.075690 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:01.075578 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-wgcs8\"" Jun 08 08:26:01.075815 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:01.075670 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 08 08:26:01.075883 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:01.075740 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 08 08:26:01.075883 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:01.075777 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 08 08:26:01.075981 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:01.075745 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 08 08:26:01.075981 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:01.075789 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 08 08:26:01.076079 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:01.075740 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 08 08:26:01.076158 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:01.076140 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 08 08:26:01.076218 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:01.076178 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 08 08:26:01.076268 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:01.076139 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 08 08:26:01.103775 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:01.103664 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 08:26:01.214378 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:01.214347 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 08:26:01.214543 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:01.214403 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 08:26:01.214543 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:01.214442 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 08:26:01.214543 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:01.214469 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4-web-config\") pod \"alertmanager-main-0\" (UID: \"ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 08:26:01.214543 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:01.214496 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4-config-volume\") pod \"alertmanager-main-0\" (UID: \"ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 08:26:01.214781 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:01.214560 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46t6s\" (UniqueName: \"kubernetes.io/projected/ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4-kube-api-access-46t6s\") pod \"alertmanager-main-0\" (UID: \"ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 08:26:01.214781 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:01.214623 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4-config-out\") pod \"alertmanager-main-0\" (UID: \"ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 08:26:01.214781 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:01.214653 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 08:26:01.214781 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:01.214676 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 08:26:01.214781 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:01.214744 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 08:26:01.215033 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:01.214788 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 08:26:01.215033 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:01.214823 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 08:26:01.215033 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:01.214859 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 08:26:01.316776 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:01.316739 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 08:26:01.316967 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:01.316797 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 08:26:01.316967 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:01.316849 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 08:26:01.316967 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:01.316884 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 08:26:01.316967 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:01.316917 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 08:26:01.316967 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:01.316937 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4-web-config\") pod \"alertmanager-main-0\" (UID: \"ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 08:26:01.316967 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:01.316960 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4-config-volume\") pod \"alertmanager-main-0\" (UID: \"ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 08:26:01.317279 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:01.316996 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46t6s\" (UniqueName: \"kubernetes.io/projected/ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4-kube-api-access-46t6s\") pod \"alertmanager-main-0\" (UID: \"ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 08:26:01.317279 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:01.317022 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4-config-out\") pod \"alertmanager-main-0\" (UID: \"ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 08:26:01.317279 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:01.317045 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 08:26:01.317279 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:01.317067 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 08:26:01.317279 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:01.317105 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 08:26:01.317279 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:01.317138 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 08:26:01.317279 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:26:01.317263 2570 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jun 08 08:26:01.317749 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:26:01.317314 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4-secret-alertmanager-main-tls podName:ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4 nodeName:}" failed. No retries permitted until 2026-06-08 08:26:01.817297921 +0000 UTC m=+273.071509364 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4") : secret "alertmanager-main-tls" not found Jun 08 08:26:01.317749 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:01.317681 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 08:26:01.318626 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:01.318603 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 08:26:01.319068 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:01.319047 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 08:26:01.320112 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:01.320090 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 08:26:01.321043 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:01.321008 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4-web-config\") pod \"alertmanager-main-0\" (UID: \"ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 08:26:01.321398 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:01.321374 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4-config-out\") pod \"alertmanager-main-0\" (UID: \"ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 08:26:01.321629 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:01.321607 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 08:26:01.322491 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:01.322445 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 08:26:01.322976 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:01.322929 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 08:26:01.323154 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:01.323137 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4-config-volume\") pod \"alertmanager-main-0\" (UID: \"ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 08:26:01.323223 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:01.323202 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 08:26:01.327243 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:01.327221 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-46t6s\" (UniqueName: \"kubernetes.io/projected/ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4-kube-api-access-46t6s\") pod \"alertmanager-main-0\" (UID: \"ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 08:26:01.821997 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:01.821962 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 08:26:01.824407 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:01.824376 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 08:26:01.969619 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:01.969597 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 08 08:26:02.073764 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:02.073730 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-qpsdk" event={"ID":"4ad642ed-bf50-4646-b788-6f4a143a556e","Type":"ContainerStarted","Data":"eb7ac2f35706a256630a7c4978f2a81ea984bd89a13ba856b1005bff6b9cf5c8"} Jun 08 08:26:02.074180 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:02.073845 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-qpsdk" event={"ID":"4ad642ed-bf50-4646-b788-6f4a143a556e","Type":"ContainerStarted","Data":"0d70f6af4b555aa2f329e26a1983185bf001ca14c2142c960d3178d2aa58444f"} Jun 08 08:26:02.074180 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:02.073874 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-qpsdk" event={"ID":"4ad642ed-bf50-4646-b788-6f4a143a556e","Type":"ContainerStarted","Data":"b377cb338a9bc5ebeb9ea463a8155021bd62ae48439f52084bdded1de294a4a4"} Jun 08 08:26:02.075475 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:02.075451 2570 generic.go:356] "Generic (PLEG): container finished" podID="8ebca971-0e2a-4f4c-b193-be807a351825" containerID="aa9c5634066efe505cdeb162df1c8ac803d3b906a8c2e285c7f8aa742d31a48f" exitCode=0 Jun 08 08:26:02.075572 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:02.075532 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-c8kdm" event={"ID":"8ebca971-0e2a-4f4c-b193-be807a351825","Type":"ContainerDied","Data":"aa9c5634066efe505cdeb162df1c8ac803d3b906a8c2e285c7f8aa742d31a48f"} Jun 08 08:26:02.078078 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:02.078036 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-fhhdl" event={"ID":"d79d0e24-b2d3-4224-85ce-4faf5bf603c7","Type":"ContainerStarted","Data":"9431dade18bab135c9e752dbc07aa32c525fbe772df6e1d12e8d12732d3b945d"} Jun 08 08:26:02.078182 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:02.078115 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-fhhdl" event={"ID":"d79d0e24-b2d3-4224-85ce-4faf5bf603c7","Type":"ContainerStarted","Data":"d89285598785165ff50df463c26f72ca70362a64db25b036058d608a82b637d6"} Jun 08 08:26:02.078182 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:02.078145 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-fhhdl" event={"ID":"d79d0e24-b2d3-4224-85ce-4faf5bf603c7","Type":"ContainerStarted","Data":"e8013c2bb10733ce3c9035cbbf2cd2a8e38fda4832dc8fb25750f7a8ccdea9ed"} Jun 08 08:26:02.121449 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:02.121396 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-qpsdk" podStartSLOduration=1.8223478690000001 podStartE2EDuration="3.121377646s" totalImagesPullingTime="1.299029777s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 08:25:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 08:26:02.104877158 +0000 UTC m=+273.359088607" watchObservedRunningTime="2026-06-08 08:26:02.121377646 +0000 UTC m=+273.375589094" Jun 08 08:26:02.123170 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:02.123151 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 08:26:02.126098 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:26:02.126077 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac6f37c6_3b22_49ad_bde4_bec9ba78eeb4.slice/crio-b8bfed01b958322d3c12b3a8d44812551c915a2ab33fe464dffc02cf2f401e09 WatchSource:0}: Error finding container b8bfed01b958322d3c12b3a8d44812551c915a2ab33fe464dffc02cf2f401e09: Status 404 returned error can't find the container with id b8bfed01b958322d3c12b3a8d44812551c915a2ab33fe464dffc02cf2f401e09 Jun 08 08:26:03.084241 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:03.084202 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-c8kdm" event={"ID":"8ebca971-0e2a-4f4c-b193-be807a351825","Type":"ContainerStarted","Data":"be044c0cf584b88b86b027e432a0796d271a20eedd3fdfcdc24fbb234f1164e6"} Jun 08 08:26:03.084683 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:03.084262 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-c8kdm" event={"ID":"8ebca971-0e2a-4f4c-b193-be807a351825","Type":"ContainerStarted","Data":"551360156f18c8a7ff1c8e820658171708dafb501b05efb25fca88c11c26c25e"} Jun 08 08:26:03.086569 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:03.086542 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-fhhdl" event={"ID":"d79d0e24-b2d3-4224-85ce-4faf5bf603c7","Type":"ContainerStarted","Data":"7e8cce91cbe628b6f8b0a3ff84335a187b739887b643d2d8237bcd69e3fbdab4"} Jun 08 08:26:03.087915 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:03.087893 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4","Type":"ContainerStarted","Data":"b8bfed01b958322d3c12b3a8d44812551c915a2ab33fe464dffc02cf2f401e09"} Jun 08 08:26:03.109788 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:03.109747 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-c8kdm" podStartSLOduration=2.678761572 podStartE2EDuration="4.109730751s" totalImagesPullingTime="1.349654065s" totalInitContainerRuntime="81.315114ms" isStatefulPod=true podCreationTimestamp="2026-06-08 08:25:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 08:26:03.108115162 +0000 UTC m=+274.362326637" watchObservedRunningTime="2026-06-08 08:26:03.109730751 +0000 UTC m=+274.363942192" Jun 08 08:26:03.128162 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:03.128105 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-fhhdl" podStartSLOduration=3.22630658 podStartE2EDuration="4.128087692s" totalImagesPullingTime="901.781112ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 08:25:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 08:26:03.127156933 +0000 UTC m=+274.381368397" watchObservedRunningTime="2026-06-08 08:26:03.128087692 +0000 UTC m=+274.382299141" Jun 08 08:26:04.093581 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:04.093549 2570 generic.go:356] "Generic (PLEG): container finished" podID="ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4" containerID="6d6450d591940a1ba4f86f32e7c575680bd8ff50c80f1a7bdfd2ddb75d57fcf6" exitCode=0 Jun 08 08:26:04.094010 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:04.093631 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4","Type":"ContainerDied","Data":"6d6450d591940a1ba4f86f32e7c575680bd8ff50c80f1a7bdfd2ddb75d57fcf6"} Jun 08 08:26:06.103639 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:06.103599 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4","Type":"ContainerStarted","Data":"ad4db40cb30bd388ca19b706356b8aef013e20b843783d2782a03b60e37b9f85"} Jun 08 08:26:06.104068 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:06.103682 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4","Type":"ContainerStarted","Data":"81c3150a0e65c34805e45ea33168e097ec1ce769389dc0c818f42080774d38e8"} Jun 08 08:26:06.104068 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:06.103738 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4","Type":"ContainerStarted","Data":"009febb9e487766e22255251749263f8e6699436b1fac78c217e323f145247cf"} Jun 08 08:26:06.104068 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:06.103781 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4","Type":"ContainerStarted","Data":"12426e356d7b43c1668b226f2eaef43249e7e6a172fc872fcacfeae136ab96ce"} Jun 08 08:26:06.104068 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:06.103823 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4","Type":"ContainerStarted","Data":"8498225aecd99f2264dc60e929c4600fea07f59a02b3f7c9b7e64ba454be3caa"} Jun 08 08:26:06.179056 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:06.178970 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 08:26:06.183429 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:06.183404 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:26:06.186605 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:06.186577 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 08 08:26:06.187118 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:06.187094 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 08 08:26:06.187118 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:06.187119 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 08 08:26:06.187308 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:06.187105 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 08 08:26:06.187308 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:06.187139 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 08 08:26:06.187783 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:06.187766 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 08 08:26:06.188443 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:06.188427 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 08 08:26:06.188546 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:06.188464 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 08 08:26:06.188546 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:06.188537 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-t99tp\"" Jun 08 08:26:06.189148 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:06.188960 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 08 08:26:06.189148 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:06.188973 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-ajfic0apu93nu\"" Jun 08 08:26:06.189315 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:06.189187 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 08 08:26:06.190029 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:06.190006 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 08 08:26:06.190125 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:06.190102 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 08 08:26:06.190184 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:06.190161 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 08 08:26:06.191643 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:06.191621 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 08 08:26:06.192293 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:06.192261 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 08 08:26:06.202347 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:06.202318 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 08:26:06.269671 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:06.269633 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c0722fb-b284-4e40-867f-609097431624-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3c0722fb-b284-4e40-867f-609097431624\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:26:06.269841 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:06.269680 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c0722fb-b284-4e40-867f-609097431624-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3c0722fb-b284-4e40-867f-609097431624\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:26:06.269841 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:06.269743 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8rft\" (UniqueName: \"kubernetes.io/projected/3c0722fb-b284-4e40-867f-609097431624-kube-api-access-s8rft\") pod \"prometheus-k8s-0\" (UID: \"3c0722fb-b284-4e40-867f-609097431624\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:26:06.269841 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:06.269822 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3c0722fb-b284-4e40-867f-609097431624-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3c0722fb-b284-4e40-867f-609097431624\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:26:06.269964 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:06.269850 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3c0722fb-b284-4e40-867f-609097431624-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3c0722fb-b284-4e40-867f-609097431624\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:26:06.269964 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:06.269875 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3c0722fb-b284-4e40-867f-609097431624-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3c0722fb-b284-4e40-867f-609097431624\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:26:06.269964 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:06.269905 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3c0722fb-b284-4e40-867f-609097431624-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3c0722fb-b284-4e40-867f-609097431624\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:26:06.269964 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:06.269935 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3c0722fb-b284-4e40-867f-609097431624-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3c0722fb-b284-4e40-867f-609097431624\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:26:06.270074 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:06.269976 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3c0722fb-b284-4e40-867f-609097431624-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3c0722fb-b284-4e40-867f-609097431624\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:26:06.270074 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:06.270005 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3c0722fb-b284-4e40-867f-609097431624-config\") pod \"prometheus-k8s-0\" (UID: \"3c0722fb-b284-4e40-867f-609097431624\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:26:06.270074 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:06.270059 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3c0722fb-b284-4e40-867f-609097431624-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3c0722fb-b284-4e40-867f-609097431624\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:26:06.270163 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:06.270102 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3c0722fb-b284-4e40-867f-609097431624-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3c0722fb-b284-4e40-867f-609097431624\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:26:06.270163 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:06.270123 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3c0722fb-b284-4e40-867f-609097431624-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3c0722fb-b284-4e40-867f-609097431624\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:26:06.270163 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:06.270149 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3c0722fb-b284-4e40-867f-609097431624-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3c0722fb-b284-4e40-867f-609097431624\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:26:06.270250 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:06.270165 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3c0722fb-b284-4e40-867f-609097431624-web-config\") pod \"prometheus-k8s-0\" (UID: \"3c0722fb-b284-4e40-867f-609097431624\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:26:06.270250 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:06.270188 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3c0722fb-b284-4e40-867f-609097431624-config-out\") pod \"prometheus-k8s-0\" (UID: \"3c0722fb-b284-4e40-867f-609097431624\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:26:06.270250 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:06.270203 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3c0722fb-b284-4e40-867f-609097431624-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3c0722fb-b284-4e40-867f-609097431624\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:26:06.270250 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:06.270219 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c0722fb-b284-4e40-867f-609097431624-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3c0722fb-b284-4e40-867f-609097431624\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:26:06.270250 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:06.270237 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3c0722fb-b284-4e40-867f-609097431624-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3c0722fb-b284-4e40-867f-609097431624\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:26:06.270402 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:06.270277 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3c0722fb-b284-4e40-867f-609097431624-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3c0722fb-b284-4e40-867f-609097431624\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:26:06.371159 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:06.371016 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3c0722fb-b284-4e40-867f-609097431624-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3c0722fb-b284-4e40-867f-609097431624\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:26:06.371159 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:06.371060 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3c0722fb-b284-4e40-867f-609097431624-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3c0722fb-b284-4e40-867f-609097431624\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:26:06.371159 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:06.371089 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3c0722fb-b284-4e40-867f-609097431624-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3c0722fb-b284-4e40-867f-609097431624\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:26:06.371159 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:06.371114 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3c0722fb-b284-4e40-867f-609097431624-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3c0722fb-b284-4e40-867f-609097431624\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:26:06.371159 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:06.371151 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3c0722fb-b284-4e40-867f-609097431624-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3c0722fb-b284-4e40-867f-609097431624\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:26:06.371544 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:06.371181 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3c0722fb-b284-4e40-867f-609097431624-config\") pod \"prometheus-k8s-0\" (UID: \"3c0722fb-b284-4e40-867f-609097431624\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:26:06.371544 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:06.371220 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3c0722fb-b284-4e40-867f-609097431624-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3c0722fb-b284-4e40-867f-609097431624\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:26:06.371544 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:06.371258 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3c0722fb-b284-4e40-867f-609097431624-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3c0722fb-b284-4e40-867f-609097431624\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:26:06.371544 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:06.371288 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3c0722fb-b284-4e40-867f-609097431624-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3c0722fb-b284-4e40-867f-609097431624\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:26:06.371544 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:06.371344 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3c0722fb-b284-4e40-867f-609097431624-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3c0722fb-b284-4e40-867f-609097431624\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:26:06.371544 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:06.371370 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3c0722fb-b284-4e40-867f-609097431624-web-config\") pod \"prometheus-k8s-0\" (UID: \"3c0722fb-b284-4e40-867f-609097431624\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:26:06.371544 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:06.371406 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3c0722fb-b284-4e40-867f-609097431624-config-out\") pod \"prometheus-k8s-0\" (UID: \"3c0722fb-b284-4e40-867f-609097431624\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:26:06.371544 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:06.371433 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3c0722fb-b284-4e40-867f-609097431624-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3c0722fb-b284-4e40-867f-609097431624\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:26:06.371544 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:06.371474 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c0722fb-b284-4e40-867f-609097431624-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3c0722fb-b284-4e40-867f-609097431624\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:26:06.371544 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:06.371504 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3c0722fb-b284-4e40-867f-609097431624-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3c0722fb-b284-4e40-867f-609097431624\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:26:06.371544 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:06.371535 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3c0722fb-b284-4e40-867f-609097431624-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3c0722fb-b284-4e40-867f-609097431624\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:26:06.372164 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:06.371569 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c0722fb-b284-4e40-867f-609097431624-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3c0722fb-b284-4e40-867f-609097431624\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:26:06.372164 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:06.371585 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3c0722fb-b284-4e40-867f-609097431624-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3c0722fb-b284-4e40-867f-609097431624\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:26:06.372164 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:06.371593 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c0722fb-b284-4e40-867f-609097431624-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3c0722fb-b284-4e40-867f-609097431624\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:26:06.372164 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:06.371794 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8rft\" (UniqueName: \"kubernetes.io/projected/3c0722fb-b284-4e40-867f-609097431624-kube-api-access-s8rft\") pod \"prometheus-k8s-0\" (UID: \"3c0722fb-b284-4e40-867f-609097431624\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:26:06.376128 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:06.374548 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3c0722fb-b284-4e40-867f-609097431624-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3c0722fb-b284-4e40-867f-609097431624\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:26:06.376128 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:06.375443 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3c0722fb-b284-4e40-867f-609097431624-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3c0722fb-b284-4e40-867f-609097431624\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:26:06.379320 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:06.376963 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3c0722fb-b284-4e40-867f-609097431624-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3c0722fb-b284-4e40-867f-609097431624\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:26:06.379320 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:06.377403 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c0722fb-b284-4e40-867f-609097431624-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3c0722fb-b284-4e40-867f-609097431624\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:26:06.379538 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:06.379509 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3c0722fb-b284-4e40-867f-609097431624-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3c0722fb-b284-4e40-867f-609097431624\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:26:06.379990 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:06.379654 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c0722fb-b284-4e40-867f-609097431624-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3c0722fb-b284-4e40-867f-609097431624\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:26:06.379990 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:06.379747 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3c0722fb-b284-4e40-867f-609097431624-config-out\") pod \"prometheus-k8s-0\" (UID: \"3c0722fb-b284-4e40-867f-609097431624\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:26:06.379990 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:06.379875 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3c0722fb-b284-4e40-867f-609097431624-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3c0722fb-b284-4e40-867f-609097431624\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:26:06.380585 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:06.380560 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3c0722fb-b284-4e40-867f-609097431624-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3c0722fb-b284-4e40-867f-609097431624\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:26:06.382582 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:06.382557 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c0722fb-b284-4e40-867f-609097431624-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3c0722fb-b284-4e40-867f-609097431624\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:26:06.385748 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:06.384307 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3c0722fb-b284-4e40-867f-609097431624-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3c0722fb-b284-4e40-867f-609097431624\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:26:06.385748 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:06.384597 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3c0722fb-b284-4e40-867f-609097431624-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3c0722fb-b284-4e40-867f-609097431624\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:26:06.385748 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:06.385300 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3c0722fb-b284-4e40-867f-609097431624-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3c0722fb-b284-4e40-867f-609097431624\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:26:06.385748 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:06.385431 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3c0722fb-b284-4e40-867f-609097431624-web-config\") pod \"prometheus-k8s-0\" (UID: \"3c0722fb-b284-4e40-867f-609097431624\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:26:06.385972 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:06.385899 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/3c0722fb-b284-4e40-867f-609097431624-config\") pod \"prometheus-k8s-0\" (UID: \"3c0722fb-b284-4e40-867f-609097431624\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:26:06.386523 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:06.386492 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3c0722fb-b284-4e40-867f-609097431624-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3c0722fb-b284-4e40-867f-609097431624\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:26:06.386916 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:06.386791 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3c0722fb-b284-4e40-867f-609097431624-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3c0722fb-b284-4e40-867f-609097431624\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:26:06.387023 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:06.386940 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3c0722fb-b284-4e40-867f-609097431624-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3c0722fb-b284-4e40-867f-609097431624\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:26:06.388161 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:06.388107 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3c0722fb-b284-4e40-867f-609097431624-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3c0722fb-b284-4e40-867f-609097431624\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:26:06.388418 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:06.388395 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8rft\" (UniqueName: \"kubernetes.io/projected/3c0722fb-b284-4e40-867f-609097431624-kube-api-access-s8rft\") pod \"prometheus-k8s-0\" (UID: \"3c0722fb-b284-4e40-867f-609097431624\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:26:06.496700 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:06.496619 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:26:06.694573 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:06.694549 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 08:26:06.697507 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:26:06.697482 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c0722fb_b284_4e40_867f_609097431624.slice/crio-1fe93fffa169a29683af20204db93a3e09aa800078f6ec0c3035a0a9896c810e WatchSource:0}: Error finding container 1fe93fffa169a29683af20204db93a3e09aa800078f6ec0c3035a0a9896c810e: Status 404 returned error can't find the container with id 1fe93fffa169a29683af20204db93a3e09aa800078f6ec0c3035a0a9896c810e Jun 08 08:26:07.108926 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:07.108890 2570 generic.go:356] "Generic (PLEG): container finished" podID="3c0722fb-b284-4e40-867f-609097431624" containerID="8469e62476ae5a7b416690297b1af7ebc0ae86e587520c1461a784d85581a8fd" exitCode=0 Jun 08 08:26:07.109372 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:07.108974 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3c0722fb-b284-4e40-867f-609097431624","Type":"ContainerDied","Data":"8469e62476ae5a7b416690297b1af7ebc0ae86e587520c1461a784d85581a8fd"} Jun 08 08:26:07.109372 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:07.109060 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3c0722fb-b284-4e40-867f-609097431624","Type":"ContainerStarted","Data":"1fe93fffa169a29683af20204db93a3e09aa800078f6ec0c3035a0a9896c810e"} Jun 08 08:26:07.112600 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:07.112576 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4","Type":"ContainerStarted","Data":"9be76c7413621759eefe5813ac6506a227b355cadc844ce01403eb7411918d9b"} Jun 08 08:26:07.166571 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:07.166524 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.769397511 podStartE2EDuration="6.166508849s" totalImagesPullingTime="3.377084351s" totalInitContainerRuntime="20.026987ms" isStatefulPod=false podCreationTimestamp="2026-06-08 08:26:01 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 08:26:07.164879518 +0000 UTC m=+278.419090971" watchObservedRunningTime="2026-06-08 08:26:07.166508849 +0000 UTC m=+278.420720298" Jun 08 08:26:10.751220 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:26:10.751128 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-6bf85bcd7b-6fpjd" podUID="92b7d091-5608-4e0c-a616-714cf3dcab1f" Jun 08 08:26:10.751220 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:26:10.751128 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-jtcbc" podUID="5dedcff5-b47c-4bd8-8684-25930d49cb60" Jun 08 08:26:11.135844 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:11.135797 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3c0722fb-b284-4e40-867f-609097431624","Type":"ContainerStarted","Data":"b26be152a6cf5e0a78c29e7b2e234819b4a1277f92de6b356a7f16c375fc529c"} Jun 08 08:26:11.136034 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:11.135924 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3c0722fb-b284-4e40-867f-609097431624","Type":"ContainerStarted","Data":"bce8ff8e5b48e87bb6bf08c2a2cdfdcc89ce6f882c2db9e0ded131fcd3891ad7"} Jun 08 08:26:11.136034 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:11.135820 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bf85bcd7b-6fpjd" Jun 08 08:26:11.136034 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:11.135822 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jtcbc" Jun 08 08:26:13.146851 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:13.146811 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3c0722fb-b284-4e40-867f-609097431624","Type":"ContainerStarted","Data":"35daf319d2b27b9110d681c9d55d9174fcce1e15ecdc4c7b9d14d39d9de5123b"} Jun 08 08:26:13.147198 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:13.146873 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3c0722fb-b284-4e40-867f-609097431624","Type":"ContainerStarted","Data":"549c6833a7cf135e959cef01531d045fba2b668165672fc663577a7cb8377eef"} Jun 08 08:26:13.147198 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:13.146899 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3c0722fb-b284-4e40-867f-609097431624","Type":"ContainerStarted","Data":"1740e4bfeaddc34ea37afc495be23e65543c1bd05525fd9eb3dfdc51c3d75d35"} Jun 08 08:26:13.147198 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:13.146927 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3c0722fb-b284-4e40-867f-609097431624","Type":"ContainerStarted","Data":"846f757e808e930dfa6d82e326b1806f73d703992d00b4cee97b41ce8d7b0c03"} Jun 08 08:26:13.176910 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:13.176846 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.25956094 podStartE2EDuration="7.176825816s" totalImagesPullingTime="4.896166334s" totalInitContainerRuntime="21.098542ms" isStatefulPod=false podCreationTimestamp="2026-06-08 08:26:06 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 08:26:13.175241913 +0000 UTC m=+284.429453393" watchObservedRunningTime="2026-06-08 08:26:13.176825816 +0000 UTC m=+284.431037267" Jun 08 08:26:14.054052 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:14.054007 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/92b7d091-5608-4e0c-a616-714cf3dcab1f-registry-tls\") pod \"image-registry-6bf85bcd7b-6fpjd\" (UID: \"92b7d091-5608-4e0c-a616-714cf3dcab1f\") " pod="openshift-image-registry/image-registry-6bf85bcd7b-6fpjd" Jun 08 08:26:14.054443 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:14.054418 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5dedcff5-b47c-4bd8-8684-25930d49cb60-metrics-tls\") pod \"dns-default-jtcbc\" (UID: \"5dedcff5-b47c-4bd8-8684-25930d49cb60\") " pod="openshift-dns/dns-default-jtcbc" Jun 08 08:26:14.056983 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:14.056954 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5dedcff5-b47c-4bd8-8684-25930d49cb60-metrics-tls\") pod \"dns-default-jtcbc\" (UID: \"5dedcff5-b47c-4bd8-8684-25930d49cb60\") " pod="openshift-dns/dns-default-jtcbc" Jun 08 08:26:14.057113 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:14.057094 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/92b7d091-5608-4e0c-a616-714cf3dcab1f-registry-tls\") pod \"image-registry-6bf85bcd7b-6fpjd\" (UID: \"92b7d091-5608-4e0c-a616-714cf3dcab1f\") " pod="openshift-image-registry/image-registry-6bf85bcd7b-6fpjd" Jun 08 08:26:14.140426 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:14.140393 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xs7cn\"" Jun 08 08:26:14.140831 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:14.140420 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-kqnwh\"" Jun 08 08:26:14.147172 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:14.147150 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jtcbc" Jun 08 08:26:14.147648 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:14.147632 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bf85bcd7b-6fpjd" Jun 08 08:26:14.318932 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:14.318833 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6bf85bcd7b-6fpjd"] Jun 08 08:26:14.333677 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:14.333653 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-jtcbc"] Jun 08 08:26:14.338820 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:26:14.338796 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5dedcff5_b47c_4bd8_8684_25930d49cb60.slice/crio-4be12c43d11e3448aaac07a674243c7f2bad9ee0453eac34a502487d5221e6a7 WatchSource:0}: Error finding container 4be12c43d11e3448aaac07a674243c7f2bad9ee0453eac34a502487d5221e6a7: Status 404 returned error can't find the container with id 4be12c43d11e3448aaac07a674243c7f2bad9ee0453eac34a502487d5221e6a7 Jun 08 08:26:15.157963 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:15.157923 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6bf85bcd7b-6fpjd" event={"ID":"92b7d091-5608-4e0c-a616-714cf3dcab1f","Type":"ContainerStarted","Data":"97a5fedfc899b66fb77a7b630a44e26918793004951fe38a1f03fe0578443c71"} Jun 08 08:26:15.158422 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:15.157988 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6bf85bcd7b-6fpjd" event={"ID":"92b7d091-5608-4e0c-a616-714cf3dcab1f","Type":"ContainerStarted","Data":"85186d440f53c3c8c892556cb82c20a49c530667bf2413f260042dba8dc2d327"} Jun 08 08:26:15.158422 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:15.158137 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6bf85bcd7b-6fpjd" Jun 08 08:26:15.159262 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:15.159238 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jtcbc" event={"ID":"5dedcff5-b47c-4bd8-8684-25930d49cb60","Type":"ContainerStarted","Data":"4be12c43d11e3448aaac07a674243c7f2bad9ee0453eac34a502487d5221e6a7"} Jun 08 08:26:15.181687 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:15.181643 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6bf85bcd7b-6fpjd" podStartSLOduration=286.181623672 podStartE2EDuration="4m46.181623672s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 08:21:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 08:26:15.180929366 +0000 UTC m=+286.435140816" watchObservedRunningTime="2026-06-08 08:26:15.181623672 +0000 UTC m=+286.435835122" Jun 08 08:26:16.165475 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:16.165431 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jtcbc" event={"ID":"5dedcff5-b47c-4bd8-8684-25930d49cb60","Type":"ContainerStarted","Data":"f973391014b56513ed6f295bb3ba87ee7084f904dc1f0d69e69dbd1e923d816f"} Jun 08 08:26:16.165902 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:16.165495 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jtcbc" event={"ID":"5dedcff5-b47c-4bd8-8684-25930d49cb60","Type":"ContainerStarted","Data":"390be55a59aa81484a146e81cdf00292f606f441268b217b1a94f0d6b89cfacf"} Jun 08 08:26:16.183948 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:16.183895 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-jtcbc" podStartSLOduration=250.753801016 podStartE2EDuration="4m12.18387808s" totalImagesPullingTime="1.430077064s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 08:22:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 08:26:16.182733079 +0000 UTC m=+287.436944527" watchObservedRunningTime="2026-06-08 08:26:16.18387808 +0000 UTC m=+287.438089529" Jun 08 08:26:16.497527 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:16.497439 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:26:17.171739 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:17.171055 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-jtcbc" Jun 08 08:26:19.180317 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:19.180238 2570 generic.go:356] "Generic (PLEG): container finished" podID="2b70d093-ed6b-4566-aebe-130f66603aec" containerID="0d1bd41f0d0d522272684e970edf125d81f53f58525702dd00b4d9670dd4320e" exitCode=255 Jun 08 08:26:19.180317 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:19.180289 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bdbf7c488-9sknb" event={"ID":"2b70d093-ed6b-4566-aebe-130f66603aec","Type":"ContainerDied","Data":"0d1bd41f0d0d522272684e970edf125d81f53f58525702dd00b4d9670dd4320e"} Jun 08 08:26:19.180701 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:19.180326 2570 scope.go:117] "RemoveContainer" containerID="397fef281d38a1e009d44229fef0c148d4f5ea471aad8ed0318c6a90ed7f7da6" Jun 08 08:26:19.186533 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:19.186509 2570 scope.go:117] "RemoveContainer" containerID="0d1bd41f0d0d522272684e970edf125d81f53f58525702dd00b4d9670dd4320e" Jun 08 08:26:19.186793 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:26:19.186768 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-bdbf7c488-9sknb_open-cluster-management-agent-addon(2b70d093-ed6b-4566-aebe-130f66603aec)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bdbf7c488-9sknb" podUID="2b70d093-ed6b-4566-aebe-130f66603aec" Jun 08 08:26:24.762162 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:24.762120 2570 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bdbf7c488-9sknb" Jun 08 08:26:24.762622 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:24.762493 2570 scope.go:117] "RemoveContainer" containerID="0d1bd41f0d0d522272684e970edf125d81f53f58525702dd00b4d9670dd4320e" Jun 08 08:26:24.762688 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:26:24.762665 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-bdbf7c488-9sknb_open-cluster-management-agent-addon(2b70d093-ed6b-4566-aebe-130f66603aec)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bdbf7c488-9sknb" podUID="2b70d093-ed6b-4566-aebe-130f66603aec" Jun 08 08:26:27.176018 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:27.175989 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-jtcbc" Jun 08 08:26:29.178554 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:29.178531 2570 kubelet.go:1648] "Image garbage collection succeeded" Jun 08 08:26:34.152805 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:34.152770 2570 patch_prober.go:28] interesting pod/image-registry-6bf85bcd7b-6fpjd container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 08 08:26:34.158167 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:34.152826 2570 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6bf85bcd7b-6fpjd" podUID="92b7d091-5608-4e0c-a616-714cf3dcab1f" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 08 08:26:36.170553 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:36.170527 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6bf85bcd7b-6fpjd" Jun 08 08:26:36.212875 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:36.212852 2570 scope.go:117] "RemoveContainer" containerID="0d1bd41f0d0d522272684e970edf125d81f53f58525702dd00b4d9670dd4320e" Jun 08 08:26:37.256420 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:37.256386 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bdbf7c488-9sknb" event={"ID":"2b70d093-ed6b-4566-aebe-130f66603aec","Type":"ContainerStarted","Data":"b815e165208ab06da033b12555379bf365336e898768ef3514da8009f620985c"} Jun 08 08:26:37.257690 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:37.257666 2570 generic.go:356] "Generic (PLEG): container finished" podID="90965077-fc1d-44f1-b9e9-34e5f57c8e38" containerID="d82735859c3b3b97a5c4a0228a7203e907906fa2eb88b0512c711007c1798a33" exitCode=0 Jun 08 08:26:37.257808 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:37.257742 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-fd4g5" event={"ID":"90965077-fc1d-44f1-b9e9-34e5f57c8e38","Type":"ContainerDied","Data":"d82735859c3b3b97a5c4a0228a7203e907906fa2eb88b0512c711007c1798a33"} Jun 08 08:26:37.258011 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:37.257998 2570 scope.go:117] "RemoveContainer" containerID="d82735859c3b3b97a5c4a0228a7203e907906fa2eb88b0512c711007c1798a33" Jun 08 08:26:38.263855 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:38.263823 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-fd4g5" event={"ID":"90965077-fc1d-44f1-b9e9-34e5f57c8e38","Type":"ContainerStarted","Data":"5d51cb8f527296a90244c1dc545dba90a53a56032665d1e20572ff360c810699"} Jun 08 08:26:44.691281 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:44.691247 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6bf85bcd7b-6fpjd"] Jun 08 08:26:51.313079 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:51.313045 2570 generic.go:356] "Generic (PLEG): container finished" podID="90190966-f98a-4a95-8ac6-564ced75358f" containerID="c923cd60eb418ea2ee1d72e384b3631633e377fd1febff65972d953f6b2fa72e" exitCode=0 Jun 08 08:26:51.313427 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:51.313102 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-7gdl7" event={"ID":"90190966-f98a-4a95-8ac6-564ced75358f","Type":"ContainerDied","Data":"c923cd60eb418ea2ee1d72e384b3631633e377fd1febff65972d953f6b2fa72e"} Jun 08 08:26:51.313427 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:51.313397 2570 scope.go:117] "RemoveContainer" containerID="c923cd60eb418ea2ee1d72e384b3631633e377fd1febff65972d953f6b2fa72e" Jun 08 08:26:51.747287 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:51.747258 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6bf85bcd7b-6fpjd_92b7d091-5608-4e0c-a616-714cf3dcab1f/registry/0.log" Jun 08 08:26:52.319101 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:52.319067 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-7gdl7" event={"ID":"90190966-f98a-4a95-8ac6-564ced75358f","Type":"ContainerStarted","Data":"344a08cf819ed1a212fce1695194b7cf37b229469d6c213b210a6ad3c2a2af1d"} Jun 08 08:26:52.322059 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:52.322034 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-hp6pw_b817d520-ebd3-4bd7-9490-90751bd573aa/node-ca/0.log" Jun 08 08:26:52.721633 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:52.721556 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5d6f988b67-lzl5t_47da3425-29f0-4210-94ce-c6dc07dc9834/router/0.log" Jun 08 08:26:53.320412 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:26:53.320381 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-pmppv_ad089e2e-24e2-432f-93d7-f24ac4c5bc99/serve-healthcheck-canary/0.log" Jun 08 08:27:06.497641 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:06.497611 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:27:06.513007 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:06.512986 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:27:07.391586 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:07.391560 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:27:09.711152 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:09.711119 2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6bf85bcd7b-6fpjd" podUID="92b7d091-5608-4e0c-a616-714cf3dcab1f" containerName="registry" containerID="cri-o://97a5fedfc899b66fb77a7b630a44e26918793004951fe38a1f03fe0578443c71" gracePeriod=30 Jun 08 08:27:10.955975 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:10.955952 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bf85bcd7b-6fpjd" Jun 08 08:27:11.027169 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:11.027132 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/92b7d091-5608-4e0c-a616-714cf3dcab1f-bound-sa-token\") pod \"92b7d091-5608-4e0c-a616-714cf3dcab1f\" (UID: \"92b7d091-5608-4e0c-a616-714cf3dcab1f\") " Jun 08 08:27:11.027317 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:11.027175 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/92b7d091-5608-4e0c-a616-714cf3dcab1f-registry-tls\") pod \"92b7d091-5608-4e0c-a616-714cf3dcab1f\" (UID: \"92b7d091-5608-4e0c-a616-714cf3dcab1f\") " Jun 08 08:27:11.027317 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:11.027221 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lw2f6\" (UniqueName: \"kubernetes.io/projected/92b7d091-5608-4e0c-a616-714cf3dcab1f-kube-api-access-lw2f6\") pod \"92b7d091-5608-4e0c-a616-714cf3dcab1f\" (UID: \"92b7d091-5608-4e0c-a616-714cf3dcab1f\") " Jun 08 08:27:11.027317 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:11.027246 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/92b7d091-5608-4e0c-a616-714cf3dcab1f-installation-pull-secrets\") pod \"92b7d091-5608-4e0c-a616-714cf3dcab1f\" (UID: \"92b7d091-5608-4e0c-a616-714cf3dcab1f\") " Jun 08 08:27:11.027317 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:11.027272 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/92b7d091-5608-4e0c-a616-714cf3dcab1f-registry-certificates\") pod \"92b7d091-5608-4e0c-a616-714cf3dcab1f\" (UID: \"92b7d091-5608-4e0c-a616-714cf3dcab1f\") " Jun 08 08:27:11.027528 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:11.027326 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/92b7d091-5608-4e0c-a616-714cf3dcab1f-trusted-ca\") pod \"92b7d091-5608-4e0c-a616-714cf3dcab1f\" (UID: \"92b7d091-5608-4e0c-a616-714cf3dcab1f\") " Jun 08 08:27:11.027528 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:11.027357 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/92b7d091-5608-4e0c-a616-714cf3dcab1f-ca-trust-extracted\") pod \"92b7d091-5608-4e0c-a616-714cf3dcab1f\" (UID: \"92b7d091-5608-4e0c-a616-714cf3dcab1f\") " Jun 08 08:27:11.027623 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:11.027551 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/92b7d091-5608-4e0c-a616-714cf3dcab1f-image-registry-private-configuration\") pod \"92b7d091-5608-4e0c-a616-714cf3dcab1f\" (UID: \"92b7d091-5608-4e0c-a616-714cf3dcab1f\") " Jun 08 08:27:11.027803 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:11.027774 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92b7d091-5608-4e0c-a616-714cf3dcab1f-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "92b7d091-5608-4e0c-a616-714cf3dcab1f" (UID: "92b7d091-5608-4e0c-a616-714cf3dcab1f"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 08:27:11.027977 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:11.027918 2570 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/92b7d091-5608-4e0c-a616-714cf3dcab1f-registry-certificates\") on node \"ip-10-0-143-101.ec2.internal\" DevicePath \"\"" Jun 08 08:27:11.027977 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:11.027953 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92b7d091-5608-4e0c-a616-714cf3dcab1f-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "92b7d091-5608-4e0c-a616-714cf3dcab1f" (UID: "92b7d091-5608-4e0c-a616-714cf3dcab1f"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 08:27:11.029780 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:11.029749 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92b7d091-5608-4e0c-a616-714cf3dcab1f-kube-api-access-lw2f6" (OuterVolumeSpecName: "kube-api-access-lw2f6") pod "92b7d091-5608-4e0c-a616-714cf3dcab1f" (UID: "92b7d091-5608-4e0c-a616-714cf3dcab1f"). InnerVolumeSpecName "kube-api-access-lw2f6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 08:27:11.029883 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:11.029829 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92b7d091-5608-4e0c-a616-714cf3dcab1f-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "92b7d091-5608-4e0c-a616-714cf3dcab1f" (UID: "92b7d091-5608-4e0c-a616-714cf3dcab1f"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 08:27:11.029953 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:11.029884 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92b7d091-5608-4e0c-a616-714cf3dcab1f-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "92b7d091-5608-4e0c-a616-714cf3dcab1f" (UID: "92b7d091-5608-4e0c-a616-714cf3dcab1f"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 08:27:11.029953 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:11.029881 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92b7d091-5608-4e0c-a616-714cf3dcab1f-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "92b7d091-5608-4e0c-a616-714cf3dcab1f" (UID: "92b7d091-5608-4e0c-a616-714cf3dcab1f"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 08:27:11.030393 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:11.030349 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92b7d091-5608-4e0c-a616-714cf3dcab1f-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "92b7d091-5608-4e0c-a616-714cf3dcab1f" (UID: "92b7d091-5608-4e0c-a616-714cf3dcab1f"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 08:27:11.036207 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:11.036185 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92b7d091-5608-4e0c-a616-714cf3dcab1f-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "92b7d091-5608-4e0c-a616-714cf3dcab1f" (UID: "92b7d091-5608-4e0c-a616-714cf3dcab1f"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 08:27:11.128520 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:11.128501 2570 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/92b7d091-5608-4e0c-a616-714cf3dcab1f-trusted-ca\") on node \"ip-10-0-143-101.ec2.internal\" DevicePath \"\"" Jun 08 08:27:11.128520 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:11.128521 2570 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/92b7d091-5608-4e0c-a616-714cf3dcab1f-ca-trust-extracted\") on node \"ip-10-0-143-101.ec2.internal\" DevicePath \"\"" Jun 08 08:27:11.128636 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:11.128530 2570 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/92b7d091-5608-4e0c-a616-714cf3dcab1f-image-registry-private-configuration\") on node \"ip-10-0-143-101.ec2.internal\" DevicePath \"\"" Jun 08 08:27:11.128636 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:11.128539 2570 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/92b7d091-5608-4e0c-a616-714cf3dcab1f-bound-sa-token\") on node \"ip-10-0-143-101.ec2.internal\" DevicePath \"\"" Jun 08 08:27:11.128636 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:11.128547 2570 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/92b7d091-5608-4e0c-a616-714cf3dcab1f-registry-tls\") on node \"ip-10-0-143-101.ec2.internal\" DevicePath \"\"" Jun 08 08:27:11.128636 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:11.128554 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lw2f6\" (UniqueName: \"kubernetes.io/projected/92b7d091-5608-4e0c-a616-714cf3dcab1f-kube-api-access-lw2f6\") on node \"ip-10-0-143-101.ec2.internal\" DevicePath \"\"" Jun 08 08:27:11.128636 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:11.128562 2570 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/92b7d091-5608-4e0c-a616-714cf3dcab1f-installation-pull-secrets\") on node \"ip-10-0-143-101.ec2.internal\" DevicePath \"\"" Jun 08 08:27:11.394582 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:11.394549 2570 generic.go:356] "Generic (PLEG): container finished" podID="92b7d091-5608-4e0c-a616-714cf3dcab1f" containerID="97a5fedfc899b66fb77a7b630a44e26918793004951fe38a1f03fe0578443c71" exitCode=0 Jun 08 08:27:11.394757 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:11.394607 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bf85bcd7b-6fpjd" Jun 08 08:27:11.394757 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:11.394629 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6bf85bcd7b-6fpjd" event={"ID":"92b7d091-5608-4e0c-a616-714cf3dcab1f","Type":"ContainerDied","Data":"97a5fedfc899b66fb77a7b630a44e26918793004951fe38a1f03fe0578443c71"} Jun 08 08:27:11.394757 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:11.394678 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6bf85bcd7b-6fpjd" event={"ID":"92b7d091-5608-4e0c-a616-714cf3dcab1f","Type":"ContainerDied","Data":"85186d440f53c3c8c892556cb82c20a49c530667bf2413f260042dba8dc2d327"} Jun 08 08:27:11.394757 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:11.394697 2570 scope.go:117] "RemoveContainer" containerID="97a5fedfc899b66fb77a7b630a44e26918793004951fe38a1f03fe0578443c71" Jun 08 08:27:11.402762 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:11.402745 2570 scope.go:117] "RemoveContainer" containerID="97a5fedfc899b66fb77a7b630a44e26918793004951fe38a1f03fe0578443c71" Jun 08 08:27:11.403033 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:27:11.403013 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"97a5fedfc899b66fb77a7b630a44e26918793004951fe38a1f03fe0578443c71\": container with ID starting with 97a5fedfc899b66fb77a7b630a44e26918793004951fe38a1f03fe0578443c71 not found: ID does not exist" containerID="97a5fedfc899b66fb77a7b630a44e26918793004951fe38a1f03fe0578443c71" Jun 08 08:27:11.403083 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:11.403041 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97a5fedfc899b66fb77a7b630a44e26918793004951fe38a1f03fe0578443c71"} err="failed to get container status \"97a5fedfc899b66fb77a7b630a44e26918793004951fe38a1f03fe0578443c71\": rpc error: code = NotFound desc = could not find container \"97a5fedfc899b66fb77a7b630a44e26918793004951fe38a1f03fe0578443c71\": container with ID starting with 97a5fedfc899b66fb77a7b630a44e26918793004951fe38a1f03fe0578443c71 not found: ID does not exist" Jun 08 08:27:11.412954 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:11.412935 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6bf85bcd7b-6fpjd"] Jun 08 08:27:11.416813 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:11.416795 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6bf85bcd7b-6fpjd"] Jun 08 08:27:13.209596 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:13.209563 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="92b7d091-5608-4e0c-a616-714cf3dcab1f" path="/var/lib/kubelet/pods/92b7d091-5608-4e0c-a616-714cf3dcab1f/volumes" Jun 08 08:27:20.262298 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:20.262218 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 08:27:20.262701 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:20.262552 2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4" containerName="alertmanager" containerID="cri-o://8498225aecd99f2264dc60e929c4600fea07f59a02b3f7c9b7e64ba454be3caa" gracePeriod=120 Jun 08 08:27:20.262701 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:20.262626 2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4" containerName="kube-rbac-proxy-web" containerID="cri-o://009febb9e487766e22255251749263f8e6699436b1fac78c217e323f145247cf" gracePeriod=120 Jun 08 08:27:20.262701 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:20.262672 2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4" containerName="prom-label-proxy" containerID="cri-o://9be76c7413621759eefe5813ac6506a227b355cadc844ce01403eb7411918d9b" gracePeriod=120 Jun 08 08:27:20.262701 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:20.262676 2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4" containerName="config-reloader" containerID="cri-o://12426e356d7b43c1668b226f2eaef43249e7e6a172fc872fcacfeae136ab96ce" gracePeriod=120 Jun 08 08:27:20.262956 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:20.262732 2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4" containerName="kube-rbac-proxy" containerID="cri-o://81c3150a0e65c34805e45ea33168e097ec1ce769389dc0c818f42080774d38e8" gracePeriod=120 Jun 08 08:27:20.262956 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:20.262620 2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4" containerName="kube-rbac-proxy-metric" containerID="cri-o://ad4db40cb30bd388ca19b706356b8aef013e20b843783d2782a03b60e37b9f85" gracePeriod=120 Jun 08 08:27:20.431846 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:20.431816 2570 generic.go:356] "Generic (PLEG): container finished" podID="ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4" containerID="9be76c7413621759eefe5813ac6506a227b355cadc844ce01403eb7411918d9b" exitCode=0 Jun 08 08:27:20.431846 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:20.431843 2570 generic.go:356] "Generic (PLEG): container finished" podID="ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4" containerID="81c3150a0e65c34805e45ea33168e097ec1ce769389dc0c818f42080774d38e8" exitCode=0 Jun 08 08:27:20.431846 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:20.431849 2570 generic.go:356] "Generic (PLEG): container finished" podID="ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4" containerID="12426e356d7b43c1668b226f2eaef43249e7e6a172fc872fcacfeae136ab96ce" exitCode=0 Jun 08 08:27:20.432077 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:20.431855 2570 generic.go:356] "Generic (PLEG): container finished" podID="ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4" containerID="8498225aecd99f2264dc60e929c4600fea07f59a02b3f7c9b7e64ba454be3caa" exitCode=0 Jun 08 08:27:20.432077 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:20.431885 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4","Type":"ContainerDied","Data":"9be76c7413621759eefe5813ac6506a227b355cadc844ce01403eb7411918d9b"} Jun 08 08:27:20.432077 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:20.431946 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4","Type":"ContainerDied","Data":"81c3150a0e65c34805e45ea33168e097ec1ce769389dc0c818f42080774d38e8"} Jun 08 08:27:20.432077 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:20.431972 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4","Type":"ContainerDied","Data":"12426e356d7b43c1668b226f2eaef43249e7e6a172fc872fcacfeae136ab96ce"} Jun 08 08:27:20.432077 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:20.431997 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4","Type":"ContainerDied","Data":"8498225aecd99f2264dc60e929c4600fea07f59a02b3f7c9b7e64ba454be3caa"} Jun 08 08:27:21.442357 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:21.442322 2570 generic.go:356] "Generic (PLEG): container finished" podID="ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4" containerID="ad4db40cb30bd388ca19b706356b8aef013e20b843783d2782a03b60e37b9f85" exitCode=0 Jun 08 08:27:21.442357 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:21.442353 2570 generic.go:356] "Generic (PLEG): container finished" podID="ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4" containerID="009febb9e487766e22255251749263f8e6699436b1fac78c217e323f145247cf" exitCode=0 Jun 08 08:27:21.442703 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:21.442378 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4","Type":"ContainerDied","Data":"ad4db40cb30bd388ca19b706356b8aef013e20b843783d2782a03b60e37b9f85"} Jun 08 08:27:21.442703 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:21.442449 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4","Type":"ContainerDied","Data":"009febb9e487766e22255251749263f8e6699436b1fac78c217e323f145247cf"} Jun 08 08:27:21.507338 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:21.507317 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 08 08:27:21.611908 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:21.611834 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4-secret-alertmanager-kube-rbac-proxy-metric\") pod \"ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4\" (UID: \"ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4\") " Jun 08 08:27:21.611908 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:21.611866 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4-config-out\") pod \"ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4\" (UID: \"ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4\") " Jun 08 08:27:21.611908 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:21.611901 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4-alertmanager-main-db\") pod \"ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4\" (UID: \"ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4\") " Jun 08 08:27:21.612163 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:21.611928 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4-web-config\") pod \"ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4\" (UID: \"ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4\") " Jun 08 08:27:21.612163 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:21.611953 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4-alertmanager-trusted-ca-bundle\") pod \"ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4\" (UID: \"ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4\") " Jun 08 08:27:21.612163 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:21.611977 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4-secret-alertmanager-kube-rbac-proxy-web\") pod \"ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4\" (UID: \"ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4\") " Jun 08 08:27:21.612163 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:21.612014 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4-secret-alertmanager-kube-rbac-proxy\") pod \"ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4\" (UID: \"ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4\") " Jun 08 08:27:21.612163 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:21.612040 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4-config-volume\") pod \"ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4\" (UID: \"ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4\") " Jun 08 08:27:21.612163 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:21.612071 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4-secret-alertmanager-main-tls\") pod \"ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4\" (UID: \"ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4\") " Jun 08 08:27:21.612163 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:21.612097 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4-metrics-client-ca\") pod \"ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4\" (UID: \"ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4\") " Jun 08 08:27:21.612507 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:21.612191 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4-tls-assets\") pod \"ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4\" (UID: \"ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4\") " Jun 08 08:27:21.612507 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:21.612217 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-46t6s\" (UniqueName: \"kubernetes.io/projected/ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4-kube-api-access-46t6s\") pod \"ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4\" (UID: \"ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4\") " Jun 08 08:27:21.612507 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:21.612332 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4" (UID: "ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 08:27:21.612663 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:21.612547 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4" (UID: "ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 08:27:21.613390 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:21.613205 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4-cluster-tls-config\") pod \"ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4\" (UID: \"ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4\") " Jun 08 08:27:21.613772 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:21.613564 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4" (UID: "ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 08:27:21.613772 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:21.613698 2570 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4-alertmanager-main-db\") on node \"ip-10-0-143-101.ec2.internal\" DevicePath \"\"" Jun 08 08:27:21.613772 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:21.613736 2570 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-143-101.ec2.internal\" DevicePath \"\"" Jun 08 08:27:21.613772 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:21.613751 2570 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4-metrics-client-ca\") on node \"ip-10-0-143-101.ec2.internal\" DevicePath \"\"" Jun 08 08:27:21.614947 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:21.614917 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4" (UID: "ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 08:27:21.615216 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:21.615189 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4-config-out" (OuterVolumeSpecName: "config-out") pod "ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4" (UID: "ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 08:27:21.615301 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:21.615215 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4" (UID: "ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 08:27:21.615358 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:21.615305 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4" (UID: "ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 08:27:21.615520 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:21.615486 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4-config-volume" (OuterVolumeSpecName: "config-volume") pod "ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4" (UID: "ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 08:27:21.615613 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:21.615584 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4-kube-api-access-46t6s" (OuterVolumeSpecName: "kube-api-access-46t6s") pod "ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4" (UID: "ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4"). InnerVolumeSpecName "kube-api-access-46t6s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 08:27:21.616353 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:21.616330 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4" (UID: "ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 08:27:21.616451 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:21.616350 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4" (UID: "ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 08:27:21.619636 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:21.619533 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4" (UID: "ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 08:27:21.624945 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:21.624921 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4-web-config" (OuterVolumeSpecName: "web-config") pod "ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4" (UID: "ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 08:27:21.714674 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:21.714650 2570 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4-tls-assets\") on node \"ip-10-0-143-101.ec2.internal\" DevicePath \"\"" Jun 08 08:27:21.714674 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:21.714671 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-46t6s\" (UniqueName: \"kubernetes.io/projected/ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4-kube-api-access-46t6s\") on node \"ip-10-0-143-101.ec2.internal\" DevicePath \"\"" Jun 08 08:27:21.714807 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:21.714681 2570 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4-cluster-tls-config\") on node \"ip-10-0-143-101.ec2.internal\" DevicePath \"\"" Jun 08 08:27:21.714807 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:21.714690 2570 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-143-101.ec2.internal\" DevicePath \"\"" Jun 08 08:27:21.714807 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:21.714701 2570 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4-config-out\") on node \"ip-10-0-143-101.ec2.internal\" DevicePath \"\"" Jun 08 08:27:21.714807 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:21.714747 2570 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4-web-config\") on node \"ip-10-0-143-101.ec2.internal\" DevicePath \"\"" Jun 08 08:27:21.714807 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:21.714756 2570 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-143-101.ec2.internal\" DevicePath \"\"" Jun 08 08:27:21.714807 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:21.714766 2570 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-143-101.ec2.internal\" DevicePath \"\"" Jun 08 08:27:21.714807 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:21.714774 2570 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4-config-volume\") on node \"ip-10-0-143-101.ec2.internal\" DevicePath \"\"" Jun 08 08:27:21.714807 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:21.714781 2570 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4-secret-alertmanager-main-tls\") on node \"ip-10-0-143-101.ec2.internal\" DevicePath \"\"" Jun 08 08:27:22.449395 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:22.449362 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4","Type":"ContainerDied","Data":"b8bfed01b958322d3c12b3a8d44812551c915a2ab33fe464dffc02cf2f401e09"} Jun 08 08:27:22.449738 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:22.449409 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 08 08:27:22.449738 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:22.449436 2570 scope.go:117] "RemoveContainer" containerID="9be76c7413621759eefe5813ac6506a227b355cadc844ce01403eb7411918d9b" Jun 08 08:27:22.457553 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:22.457530 2570 scope.go:117] "RemoveContainer" containerID="ad4db40cb30bd388ca19b706356b8aef013e20b843783d2782a03b60e37b9f85" Jun 08 08:27:22.463879 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:22.463862 2570 scope.go:117] "RemoveContainer" containerID="81c3150a0e65c34805e45ea33168e097ec1ce769389dc0c818f42080774d38e8" Jun 08 08:27:22.469839 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:22.469825 2570 scope.go:117] "RemoveContainer" containerID="009febb9e487766e22255251749263f8e6699436b1fac78c217e323f145247cf" Jun 08 08:27:22.474617 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:22.474596 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 08:27:22.477859 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:22.477821 2570 scope.go:117] "RemoveContainer" containerID="12426e356d7b43c1668b226f2eaef43249e7e6a172fc872fcacfeae136ab96ce" Jun 08 08:27:22.478905 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:22.478886 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 08:27:22.484299 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:22.484280 2570 scope.go:117] "RemoveContainer" containerID="8498225aecd99f2264dc60e929c4600fea07f59a02b3f7c9b7e64ba454be3caa" Jun 08 08:27:22.491040 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:22.491025 2570 scope.go:117] "RemoveContainer" containerID="6d6450d591940a1ba4f86f32e7c575680bd8ff50c80f1a7bdfd2ddb75d57fcf6" Jun 08 08:27:22.507610 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:22.507591 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 08:27:22.507888 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:22.507873 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4" containerName="prom-label-proxy" Jun 08 08:27:22.507888 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:22.507889 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4" containerName="prom-label-proxy" Jun 08 08:27:22.507975 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:22.507900 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4" containerName="kube-rbac-proxy-web" Jun 08 08:27:22.507975 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:22.507906 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4" containerName="kube-rbac-proxy-web" Jun 08 08:27:22.507975 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:22.507913 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92b7d091-5608-4e0c-a616-714cf3dcab1f" containerName="registry" Jun 08 08:27:22.507975 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:22.507919 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="92b7d091-5608-4e0c-a616-714cf3dcab1f" containerName="registry" Jun 08 08:27:22.507975 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:22.507931 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4" containerName="alertmanager" Jun 08 08:27:22.507975 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:22.507936 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4" containerName="alertmanager" Jun 08 08:27:22.507975 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:22.507942 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4" containerName="kube-rbac-proxy-metric" Jun 08 08:27:22.507975 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:22.507947 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4" containerName="kube-rbac-proxy-metric" Jun 08 08:27:22.507975 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:22.507956 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4" containerName="init-config-reloader" Jun 08 08:27:22.507975 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:22.507961 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4" containerName="init-config-reloader" Jun 08 08:27:22.507975 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:22.507967 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4" containerName="config-reloader" Jun 08 08:27:22.507975 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:22.507971 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4" containerName="config-reloader" Jun 08 08:27:22.507975 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:22.507978 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4" containerName="kube-rbac-proxy" Jun 08 08:27:22.508332 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:22.507983 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4" containerName="kube-rbac-proxy" Jun 08 08:27:22.508332 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:22.508028 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4" containerName="kube-rbac-proxy" Jun 08 08:27:22.508332 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:22.508034 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4" containerName="kube-rbac-proxy-metric" Jun 08 08:27:22.508332 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:22.508041 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="92b7d091-5608-4e0c-a616-714cf3dcab1f" containerName="registry" Jun 08 08:27:22.508332 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:22.508047 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4" containerName="config-reloader" Jun 08 08:27:22.508332 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:22.508053 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4" containerName="alertmanager" Jun 08 08:27:22.508332 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:22.508059 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4" containerName="prom-label-proxy" Jun 08 08:27:22.508332 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:22.508064 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4" containerName="kube-rbac-proxy-web" Jun 08 08:27:22.511245 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:22.511222 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 08 08:27:22.514381 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:22.514363 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 08 08:27:22.514476 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:22.514410 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 08 08:27:22.514476 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:22.514432 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 08 08:27:22.514844 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:22.514824 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 08 08:27:22.514934 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:22.514856 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-wgcs8\"" Jun 08 08:27:22.514934 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:22.514911 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 08 08:27:22.515028 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:22.514944 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 08 08:27:22.515028 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:22.514946 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 08 08:27:22.515272 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:22.515255 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 08 08:27:22.521321 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:22.521299 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 08 08:27:22.530489 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:22.530470 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 08:27:22.621667 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:22.621598 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/adc8c82a-b8cf-4a96-8564-e0c026cba79f-config-volume\") pod \"alertmanager-main-0\" (UID: \"adc8c82a-b8cf-4a96-8564-e0c026cba79f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 08:27:22.621667 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:22.621633 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/adc8c82a-b8cf-4a96-8564-e0c026cba79f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"adc8c82a-b8cf-4a96-8564-e0c026cba79f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 08:27:22.621918 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:22.621671 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/adc8c82a-b8cf-4a96-8564-e0c026cba79f-config-out\") pod \"alertmanager-main-0\" (UID: \"adc8c82a-b8cf-4a96-8564-e0c026cba79f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 08:27:22.621918 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:22.621699 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/adc8c82a-b8cf-4a96-8564-e0c026cba79f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"adc8c82a-b8cf-4a96-8564-e0c026cba79f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 08:27:22.621918 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:22.621754 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/adc8c82a-b8cf-4a96-8564-e0c026cba79f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"adc8c82a-b8cf-4a96-8564-e0c026cba79f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 08:27:22.621918 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:22.621780 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/adc8c82a-b8cf-4a96-8564-e0c026cba79f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"adc8c82a-b8cf-4a96-8564-e0c026cba79f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 08:27:22.621918 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:22.621814 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/adc8c82a-b8cf-4a96-8564-e0c026cba79f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"adc8c82a-b8cf-4a96-8564-e0c026cba79f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 08:27:22.621918 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:22.621837 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/adc8c82a-b8cf-4a96-8564-e0c026cba79f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"adc8c82a-b8cf-4a96-8564-e0c026cba79f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 08:27:22.621918 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:22.621866 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/adc8c82a-b8cf-4a96-8564-e0c026cba79f-web-config\") pod \"alertmanager-main-0\" (UID: \"adc8c82a-b8cf-4a96-8564-e0c026cba79f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 08:27:22.622153 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:22.621949 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/adc8c82a-b8cf-4a96-8564-e0c026cba79f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"adc8c82a-b8cf-4a96-8564-e0c026cba79f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 08:27:22.622153 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:22.621974 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghrf2\" (UniqueName: \"kubernetes.io/projected/adc8c82a-b8cf-4a96-8564-e0c026cba79f-kube-api-access-ghrf2\") pod \"alertmanager-main-0\" (UID: \"adc8c82a-b8cf-4a96-8564-e0c026cba79f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 08:27:22.622153 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:22.622008 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/adc8c82a-b8cf-4a96-8564-e0c026cba79f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"adc8c82a-b8cf-4a96-8564-e0c026cba79f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 08:27:22.622153 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:22.622045 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/adc8c82a-b8cf-4a96-8564-e0c026cba79f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"adc8c82a-b8cf-4a96-8564-e0c026cba79f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 08:27:22.723215 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:22.723180 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/adc8c82a-b8cf-4a96-8564-e0c026cba79f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"adc8c82a-b8cf-4a96-8564-e0c026cba79f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 08:27:22.723215 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:22.723219 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghrf2\" (UniqueName: \"kubernetes.io/projected/adc8c82a-b8cf-4a96-8564-e0c026cba79f-kube-api-access-ghrf2\") pod \"alertmanager-main-0\" (UID: \"adc8c82a-b8cf-4a96-8564-e0c026cba79f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 08:27:22.723365 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:22.723262 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/adc8c82a-b8cf-4a96-8564-e0c026cba79f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"adc8c82a-b8cf-4a96-8564-e0c026cba79f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 08:27:22.723365 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:22.723294 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/adc8c82a-b8cf-4a96-8564-e0c026cba79f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"adc8c82a-b8cf-4a96-8564-e0c026cba79f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 08:27:22.723365 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:22.723329 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/adc8c82a-b8cf-4a96-8564-e0c026cba79f-config-volume\") pod \"alertmanager-main-0\" (UID: \"adc8c82a-b8cf-4a96-8564-e0c026cba79f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 08:27:22.723365 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:22.723352 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/adc8c82a-b8cf-4a96-8564-e0c026cba79f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"adc8c82a-b8cf-4a96-8564-e0c026cba79f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 08:27:22.723572 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:22.723391 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/adc8c82a-b8cf-4a96-8564-e0c026cba79f-config-out\") pod \"alertmanager-main-0\" (UID: \"adc8c82a-b8cf-4a96-8564-e0c026cba79f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 08:27:22.723572 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:22.723418 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/adc8c82a-b8cf-4a96-8564-e0c026cba79f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"adc8c82a-b8cf-4a96-8564-e0c026cba79f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 08:27:22.723572 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:22.723443 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/adc8c82a-b8cf-4a96-8564-e0c026cba79f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"adc8c82a-b8cf-4a96-8564-e0c026cba79f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 08:27:22.723572 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:22.723471 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/adc8c82a-b8cf-4a96-8564-e0c026cba79f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"adc8c82a-b8cf-4a96-8564-e0c026cba79f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 08:27:22.723572 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:22.723508 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/adc8c82a-b8cf-4a96-8564-e0c026cba79f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"adc8c82a-b8cf-4a96-8564-e0c026cba79f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 08:27:22.723572 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:22.723531 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/adc8c82a-b8cf-4a96-8564-e0c026cba79f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"adc8c82a-b8cf-4a96-8564-e0c026cba79f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 08:27:22.723572 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:22.723561 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/adc8c82a-b8cf-4a96-8564-e0c026cba79f-web-config\") pod \"alertmanager-main-0\" (UID: \"adc8c82a-b8cf-4a96-8564-e0c026cba79f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 08:27:22.724357 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:22.724030 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/adc8c82a-b8cf-4a96-8564-e0c026cba79f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"adc8c82a-b8cf-4a96-8564-e0c026cba79f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 08:27:22.724357 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:22.724288 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/adc8c82a-b8cf-4a96-8564-e0c026cba79f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"adc8c82a-b8cf-4a96-8564-e0c026cba79f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 08:27:22.726272 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:22.726196 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/adc8c82a-b8cf-4a96-8564-e0c026cba79f-config-out\") pod \"alertmanager-main-0\" (UID: \"adc8c82a-b8cf-4a96-8564-e0c026cba79f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 08:27:22.726649 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:22.726484 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/adc8c82a-b8cf-4a96-8564-e0c026cba79f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"adc8c82a-b8cf-4a96-8564-e0c026cba79f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 08:27:22.726649 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:22.726481 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/adc8c82a-b8cf-4a96-8564-e0c026cba79f-config-volume\") pod \"alertmanager-main-0\" (UID: \"adc8c82a-b8cf-4a96-8564-e0c026cba79f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 08:27:22.726649 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:22.726581 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/adc8c82a-b8cf-4a96-8564-e0c026cba79f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"adc8c82a-b8cf-4a96-8564-e0c026cba79f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 08:27:22.726649 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:22.726619 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/adc8c82a-b8cf-4a96-8564-e0c026cba79f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"adc8c82a-b8cf-4a96-8564-e0c026cba79f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 08:27:22.726871 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:22.726669 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/adc8c82a-b8cf-4a96-8564-e0c026cba79f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"adc8c82a-b8cf-4a96-8564-e0c026cba79f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 08:27:22.726871 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:22.726752 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/adc8c82a-b8cf-4a96-8564-e0c026cba79f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"adc8c82a-b8cf-4a96-8564-e0c026cba79f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 08:27:22.726871 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:22.726862 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/adc8c82a-b8cf-4a96-8564-e0c026cba79f-web-config\") pod \"alertmanager-main-0\" (UID: \"adc8c82a-b8cf-4a96-8564-e0c026cba79f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 08:27:22.727184 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:22.727168 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/adc8c82a-b8cf-4a96-8564-e0c026cba79f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"adc8c82a-b8cf-4a96-8564-e0c026cba79f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 08:27:22.728437 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:22.728420 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/adc8c82a-b8cf-4a96-8564-e0c026cba79f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"adc8c82a-b8cf-4a96-8564-e0c026cba79f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 08:27:22.731070 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:22.731047 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghrf2\" (UniqueName: \"kubernetes.io/projected/adc8c82a-b8cf-4a96-8564-e0c026cba79f-kube-api-access-ghrf2\") pod \"alertmanager-main-0\" (UID: \"adc8c82a-b8cf-4a96-8564-e0c026cba79f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 08:27:22.822149 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:22.822110 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 08 08:27:22.958098 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:22.958075 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 08:27:22.960139 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:27:22.960116 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadc8c82a_b8cf_4a96_8564_e0c026cba79f.slice/crio-fe73e7f6918ab4d2e92f74b4cb74aa346caab682422a96afdb4a52dd9009f12e WatchSource:0}: Error finding container fe73e7f6918ab4d2e92f74b4cb74aa346caab682422a96afdb4a52dd9009f12e: Status 404 returned error can't find the container with id fe73e7f6918ab4d2e92f74b4cb74aa346caab682422a96afdb4a52dd9009f12e Jun 08 08:27:23.209505 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:23.209420 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4" path="/var/lib/kubelet/pods/ac6f37c6-3b22-49ad-bde4-bec9ba78eeb4/volumes" Jun 08 08:27:23.454598 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:23.454566 2570 generic.go:356] "Generic (PLEG): container finished" podID="adc8c82a-b8cf-4a96-8564-e0c026cba79f" containerID="9075f0b059cd85d32f318f8c9b2c288cb461110baf15de62fdf73a7e90fe01f6" exitCode=0 Jun 08 08:27:23.455058 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:23.454651 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"adc8c82a-b8cf-4a96-8564-e0c026cba79f","Type":"ContainerDied","Data":"9075f0b059cd85d32f318f8c9b2c288cb461110baf15de62fdf73a7e90fe01f6"} Jun 08 08:27:23.455058 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:23.454756 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"adc8c82a-b8cf-4a96-8564-e0c026cba79f","Type":"ContainerStarted","Data":"fe73e7f6918ab4d2e92f74b4cb74aa346caab682422a96afdb4a52dd9009f12e"} Jun 08 08:27:24.375338 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:24.375299 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-67dd799b9b-dlmhk"] Jun 08 08:27:24.378281 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:24.378258 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-67dd799b9b-dlmhk" Jun 08 08:27:24.383668 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:24.383645 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 08 08:27:24.384229 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:24.384213 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 08 08:27:24.384465 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:24.384451 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-9mjm9\"" Jun 08 08:27:24.384790 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:24.384770 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 08 08:27:24.384894 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:24.384880 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 08 08:27:24.388857 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:24.388837 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 08 08:27:24.390066 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:24.390050 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 08 08:27:24.395691 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:24.395670 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-67dd799b9b-dlmhk"] Jun 08 08:27:24.439483 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:24.439453 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/e260c645-ff1e-471e-b01c-61ca11ad3e22-secret-telemeter-client\") pod \"telemeter-client-67dd799b9b-dlmhk\" (UID: \"e260c645-ff1e-471e-b01c-61ca11ad3e22\") " pod="openshift-monitoring/telemeter-client-67dd799b9b-dlmhk" Jun 08 08:27:24.439587 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:24.439496 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/e260c645-ff1e-471e-b01c-61ca11ad3e22-telemeter-client-tls\") pod \"telemeter-client-67dd799b9b-dlmhk\" (UID: \"e260c645-ff1e-471e-b01c-61ca11ad3e22\") " pod="openshift-monitoring/telemeter-client-67dd799b9b-dlmhk" Jun 08 08:27:24.439587 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:24.439539 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e260c645-ff1e-471e-b01c-61ca11ad3e22-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-67dd799b9b-dlmhk\" (UID: \"e260c645-ff1e-471e-b01c-61ca11ad3e22\") " pod="openshift-monitoring/telemeter-client-67dd799b9b-dlmhk" Jun 08 08:27:24.439587 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:24.439562 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/e260c645-ff1e-471e-b01c-61ca11ad3e22-federate-client-tls\") pod \"telemeter-client-67dd799b9b-dlmhk\" (UID: \"e260c645-ff1e-471e-b01c-61ca11ad3e22\") " pod="openshift-monitoring/telemeter-client-67dd799b9b-dlmhk" Jun 08 08:27:24.439587 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:24.439583 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t46bs\" (UniqueName: \"kubernetes.io/projected/e260c645-ff1e-471e-b01c-61ca11ad3e22-kube-api-access-t46bs\") pod \"telemeter-client-67dd799b9b-dlmhk\" (UID: \"e260c645-ff1e-471e-b01c-61ca11ad3e22\") " pod="openshift-monitoring/telemeter-client-67dd799b9b-dlmhk" Jun 08 08:27:24.439766 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:24.439647 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e260c645-ff1e-471e-b01c-61ca11ad3e22-telemeter-trusted-ca-bundle\") pod \"telemeter-client-67dd799b9b-dlmhk\" (UID: \"e260c645-ff1e-471e-b01c-61ca11ad3e22\") " pod="openshift-monitoring/telemeter-client-67dd799b9b-dlmhk" Jun 08 08:27:24.439766 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:24.439685 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e260c645-ff1e-471e-b01c-61ca11ad3e22-serving-certs-ca-bundle\") pod \"telemeter-client-67dd799b9b-dlmhk\" (UID: \"e260c645-ff1e-471e-b01c-61ca11ad3e22\") " pod="openshift-monitoring/telemeter-client-67dd799b9b-dlmhk" Jun 08 08:27:24.439766 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:24.439727 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e260c645-ff1e-471e-b01c-61ca11ad3e22-metrics-client-ca\") pod \"telemeter-client-67dd799b9b-dlmhk\" (UID: \"e260c645-ff1e-471e-b01c-61ca11ad3e22\") " pod="openshift-monitoring/telemeter-client-67dd799b9b-dlmhk" Jun 08 08:27:24.464144 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:24.464104 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"adc8c82a-b8cf-4a96-8564-e0c026cba79f","Type":"ContainerStarted","Data":"6e8517a551f2e8e0046bda331b9495f36b22785609c49a8e337eeaca4dd09b23"} Jun 08 08:27:24.464452 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:24.464165 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"adc8c82a-b8cf-4a96-8564-e0c026cba79f","Type":"ContainerStarted","Data":"c0728fbd5901f2fc96d9d6a5293320ac448ab6751ebbf0e6777163fb0da8cc38"} Jun 08 08:27:24.464452 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:24.464190 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"adc8c82a-b8cf-4a96-8564-e0c026cba79f","Type":"ContainerStarted","Data":"d0a73d8cbe252ae9102b688c8d24f0e232908f55e69eb50f184e684a914cd1db"} Jun 08 08:27:24.464452 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:24.464222 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"adc8c82a-b8cf-4a96-8564-e0c026cba79f","Type":"ContainerStarted","Data":"5aabc1f4fadf3d09b8b2cd3fd92e100dba47262036a6bd4f3105ec6af9de0118"} Jun 08 08:27:24.464452 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:24.464245 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"adc8c82a-b8cf-4a96-8564-e0c026cba79f","Type":"ContainerStarted","Data":"17b54b5a633a5297908b37df40c832c326a130a3eea6c6364ce5af2c3dd03b4d"} Jun 08 08:27:24.464452 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:24.464268 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"adc8c82a-b8cf-4a96-8564-e0c026cba79f","Type":"ContainerStarted","Data":"a4822c423933c70232b172cccdc84edd8e159350418f805b95b01f53bcbe0ed4"} Jun 08 08:27:24.502672 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:24.502618 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.487862449 podStartE2EDuration="2.502598787s" totalImagesPullingTime="0s" totalInitContainerRuntime="14.736338ms" isStatefulPod=false podCreationTimestamp="2026-06-08 08:27:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 08:27:24.500336402 +0000 UTC m=+355.754547853" watchObservedRunningTime="2026-06-08 08:27:24.502598787 +0000 UTC m=+355.756810239" Jun 08 08:27:24.540389 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:24.540357 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/e260c645-ff1e-471e-b01c-61ca11ad3e22-telemeter-client-tls\") pod \"telemeter-client-67dd799b9b-dlmhk\" (UID: \"e260c645-ff1e-471e-b01c-61ca11ad3e22\") " pod="openshift-monitoring/telemeter-client-67dd799b9b-dlmhk" Jun 08 08:27:24.540635 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:24.540535 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e260c645-ff1e-471e-b01c-61ca11ad3e22-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-67dd799b9b-dlmhk\" (UID: \"e260c645-ff1e-471e-b01c-61ca11ad3e22\") " pod="openshift-monitoring/telemeter-client-67dd799b9b-dlmhk" Jun 08 08:27:24.540842 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:24.540803 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/e260c645-ff1e-471e-b01c-61ca11ad3e22-federate-client-tls\") pod \"telemeter-client-67dd799b9b-dlmhk\" (UID: \"e260c645-ff1e-471e-b01c-61ca11ad3e22\") " pod="openshift-monitoring/telemeter-client-67dd799b9b-dlmhk" Jun 08 08:27:24.540929 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:24.540864 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t46bs\" (UniqueName: \"kubernetes.io/projected/e260c645-ff1e-471e-b01c-61ca11ad3e22-kube-api-access-t46bs\") pod \"telemeter-client-67dd799b9b-dlmhk\" (UID: \"e260c645-ff1e-471e-b01c-61ca11ad3e22\") " pod="openshift-monitoring/telemeter-client-67dd799b9b-dlmhk" Jun 08 08:27:24.540983 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:24.540936 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e260c645-ff1e-471e-b01c-61ca11ad3e22-telemeter-trusted-ca-bundle\") pod \"telemeter-client-67dd799b9b-dlmhk\" (UID: \"e260c645-ff1e-471e-b01c-61ca11ad3e22\") " pod="openshift-monitoring/telemeter-client-67dd799b9b-dlmhk" Jun 08 08:27:24.541046 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:24.540992 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e260c645-ff1e-471e-b01c-61ca11ad3e22-serving-certs-ca-bundle\") pod \"telemeter-client-67dd799b9b-dlmhk\" (UID: \"e260c645-ff1e-471e-b01c-61ca11ad3e22\") " pod="openshift-monitoring/telemeter-client-67dd799b9b-dlmhk" Jun 08 08:27:24.541588 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:24.541327 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e260c645-ff1e-471e-b01c-61ca11ad3e22-metrics-client-ca\") pod \"telemeter-client-67dd799b9b-dlmhk\" (UID: \"e260c645-ff1e-471e-b01c-61ca11ad3e22\") " pod="openshift-monitoring/telemeter-client-67dd799b9b-dlmhk" Jun 08 08:27:24.541588 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:24.541398 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/e260c645-ff1e-471e-b01c-61ca11ad3e22-secret-telemeter-client\") pod \"telemeter-client-67dd799b9b-dlmhk\" (UID: \"e260c645-ff1e-471e-b01c-61ca11ad3e22\") " pod="openshift-monitoring/telemeter-client-67dd799b9b-dlmhk" Jun 08 08:27:24.541919 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:24.541886 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e260c645-ff1e-471e-b01c-61ca11ad3e22-telemeter-trusted-ca-bundle\") pod \"telemeter-client-67dd799b9b-dlmhk\" (UID: \"e260c645-ff1e-471e-b01c-61ca11ad3e22\") " pod="openshift-monitoring/telemeter-client-67dd799b9b-dlmhk" Jun 08 08:27:24.542480 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:24.542458 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e260c645-ff1e-471e-b01c-61ca11ad3e22-serving-certs-ca-bundle\") pod \"telemeter-client-67dd799b9b-dlmhk\" (UID: \"e260c645-ff1e-471e-b01c-61ca11ad3e22\") " pod="openshift-monitoring/telemeter-client-67dd799b9b-dlmhk" Jun 08 08:27:24.543043 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:24.542996 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e260c645-ff1e-471e-b01c-61ca11ad3e22-metrics-client-ca\") pod \"telemeter-client-67dd799b9b-dlmhk\" (UID: \"e260c645-ff1e-471e-b01c-61ca11ad3e22\") " pod="openshift-monitoring/telemeter-client-67dd799b9b-dlmhk" Jun 08 08:27:24.544870 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:24.544158 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e260c645-ff1e-471e-b01c-61ca11ad3e22-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-67dd799b9b-dlmhk\" (UID: \"e260c645-ff1e-471e-b01c-61ca11ad3e22\") " pod="openshift-monitoring/telemeter-client-67dd799b9b-dlmhk" Jun 08 08:27:24.544870 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:24.544622 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/e260c645-ff1e-471e-b01c-61ca11ad3e22-secret-telemeter-client\") pod \"telemeter-client-67dd799b9b-dlmhk\" (UID: \"e260c645-ff1e-471e-b01c-61ca11ad3e22\") " pod="openshift-monitoring/telemeter-client-67dd799b9b-dlmhk" Jun 08 08:27:24.545645 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:24.545621 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/e260c645-ff1e-471e-b01c-61ca11ad3e22-telemeter-client-tls\") pod \"telemeter-client-67dd799b9b-dlmhk\" (UID: \"e260c645-ff1e-471e-b01c-61ca11ad3e22\") " pod="openshift-monitoring/telemeter-client-67dd799b9b-dlmhk" Jun 08 08:27:24.545796 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:24.545646 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/e260c645-ff1e-471e-b01c-61ca11ad3e22-federate-client-tls\") pod \"telemeter-client-67dd799b9b-dlmhk\" (UID: \"e260c645-ff1e-471e-b01c-61ca11ad3e22\") " pod="openshift-monitoring/telemeter-client-67dd799b9b-dlmhk" Jun 08 08:27:24.557885 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:24.557865 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t46bs\" (UniqueName: \"kubernetes.io/projected/e260c645-ff1e-471e-b01c-61ca11ad3e22-kube-api-access-t46bs\") pod \"telemeter-client-67dd799b9b-dlmhk\" (UID: \"e260c645-ff1e-471e-b01c-61ca11ad3e22\") " pod="openshift-monitoring/telemeter-client-67dd799b9b-dlmhk" Jun 08 08:27:24.680922 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:24.680837 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 08:27:24.681145 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:24.681104 2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="3c0722fb-b284-4e40-867f-609097431624" containerName="prometheus" containerID="cri-o://bce8ff8e5b48e87bb6bf08c2a2cdfdcc89ce6f882c2db9e0ded131fcd3891ad7" gracePeriod=600 Jun 08 08:27:24.681145 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:24.681123 2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="3c0722fb-b284-4e40-867f-609097431624" containerName="kube-rbac-proxy" containerID="cri-o://549c6833a7cf135e959cef01531d045fba2b668165672fc663577a7cb8377eef" gracePeriod=600 Jun 08 08:27:24.681342 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:24.681167 2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="3c0722fb-b284-4e40-867f-609097431624" containerName="config-reloader" containerID="cri-o://b26be152a6cf5e0a78c29e7b2e234819b4a1277f92de6b356a7f16c375fc529c" gracePeriod=600 Jun 08 08:27:24.681342 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:24.681159 2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="3c0722fb-b284-4e40-867f-609097431624" containerName="thanos-sidecar" containerID="cri-o://846f757e808e930dfa6d82e326b1806f73d703992d00b4cee97b41ce8d7b0c03" gracePeriod=600 Jun 08 08:27:24.681342 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:24.681167 2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="3c0722fb-b284-4e40-867f-609097431624" containerName="kube-rbac-proxy-thanos" containerID="cri-o://35daf319d2b27b9110d681c9d55d9174fcce1e15ecdc4c7b9d14d39d9de5123b" gracePeriod=600 Jun 08 08:27:24.681342 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:24.681230 2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="3c0722fb-b284-4e40-867f-609097431624" containerName="kube-rbac-proxy-web" containerID="cri-o://1740e4bfeaddc34ea37afc495be23e65543c1bd05525fd9eb3dfdc51c3d75d35" gracePeriod=600 Jun 08 08:27:24.690274 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:24.688366 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-67dd799b9b-dlmhk" Jun 08 08:27:24.841760 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:24.841735 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-67dd799b9b-dlmhk"] Jun 08 08:27:24.843779 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:27:24.843753 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode260c645_ff1e_471e_b01c_61ca11ad3e22.slice/crio-0b31b635565785ade18c16f14e5519996e019b74c0b0caa0e99428f60c4c3b56 WatchSource:0}: Error finding container 0b31b635565785ade18c16f14e5519996e019b74c0b0caa0e99428f60c4c3b56: Status 404 returned error can't find the container with id 0b31b635565785ade18c16f14e5519996e019b74c0b0caa0e99428f60c4c3b56 Jun 08 08:27:24.845661 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:24.845644 2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 08:27:25.471288 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:25.471252 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-67dd799b9b-dlmhk" event={"ID":"e260c645-ff1e-471e-b01c-61ca11ad3e22","Type":"ContainerStarted","Data":"0b31b635565785ade18c16f14e5519996e019b74c0b0caa0e99428f60c4c3b56"} Jun 08 08:27:25.475253 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:25.475221 2570 generic.go:356] "Generic (PLEG): container finished" podID="3c0722fb-b284-4e40-867f-609097431624" containerID="35daf319d2b27b9110d681c9d55d9174fcce1e15ecdc4c7b9d14d39d9de5123b" exitCode=0 Jun 08 08:27:25.475253 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:25.475248 2570 generic.go:356] "Generic (PLEG): container finished" podID="3c0722fb-b284-4e40-867f-609097431624" containerID="549c6833a7cf135e959cef01531d045fba2b668165672fc663577a7cb8377eef" exitCode=0 Jun 08 08:27:25.475253 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:25.475257 2570 generic.go:356] "Generic (PLEG): container finished" podID="3c0722fb-b284-4e40-867f-609097431624" containerID="846f757e808e930dfa6d82e326b1806f73d703992d00b4cee97b41ce8d7b0c03" exitCode=0 Jun 08 08:27:25.475502 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:25.475264 2570 generic.go:356] "Generic (PLEG): container finished" podID="3c0722fb-b284-4e40-867f-609097431624" containerID="b26be152a6cf5e0a78c29e7b2e234819b4a1277f92de6b356a7f16c375fc529c" exitCode=0 Jun 08 08:27:25.475502 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:25.475269 2570 generic.go:356] "Generic (PLEG): container finished" podID="3c0722fb-b284-4e40-867f-609097431624" containerID="bce8ff8e5b48e87bb6bf08c2a2cdfdcc89ce6f882c2db9e0ded131fcd3891ad7" exitCode=0 Jun 08 08:27:25.475502 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:25.475298 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3c0722fb-b284-4e40-867f-609097431624","Type":"ContainerDied","Data":"35daf319d2b27b9110d681c9d55d9174fcce1e15ecdc4c7b9d14d39d9de5123b"} Jun 08 08:27:25.475502 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:25.475386 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3c0722fb-b284-4e40-867f-609097431624","Type":"ContainerDied","Data":"549c6833a7cf135e959cef01531d045fba2b668165672fc663577a7cb8377eef"} Jun 08 08:27:25.475502 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:25.475432 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3c0722fb-b284-4e40-867f-609097431624","Type":"ContainerDied","Data":"846f757e808e930dfa6d82e326b1806f73d703992d00b4cee97b41ce8d7b0c03"} Jun 08 08:27:25.475502 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:25.475473 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3c0722fb-b284-4e40-867f-609097431624","Type":"ContainerDied","Data":"b26be152a6cf5e0a78c29e7b2e234819b4a1277f92de6b356a7f16c375fc529c"} Jun 08 08:27:25.475837 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:25.475518 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3c0722fb-b284-4e40-867f-609097431624","Type":"ContainerDied","Data":"bce8ff8e5b48e87bb6bf08c2a2cdfdcc89ce6f882c2db9e0ded131fcd3891ad7"} Jun 08 08:27:25.928844 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:25.928823 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:27:26.053882 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.053855 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3c0722fb-b284-4e40-867f-609097431624-tls-assets\") pod \"3c0722fb-b284-4e40-867f-609097431624\" (UID: \"3c0722fb-b284-4e40-867f-609097431624\") " Jun 08 08:27:26.054043 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.053890 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c0722fb-b284-4e40-867f-609097431624-configmap-serving-certs-ca-bundle\") pod \"3c0722fb-b284-4e40-867f-609097431624\" (UID: \"3c0722fb-b284-4e40-867f-609097431624\") " Jun 08 08:27:26.054043 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.053913 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c0722fb-b284-4e40-867f-609097431624-prometheus-trusted-ca-bundle\") pod \"3c0722fb-b284-4e40-867f-609097431624\" (UID: \"3c0722fb-b284-4e40-867f-609097431624\") " Jun 08 08:27:26.054043 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.053932 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3c0722fb-b284-4e40-867f-609097431624-prometheus-k8s-db\") pod \"3c0722fb-b284-4e40-867f-609097431624\" (UID: \"3c0722fb-b284-4e40-867f-609097431624\") " Jun 08 08:27:26.054235 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.054071 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3c0722fb-b284-4e40-867f-609097431624-secret-prometheus-k8s-tls\") pod \"3c0722fb-b284-4e40-867f-609097431624\" (UID: \"3c0722fb-b284-4e40-867f-609097431624\") " Jun 08 08:27:26.054235 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.054121 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3c0722fb-b284-4e40-867f-609097431624-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"3c0722fb-b284-4e40-867f-609097431624\" (UID: \"3c0722fb-b284-4e40-867f-609097431624\") " Jun 08 08:27:26.054235 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.054148 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3c0722fb-b284-4e40-867f-609097431624-config-out\") pod \"3c0722fb-b284-4e40-867f-609097431624\" (UID: \"3c0722fb-b284-4e40-867f-609097431624\") " Jun 08 08:27:26.054235 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.054180 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3c0722fb-b284-4e40-867f-609097431624-config\") pod \"3c0722fb-b284-4e40-867f-609097431624\" (UID: \"3c0722fb-b284-4e40-867f-609097431624\") " Jun 08 08:27:26.054235 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.054219 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3c0722fb-b284-4e40-867f-609097431624-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"3c0722fb-b284-4e40-867f-609097431624\" (UID: \"3c0722fb-b284-4e40-867f-609097431624\") " Jun 08 08:27:26.054475 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.054246 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3c0722fb-b284-4e40-867f-609097431624-prometheus-k8s-rulefiles-0\") pod \"3c0722fb-b284-4e40-867f-609097431624\" (UID: \"3c0722fb-b284-4e40-867f-609097431624\") " Jun 08 08:27:26.054475 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.054278 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3c0722fb-b284-4e40-867f-609097431624-web-config\") pod \"3c0722fb-b284-4e40-867f-609097431624\" (UID: \"3c0722fb-b284-4e40-867f-609097431624\") " Jun 08 08:27:26.054475 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.054278 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c0722fb-b284-4e40-867f-609097431624-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "3c0722fb-b284-4e40-867f-609097431624" (UID: "3c0722fb-b284-4e40-867f-609097431624"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 08:27:26.054475 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.054310 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3c0722fb-b284-4e40-867f-609097431624-secret-grpc-tls\") pod \"3c0722fb-b284-4e40-867f-609097431624\" (UID: \"3c0722fb-b284-4e40-867f-609097431624\") " Jun 08 08:27:26.054475 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.054361 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c0722fb-b284-4e40-867f-609097431624-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "3c0722fb-b284-4e40-867f-609097431624" (UID: "3c0722fb-b284-4e40-867f-609097431624"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 08:27:26.054475 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.054381 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3c0722fb-b284-4e40-867f-609097431624-thanos-prometheus-http-client-file\") pod \"3c0722fb-b284-4e40-867f-609097431624\" (UID: \"3c0722fb-b284-4e40-867f-609097431624\") " Jun 08 08:27:26.054475 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.054420 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s8rft\" (UniqueName: \"kubernetes.io/projected/3c0722fb-b284-4e40-867f-609097431624-kube-api-access-s8rft\") pod \"3c0722fb-b284-4e40-867f-609097431624\" (UID: \"3c0722fb-b284-4e40-867f-609097431624\") " Jun 08 08:27:26.054475 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.054449 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3c0722fb-b284-4e40-867f-609097431624-prometheus-k8s-rulefiles-2\") pod \"3c0722fb-b284-4e40-867f-609097431624\" (UID: \"3c0722fb-b284-4e40-867f-609097431624\") " Jun 08 08:27:26.054914 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.054488 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3c0722fb-b284-4e40-867f-609097431624-prometheus-k8s-rulefiles-1\") pod \"3c0722fb-b284-4e40-867f-609097431624\" (UID: \"3c0722fb-b284-4e40-867f-609097431624\") " Jun 08 08:27:26.054914 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.054516 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3c0722fb-b284-4e40-867f-609097431624-secret-metrics-client-certs\") pod \"3c0722fb-b284-4e40-867f-609097431624\" (UID: \"3c0722fb-b284-4e40-867f-609097431624\") " Jun 08 08:27:26.054914 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.054555 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c0722fb-b284-4e40-867f-609097431624-configmap-kubelet-serving-ca-bundle\") pod \"3c0722fb-b284-4e40-867f-609097431624\" (UID: \"3c0722fb-b284-4e40-867f-609097431624\") " Jun 08 08:27:26.054914 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.054585 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3c0722fb-b284-4e40-867f-609097431624-secret-kube-rbac-proxy\") pod \"3c0722fb-b284-4e40-867f-609097431624\" (UID: \"3c0722fb-b284-4e40-867f-609097431624\") " Jun 08 08:27:26.054914 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.054610 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3c0722fb-b284-4e40-867f-609097431624-configmap-metrics-client-ca\") pod \"3c0722fb-b284-4e40-867f-609097431624\" (UID: \"3c0722fb-b284-4e40-867f-609097431624\") " Jun 08 08:27:26.055158 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.054929 2570 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c0722fb-b284-4e40-867f-609097431624-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-143-101.ec2.internal\" DevicePath \"\"" Jun 08 08:27:26.055158 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.054949 2570 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c0722fb-b284-4e40-867f-609097431624-prometheus-trusted-ca-bundle\") on node \"ip-10-0-143-101.ec2.internal\" DevicePath \"\"" Jun 08 08:27:26.055366 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.055342 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c0722fb-b284-4e40-867f-609097431624-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "3c0722fb-b284-4e40-867f-609097431624" (UID: "3c0722fb-b284-4e40-867f-609097431624"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 08:27:26.055462 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.055438 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c0722fb-b284-4e40-867f-609097431624-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "3c0722fb-b284-4e40-867f-609097431624" (UID: "3c0722fb-b284-4e40-867f-609097431624"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 08:27:26.056094 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.055856 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c0722fb-b284-4e40-867f-609097431624-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "3c0722fb-b284-4e40-867f-609097431624" (UID: "3c0722fb-b284-4e40-867f-609097431624"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 08:27:26.056732 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.056567 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c0722fb-b284-4e40-867f-609097431624-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "3c0722fb-b284-4e40-867f-609097431624" (UID: "3c0722fb-b284-4e40-867f-609097431624"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 08:27:26.056732 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.056569 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c0722fb-b284-4e40-867f-609097431624-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "3c0722fb-b284-4e40-867f-609097431624" (UID: "3c0722fb-b284-4e40-867f-609097431624"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 08:27:26.056896 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.056778 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c0722fb-b284-4e40-867f-609097431624-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "3c0722fb-b284-4e40-867f-609097431624" (UID: "3c0722fb-b284-4e40-867f-609097431624"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 08:27:26.056967 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.056923 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c0722fb-b284-4e40-867f-609097431624-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "3c0722fb-b284-4e40-867f-609097431624" (UID: "3c0722fb-b284-4e40-867f-609097431624"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 08:27:26.057181 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.057131 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c0722fb-b284-4e40-867f-609097431624-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "3c0722fb-b284-4e40-867f-609097431624" (UID: "3c0722fb-b284-4e40-867f-609097431624"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 08:27:26.057739 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.057463 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c0722fb-b284-4e40-867f-609097431624-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "3c0722fb-b284-4e40-867f-609097431624" (UID: "3c0722fb-b284-4e40-867f-609097431624"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 08:27:26.057899 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.057872 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c0722fb-b284-4e40-867f-609097431624-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "3c0722fb-b284-4e40-867f-609097431624" (UID: "3c0722fb-b284-4e40-867f-609097431624"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 08:27:26.057963 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.057893 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c0722fb-b284-4e40-867f-609097431624-config" (OuterVolumeSpecName: "config") pod "3c0722fb-b284-4e40-867f-609097431624" (UID: "3c0722fb-b284-4e40-867f-609097431624"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 08:27:26.058913 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.058882 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c0722fb-b284-4e40-867f-609097431624-config-out" (OuterVolumeSpecName: "config-out") pod "3c0722fb-b284-4e40-867f-609097431624" (UID: "3c0722fb-b284-4e40-867f-609097431624"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 08:27:26.059132 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.059095 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c0722fb-b284-4e40-867f-609097431624-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "3c0722fb-b284-4e40-867f-609097431624" (UID: "3c0722fb-b284-4e40-867f-609097431624"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 08:27:26.059272 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.059245 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c0722fb-b284-4e40-867f-609097431624-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "3c0722fb-b284-4e40-867f-609097431624" (UID: "3c0722fb-b284-4e40-867f-609097431624"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 08:27:26.059537 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.059516 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c0722fb-b284-4e40-867f-609097431624-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "3c0722fb-b284-4e40-867f-609097431624" (UID: "3c0722fb-b284-4e40-867f-609097431624"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 08:27:26.059824 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.059808 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c0722fb-b284-4e40-867f-609097431624-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "3c0722fb-b284-4e40-867f-609097431624" (UID: "3c0722fb-b284-4e40-867f-609097431624"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 08:27:26.060161 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.060142 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c0722fb-b284-4e40-867f-609097431624-kube-api-access-s8rft" (OuterVolumeSpecName: "kube-api-access-s8rft") pod "3c0722fb-b284-4e40-867f-609097431624" (UID: "3c0722fb-b284-4e40-867f-609097431624"). InnerVolumeSpecName "kube-api-access-s8rft". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 08:27:26.068545 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.068527 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c0722fb-b284-4e40-867f-609097431624-web-config" (OuterVolumeSpecName: "web-config") pod "3c0722fb-b284-4e40-867f-609097431624" (UID: "3c0722fb-b284-4e40-867f-609097431624"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 08:27:26.156362 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.156340 2570 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3c0722fb-b284-4e40-867f-609097431624-tls-assets\") on node \"ip-10-0-143-101.ec2.internal\" DevicePath \"\"" Jun 08 08:27:26.156362 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.156363 2570 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3c0722fb-b284-4e40-867f-609097431624-prometheus-k8s-db\") on node \"ip-10-0-143-101.ec2.internal\" DevicePath \"\"" Jun 08 08:27:26.156537 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.156372 2570 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3c0722fb-b284-4e40-867f-609097431624-secret-prometheus-k8s-tls\") on node \"ip-10-0-143-101.ec2.internal\" DevicePath \"\"" Jun 08 08:27:26.156537 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.156382 2570 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3c0722fb-b284-4e40-867f-609097431624-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-143-101.ec2.internal\" DevicePath \"\"" Jun 08 08:27:26.156537 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.156393 2570 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3c0722fb-b284-4e40-867f-609097431624-config-out\") on node \"ip-10-0-143-101.ec2.internal\" DevicePath \"\"" Jun 08 08:27:26.156537 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.156401 2570 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/3c0722fb-b284-4e40-867f-609097431624-config\") on node \"ip-10-0-143-101.ec2.internal\" DevicePath \"\"" Jun 08 08:27:26.156537 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.156413 2570 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3c0722fb-b284-4e40-867f-609097431624-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-143-101.ec2.internal\" DevicePath \"\"" Jun 08 08:27:26.156537 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.156429 2570 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3c0722fb-b284-4e40-867f-609097431624-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-143-101.ec2.internal\" DevicePath \"\"" Jun 08 08:27:26.156537 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.156442 2570 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3c0722fb-b284-4e40-867f-609097431624-web-config\") on node \"ip-10-0-143-101.ec2.internal\" DevicePath \"\"" Jun 08 08:27:26.156537 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.156455 2570 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3c0722fb-b284-4e40-867f-609097431624-secret-grpc-tls\") on node \"ip-10-0-143-101.ec2.internal\" DevicePath \"\"" Jun 08 08:27:26.156537 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.156468 2570 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3c0722fb-b284-4e40-867f-609097431624-thanos-prometheus-http-client-file\") on node \"ip-10-0-143-101.ec2.internal\" DevicePath \"\"" Jun 08 08:27:26.156537 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.156482 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s8rft\" (UniqueName: \"kubernetes.io/projected/3c0722fb-b284-4e40-867f-609097431624-kube-api-access-s8rft\") on node \"ip-10-0-143-101.ec2.internal\" DevicePath \"\"" Jun 08 08:27:26.156537 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.156493 2570 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3c0722fb-b284-4e40-867f-609097431624-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-143-101.ec2.internal\" DevicePath \"\"" Jun 08 08:27:26.156537 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.156500 2570 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3c0722fb-b284-4e40-867f-609097431624-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-143-101.ec2.internal\" DevicePath \"\"" Jun 08 08:27:26.156537 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.156509 2570 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3c0722fb-b284-4e40-867f-609097431624-secret-metrics-client-certs\") on node \"ip-10-0-143-101.ec2.internal\" DevicePath \"\"" Jun 08 08:27:26.156537 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.156519 2570 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c0722fb-b284-4e40-867f-609097431624-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-143-101.ec2.internal\" DevicePath \"\"" Jun 08 08:27:26.156537 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.156527 2570 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3c0722fb-b284-4e40-867f-609097431624-secret-kube-rbac-proxy\") on node \"ip-10-0-143-101.ec2.internal\" DevicePath \"\"" Jun 08 08:27:26.156537 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.156537 2570 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3c0722fb-b284-4e40-867f-609097431624-configmap-metrics-client-ca\") on node \"ip-10-0-143-101.ec2.internal\" DevicePath \"\"" Jun 08 08:27:26.481785 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.481755 2570 generic.go:356] "Generic (PLEG): container finished" podID="3c0722fb-b284-4e40-867f-609097431624" containerID="1740e4bfeaddc34ea37afc495be23e65543c1bd05525fd9eb3dfdc51c3d75d35" exitCode=0 Jun 08 08:27:26.482128 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.481791 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3c0722fb-b284-4e40-867f-609097431624","Type":"ContainerDied","Data":"1740e4bfeaddc34ea37afc495be23e65543c1bd05525fd9eb3dfdc51c3d75d35"} Jun 08 08:27:26.482128 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.481825 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:27:26.482128 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.481846 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3c0722fb-b284-4e40-867f-609097431624","Type":"ContainerDied","Data":"1fe93fffa169a29683af20204db93a3e09aa800078f6ec0c3035a0a9896c810e"} Jun 08 08:27:26.482128 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.481877 2570 scope.go:117] "RemoveContainer" containerID="35daf319d2b27b9110d681c9d55d9174fcce1e15ecdc4c7b9d14d39d9de5123b" Jun 08 08:27:26.493430 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.493406 2570 scope.go:117] "RemoveContainer" containerID="549c6833a7cf135e959cef01531d045fba2b668165672fc663577a7cb8377eef" Jun 08 08:27:26.500250 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.500235 2570 scope.go:117] "RemoveContainer" containerID="1740e4bfeaddc34ea37afc495be23e65543c1bd05525fd9eb3dfdc51c3d75d35" Jun 08 08:27:26.506852 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.506836 2570 scope.go:117] "RemoveContainer" containerID="846f757e808e930dfa6d82e326b1806f73d703992d00b4cee97b41ce8d7b0c03" Jun 08 08:27:26.513132 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.513111 2570 scope.go:117] "RemoveContainer" containerID="b26be152a6cf5e0a78c29e7b2e234819b4a1277f92de6b356a7f16c375fc529c" Jun 08 08:27:26.516164 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.516142 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 08:27:26.520495 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.520478 2570 scope.go:117] "RemoveContainer" containerID="bce8ff8e5b48e87bb6bf08c2a2cdfdcc89ce6f882c2db9e0ded131fcd3891ad7" Jun 08 08:27:26.522299 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.522280 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 08:27:26.527670 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.527651 2570 scope.go:117] "RemoveContainer" containerID="8469e62476ae5a7b416690297b1af7ebc0ae86e587520c1461a784d85581a8fd" Jun 08 08:27:26.533934 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.533917 2570 scope.go:117] "RemoveContainer" containerID="35daf319d2b27b9110d681c9d55d9174fcce1e15ecdc4c7b9d14d39d9de5123b" Jun 08 08:27:26.534171 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:27:26.534150 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"35daf319d2b27b9110d681c9d55d9174fcce1e15ecdc4c7b9d14d39d9de5123b\": container with ID starting with 35daf319d2b27b9110d681c9d55d9174fcce1e15ecdc4c7b9d14d39d9de5123b not found: ID does not exist" containerID="35daf319d2b27b9110d681c9d55d9174fcce1e15ecdc4c7b9d14d39d9de5123b" Jun 08 08:27:26.534225 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.534181 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35daf319d2b27b9110d681c9d55d9174fcce1e15ecdc4c7b9d14d39d9de5123b"} err="failed to get container status \"35daf319d2b27b9110d681c9d55d9174fcce1e15ecdc4c7b9d14d39d9de5123b\": rpc error: code = NotFound desc = could not find container \"35daf319d2b27b9110d681c9d55d9174fcce1e15ecdc4c7b9d14d39d9de5123b\": container with ID starting with 35daf319d2b27b9110d681c9d55d9174fcce1e15ecdc4c7b9d14d39d9de5123b not found: ID does not exist" Jun 08 08:27:26.534225 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.534198 2570 scope.go:117] "RemoveContainer" containerID="549c6833a7cf135e959cef01531d045fba2b668165672fc663577a7cb8377eef" Jun 08 08:27:26.534447 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:27:26.534429 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"549c6833a7cf135e959cef01531d045fba2b668165672fc663577a7cb8377eef\": container with ID starting with 549c6833a7cf135e959cef01531d045fba2b668165672fc663577a7cb8377eef not found: ID does not exist" containerID="549c6833a7cf135e959cef01531d045fba2b668165672fc663577a7cb8377eef" Jun 08 08:27:26.534490 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.534452 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"549c6833a7cf135e959cef01531d045fba2b668165672fc663577a7cb8377eef"} err="failed to get container status \"549c6833a7cf135e959cef01531d045fba2b668165672fc663577a7cb8377eef\": rpc error: code = NotFound desc = could not find container \"549c6833a7cf135e959cef01531d045fba2b668165672fc663577a7cb8377eef\": container with ID starting with 549c6833a7cf135e959cef01531d045fba2b668165672fc663577a7cb8377eef not found: ID does not exist" Jun 08 08:27:26.534490 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.534467 2570 scope.go:117] "RemoveContainer" containerID="1740e4bfeaddc34ea37afc495be23e65543c1bd05525fd9eb3dfdc51c3d75d35" Jun 08 08:27:26.534678 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:27:26.534663 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1740e4bfeaddc34ea37afc495be23e65543c1bd05525fd9eb3dfdc51c3d75d35\": container with ID starting with 1740e4bfeaddc34ea37afc495be23e65543c1bd05525fd9eb3dfdc51c3d75d35 not found: ID does not exist" containerID="1740e4bfeaddc34ea37afc495be23e65543c1bd05525fd9eb3dfdc51c3d75d35" Jun 08 08:27:26.534732 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.534680 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1740e4bfeaddc34ea37afc495be23e65543c1bd05525fd9eb3dfdc51c3d75d35"} err="failed to get container status \"1740e4bfeaddc34ea37afc495be23e65543c1bd05525fd9eb3dfdc51c3d75d35\": rpc error: code = NotFound desc = could not find container \"1740e4bfeaddc34ea37afc495be23e65543c1bd05525fd9eb3dfdc51c3d75d35\": container with ID starting with 1740e4bfeaddc34ea37afc495be23e65543c1bd05525fd9eb3dfdc51c3d75d35 not found: ID does not exist" Jun 08 08:27:26.534732 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.534692 2570 scope.go:117] "RemoveContainer" containerID="846f757e808e930dfa6d82e326b1806f73d703992d00b4cee97b41ce8d7b0c03" Jun 08 08:27:26.534963 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:27:26.534945 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"846f757e808e930dfa6d82e326b1806f73d703992d00b4cee97b41ce8d7b0c03\": container with ID starting with 846f757e808e930dfa6d82e326b1806f73d703992d00b4cee97b41ce8d7b0c03 not found: ID does not exist" containerID="846f757e808e930dfa6d82e326b1806f73d703992d00b4cee97b41ce8d7b0c03" Jun 08 08:27:26.535015 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.534966 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"846f757e808e930dfa6d82e326b1806f73d703992d00b4cee97b41ce8d7b0c03"} err="failed to get container status \"846f757e808e930dfa6d82e326b1806f73d703992d00b4cee97b41ce8d7b0c03\": rpc error: code = NotFound desc = could not find container \"846f757e808e930dfa6d82e326b1806f73d703992d00b4cee97b41ce8d7b0c03\": container with ID starting with 846f757e808e930dfa6d82e326b1806f73d703992d00b4cee97b41ce8d7b0c03 not found: ID does not exist" Jun 08 08:27:26.535015 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.534981 2570 scope.go:117] "RemoveContainer" containerID="b26be152a6cf5e0a78c29e7b2e234819b4a1277f92de6b356a7f16c375fc529c" Jun 08 08:27:26.535191 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:27:26.535175 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b26be152a6cf5e0a78c29e7b2e234819b4a1277f92de6b356a7f16c375fc529c\": container with ID starting with b26be152a6cf5e0a78c29e7b2e234819b4a1277f92de6b356a7f16c375fc529c not found: ID does not exist" containerID="b26be152a6cf5e0a78c29e7b2e234819b4a1277f92de6b356a7f16c375fc529c" Jun 08 08:27:26.535231 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.535196 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b26be152a6cf5e0a78c29e7b2e234819b4a1277f92de6b356a7f16c375fc529c"} err="failed to get container status \"b26be152a6cf5e0a78c29e7b2e234819b4a1277f92de6b356a7f16c375fc529c\": rpc error: code = NotFound desc = could not find container \"b26be152a6cf5e0a78c29e7b2e234819b4a1277f92de6b356a7f16c375fc529c\": container with ID starting with b26be152a6cf5e0a78c29e7b2e234819b4a1277f92de6b356a7f16c375fc529c not found: ID does not exist" Jun 08 08:27:26.535231 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.535208 2570 scope.go:117] "RemoveContainer" containerID="bce8ff8e5b48e87bb6bf08c2a2cdfdcc89ce6f882c2db9e0ded131fcd3891ad7" Jun 08 08:27:26.535393 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:27:26.535379 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bce8ff8e5b48e87bb6bf08c2a2cdfdcc89ce6f882c2db9e0ded131fcd3891ad7\": container with ID starting with bce8ff8e5b48e87bb6bf08c2a2cdfdcc89ce6f882c2db9e0ded131fcd3891ad7 not found: ID does not exist" containerID="bce8ff8e5b48e87bb6bf08c2a2cdfdcc89ce6f882c2db9e0ded131fcd3891ad7" Jun 08 08:27:26.535429 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.535397 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bce8ff8e5b48e87bb6bf08c2a2cdfdcc89ce6f882c2db9e0ded131fcd3891ad7"} err="failed to get container status \"bce8ff8e5b48e87bb6bf08c2a2cdfdcc89ce6f882c2db9e0ded131fcd3891ad7\": rpc error: code = NotFound desc = could not find container \"bce8ff8e5b48e87bb6bf08c2a2cdfdcc89ce6f882c2db9e0ded131fcd3891ad7\": container with ID starting with bce8ff8e5b48e87bb6bf08c2a2cdfdcc89ce6f882c2db9e0ded131fcd3891ad7 not found: ID does not exist" Jun 08 08:27:26.535429 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.535409 2570 scope.go:117] "RemoveContainer" containerID="8469e62476ae5a7b416690297b1af7ebc0ae86e587520c1461a784d85581a8fd" Jun 08 08:27:26.535622 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:27:26.535608 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8469e62476ae5a7b416690297b1af7ebc0ae86e587520c1461a784d85581a8fd\": container with ID starting with 8469e62476ae5a7b416690297b1af7ebc0ae86e587520c1461a784d85581a8fd not found: ID does not exist" containerID="8469e62476ae5a7b416690297b1af7ebc0ae86e587520c1461a784d85581a8fd" Jun 08 08:27:26.535678 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.535624 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8469e62476ae5a7b416690297b1af7ebc0ae86e587520c1461a784d85581a8fd"} err="failed to get container status \"8469e62476ae5a7b416690297b1af7ebc0ae86e587520c1461a784d85581a8fd\": rpc error: code = NotFound desc = could not find container \"8469e62476ae5a7b416690297b1af7ebc0ae86e587520c1461a784d85581a8fd\": container with ID starting with 8469e62476ae5a7b416690297b1af7ebc0ae86e587520c1461a784d85581a8fd not found: ID does not exist" Jun 08 08:27:26.553690 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.553670 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 08:27:26.553982 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.553970 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c0722fb-b284-4e40-867f-609097431624" containerName="init-config-reloader" Jun 08 08:27:26.554018 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.553984 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c0722fb-b284-4e40-867f-609097431624" containerName="init-config-reloader" Jun 08 08:27:26.554018 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.553993 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c0722fb-b284-4e40-867f-609097431624" containerName="kube-rbac-proxy-thanos" Jun 08 08:27:26.554018 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.553999 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c0722fb-b284-4e40-867f-609097431624" containerName="kube-rbac-proxy-thanos" Jun 08 08:27:26.554018 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.554007 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c0722fb-b284-4e40-867f-609097431624" containerName="kube-rbac-proxy-web" Jun 08 08:27:26.554018 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.554012 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c0722fb-b284-4e40-867f-609097431624" containerName="kube-rbac-proxy-web" Jun 08 08:27:26.554166 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.554020 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c0722fb-b284-4e40-867f-609097431624" containerName="prometheus" Jun 08 08:27:26.554166 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.554026 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c0722fb-b284-4e40-867f-609097431624" containerName="prometheus" Jun 08 08:27:26.554166 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.554036 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c0722fb-b284-4e40-867f-609097431624" containerName="config-reloader" Jun 08 08:27:26.554166 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.554042 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c0722fb-b284-4e40-867f-609097431624" containerName="config-reloader" Jun 08 08:27:26.554166 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.554050 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c0722fb-b284-4e40-867f-609097431624" containerName="thanos-sidecar" Jun 08 08:27:26.554166 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.554055 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c0722fb-b284-4e40-867f-609097431624" containerName="thanos-sidecar" Jun 08 08:27:26.554166 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.554064 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c0722fb-b284-4e40-867f-609097431624" containerName="kube-rbac-proxy" Jun 08 08:27:26.554166 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.554069 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c0722fb-b284-4e40-867f-609097431624" containerName="kube-rbac-proxy" Jun 08 08:27:26.554166 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.554116 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c0722fb-b284-4e40-867f-609097431624" containerName="config-reloader" Jun 08 08:27:26.554166 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.554124 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c0722fb-b284-4e40-867f-609097431624" containerName="kube-rbac-proxy-web" Jun 08 08:27:26.554166 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.554131 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c0722fb-b284-4e40-867f-609097431624" containerName="kube-rbac-proxy" Jun 08 08:27:26.554166 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.554139 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c0722fb-b284-4e40-867f-609097431624" containerName="thanos-sidecar" Jun 08 08:27:26.554166 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.554144 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c0722fb-b284-4e40-867f-609097431624" containerName="kube-rbac-proxy-thanos" Jun 08 08:27:26.554166 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.554150 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c0722fb-b284-4e40-867f-609097431624" containerName="prometheus" Jun 08 08:27:26.557482 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.557466 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:27:26.560449 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.560428 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 08 08:27:26.560531 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.560479 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 08 08:27:26.560531 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.560480 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 08 08:27:26.560729 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.560698 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 08 08:27:26.560814 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.560706 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 08 08:27:26.560814 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.560789 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 08 08:27:26.560814 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.560803 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 08 08:27:26.560965 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.560852 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 08 08:27:26.561165 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.561147 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-t99tp\"" Jun 08 08:27:26.561232 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.561175 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 08 08:27:26.561232 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.561181 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 08 08:27:26.561232 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.561179 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 08 08:27:26.561232 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.561222 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 08 08:27:26.561835 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.561818 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 08 08:27:26.562368 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.562346 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-ajfic0apu93nu\"" Jun 08 08:27:26.565027 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.565006 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 08 08:27:26.567117 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.567097 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 08 08:27:26.577472 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.577417 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 08:27:26.659763 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.659731 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa8740de-2a44-48e2-a3cf-80678f526b3d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fa8740de-2a44-48e2-a3cf-80678f526b3d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:27:26.659922 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.659776 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fa8740de-2a44-48e2-a3cf-80678f526b3d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"fa8740de-2a44-48e2-a3cf-80678f526b3d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:27:26.659922 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.659803 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fa8740de-2a44-48e2-a3cf-80678f526b3d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"fa8740de-2a44-48e2-a3cf-80678f526b3d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:27:26.659922 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.659830 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fa8740de-2a44-48e2-a3cf-80678f526b3d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"fa8740de-2a44-48e2-a3cf-80678f526b3d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:27:26.659922 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.659856 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fa8740de-2a44-48e2-a3cf-80678f526b3d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"fa8740de-2a44-48e2-a3cf-80678f526b3d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:27:26.659922 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.659881 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fa8740de-2a44-48e2-a3cf-80678f526b3d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"fa8740de-2a44-48e2-a3cf-80678f526b3d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:27:26.659922 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.659917 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ts7w5\" (UniqueName: \"kubernetes.io/projected/fa8740de-2a44-48e2-a3cf-80678f526b3d-kube-api-access-ts7w5\") pod \"prometheus-k8s-0\" (UID: \"fa8740de-2a44-48e2-a3cf-80678f526b3d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:27:26.660237 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.659933 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fa8740de-2a44-48e2-a3cf-80678f526b3d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"fa8740de-2a44-48e2-a3cf-80678f526b3d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:27:26.660237 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.659967 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fa8740de-2a44-48e2-a3cf-80678f526b3d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"fa8740de-2a44-48e2-a3cf-80678f526b3d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:27:26.660237 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.659995 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa8740de-2a44-48e2-a3cf-80678f526b3d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fa8740de-2a44-48e2-a3cf-80678f526b3d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:27:26.660237 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.660023 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fa8740de-2a44-48e2-a3cf-80678f526b3d-config-out\") pod \"prometheus-k8s-0\" (UID: \"fa8740de-2a44-48e2-a3cf-80678f526b3d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:27:26.660237 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.660068 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fa8740de-2a44-48e2-a3cf-80678f526b3d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"fa8740de-2a44-48e2-a3cf-80678f526b3d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:27:26.660237 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.660136 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fa8740de-2a44-48e2-a3cf-80678f526b3d-web-config\") pod \"prometheus-k8s-0\" (UID: \"fa8740de-2a44-48e2-a3cf-80678f526b3d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:27:26.660237 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.660164 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fa8740de-2a44-48e2-a3cf-80678f526b3d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"fa8740de-2a44-48e2-a3cf-80678f526b3d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:27:26.660237 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.660192 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fa8740de-2a44-48e2-a3cf-80678f526b3d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"fa8740de-2a44-48e2-a3cf-80678f526b3d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:27:26.660237 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.660225 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fa8740de-2a44-48e2-a3cf-80678f526b3d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"fa8740de-2a44-48e2-a3cf-80678f526b3d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:27:26.660655 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.660259 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/fa8740de-2a44-48e2-a3cf-80678f526b3d-config\") pod \"prometheus-k8s-0\" (UID: \"fa8740de-2a44-48e2-a3cf-80678f526b3d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:27:26.660655 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.660277 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa8740de-2a44-48e2-a3cf-80678f526b3d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fa8740de-2a44-48e2-a3cf-80678f526b3d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:27:26.660655 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.660292 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fa8740de-2a44-48e2-a3cf-80678f526b3d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"fa8740de-2a44-48e2-a3cf-80678f526b3d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:27:26.660655 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.660320 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fa8740de-2a44-48e2-a3cf-80678f526b3d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"fa8740de-2a44-48e2-a3cf-80678f526b3d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:27:26.761090 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.761059 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fa8740de-2a44-48e2-a3cf-80678f526b3d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"fa8740de-2a44-48e2-a3cf-80678f526b3d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:27:26.761273 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.761100 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fa8740de-2a44-48e2-a3cf-80678f526b3d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"fa8740de-2a44-48e2-a3cf-80678f526b3d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:27:26.761273 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.761128 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fa8740de-2a44-48e2-a3cf-80678f526b3d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"fa8740de-2a44-48e2-a3cf-80678f526b3d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:27:26.761273 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.761159 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fa8740de-2a44-48e2-a3cf-80678f526b3d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"fa8740de-2a44-48e2-a3cf-80678f526b3d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:27:26.761273 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.761186 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fa8740de-2a44-48e2-a3cf-80678f526b3d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"fa8740de-2a44-48e2-a3cf-80678f526b3d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:27:26.761273 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.761213 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ts7w5\" (UniqueName: \"kubernetes.io/projected/fa8740de-2a44-48e2-a3cf-80678f526b3d-kube-api-access-ts7w5\") pod \"prometheus-k8s-0\" (UID: \"fa8740de-2a44-48e2-a3cf-80678f526b3d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:27:26.761528 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.761319 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fa8740de-2a44-48e2-a3cf-80678f526b3d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"fa8740de-2a44-48e2-a3cf-80678f526b3d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:27:26.761528 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.761396 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fa8740de-2a44-48e2-a3cf-80678f526b3d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"fa8740de-2a44-48e2-a3cf-80678f526b3d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:27:26.761528 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.761442 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa8740de-2a44-48e2-a3cf-80678f526b3d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fa8740de-2a44-48e2-a3cf-80678f526b3d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:27:26.761528 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.761478 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fa8740de-2a44-48e2-a3cf-80678f526b3d-config-out\") pod \"prometheus-k8s-0\" (UID: \"fa8740de-2a44-48e2-a3cf-80678f526b3d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:27:26.761528 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.761509 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fa8740de-2a44-48e2-a3cf-80678f526b3d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"fa8740de-2a44-48e2-a3cf-80678f526b3d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:27:26.761780 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.761539 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fa8740de-2a44-48e2-a3cf-80678f526b3d-web-config\") pod \"prometheus-k8s-0\" (UID: \"fa8740de-2a44-48e2-a3cf-80678f526b3d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:27:26.761780 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.761567 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fa8740de-2a44-48e2-a3cf-80678f526b3d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"fa8740de-2a44-48e2-a3cf-80678f526b3d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:27:26.761780 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.761591 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fa8740de-2a44-48e2-a3cf-80678f526b3d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"fa8740de-2a44-48e2-a3cf-80678f526b3d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:27:26.761780 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.761616 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fa8740de-2a44-48e2-a3cf-80678f526b3d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"fa8740de-2a44-48e2-a3cf-80678f526b3d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:27:26.761780 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.761663 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/fa8740de-2a44-48e2-a3cf-80678f526b3d-config\") pod \"prometheus-k8s-0\" (UID: \"fa8740de-2a44-48e2-a3cf-80678f526b3d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:27:26.761780 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.761685 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa8740de-2a44-48e2-a3cf-80678f526b3d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fa8740de-2a44-48e2-a3cf-80678f526b3d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:27:26.761780 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.761723 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fa8740de-2a44-48e2-a3cf-80678f526b3d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"fa8740de-2a44-48e2-a3cf-80678f526b3d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:27:26.761780 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.761755 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fa8740de-2a44-48e2-a3cf-80678f526b3d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"fa8740de-2a44-48e2-a3cf-80678f526b3d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:27:26.762151 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.761790 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa8740de-2a44-48e2-a3cf-80678f526b3d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fa8740de-2a44-48e2-a3cf-80678f526b3d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:27:26.763473 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.762318 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fa8740de-2a44-48e2-a3cf-80678f526b3d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"fa8740de-2a44-48e2-a3cf-80678f526b3d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:27:26.763473 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.762455 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa8740de-2a44-48e2-a3cf-80678f526b3d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fa8740de-2a44-48e2-a3cf-80678f526b3d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:27:26.763473 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.763149 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa8740de-2a44-48e2-a3cf-80678f526b3d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fa8740de-2a44-48e2-a3cf-80678f526b3d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:27:26.764656 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.764356 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fa8740de-2a44-48e2-a3cf-80678f526b3d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"fa8740de-2a44-48e2-a3cf-80678f526b3d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:27:26.764783 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.764745 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fa8740de-2a44-48e2-a3cf-80678f526b3d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"fa8740de-2a44-48e2-a3cf-80678f526b3d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:27:26.765161 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.765136 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fa8740de-2a44-48e2-a3cf-80678f526b3d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"fa8740de-2a44-48e2-a3cf-80678f526b3d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:27:26.765374 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.765352 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fa8740de-2a44-48e2-a3cf-80678f526b3d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"fa8740de-2a44-48e2-a3cf-80678f526b3d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:27:26.765654 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.765632 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fa8740de-2a44-48e2-a3cf-80678f526b3d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"fa8740de-2a44-48e2-a3cf-80678f526b3d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:27:26.766321 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.765983 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa8740de-2a44-48e2-a3cf-80678f526b3d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fa8740de-2a44-48e2-a3cf-80678f526b3d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:27:26.766321 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.766046 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fa8740de-2a44-48e2-a3cf-80678f526b3d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"fa8740de-2a44-48e2-a3cf-80678f526b3d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:27:26.766321 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.766091 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fa8740de-2a44-48e2-a3cf-80678f526b3d-web-config\") pod \"prometheus-k8s-0\" (UID: \"fa8740de-2a44-48e2-a3cf-80678f526b3d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:27:26.766321 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.766236 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fa8740de-2a44-48e2-a3cf-80678f526b3d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"fa8740de-2a44-48e2-a3cf-80678f526b3d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:27:26.767202 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.767160 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fa8740de-2a44-48e2-a3cf-80678f526b3d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"fa8740de-2a44-48e2-a3cf-80678f526b3d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:27:26.767202 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.767176 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/fa8740de-2a44-48e2-a3cf-80678f526b3d-config\") pod \"prometheus-k8s-0\" (UID: \"fa8740de-2a44-48e2-a3cf-80678f526b3d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:27:26.767355 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.767328 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fa8740de-2a44-48e2-a3cf-80678f526b3d-config-out\") pod \"prometheus-k8s-0\" (UID: \"fa8740de-2a44-48e2-a3cf-80678f526b3d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:27:26.767681 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.767655 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fa8740de-2a44-48e2-a3cf-80678f526b3d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"fa8740de-2a44-48e2-a3cf-80678f526b3d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:27:26.768027 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.768006 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fa8740de-2a44-48e2-a3cf-80678f526b3d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"fa8740de-2a44-48e2-a3cf-80678f526b3d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:27:26.768318 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.768294 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fa8740de-2a44-48e2-a3cf-80678f526b3d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"fa8740de-2a44-48e2-a3cf-80678f526b3d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:27:26.768845 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.768826 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fa8740de-2a44-48e2-a3cf-80678f526b3d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"fa8740de-2a44-48e2-a3cf-80678f526b3d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:27:26.771415 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.771392 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ts7w5\" (UniqueName: \"kubernetes.io/projected/fa8740de-2a44-48e2-a3cf-80678f526b3d-kube-api-access-ts7w5\") pod \"prometheus-k8s-0\" (UID: \"fa8740de-2a44-48e2-a3cf-80678f526b3d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:27:26.868551 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:26.868482 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:27:27.167861 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:27.167838 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 08:27:27.170239 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:27:27.170215 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa8740de_2a44_48e2_a3cf_80678f526b3d.slice/crio-a9ce1a699b3412d0a9d387fe6ad90008d8d7da1b490dcab426459c7d837c7fe6 WatchSource:0}: Error finding container a9ce1a699b3412d0a9d387fe6ad90008d8d7da1b490dcab426459c7d837c7fe6: Status 404 returned error can't find the container with id a9ce1a699b3412d0a9d387fe6ad90008d8d7da1b490dcab426459c7d837c7fe6 Jun 08 08:27:27.210588 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:27.210558 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c0722fb-b284-4e40-867f-609097431624" path="/var/lib/kubelet/pods/3c0722fb-b284-4e40-867f-609097431624/volumes" Jun 08 08:27:27.487419 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:27.487346 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-67dd799b9b-dlmhk" event={"ID":"e260c645-ff1e-471e-b01c-61ca11ad3e22","Type":"ContainerStarted","Data":"733c7508eb8af0ce1eb154f2544cd4417d1adb351430cd2db4ffbb9278a87984"} Jun 08 08:27:27.487419 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:27.487406 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-67dd799b9b-dlmhk" event={"ID":"e260c645-ff1e-471e-b01c-61ca11ad3e22","Type":"ContainerStarted","Data":"61656a8ba08c14f6ce997ff47acf01b24932375d4c893ea3ce128b8effad9c2b"} Jun 08 08:27:27.487873 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:27.487433 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-67dd799b9b-dlmhk" event={"ID":"e260c645-ff1e-471e-b01c-61ca11ad3e22","Type":"ContainerStarted","Data":"e6969f74ae40d5e18c7516273376dd09a612af22c0cce062064e0bacccdb620e"} Jun 08 08:27:27.488859 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:27.488838 2570 generic.go:356] "Generic (PLEG): container finished" podID="fa8740de-2a44-48e2-a3cf-80678f526b3d" containerID="bc4bbe04e5efebbd8ba8a24b0436eff2335051580870da9815ecc2459721f907" exitCode=0 Jun 08 08:27:27.488947 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:27.488923 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fa8740de-2a44-48e2-a3cf-80678f526b3d","Type":"ContainerDied","Data":"bc4bbe04e5efebbd8ba8a24b0436eff2335051580870da9815ecc2459721f907"} Jun 08 08:27:27.489000 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:27.488993 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fa8740de-2a44-48e2-a3cf-80678f526b3d","Type":"ContainerStarted","Data":"a9ce1a699b3412d0a9d387fe6ad90008d8d7da1b490dcab426459c7d837c7fe6"} Jun 08 08:27:27.508477 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:27.508439 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-67dd799b9b-dlmhk" podStartSLOduration=1.290895002 podStartE2EDuration="3.50842537s" totalImagesPullingTime="2.217530368s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 08:27:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 08:27:27.507163564 +0000 UTC m=+358.761375014" watchObservedRunningTime="2026-06-08 08:27:27.50842537 +0000 UTC m=+358.762636798" Jun 08 08:27:28.499186 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:28.499133 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fa8740de-2a44-48e2-a3cf-80678f526b3d","Type":"ContainerStarted","Data":"c4eb2d55ebd0ad275d0a3ef1873390439eaec3ad0b0f443861307977cfa38c77"} Jun 08 08:27:28.499625 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:28.499222 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fa8740de-2a44-48e2-a3cf-80678f526b3d","Type":"ContainerStarted","Data":"39530ecc1303d370fe84cc3a84939bfeae588a5c83f701085bc86c481e3b750e"} Jun 08 08:27:28.499625 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:28.499249 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fa8740de-2a44-48e2-a3cf-80678f526b3d","Type":"ContainerStarted","Data":"0fbb7739296c32e360484d0e8981cfa4327b9b8c7f5816cf6a35d2f537639161"} Jun 08 08:27:28.499625 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:28.499275 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fa8740de-2a44-48e2-a3cf-80678f526b3d","Type":"ContainerStarted","Data":"97357b47c35d502f675bbbab527d6e3a4838ec5519c74330c7c9e62a6925b135"} Jun 08 08:27:28.499625 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:28.499296 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fa8740de-2a44-48e2-a3cf-80678f526b3d","Type":"ContainerStarted","Data":"7279ae21ff738ed7ef1f34a0ba1ab9e9574e0f6824d1e9f43fcbd2120400d8ff"} Jun 08 08:27:28.499625 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:28.499318 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fa8740de-2a44-48e2-a3cf-80678f526b3d","Type":"ContainerStarted","Data":"b5d5dfa8f321152441138edfb280980582b712fd0a050f1c12b4a4aebdbd1240"} Jun 08 08:27:28.535093 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:28.535038 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.511952826 podStartE2EDuration="2.535022712s" totalImagesPullingTime="0s" totalInitContainerRuntime="23.069886ms" isStatefulPod=false podCreationTimestamp="2026-06-08 08:27:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 08:27:28.532115763 +0000 UTC m=+359.786327240" watchObservedRunningTime="2026-06-08 08:27:28.535022712 +0000 UTC m=+359.789234162" Jun 08 08:27:31.869074 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:27:31.869047 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:28:26.869730 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:28:26.869670 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:28:26.884947 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:28:26.884921 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:28:27.740143 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:28:27.740115 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 08:31:23.272430 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:31:23.272394 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5f8c795659-gdmps"] Jun 08 08:31:23.275614 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:31:23.275583 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5f8c795659-gdmps" Jun 08 08:31:23.278445 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:31:23.278421 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 08 08:31:23.279342 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:31:23.279317 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 08 08:31:23.279459 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:31:23.279390 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 08 08:31:23.279459 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:31:23.279450 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 08 08:31:23.279581 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:31:23.279469 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-hzhvr\"" Jun 08 08:31:23.279581 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:31:23.279538 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 08 08:31:23.301991 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:31:23.301790 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5f8c795659-gdmps"] Jun 08 08:31:23.386935 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:31:23.386899 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a8b2fd10-cdd6-4b51-b57e-2c0a05df87c2-metrics-cert\") pod \"lws-controller-manager-5f8c795659-gdmps\" (UID: \"a8b2fd10-cdd6-4b51-b57e-2c0a05df87c2\") " pod="openshift-lws-operator/lws-controller-manager-5f8c795659-gdmps" Jun 08 08:31:23.387105 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:31:23.386938 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a8b2fd10-cdd6-4b51-b57e-2c0a05df87c2-cert\") pod \"lws-controller-manager-5f8c795659-gdmps\" (UID: \"a8b2fd10-cdd6-4b51-b57e-2c0a05df87c2\") " pod="openshift-lws-operator/lws-controller-manager-5f8c795659-gdmps" Jun 08 08:31:23.387105 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:31:23.386986 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ww6s\" (UniqueName: \"kubernetes.io/projected/a8b2fd10-cdd6-4b51-b57e-2c0a05df87c2-kube-api-access-8ww6s\") pod \"lws-controller-manager-5f8c795659-gdmps\" (UID: \"a8b2fd10-cdd6-4b51-b57e-2c0a05df87c2\") " pod="openshift-lws-operator/lws-controller-manager-5f8c795659-gdmps" Jun 08 08:31:23.387105 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:31:23.387060 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a8b2fd10-cdd6-4b51-b57e-2c0a05df87c2-manager-config\") pod \"lws-controller-manager-5f8c795659-gdmps\" (UID: \"a8b2fd10-cdd6-4b51-b57e-2c0a05df87c2\") " pod="openshift-lws-operator/lws-controller-manager-5f8c795659-gdmps" Jun 08 08:31:23.487660 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:31:23.487624 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a8b2fd10-cdd6-4b51-b57e-2c0a05df87c2-metrics-cert\") pod \"lws-controller-manager-5f8c795659-gdmps\" (UID: \"a8b2fd10-cdd6-4b51-b57e-2c0a05df87c2\") " pod="openshift-lws-operator/lws-controller-manager-5f8c795659-gdmps" Jun 08 08:31:23.487660 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:31:23.487664 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a8b2fd10-cdd6-4b51-b57e-2c0a05df87c2-cert\") pod \"lws-controller-manager-5f8c795659-gdmps\" (UID: \"a8b2fd10-cdd6-4b51-b57e-2c0a05df87c2\") " pod="openshift-lws-operator/lws-controller-manager-5f8c795659-gdmps" Jun 08 08:31:23.487888 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:31:23.487789 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ww6s\" (UniqueName: \"kubernetes.io/projected/a8b2fd10-cdd6-4b51-b57e-2c0a05df87c2-kube-api-access-8ww6s\") pod \"lws-controller-manager-5f8c795659-gdmps\" (UID: \"a8b2fd10-cdd6-4b51-b57e-2c0a05df87c2\") " pod="openshift-lws-operator/lws-controller-manager-5f8c795659-gdmps" Jun 08 08:31:23.487888 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:31:23.487821 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a8b2fd10-cdd6-4b51-b57e-2c0a05df87c2-manager-config\") pod \"lws-controller-manager-5f8c795659-gdmps\" (UID: \"a8b2fd10-cdd6-4b51-b57e-2c0a05df87c2\") " pod="openshift-lws-operator/lws-controller-manager-5f8c795659-gdmps" Jun 08 08:31:23.488484 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:31:23.488460 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a8b2fd10-cdd6-4b51-b57e-2c0a05df87c2-manager-config\") pod \"lws-controller-manager-5f8c795659-gdmps\" (UID: \"a8b2fd10-cdd6-4b51-b57e-2c0a05df87c2\") " pod="openshift-lws-operator/lws-controller-manager-5f8c795659-gdmps" Jun 08 08:31:23.490196 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:31:23.490171 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a8b2fd10-cdd6-4b51-b57e-2c0a05df87c2-metrics-cert\") pod \"lws-controller-manager-5f8c795659-gdmps\" (UID: \"a8b2fd10-cdd6-4b51-b57e-2c0a05df87c2\") " pod="openshift-lws-operator/lws-controller-manager-5f8c795659-gdmps" Jun 08 08:31:23.490305 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:31:23.490241 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a8b2fd10-cdd6-4b51-b57e-2c0a05df87c2-cert\") pod \"lws-controller-manager-5f8c795659-gdmps\" (UID: \"a8b2fd10-cdd6-4b51-b57e-2c0a05df87c2\") " pod="openshift-lws-operator/lws-controller-manager-5f8c795659-gdmps" Jun 08 08:31:23.501021 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:31:23.501001 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ww6s\" (UniqueName: \"kubernetes.io/projected/a8b2fd10-cdd6-4b51-b57e-2c0a05df87c2-kube-api-access-8ww6s\") pod \"lws-controller-manager-5f8c795659-gdmps\" (UID: \"a8b2fd10-cdd6-4b51-b57e-2c0a05df87c2\") " pod="openshift-lws-operator/lws-controller-manager-5f8c795659-gdmps" Jun 08 08:31:23.517635 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:31:23.517608 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6988fb75f5-2pmd2"] Jun 08 08:31:23.521093 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:31:23.521080 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6988fb75f5-2pmd2" Jun 08 08:31:23.526875 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:31:23.526787 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-gq2x5\"" Jun 08 08:31:23.526875 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:31:23.526794 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 08 08:31:23.526875 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:31:23.526825 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 08 08:31:23.527089 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:31:23.526819 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 08 08:31:23.531244 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:31:23.531228 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 08 08:31:23.567418 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:31:23.567392 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6988fb75f5-2pmd2"] Jun 08 08:31:23.586854 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:31:23.586831 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5f8c795659-gdmps" Jun 08 08:31:23.588315 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:31:23.588292 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3348bfd2-3427-4eb5-95e5-4c43419f44fe-webhook-cert\") pod \"opendatahub-operator-controller-manager-6988fb75f5-2pmd2\" (UID: \"3348bfd2-3427-4eb5-95e5-4c43419f44fe\") " pod="opendatahub/opendatahub-operator-controller-manager-6988fb75f5-2pmd2" Jun 08 08:31:23.588409 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:31:23.588324 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5grrc\" (UniqueName: \"kubernetes.io/projected/3348bfd2-3427-4eb5-95e5-4c43419f44fe-kube-api-access-5grrc\") pod \"opendatahub-operator-controller-manager-6988fb75f5-2pmd2\" (UID: \"3348bfd2-3427-4eb5-95e5-4c43419f44fe\") " pod="opendatahub/opendatahub-operator-controller-manager-6988fb75f5-2pmd2" Jun 08 08:31:23.588409 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:31:23.588350 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3348bfd2-3427-4eb5-95e5-4c43419f44fe-tmp\") pod \"opendatahub-operator-controller-manager-6988fb75f5-2pmd2\" (UID: \"3348bfd2-3427-4eb5-95e5-4c43419f44fe\") " pod="opendatahub/opendatahub-operator-controller-manager-6988fb75f5-2pmd2" Jun 08 08:31:23.588485 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:31:23.588414 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3348bfd2-3427-4eb5-95e5-4c43419f44fe-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6988fb75f5-2pmd2\" (UID: \"3348bfd2-3427-4eb5-95e5-4c43419f44fe\") " pod="opendatahub/opendatahub-operator-controller-manager-6988fb75f5-2pmd2" Jun 08 08:31:23.588485 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:31:23.588450 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3348bfd2-3427-4eb5-95e5-4c43419f44fe-manifests\") pod \"opendatahub-operator-controller-manager-6988fb75f5-2pmd2\" (UID: \"3348bfd2-3427-4eb5-95e5-4c43419f44fe\") " pod="opendatahub/opendatahub-operator-controller-manager-6988fb75f5-2pmd2" Jun 08 08:31:23.689341 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:31:23.689301 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3348bfd2-3427-4eb5-95e5-4c43419f44fe-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6988fb75f5-2pmd2\" (UID: \"3348bfd2-3427-4eb5-95e5-4c43419f44fe\") " pod="opendatahub/opendatahub-operator-controller-manager-6988fb75f5-2pmd2" Jun 08 08:31:23.689514 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:31:23.689376 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3348bfd2-3427-4eb5-95e5-4c43419f44fe-manifests\") pod \"opendatahub-operator-controller-manager-6988fb75f5-2pmd2\" (UID: \"3348bfd2-3427-4eb5-95e5-4c43419f44fe\") " pod="opendatahub/opendatahub-operator-controller-manager-6988fb75f5-2pmd2" Jun 08 08:31:23.689514 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:31:23.689443 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3348bfd2-3427-4eb5-95e5-4c43419f44fe-webhook-cert\") pod \"opendatahub-operator-controller-manager-6988fb75f5-2pmd2\" (UID: \"3348bfd2-3427-4eb5-95e5-4c43419f44fe\") " pod="opendatahub/opendatahub-operator-controller-manager-6988fb75f5-2pmd2" Jun 08 08:31:23.689514 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:31:23.689474 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5grrc\" (UniqueName: \"kubernetes.io/projected/3348bfd2-3427-4eb5-95e5-4c43419f44fe-kube-api-access-5grrc\") pod \"opendatahub-operator-controller-manager-6988fb75f5-2pmd2\" (UID: \"3348bfd2-3427-4eb5-95e5-4c43419f44fe\") " pod="opendatahub/opendatahub-operator-controller-manager-6988fb75f5-2pmd2" Jun 08 08:31:23.689514 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:31:23.689505 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3348bfd2-3427-4eb5-95e5-4c43419f44fe-tmp\") pod \"opendatahub-operator-controller-manager-6988fb75f5-2pmd2\" (UID: \"3348bfd2-3427-4eb5-95e5-4c43419f44fe\") " pod="opendatahub/opendatahub-operator-controller-manager-6988fb75f5-2pmd2" Jun 08 08:31:23.689891 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:31:23.689865 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3348bfd2-3427-4eb5-95e5-4c43419f44fe-manifests\") pod \"opendatahub-operator-controller-manager-6988fb75f5-2pmd2\" (UID: \"3348bfd2-3427-4eb5-95e5-4c43419f44fe\") " pod="opendatahub/opendatahub-operator-controller-manager-6988fb75f5-2pmd2" Jun 08 08:31:23.691885 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:31:23.691860 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3348bfd2-3427-4eb5-95e5-4c43419f44fe-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6988fb75f5-2pmd2\" (UID: \"3348bfd2-3427-4eb5-95e5-4c43419f44fe\") " pod="opendatahub/opendatahub-operator-controller-manager-6988fb75f5-2pmd2" Jun 08 08:31:23.692090 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:31:23.692074 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3348bfd2-3427-4eb5-95e5-4c43419f44fe-tmp\") pod \"opendatahub-operator-controller-manager-6988fb75f5-2pmd2\" (UID: \"3348bfd2-3427-4eb5-95e5-4c43419f44fe\") " pod="opendatahub/opendatahub-operator-controller-manager-6988fb75f5-2pmd2" Jun 08 08:31:23.692196 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:31:23.692176 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3348bfd2-3427-4eb5-95e5-4c43419f44fe-webhook-cert\") pod \"opendatahub-operator-controller-manager-6988fb75f5-2pmd2\" (UID: \"3348bfd2-3427-4eb5-95e5-4c43419f44fe\") " pod="opendatahub/opendatahub-operator-controller-manager-6988fb75f5-2pmd2" Jun 08 08:31:23.701511 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:31:23.701487 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5grrc\" (UniqueName: \"kubernetes.io/projected/3348bfd2-3427-4eb5-95e5-4c43419f44fe-kube-api-access-5grrc\") pod \"opendatahub-operator-controller-manager-6988fb75f5-2pmd2\" (UID: \"3348bfd2-3427-4eb5-95e5-4c43419f44fe\") " pod="opendatahub/opendatahub-operator-controller-manager-6988fb75f5-2pmd2" Jun 08 08:31:23.721265 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:31:23.721238 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5f8c795659-gdmps"] Jun 08 08:31:23.723815 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:31:23.723792 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8b2fd10_cdd6_4b51_b57e_2c0a05df87c2.slice/crio-02af0c816fc6721e6351bda8b55b3611986c790bf263396ccef850ef4d79b641 WatchSource:0}: Error finding container 02af0c816fc6721e6351bda8b55b3611986c790bf263396ccef850ef4d79b641: Status 404 returned error can't find the container with id 02af0c816fc6721e6351bda8b55b3611986c790bf263396ccef850ef4d79b641 Jun 08 08:31:23.831399 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:31:23.831378 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6988fb75f5-2pmd2" Jun 08 08:31:23.968072 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:31:23.967995 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6988fb75f5-2pmd2"] Jun 08 08:31:23.970688 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:31:23.970664 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3348bfd2_3427_4eb5_95e5_4c43419f44fe.slice/crio-4e7fdcbb5f75b4e92fed8c24b733b4c7916a488cf0ed09ce9d14843c7c74ff0b WatchSource:0}: Error finding container 4e7fdcbb5f75b4e92fed8c24b733b4c7916a488cf0ed09ce9d14843c7c74ff0b: Status 404 returned error can't find the container with id 4e7fdcbb5f75b4e92fed8c24b733b4c7916a488cf0ed09ce9d14843c7c74ff0b Jun 08 08:31:24.409775 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:31:24.409743 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6988fb75f5-2pmd2" event={"ID":"3348bfd2-3427-4eb5-95e5-4c43419f44fe","Type":"ContainerStarted","Data":"4e7fdcbb5f75b4e92fed8c24b733b4c7916a488cf0ed09ce9d14843c7c74ff0b"} Jun 08 08:31:24.410827 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:31:24.410800 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5f8c795659-gdmps" event={"ID":"a8b2fd10-cdd6-4b51-b57e-2c0a05df87c2","Type":"ContainerStarted","Data":"02af0c816fc6721e6351bda8b55b3611986c790bf263396ccef850ef4d79b641"} Jun 08 08:31:28.433208 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:31:28.433167 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6988fb75f5-2pmd2" event={"ID":"3348bfd2-3427-4eb5-95e5-4c43419f44fe","Type":"ContainerStarted","Data":"01b8520fba53c60e25682c05b1a6fa8c6cd1e204b4aa00d48091246bd5dd52f8"} Jun 08 08:31:28.434611 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:31:28.434583 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5f8c795659-gdmps" event={"ID":"a8b2fd10-cdd6-4b51-b57e-2c0a05df87c2","Type":"ContainerStarted","Data":"486c618efb18e064799b01fc9af833bf002035c747499cd6615280a7aa54a574"} Jun 08 08:31:28.434760 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:31:28.434648 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5f8c795659-gdmps" Jun 08 08:31:28.480618 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:31:28.480524 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5f8c795659-gdmps" podStartSLOduration=0.969531349 podStartE2EDuration="5.480509958s" totalImagesPullingTime="4.510978609s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 08:31:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 08:31:28.479250354 +0000 UTC m=+599.733461804" watchObservedRunningTime="2026-06-08 08:31:28.480509958 +0000 UTC m=+599.734721407" Jun 08 08:31:29.440349 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:31:29.440309 2570 generic.go:356] "Generic (PLEG): container finished" podID="3348bfd2-3427-4eb5-95e5-4c43419f44fe" containerID="01b8520fba53c60e25682c05b1a6fa8c6cd1e204b4aa00d48091246bd5dd52f8" exitCode=0 Jun 08 08:31:29.440803 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:31:29.440388 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6988fb75f5-2pmd2" event={"ID":"3348bfd2-3427-4eb5-95e5-4c43419f44fe","Type":"ContainerDied","Data":"01b8520fba53c60e25682c05b1a6fa8c6cd1e204b4aa00d48091246bd5dd52f8"} Jun 08 08:31:30.446984 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:31:30.446948 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6988fb75f5-2pmd2" event={"ID":"3348bfd2-3427-4eb5-95e5-4c43419f44fe","Type":"ContainerStarted","Data":"aaf0bc94ef35e59ef9aef2617a494cb0cf7903077210caa17647598efa0b7fbf"} Jun 08 08:31:30.447390 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:31:30.447057 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6988fb75f5-2pmd2" Jun 08 08:31:30.469463 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:31:30.469405 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6988fb75f5-2pmd2" podStartSLOduration=1.898777462 podStartE2EDuration="7.469388454s" totalImagesPullingTime="4.600014847s" totalInitContainerRuntime="970.596145ms" isStatefulPod=false podCreationTimestamp="2026-06-08 08:31:23 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 08:31:30.467870167 +0000 UTC m=+601.722081617" watchObservedRunningTime="2026-06-08 08:31:30.469388454 +0000 UTC m=+601.723599904" Jun 08 08:31:39.442593 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:31:39.442557 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5f8c795659-gdmps" Jun 08 08:31:41.453026 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:31:41.452997 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6988fb75f5-2pmd2" Jun 08 08:31:43.640749 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:31:43.640702 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7464d86fc4-kq82r"] Jun 08 08:31:43.648130 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:31:43.648113 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7464d86fc4-kq82r" Jun 08 08:31:43.651847 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:31:43.651822 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-6dq4z\"" Jun 08 08:31:43.651980 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:31:43.651930 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 08 08:31:43.659557 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:31:43.659534 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7464d86fc4-kq82r"] Jun 08 08:31:43.665375 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:31:43.665352 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 08 08:31:43.665906 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:31:43.665886 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ce2c206-f875-4aff-a52c-53cb3c6158d0-tls-certs\") pod \"kube-auth-proxy-7464d86fc4-kq82r\" (UID: \"8ce2c206-f875-4aff-a52c-53cb3c6158d0\") " pod="openshift-ingress/kube-auth-proxy-7464d86fc4-kq82r" Jun 08 08:31:43.666008 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:31:43.665921 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96bwv\" (UniqueName: \"kubernetes.io/projected/8ce2c206-f875-4aff-a52c-53cb3c6158d0-kube-api-access-96bwv\") pod \"kube-auth-proxy-7464d86fc4-kq82r\" (UID: \"8ce2c206-f875-4aff-a52c-53cb3c6158d0\") " pod="openshift-ingress/kube-auth-proxy-7464d86fc4-kq82r" Jun 08 08:31:43.666008 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:31:43.666001 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8ce2c206-f875-4aff-a52c-53cb3c6158d0-tmp\") pod \"kube-auth-proxy-7464d86fc4-kq82r\" (UID: \"8ce2c206-f875-4aff-a52c-53cb3c6158d0\") " pod="openshift-ingress/kube-auth-proxy-7464d86fc4-kq82r" Jun 08 08:31:43.767111 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:31:43.767080 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ce2c206-f875-4aff-a52c-53cb3c6158d0-tls-certs\") pod \"kube-auth-proxy-7464d86fc4-kq82r\" (UID: \"8ce2c206-f875-4aff-a52c-53cb3c6158d0\") " pod="openshift-ingress/kube-auth-proxy-7464d86fc4-kq82r" Jun 08 08:31:43.767111 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:31:43.767113 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96bwv\" (UniqueName: \"kubernetes.io/projected/8ce2c206-f875-4aff-a52c-53cb3c6158d0-kube-api-access-96bwv\") pod \"kube-auth-proxy-7464d86fc4-kq82r\" (UID: \"8ce2c206-f875-4aff-a52c-53cb3c6158d0\") " pod="openshift-ingress/kube-auth-proxy-7464d86fc4-kq82r" Jun 08 08:31:43.767304 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:31:43.767216 2570 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jun 08 08:31:43.767304 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:31:43.767246 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8ce2c206-f875-4aff-a52c-53cb3c6158d0-tmp\") pod \"kube-auth-proxy-7464d86fc4-kq82r\" (UID: \"8ce2c206-f875-4aff-a52c-53cb3c6158d0\") " pod="openshift-ingress/kube-auth-proxy-7464d86fc4-kq82r" Jun 08 08:31:43.767304 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:31:43.767280 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ce2c206-f875-4aff-a52c-53cb3c6158d0-tls-certs podName:8ce2c206-f875-4aff-a52c-53cb3c6158d0 nodeName:}" failed. No retries permitted until 2026-06-08 08:31:44.267262526 +0000 UTC m=+615.521473954 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/8ce2c206-f875-4aff-a52c-53cb3c6158d0-tls-certs") pod "kube-auth-proxy-7464d86fc4-kq82r" (UID: "8ce2c206-f875-4aff-a52c-53cb3c6158d0") : secret "kube-auth-proxy-tls" not found Jun 08 08:31:43.769355 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:31:43.769334 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8ce2c206-f875-4aff-a52c-53cb3c6158d0-tmp\") pod \"kube-auth-proxy-7464d86fc4-kq82r\" (UID: \"8ce2c206-f875-4aff-a52c-53cb3c6158d0\") " pod="openshift-ingress/kube-auth-proxy-7464d86fc4-kq82r" Jun 08 08:31:43.811234 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:31:43.811168 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-96bwv\" (UniqueName: \"kubernetes.io/projected/8ce2c206-f875-4aff-a52c-53cb3c6158d0-kube-api-access-96bwv\") pod \"kube-auth-proxy-7464d86fc4-kq82r\" (UID: \"8ce2c206-f875-4aff-a52c-53cb3c6158d0\") " pod="openshift-ingress/kube-auth-proxy-7464d86fc4-kq82r" Jun 08 08:31:44.273063 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:31:44.273013 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ce2c206-f875-4aff-a52c-53cb3c6158d0-tls-certs\") pod \"kube-auth-proxy-7464d86fc4-kq82r\" (UID: \"8ce2c206-f875-4aff-a52c-53cb3c6158d0\") " pod="openshift-ingress/kube-auth-proxy-7464d86fc4-kq82r" Jun 08 08:31:44.275441 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:31:44.275417 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ce2c206-f875-4aff-a52c-53cb3c6158d0-tls-certs\") pod \"kube-auth-proxy-7464d86fc4-kq82r\" (UID: \"8ce2c206-f875-4aff-a52c-53cb3c6158d0\") " pod="openshift-ingress/kube-auth-proxy-7464d86fc4-kq82r" Jun 08 08:31:44.557764 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:31:44.557740 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7464d86fc4-kq82r" Jun 08 08:31:44.696070 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:31:44.696047 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7464d86fc4-kq82r"] Jun 08 08:31:44.698695 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:31:44.698667 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ce2c206_f875_4aff_a52c_53cb3c6158d0.slice/crio-fc41472f695736776b75a895bbba9b06be005d2b7f8ea1d238eb5bab5642f555 WatchSource:0}: Error finding container fc41472f695736776b75a895bbba9b06be005d2b7f8ea1d238eb5bab5642f555: Status 404 returned error can't find the container with id fc41472f695736776b75a895bbba9b06be005d2b7f8ea1d238eb5bab5642f555 Jun 08 08:31:45.516195 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:31:45.516146 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7464d86fc4-kq82r" event={"ID":"8ce2c206-f875-4aff-a52c-53cb3c6158d0","Type":"ContainerStarted","Data":"fc41472f695736776b75a895bbba9b06be005d2b7f8ea1d238eb5bab5642f555"} Jun 08 08:31:47.528837 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:31:47.528804 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7464d86fc4-kq82r" event={"ID":"8ce2c206-f875-4aff-a52c-53cb3c6158d0","Type":"ContainerStarted","Data":"84f08c5bf18c0380d3ea92d4be35f1edcefc995bbf82fcc2e71f3f3cea802971"} Jun 08 08:31:47.546446 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:31:47.546404 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7464d86fc4-kq82r" podStartSLOduration=1.7943764199999999 podStartE2EDuration="4.546389893s" totalImagesPullingTime="2.752013473s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 08:31:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 08:31:47.544292272 +0000 UTC m=+618.798503722" watchObservedRunningTime="2026-06-08 08:31:47.546389893 +0000 UTC m=+618.800601356" Jun 08 08:33:24.158747 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:33:24.158657 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-lhczr"] Jun 08 08:33:24.162083 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:33:24.162062 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-lhczr" Jun 08 08:33:24.165794 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:33:24.165767 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-gjz77\"" Jun 08 08:33:24.165794 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:33:24.165783 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 08 08:33:24.166647 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:33:24.166623 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 08 08:33:24.167363 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:33:24.167345 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 08 08:33:24.173901 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:33:24.173866 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-lhczr"] Jun 08 08:33:24.300543 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:33:24.300518 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfgqb\" (UniqueName: \"kubernetes.io/projected/a7d720ec-93a9-4788-90d3-0cbf6fada76d-kube-api-access-gfgqb\") pod \"dns-operator-controller-manager-864dd78c4c-lhczr\" (UID: \"a7d720ec-93a9-4788-90d3-0cbf6fada76d\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-lhczr" Jun 08 08:33:24.401391 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:33:24.401364 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfgqb\" (UniqueName: \"kubernetes.io/projected/a7d720ec-93a9-4788-90d3-0cbf6fada76d-kube-api-access-gfgqb\") pod \"dns-operator-controller-manager-864dd78c4c-lhczr\" (UID: \"a7d720ec-93a9-4788-90d3-0cbf6fada76d\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-lhczr" Jun 08 08:33:24.409376 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:33:24.409328 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfgqb\" (UniqueName: \"kubernetes.io/projected/a7d720ec-93a9-4788-90d3-0cbf6fada76d-kube-api-access-gfgqb\") pod \"dns-operator-controller-manager-864dd78c4c-lhczr\" (UID: \"a7d720ec-93a9-4788-90d3-0cbf6fada76d\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-lhczr" Jun 08 08:33:24.476021 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:33:24.476000 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-lhczr" Jun 08 08:33:24.605989 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:33:24.605898 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-lhczr"] Jun 08 08:33:24.608297 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:33:24.608269 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7d720ec_93a9_4788_90d3_0cbf6fada76d.slice/crio-9061536905e1c53870111c557af199244aa7b55775b3e083a63480b750e14e35 WatchSource:0}: Error finding container 9061536905e1c53870111c557af199244aa7b55775b3e083a63480b750e14e35: Status 404 returned error can't find the container with id 9061536905e1c53870111c557af199244aa7b55775b3e083a63480b750e14e35 Jun 08 08:33:24.610280 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:33:24.610265 2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 08:33:24.948569 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:33:24.948536 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-lhczr" event={"ID":"a7d720ec-93a9-4788-90d3-0cbf6fada76d","Type":"ContainerStarted","Data":"9061536905e1c53870111c557af199244aa7b55775b3e083a63480b750e14e35"} Jun 08 08:33:25.079528 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:33:25.079499 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-hzsnn"] Jun 08 08:33:25.084072 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:33:25.084057 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hzsnn" Jun 08 08:33:25.086607 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:33:25.086583 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jun 08 08:33:25.086758 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:33:25.086673 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jun 08 08:33:25.086905 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:33:25.086892 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-h7s27\"" Jun 08 08:33:25.091557 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:33:25.091537 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-hzsnn"] Jun 08 08:33:25.207870 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:33:25.207797 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ec00ed92-6d5c-4ea1-8ae2-c8b50d3bc3c4-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-hzsnn\" (UID: \"ec00ed92-6d5c-4ea1-8ae2-c8b50d3bc3c4\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hzsnn" Jun 08 08:33:25.208194 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:33:25.207866 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/ec00ed92-6d5c-4ea1-8ae2-c8b50d3bc3c4-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-hzsnn\" (UID: \"ec00ed92-6d5c-4ea1-8ae2-c8b50d3bc3c4\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hzsnn" Jun 08 08:33:25.208194 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:33:25.207890 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9djg5\" (UniqueName: \"kubernetes.io/projected/ec00ed92-6d5c-4ea1-8ae2-c8b50d3bc3c4-kube-api-access-9djg5\") pod \"kuadrant-console-plugin-66b5774985-hzsnn\" (UID: \"ec00ed92-6d5c-4ea1-8ae2-c8b50d3bc3c4\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hzsnn" Jun 08 08:33:25.308463 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:33:25.308409 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ec00ed92-6d5c-4ea1-8ae2-c8b50d3bc3c4-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-hzsnn\" (UID: \"ec00ed92-6d5c-4ea1-8ae2-c8b50d3bc3c4\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hzsnn" Jun 08 08:33:25.308463 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:33:25.308458 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/ec00ed92-6d5c-4ea1-8ae2-c8b50d3bc3c4-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-hzsnn\" (UID: \"ec00ed92-6d5c-4ea1-8ae2-c8b50d3bc3c4\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hzsnn" Jun 08 08:33:25.308642 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:33:25.308477 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9djg5\" (UniqueName: \"kubernetes.io/projected/ec00ed92-6d5c-4ea1-8ae2-c8b50d3bc3c4-kube-api-access-9djg5\") pod \"kuadrant-console-plugin-66b5774985-hzsnn\" (UID: \"ec00ed92-6d5c-4ea1-8ae2-c8b50d3bc3c4\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hzsnn" Jun 08 08:33:25.308642 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:33:25.308575 2570 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jun 08 08:33:25.308746 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:33:25.308661 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec00ed92-6d5c-4ea1-8ae2-c8b50d3bc3c4-plugin-serving-cert podName:ec00ed92-6d5c-4ea1-8ae2-c8b50d3bc3c4 nodeName:}" failed. No retries permitted until 2026-06-08 08:33:25.808638564 +0000 UTC m=+717.062850002 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/ec00ed92-6d5c-4ea1-8ae2-c8b50d3bc3c4-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-hzsnn" (UID: "ec00ed92-6d5c-4ea1-8ae2-c8b50d3bc3c4") : secret "plugin-serving-cert" not found Jun 08 08:33:25.309094 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:33:25.309077 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ec00ed92-6d5c-4ea1-8ae2-c8b50d3bc3c4-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-hzsnn\" (UID: \"ec00ed92-6d5c-4ea1-8ae2-c8b50d3bc3c4\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hzsnn" Jun 08 08:33:25.322458 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:33:25.322437 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9djg5\" (UniqueName: \"kubernetes.io/projected/ec00ed92-6d5c-4ea1-8ae2-c8b50d3bc3c4-kube-api-access-9djg5\") pod \"kuadrant-console-plugin-66b5774985-hzsnn\" (UID: \"ec00ed92-6d5c-4ea1-8ae2-c8b50d3bc3c4\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hzsnn" Jun 08 08:33:25.812693 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:33:25.812656 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/ec00ed92-6d5c-4ea1-8ae2-c8b50d3bc3c4-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-hzsnn\" (UID: \"ec00ed92-6d5c-4ea1-8ae2-c8b50d3bc3c4\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hzsnn" Jun 08 08:33:25.815264 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:33:25.815240 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/ec00ed92-6d5c-4ea1-8ae2-c8b50d3bc3c4-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-hzsnn\" (UID: \"ec00ed92-6d5c-4ea1-8ae2-c8b50d3bc3c4\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hzsnn" Jun 08 08:33:25.994059 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:33:25.994013 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hzsnn" Jun 08 08:33:26.128661 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:33:26.128628 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-hzsnn"] Jun 08 08:33:26.131851 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:33:26.131825 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podec00ed92_6d5c_4ea1_8ae2_c8b50d3bc3c4.slice/crio-9fc9fc85cc15312e9411b10e0ad7a86cab361a6b6d63bba8b0b9c8149f7e9a9e WatchSource:0}: Error finding container 9fc9fc85cc15312e9411b10e0ad7a86cab361a6b6d63bba8b0b9c8149f7e9a9e: Status 404 returned error can't find the container with id 9fc9fc85cc15312e9411b10e0ad7a86cab361a6b6d63bba8b0b9c8149f7e9a9e Jun 08 08:33:26.958776 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:33:26.958668 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-lhczr" event={"ID":"a7d720ec-93a9-4788-90d3-0cbf6fada76d","Type":"ContainerStarted","Data":"de841e89034f42a7cb0c47f2f6a0db22179ed3316bf26f5b798a3a606383700b"} Jun 08 08:33:26.958776 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:33:26.958759 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-lhczr" Jun 08 08:33:26.960005 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:33:26.959982 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hzsnn" event={"ID":"ec00ed92-6d5c-4ea1-8ae2-c8b50d3bc3c4","Type":"ContainerStarted","Data":"9fc9fc85cc15312e9411b10e0ad7a86cab361a6b6d63bba8b0b9c8149f7e9a9e"} Jun 08 08:33:26.984336 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:33:26.984283 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-lhczr" podStartSLOduration=0.894173674 podStartE2EDuration="2.984265936s" totalImagesPullingTime="2.090092262s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 08:33:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 08:33:26.982525469 +0000 UTC m=+718.236736921" watchObservedRunningTime="2026-06-08 08:33:26.984265936 +0000 UTC m=+718.238477386" Jun 08 08:33:37.967326 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:33:37.967286 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-lhczr" Jun 08 08:33:49.079507 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:33:49.079473 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hzsnn" event={"ID":"ec00ed92-6d5c-4ea1-8ae2-c8b50d3bc3c4","Type":"ContainerStarted","Data":"efdfe413d864253ef9d6d5c81c3a235d54cdf0dc523208eaae60f0b5a9943e1c"} Jun 08 08:33:49.099309 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:33:49.099262 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hzsnn" podStartSLOduration=1.242139147 podStartE2EDuration="24.099248447s" totalImagesPullingTime="22.8571093s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 08:33:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 08:33:49.098288533 +0000 UTC m=+740.352499986" watchObservedRunningTime="2026-06-08 08:33:49.099248447 +0000 UTC m=+740.353459896" Jun 08 08:34:09.124778 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:34:09.124747 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-5dvzt"] Jun 08 08:34:09.129238 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:34:09.129220 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-5dvzt" Jun 08 08:34:09.131920 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:34:09.131900 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 08 08:34:09.137580 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:34:09.137553 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-5dvzt"] Jun 08 08:34:09.218919 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:34:09.218889 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-5dvzt"] Jun 08 08:34:09.292359 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:34:09.292334 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c0cafd4c-dbfb-44b7-bb76-f033343166e1-config-file\") pod \"limitador-limitador-64c94fd64f-5dvzt\" (UID: \"c0cafd4c-dbfb-44b7-bb76-f033343166e1\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-5dvzt" Jun 08 08:34:09.292526 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:34:09.292367 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2h6q\" (UniqueName: \"kubernetes.io/projected/c0cafd4c-dbfb-44b7-bb76-f033343166e1-kube-api-access-s2h6q\") pod \"limitador-limitador-64c94fd64f-5dvzt\" (UID: \"c0cafd4c-dbfb-44b7-bb76-f033343166e1\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-5dvzt" Jun 08 08:34:09.393525 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:34:09.393455 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c0cafd4c-dbfb-44b7-bb76-f033343166e1-config-file\") pod \"limitador-limitador-64c94fd64f-5dvzt\" (UID: \"c0cafd4c-dbfb-44b7-bb76-f033343166e1\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-5dvzt" Jun 08 08:34:09.393525 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:34:09.393489 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2h6q\" (UniqueName: \"kubernetes.io/projected/c0cafd4c-dbfb-44b7-bb76-f033343166e1-kube-api-access-s2h6q\") pod \"limitador-limitador-64c94fd64f-5dvzt\" (UID: \"c0cafd4c-dbfb-44b7-bb76-f033343166e1\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-5dvzt" Jun 08 08:34:09.394074 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:34:09.394055 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c0cafd4c-dbfb-44b7-bb76-f033343166e1-config-file\") pod \"limitador-limitador-64c94fd64f-5dvzt\" (UID: \"c0cafd4c-dbfb-44b7-bb76-f033343166e1\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-5dvzt" Jun 08 08:34:09.401197 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:34:09.401174 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2h6q\" (UniqueName: \"kubernetes.io/projected/c0cafd4c-dbfb-44b7-bb76-f033343166e1-kube-api-access-s2h6q\") pod \"limitador-limitador-64c94fd64f-5dvzt\" (UID: \"c0cafd4c-dbfb-44b7-bb76-f033343166e1\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-5dvzt" Jun 08 08:34:09.439154 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:34:09.439136 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-5dvzt" Jun 08 08:34:09.562887 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:34:09.562863 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-5dvzt"] Jun 08 08:34:09.565101 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:34:09.565075 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0cafd4c_dbfb_44b7_bb76_f033343166e1.slice/crio-97a4419402a22e7564cb705b52178030bea2c4eb13bbd2e4cfd00642304285b1 WatchSource:0}: Error finding container 97a4419402a22e7564cb705b52178030bea2c4eb13bbd2e4cfd00642304285b1: Status 404 returned error can't find the container with id 97a4419402a22e7564cb705b52178030bea2c4eb13bbd2e4cfd00642304285b1 Jun 08 08:34:10.174982 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:34:10.174936 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-5dvzt" event={"ID":"c0cafd4c-dbfb-44b7-bb76-f033343166e1","Type":"ContainerStarted","Data":"97a4419402a22e7564cb705b52178030bea2c4eb13bbd2e4cfd00642304285b1"} Jun 08 08:34:12.185934 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:34:12.185906 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-5dvzt" event={"ID":"c0cafd4c-dbfb-44b7-bb76-f033343166e1","Type":"ContainerStarted","Data":"c2789ffd11b8a41e0449b17bc6209e0e88b4592a324924d60aae1138f9ef092c"} Jun 08 08:34:12.186253 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:34:12.185963 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-5dvzt" Jun 08 08:34:12.202746 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:34:12.202688 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-5dvzt" podStartSLOduration=0.688682572 podStartE2EDuration="3.202675452s" totalImagesPullingTime="2.51399288s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 08:34:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 08:34:12.201321948 +0000 UTC m=+763.455533398" watchObservedRunningTime="2026-06-08 08:34:12.202675452 +0000 UTC m=+763.456886902" Jun 08 08:34:23.192588 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:34:23.192557 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-5dvzt" Jun 08 08:34:24.166785 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:34:24.166748 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-5dvzt"] Jun 08 08:34:24.166971 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:34:24.166949 2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-5dvzt" podUID="c0cafd4c-dbfb-44b7-bb76-f033343166e1" containerName="limitador" containerID="cri-o://c2789ffd11b8a41e0449b17bc6209e0e88b4592a324924d60aae1138f9ef092c" gracePeriod=30 Jun 08 08:34:24.712953 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:34:24.712932 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-5dvzt" Jun 08 08:34:24.716307 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:34:24.716288 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s2h6q\" (UniqueName: \"kubernetes.io/projected/c0cafd4c-dbfb-44b7-bb76-f033343166e1-kube-api-access-s2h6q\") pod \"c0cafd4c-dbfb-44b7-bb76-f033343166e1\" (UID: \"c0cafd4c-dbfb-44b7-bb76-f033343166e1\") " Jun 08 08:34:24.716415 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:34:24.716325 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c0cafd4c-dbfb-44b7-bb76-f033343166e1-config-file\") pod \"c0cafd4c-dbfb-44b7-bb76-f033343166e1\" (UID: \"c0cafd4c-dbfb-44b7-bb76-f033343166e1\") " Jun 08 08:34:24.716689 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:34:24.716666 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c0cafd4c-dbfb-44b7-bb76-f033343166e1-config-file" (OuterVolumeSpecName: "config-file") pod "c0cafd4c-dbfb-44b7-bb76-f033343166e1" (UID: "c0cafd4c-dbfb-44b7-bb76-f033343166e1"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 08:34:24.718317 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:34:24.718295 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0cafd4c-dbfb-44b7-bb76-f033343166e1-kube-api-access-s2h6q" (OuterVolumeSpecName: "kube-api-access-s2h6q") pod "c0cafd4c-dbfb-44b7-bb76-f033343166e1" (UID: "c0cafd4c-dbfb-44b7-bb76-f033343166e1"). InnerVolumeSpecName "kube-api-access-s2h6q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 08:34:24.816871 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:34:24.816845 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s2h6q\" (UniqueName: \"kubernetes.io/projected/c0cafd4c-dbfb-44b7-bb76-f033343166e1-kube-api-access-s2h6q\") on node \"ip-10-0-143-101.ec2.internal\" DevicePath \"\"" Jun 08 08:34:24.816871 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:34:24.816867 2570 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c0cafd4c-dbfb-44b7-bb76-f033343166e1-config-file\") on node \"ip-10-0-143-101.ec2.internal\" DevicePath \"\"" Jun 08 08:34:25.212159 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:34:25.212136 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-j84nf"] Jun 08 08:34:25.212745 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:34:25.212706 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0cafd4c-dbfb-44b7-bb76-f033343166e1" containerName="limitador" Jun 08 08:34:25.212745 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:34:25.212742 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0cafd4c-dbfb-44b7-bb76-f033343166e1" containerName="limitador" Jun 08 08:34:25.213025 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:34:25.212871 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0cafd4c-dbfb-44b7-bb76-f033343166e1" containerName="limitador" Jun 08 08:34:25.216149 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:34:25.216129 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-j84nf" Jun 08 08:34:25.219025 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:34:25.219001 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jun 08 08:34:25.219484 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:34:25.219343 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-st6qj\"" Jun 08 08:34:25.220346 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:34:25.220121 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/e23e2094-9711-403c-9757-9d4d0352698c-data\") pod \"postgres-69fb4594cf-j84nf\" (UID: \"e23e2094-9711-403c-9757-9d4d0352698c\") " pod="opendatahub/postgres-69fb4594cf-j84nf" Jun 08 08:34:25.220346 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:34:25.220189 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-j84nf"] Jun 08 08:34:25.220346 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:34:25.220199 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dszl\" (UniqueName: \"kubernetes.io/projected/e23e2094-9711-403c-9757-9d4d0352698c-kube-api-access-4dszl\") pod \"postgres-69fb4594cf-j84nf\" (UID: \"e23e2094-9711-403c-9757-9d4d0352698c\") " pod="opendatahub/postgres-69fb4594cf-j84nf" Jun 08 08:34:25.247996 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:34:25.247972 2570 generic.go:356] "Generic (PLEG): container finished" podID="c0cafd4c-dbfb-44b7-bb76-f033343166e1" containerID="c2789ffd11b8a41e0449b17bc6209e0e88b4592a324924d60aae1138f9ef092c" exitCode=0 Jun 08 08:34:25.248103 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:34:25.248012 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-5dvzt" Jun 08 08:34:25.248103 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:34:25.248018 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-5dvzt" event={"ID":"c0cafd4c-dbfb-44b7-bb76-f033343166e1","Type":"ContainerDied","Data":"c2789ffd11b8a41e0449b17bc6209e0e88b4592a324924d60aae1138f9ef092c"} Jun 08 08:34:25.248103 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:34:25.248072 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-5dvzt" event={"ID":"c0cafd4c-dbfb-44b7-bb76-f033343166e1","Type":"ContainerDied","Data":"97a4419402a22e7564cb705b52178030bea2c4eb13bbd2e4cfd00642304285b1"} Jun 08 08:34:25.248225 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:34:25.248103 2570 scope.go:117] "RemoveContainer" containerID="c2789ffd11b8a41e0449b17bc6209e0e88b4592a324924d60aae1138f9ef092c" Jun 08 08:34:25.255978 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:34:25.255962 2570 scope.go:117] "RemoveContainer" containerID="c2789ffd11b8a41e0449b17bc6209e0e88b4592a324924d60aae1138f9ef092c" Jun 08 08:34:25.256218 ip-10-0-143-101 kubenswrapper[2570]: E0608 08:34:25.256200 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c2789ffd11b8a41e0449b17bc6209e0e88b4592a324924d60aae1138f9ef092c\": container with ID starting with c2789ffd11b8a41e0449b17bc6209e0e88b4592a324924d60aae1138f9ef092c not found: ID does not exist" containerID="c2789ffd11b8a41e0449b17bc6209e0e88b4592a324924d60aae1138f9ef092c" Jun 08 08:34:25.256273 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:34:25.256226 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2789ffd11b8a41e0449b17bc6209e0e88b4592a324924d60aae1138f9ef092c"} err="failed to get container status \"c2789ffd11b8a41e0449b17bc6209e0e88b4592a324924d60aae1138f9ef092c\": rpc error: code = NotFound desc = could not find container \"c2789ffd11b8a41e0449b17bc6209e0e88b4592a324924d60aae1138f9ef092c\": container with ID starting with c2789ffd11b8a41e0449b17bc6209e0e88b4592a324924d60aae1138f9ef092c not found: ID does not exist" Jun 08 08:34:25.265590 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:34:25.265569 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-5dvzt"] Jun 08 08:34:25.269677 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:34:25.269658 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-5dvzt"] Jun 08 08:34:25.321548 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:34:25.321527 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dszl\" (UniqueName: \"kubernetes.io/projected/e23e2094-9711-403c-9757-9d4d0352698c-kube-api-access-4dszl\") pod \"postgres-69fb4594cf-j84nf\" (UID: \"e23e2094-9711-403c-9757-9d4d0352698c\") " pod="opendatahub/postgres-69fb4594cf-j84nf" Jun 08 08:34:25.321619 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:34:25.321581 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/e23e2094-9711-403c-9757-9d4d0352698c-data\") pod \"postgres-69fb4594cf-j84nf\" (UID: \"e23e2094-9711-403c-9757-9d4d0352698c\") " pod="opendatahub/postgres-69fb4594cf-j84nf" Jun 08 08:34:25.321911 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:34:25.321896 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/e23e2094-9711-403c-9757-9d4d0352698c-data\") pod \"postgres-69fb4594cf-j84nf\" (UID: \"e23e2094-9711-403c-9757-9d4d0352698c\") " pod="opendatahub/postgres-69fb4594cf-j84nf" Jun 08 08:34:25.331098 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:34:25.331082 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dszl\" (UniqueName: \"kubernetes.io/projected/e23e2094-9711-403c-9757-9d4d0352698c-kube-api-access-4dszl\") pod \"postgres-69fb4594cf-j84nf\" (UID: \"e23e2094-9711-403c-9757-9d4d0352698c\") " pod="opendatahub/postgres-69fb4594cf-j84nf" Jun 08 08:34:25.529983 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:34:25.529927 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-j84nf" Jun 08 08:34:25.655993 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:34:25.655965 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-j84nf"] Jun 08 08:34:25.659640 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:34:25.659614 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode23e2094_9711_403c_9757_9d4d0352698c.slice/crio-1539d26cac6b071523dc5bcb1d5ba3f2fe67b115fa3257e09b99de2bc178dd23 WatchSource:0}: Error finding container 1539d26cac6b071523dc5bcb1d5ba3f2fe67b115fa3257e09b99de2bc178dd23: Status 404 returned error can't find the container with id 1539d26cac6b071523dc5bcb1d5ba3f2fe67b115fa3257e09b99de2bc178dd23 Jun 08 08:34:26.254479 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:34:26.254441 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-j84nf" event={"ID":"e23e2094-9711-403c-9757-9d4d0352698c","Type":"ContainerStarted","Data":"1539d26cac6b071523dc5bcb1d5ba3f2fe67b115fa3257e09b99de2bc178dd23"} Jun 08 08:34:27.218081 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:34:27.218039 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c0cafd4c-dbfb-44b7-bb76-f033343166e1" path="/var/lib/kubelet/pods/c0cafd4c-dbfb-44b7-bb76-f033343166e1/volumes" Jun 08 08:34:28.266450 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:34:28.266363 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-j84nf" event={"ID":"e23e2094-9711-403c-9757-9d4d0352698c","Type":"ContainerStarted","Data":"064c5832d7c1a3edae56bd88290e17065ba3a78f5903e8716a0ed58f9d593535"} Jun 08 08:34:28.266934 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:34:28.266510 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-j84nf" Jun 08 08:34:28.284690 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:34:28.284634 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-j84nf" podStartSLOduration=1.058463954 podStartE2EDuration="3.284619104s" totalImagesPullingTime="2.22615515s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 08:34:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 08:34:28.283137721 +0000 UTC m=+779.537349168" watchObservedRunningTime="2026-06-08 08:34:28.284619104 +0000 UTC m=+779.538830554" Jun 08 08:34:34.303766 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:34:34.303735 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-j84nf" Jun 08 08:34:43.737043 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:34:43.737012 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-jdl5w"] Jun 08 08:34:43.743109 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:34:43.743088 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-jdl5w" Jun 08 08:34:43.746657 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:34:43.746636 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 08 08:34:43.746797 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:34:43.746635 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 08 08:34:43.747744 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:34:43.747706 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-kxfsz\"" Jun 08 08:34:43.750800 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:34:43.750775 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-jdl5w"] Jun 08 08:34:43.795017 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:34:43.794987 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mr9b\" (UniqueName: \"kubernetes.io/projected/a8058f3a-83ee-4d7e-80cc-f1c813e96980-kube-api-access-6mr9b\") pod \"keycloak-operator-d67dbbb48-jdl5w\" (UID: \"a8058f3a-83ee-4d7e-80cc-f1c813e96980\") " pod="keycloak-system/keycloak-operator-d67dbbb48-jdl5w" Jun 08 08:34:43.895506 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:34:43.895467 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mr9b\" (UniqueName: \"kubernetes.io/projected/a8058f3a-83ee-4d7e-80cc-f1c813e96980-kube-api-access-6mr9b\") pod \"keycloak-operator-d67dbbb48-jdl5w\" (UID: \"a8058f3a-83ee-4d7e-80cc-f1c813e96980\") " pod="keycloak-system/keycloak-operator-d67dbbb48-jdl5w" Jun 08 08:34:43.905959 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:34:43.905926 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mr9b\" (UniqueName: \"kubernetes.io/projected/a8058f3a-83ee-4d7e-80cc-f1c813e96980-kube-api-access-6mr9b\") pod \"keycloak-operator-d67dbbb48-jdl5w\" (UID: \"a8058f3a-83ee-4d7e-80cc-f1c813e96980\") " pod="keycloak-system/keycloak-operator-d67dbbb48-jdl5w" Jun 08 08:34:44.054022 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:34:44.053996 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-jdl5w" Jun 08 08:34:44.198689 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:34:44.198655 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-jdl5w"] Jun 08 08:34:44.202075 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:34:44.202051 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8058f3a_83ee_4d7e_80cc_f1c813e96980.slice/crio-1cae0973a9f2c425b0201be0075bb86bbc2b043d250620ada765a82985c81d13 WatchSource:0}: Error finding container 1cae0973a9f2c425b0201be0075bb86bbc2b043d250620ada765a82985c81d13: Status 404 returned error can't find the container with id 1cae0973a9f2c425b0201be0075bb86bbc2b043d250620ada765a82985c81d13 Jun 08 08:34:44.342530 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:34:44.342452 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-jdl5w" event={"ID":"a8058f3a-83ee-4d7e-80cc-f1c813e96980","Type":"ContainerStarted","Data":"1cae0973a9f2c425b0201be0075bb86bbc2b043d250620ada765a82985c81d13"} Jun 08 08:34:49.370093 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:34:49.370050 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-jdl5w" event={"ID":"a8058f3a-83ee-4d7e-80cc-f1c813e96980","Type":"ContainerStarted","Data":"70e43ef13c1ffc0a3ef50adf599be772f55012e035e66505897bf0e74b4742f9"} Jun 08 08:34:49.389180 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:34:49.389087 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-d67dbbb48-jdl5w" podStartSLOduration=1.3090565490000001 podStartE2EDuration="6.389066302s" totalImagesPullingTime="5.080009753s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 08:34:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 08:34:49.387453166 +0000 UTC m=+800.641664616" watchObservedRunningTime="2026-06-08 08:34:49.389066302 +0000 UTC m=+800.643277753" Jun 08 08:37:37.708856 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:37:37.708827 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6988fb75f5-2pmd2_3348bfd2-3427-4eb5-95e5-4c43419f44fe/copy-manifests/0.log" Jun 08 08:37:37.715707 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:37:37.715666 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6988fb75f5-2pmd2_3348bfd2-3427-4eb5-95e5-4c43419f44fe/manager/0.log" Jun 08 08:37:38.084112 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:37:38.084085 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-j84nf_e23e2094-9711-403c-9757-9d4d0352698c/postgres/0.log" Jun 08 08:37:39.493891 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:37:39.493862 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-lhczr_a7d720ec-93a9-4788-90d3-0cbf6fada76d/manager/0.log" Jun 08 08:37:39.607099 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:37:39.607075 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-hzsnn_ec00ed92-6d5c-4ea1-8ae2-c8b50d3bc3c4/kuadrant-console-plugin/0.log" Jun 08 08:37:40.655912 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:37:40.655886 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7464d86fc4-kq82r_8ce2c206-f875-4aff-a52c-53cb3c6158d0/kube-auth-proxy/0.log" Jun 08 08:37:40.994845 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:37:40.994778 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5d6f988b67-lzl5t_47da3425-29f0-4210-94ce-c6dc07dc9834/router/0.log" Jun 08 08:37:44.593603 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:37:44.593571 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-kqgfc/must-gather-pg8tb"] Jun 08 08:37:44.597414 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:37:44.597393 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kqgfc/must-gather-pg8tb" Jun 08 08:37:44.600817 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:37:44.600798 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-kqgfc\"/\"kube-root-ca.crt\"" Jun 08 08:37:44.600906 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:37:44.600812 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-kqgfc\"/\"default-dockercfg-4dj56\"" Jun 08 08:37:44.601858 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:37:44.601841 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-kqgfc\"/\"openshift-service-ca.crt\"" Jun 08 08:37:44.609105 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:37:44.609084 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kqgfc/must-gather-pg8tb"] Jun 08 08:37:44.652504 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:37:44.652470 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/17a4b055-741a-4603-8e55-37b646c31f64-must-gather-output\") pod \"must-gather-pg8tb\" (UID: \"17a4b055-741a-4603-8e55-37b646c31f64\") " pod="openshift-must-gather-kqgfc/must-gather-pg8tb" Jun 08 08:37:44.652593 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:37:44.652533 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9rrq\" (UniqueName: \"kubernetes.io/projected/17a4b055-741a-4603-8e55-37b646c31f64-kube-api-access-h9rrq\") pod \"must-gather-pg8tb\" (UID: \"17a4b055-741a-4603-8e55-37b646c31f64\") " pod="openshift-must-gather-kqgfc/must-gather-pg8tb" Jun 08 08:37:44.753102 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:37:44.753072 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9rrq\" (UniqueName: \"kubernetes.io/projected/17a4b055-741a-4603-8e55-37b646c31f64-kube-api-access-h9rrq\") pod \"must-gather-pg8tb\" (UID: \"17a4b055-741a-4603-8e55-37b646c31f64\") " pod="openshift-must-gather-kqgfc/must-gather-pg8tb" Jun 08 08:37:44.753248 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:37:44.753148 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/17a4b055-741a-4603-8e55-37b646c31f64-must-gather-output\") pod \"must-gather-pg8tb\" (UID: \"17a4b055-741a-4603-8e55-37b646c31f64\") " pod="openshift-must-gather-kqgfc/must-gather-pg8tb" Jun 08 08:37:44.753461 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:37:44.753442 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/17a4b055-741a-4603-8e55-37b646c31f64-must-gather-output\") pod \"must-gather-pg8tb\" (UID: \"17a4b055-741a-4603-8e55-37b646c31f64\") " pod="openshift-must-gather-kqgfc/must-gather-pg8tb" Jun 08 08:37:44.761272 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:37:44.761249 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9rrq\" (UniqueName: \"kubernetes.io/projected/17a4b055-741a-4603-8e55-37b646c31f64-kube-api-access-h9rrq\") pod \"must-gather-pg8tb\" (UID: \"17a4b055-741a-4603-8e55-37b646c31f64\") " pod="openshift-must-gather-kqgfc/must-gather-pg8tb" Jun 08 08:37:44.906452 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:37:44.906369 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kqgfc/must-gather-pg8tb" Jun 08 08:37:45.040823 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:37:45.040795 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kqgfc/must-gather-pg8tb"] Jun 08 08:37:45.043365 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:37:45.043337 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod17a4b055_741a_4603_8e55_37b646c31f64.slice/crio-97904c127b0a25dc544ccc9c058943c2627a26dbf094fc37151424738d34fee3 WatchSource:0}: Error finding container 97904c127b0a25dc544ccc9c058943c2627a26dbf094fc37151424738d34fee3: Status 404 returned error can't find the container with id 97904c127b0a25dc544ccc9c058943c2627a26dbf094fc37151424738d34fee3 Jun 08 08:37:45.168094 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:37:45.168014 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kqgfc/must-gather-pg8tb" event={"ID":"17a4b055-741a-4603-8e55-37b646c31f64","Type":"ContainerStarted","Data":"97904c127b0a25dc544ccc9c058943c2627a26dbf094fc37151424738d34fee3"} Jun 08 08:37:46.177214 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:37:46.177130 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kqgfc/must-gather-pg8tb" event={"ID":"17a4b055-741a-4603-8e55-37b646c31f64","Type":"ContainerStarted","Data":"240df4403885eba40465b8e1f79b7b0befedb3a464cead9ddb35bf5a549fd9e9"} Jun 08 08:37:46.177214 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:37:46.177170 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kqgfc/must-gather-pg8tb" event={"ID":"17a4b055-741a-4603-8e55-37b646c31f64","Type":"ContainerStarted","Data":"b8da36fcad0ec313028f78d37d3789bc8cbe05f14137bc38afad39f49f48ec3b"} Jun 08 08:37:46.195740 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:37:46.195642 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-kqgfc/must-gather-pg8tb" podStartSLOduration=1.422688112 podStartE2EDuration="2.195622801s" totalImagesPullingTime="772.934689ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 08:37:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 08:37:46.194495129 +0000 UTC m=+977.448706582" watchObservedRunningTime="2026-06-08 08:37:46.195622801 +0000 UTC m=+977.449834252" Jun 08 08:37:47.502179 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:37:47.502125 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-6gvcs_4281d80d-e366-4f22-a397-e17c9be0e9f4/global-pull-secret-syncer/0.log" Jun 08 08:37:47.584702 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:37:47.584674 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-jqgqd_87ee6f5d-c749-452a-9574-287d8a6913cc/konnectivity-agent/0.log" Jun 08 08:37:47.684692 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:37:47.684665 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-101.ec2.internal_690c9e7947c5aecc188863a395b640fd/haproxy/0.log" Jun 08 08:37:52.785728 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:37:52.785632 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-lhczr_a7d720ec-93a9-4788-90d3-0cbf6fada76d/manager/0.log" Jun 08 08:37:52.811006 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:37:52.810978 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-hzsnn_ec00ed92-6d5c-4ea1-8ae2-c8b50d3bc3c4/kuadrant-console-plugin/0.log" Jun 08 08:37:54.453441 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:37:54.453409 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_adc8c82a-b8cf-4a96-8564-e0c026cba79f/alertmanager/0.log" Jun 08 08:37:54.475944 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:37:54.475919 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_adc8c82a-b8cf-4a96-8564-e0c026cba79f/config-reloader/0.log" Jun 08 08:37:54.497812 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:37:54.497778 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_adc8c82a-b8cf-4a96-8564-e0c026cba79f/kube-rbac-proxy-web/0.log" Jun 08 08:37:54.520987 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:37:54.520947 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_adc8c82a-b8cf-4a96-8564-e0c026cba79f/kube-rbac-proxy/0.log" Jun 08 08:37:54.543332 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:37:54.543222 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_adc8c82a-b8cf-4a96-8564-e0c026cba79f/kube-rbac-proxy-metric/0.log" Jun 08 08:37:54.569113 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:37:54.569083 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_adc8c82a-b8cf-4a96-8564-e0c026cba79f/prom-label-proxy/0.log" Jun 08 08:37:54.593750 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:37:54.593679 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_adc8c82a-b8cf-4a96-8564-e0c026cba79f/init-config-reloader/0.log" Jun 08 08:37:54.666117 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:37:54.666044 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-qpsdk_4ad642ed-bf50-4646-b788-6f4a143a556e/kube-state-metrics/0.log" Jun 08 08:37:54.692436 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:37:54.692374 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-qpsdk_4ad642ed-bf50-4646-b788-6f4a143a556e/kube-rbac-proxy-main/0.log" Jun 08 08:37:54.713586 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:37:54.713553 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-qpsdk_4ad642ed-bf50-4646-b788-6f4a143a556e/kube-rbac-proxy-self/0.log" Jun 08 08:37:54.895880 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:37:54.895852 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-c8kdm_8ebca971-0e2a-4f4c-b193-be807a351825/node-exporter/0.log" Jun 08 08:37:54.929359 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:37:54.929326 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-c8kdm_8ebca971-0e2a-4f4c-b193-be807a351825/kube-rbac-proxy/0.log" Jun 08 08:37:54.957277 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:37:54.957242 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-c8kdm_8ebca971-0e2a-4f4c-b193-be807a351825/init-textfile/0.log" Jun 08 08:37:55.080093 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:37:55.080013 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-fhhdl_d79d0e24-b2d3-4224-85ce-4faf5bf603c7/kube-rbac-proxy-main/0.log" Jun 08 08:37:55.105526 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:37:55.105462 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-fhhdl_d79d0e24-b2d3-4224-85ce-4faf5bf603c7/kube-rbac-proxy-self/0.log" Jun 08 08:37:55.137133 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:37:55.137100 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-fhhdl_d79d0e24-b2d3-4224-85ce-4faf5bf603c7/openshift-state-metrics/0.log" Jun 08 08:37:55.174335 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:37:55.174303 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fa8740de-2a44-48e2-a3cf-80678f526b3d/prometheus/0.log" Jun 08 08:37:55.194343 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:37:55.194310 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fa8740de-2a44-48e2-a3cf-80678f526b3d/config-reloader/0.log" Jun 08 08:37:55.216161 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:37:55.216136 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fa8740de-2a44-48e2-a3cf-80678f526b3d/thanos-sidecar/0.log" Jun 08 08:37:55.241218 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:37:55.241177 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fa8740de-2a44-48e2-a3cf-80678f526b3d/kube-rbac-proxy-web/0.log" Jun 08 08:37:55.261801 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:37:55.261746 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fa8740de-2a44-48e2-a3cf-80678f526b3d/kube-rbac-proxy/0.log" Jun 08 08:37:55.283613 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:37:55.283578 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fa8740de-2a44-48e2-a3cf-80678f526b3d/kube-rbac-proxy-thanos/0.log" Jun 08 08:37:55.305703 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:37:55.305679 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fa8740de-2a44-48e2-a3cf-80678f526b3d/init-config-reloader/0.log" Jun 08 08:37:55.339184 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:37:55.339105 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-cl5jh_9391e286-fc1c-4693-9ef7-5d2e1151b2ad/prometheus-operator/0.log" Jun 08 08:37:55.359783 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:37:55.359757 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-cl5jh_9391e286-fc1c-4693-9ef7-5d2e1151b2ad/kube-rbac-proxy/0.log" Jun 08 08:37:55.385130 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:37:55.385099 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-xl9sb_8fc38247-6a93-4d19-af10-1fe008db28f1/prometheus-operator-admission-webhook/0.log" Jun 08 08:37:55.418562 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:37:55.418533 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-67dd799b9b-dlmhk_e260c645-ff1e-471e-b01c-61ca11ad3e22/telemeter-client/0.log" Jun 08 08:37:55.440408 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:37:55.440380 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-67dd799b9b-dlmhk_e260c645-ff1e-471e-b01c-61ca11ad3e22/reload/0.log" Jun 08 08:37:55.466461 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:37:55.466428 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-67dd799b9b-dlmhk_e260c645-ff1e-471e-b01c-61ca11ad3e22/kube-rbac-proxy/0.log" Jun 08 08:37:57.700871 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:37:57.700824 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-kqgfc/perf-node-gather-daemonset-rg47c"] Jun 08 08:37:57.708660 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:37:57.708630 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kqgfc/perf-node-gather-daemonset-rg47c" Jun 08 08:37:57.715362 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:37:57.715321 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kqgfc/perf-node-gather-daemonset-rg47c"] Jun 08 08:37:57.797406 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:37:57.797360 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9008384b-946b-4593-ac40-dae30fe250fa-proc\") pod \"perf-node-gather-daemonset-rg47c\" (UID: \"9008384b-946b-4593-ac40-dae30fe250fa\") " pod="openshift-must-gather-kqgfc/perf-node-gather-daemonset-rg47c" Jun 08 08:37:57.797588 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:37:57.797420 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9008384b-946b-4593-ac40-dae30fe250fa-lib-modules\") pod \"perf-node-gather-daemonset-rg47c\" (UID: \"9008384b-946b-4593-ac40-dae30fe250fa\") " pod="openshift-must-gather-kqgfc/perf-node-gather-daemonset-rg47c" Jun 08 08:37:57.797588 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:37:57.797450 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9008384b-946b-4593-ac40-dae30fe250fa-sys\") pod \"perf-node-gather-daemonset-rg47c\" (UID: \"9008384b-946b-4593-ac40-dae30fe250fa\") " pod="openshift-must-gather-kqgfc/perf-node-gather-daemonset-rg47c" Jun 08 08:37:57.797588 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:37:57.797491 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9008384b-946b-4593-ac40-dae30fe250fa-podres\") pod \"perf-node-gather-daemonset-rg47c\" (UID: \"9008384b-946b-4593-ac40-dae30fe250fa\") " pod="openshift-must-gather-kqgfc/perf-node-gather-daemonset-rg47c" Jun 08 08:37:57.797588 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:37:57.797547 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25lmb\" (UniqueName: \"kubernetes.io/projected/9008384b-946b-4593-ac40-dae30fe250fa-kube-api-access-25lmb\") pod \"perf-node-gather-daemonset-rg47c\" (UID: \"9008384b-946b-4593-ac40-dae30fe250fa\") " pod="openshift-must-gather-kqgfc/perf-node-gather-daemonset-rg47c" Jun 08 08:37:57.898777 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:37:57.898732 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9008384b-946b-4593-ac40-dae30fe250fa-proc\") pod \"perf-node-gather-daemonset-rg47c\" (UID: \"9008384b-946b-4593-ac40-dae30fe250fa\") " pod="openshift-must-gather-kqgfc/perf-node-gather-daemonset-rg47c" Jun 08 08:37:57.898964 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:37:57.898788 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9008384b-946b-4593-ac40-dae30fe250fa-lib-modules\") pod \"perf-node-gather-daemonset-rg47c\" (UID: \"9008384b-946b-4593-ac40-dae30fe250fa\") " pod="openshift-must-gather-kqgfc/perf-node-gather-daemonset-rg47c" Jun 08 08:37:57.898964 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:37:57.898814 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9008384b-946b-4593-ac40-dae30fe250fa-sys\") pod \"perf-node-gather-daemonset-rg47c\" (UID: \"9008384b-946b-4593-ac40-dae30fe250fa\") " pod="openshift-must-gather-kqgfc/perf-node-gather-daemonset-rg47c" Jun 08 08:37:57.898964 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:37:57.898852 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9008384b-946b-4593-ac40-dae30fe250fa-podres\") pod \"perf-node-gather-daemonset-rg47c\" (UID: \"9008384b-946b-4593-ac40-dae30fe250fa\") " pod="openshift-must-gather-kqgfc/perf-node-gather-daemonset-rg47c" Jun 08 08:37:57.898964 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:37:57.898904 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25lmb\" (UniqueName: \"kubernetes.io/projected/9008384b-946b-4593-ac40-dae30fe250fa-kube-api-access-25lmb\") pod \"perf-node-gather-daemonset-rg47c\" (UID: \"9008384b-946b-4593-ac40-dae30fe250fa\") " pod="openshift-must-gather-kqgfc/perf-node-gather-daemonset-rg47c" Jun 08 08:37:57.899319 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:37:57.899296 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9008384b-946b-4593-ac40-dae30fe250fa-proc\") pod \"perf-node-gather-daemonset-rg47c\" (UID: \"9008384b-946b-4593-ac40-dae30fe250fa\") " pod="openshift-must-gather-kqgfc/perf-node-gather-daemonset-rg47c" Jun 08 08:37:57.899443 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:37:57.899425 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9008384b-946b-4593-ac40-dae30fe250fa-lib-modules\") pod \"perf-node-gather-daemonset-rg47c\" (UID: \"9008384b-946b-4593-ac40-dae30fe250fa\") " pod="openshift-must-gather-kqgfc/perf-node-gather-daemonset-rg47c" Jun 08 08:37:57.899531 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:37:57.899473 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9008384b-946b-4593-ac40-dae30fe250fa-sys\") pod \"perf-node-gather-daemonset-rg47c\" (UID: \"9008384b-946b-4593-ac40-dae30fe250fa\") " pod="openshift-must-gather-kqgfc/perf-node-gather-daemonset-rg47c" Jun 08 08:37:57.899595 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:37:57.899539 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9008384b-946b-4593-ac40-dae30fe250fa-podres\") pod \"perf-node-gather-daemonset-rg47c\" (UID: \"9008384b-946b-4593-ac40-dae30fe250fa\") " pod="openshift-must-gather-kqgfc/perf-node-gather-daemonset-rg47c" Jun 08 08:37:57.908904 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:37:57.908875 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-25lmb\" (UniqueName: \"kubernetes.io/projected/9008384b-946b-4593-ac40-dae30fe250fa-kube-api-access-25lmb\") pod \"perf-node-gather-daemonset-rg47c\" (UID: \"9008384b-946b-4593-ac40-dae30fe250fa\") " pod="openshift-must-gather-kqgfc/perf-node-gather-daemonset-rg47c" Jun 08 08:37:58.022085 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:37:58.022000 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kqgfc/perf-node-gather-daemonset-rg47c" Jun 08 08:37:58.211609 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:37:58.211573 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kqgfc/perf-node-gather-daemonset-rg47c"] Jun 08 08:37:58.215249 ip-10-0-143-101 kubenswrapper[2570]: W0608 08:37:58.215201 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod9008384b_946b_4593_ac40_dae30fe250fa.slice/crio-1f973218f5579bd5e3c599bcd57ba0e39b26473c991e439e4a75c17348f6ae72 WatchSource:0}: Error finding container 1f973218f5579bd5e3c599bcd57ba0e39b26473c991e439e4a75c17348f6ae72: Status 404 returned error can't find the container with id 1f973218f5579bd5e3c599bcd57ba0e39b26473c991e439e4a75c17348f6ae72 Jun 08 08:37:58.272003 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:37:58.271896 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kqgfc/perf-node-gather-daemonset-rg47c" event={"ID":"9008384b-946b-4593-ac40-dae30fe250fa","Type":"ContainerStarted","Data":"1f973218f5579bd5e3c599bcd57ba0e39b26473c991e439e4a75c17348f6ae72"} Jun 08 08:37:59.280735 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:37:59.279820 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kqgfc/perf-node-gather-daemonset-rg47c" event={"ID":"9008384b-946b-4593-ac40-dae30fe250fa","Type":"ContainerStarted","Data":"f611f5ab2ff6fd67b3699a814ceca41157717ee07531f636e6c0392623ccd3cd"} Jun 08 08:37:59.280735 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:37:59.280572 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-kqgfc/perf-node-gather-daemonset-rg47c" Jun 08 08:37:59.296869 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:37:59.296821 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-kqgfc/perf-node-gather-daemonset-rg47c" podStartSLOduration=2.296805762 podStartE2EDuration="2.296805762s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 08:37:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 08:37:59.295588696 +0000 UTC m=+990.549800149" watchObservedRunningTime="2026-06-08 08:37:59.296805762 +0000 UTC m=+990.551017212" Jun 08 08:37:59.729384 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:37:59.729354 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-jtcbc_5dedcff5-b47c-4bd8-8684-25930d49cb60/dns/0.log" Jun 08 08:37:59.750770 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:37:59.750737 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-jtcbc_5dedcff5-b47c-4bd8-8684-25930d49cb60/kube-rbac-proxy/0.log" Jun 08 08:37:59.859147 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:37:59.859119 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-f845l_28880cc4-90dd-4d3f-8bf7-df18edcdd096/dns-node-resolver/0.log" Jun 08 08:38:00.473465 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:38:00.473438 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-hp6pw_b817d520-ebd3-4bd7-9490-90751bd573aa/node-ca/0.log" Jun 08 08:38:01.502987 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:38:01.502951 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7464d86fc4-kq82r_8ce2c206-f875-4aff-a52c-53cb3c6158d0/kube-auth-proxy/0.log" Jun 08 08:38:01.589926 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:38:01.589893 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5d6f988b67-lzl5t_47da3425-29f0-4210-94ce-c6dc07dc9834/router/0.log" Jun 08 08:38:02.190746 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:38:02.190678 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-pmppv_ad089e2e-24e2-432f-93d7-f24ac4c5bc99/serve-healthcheck-canary/0.log" Jun 08 08:38:02.701763 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:38:02.701733 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-7gdl7_90190966-f98a-4a95-8ac6-564ced75358f/insights-operator/0.log" Jun 08 08:38:02.702255 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:38:02.702063 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-7gdl7_90190966-f98a-4a95-8ac6-564ced75358f/insights-operator/1.log" Jun 08 08:38:02.792684 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:38:02.792645 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-v59t5_44e7e45c-b61b-4afd-a19e-048bca27595e/kube-rbac-proxy/0.log" Jun 08 08:38:02.813482 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:38:02.813453 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-v59t5_44e7e45c-b61b-4afd-a19e-048bca27595e/exporter/0.log" Jun 08 08:38:02.834701 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:38:02.834679 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-v59t5_44e7e45c-b61b-4afd-a19e-048bca27595e/extractor/0.log" Jun 08 08:38:05.333481 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:38:05.333455 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6988fb75f5-2pmd2_3348bfd2-3427-4eb5-95e5-4c43419f44fe/manager/0.log" Jun 08 08:38:05.357658 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:38:05.357631 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6988fb75f5-2pmd2_3348bfd2-3427-4eb5-95e5-4c43419f44fe/copy-manifests/0.log" Jun 08 08:38:05.514291 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:38:05.514263 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-j84nf_e23e2094-9711-403c-9757-9d4d0352698c/postgres/0.log" Jun 08 08:38:06.301985 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:38:06.301956 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-kqgfc/perf-node-gather-daemonset-rg47c" Jun 08 08:38:06.953309 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:38:06.953280 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5f8c795659-gdmps_a8b2fd10-cdd6-4b51-b57e-2c0a05df87c2/manager/0.log" Jun 08 08:38:11.946467 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:38:11.946431 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7464d86fc4-kq82r_8ce2c206-f875-4aff-a52c-53cb3c6158d0/kube-auth-proxy/0.log" Jun 08 08:38:12.001386 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:38:12.001359 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5d6f988b67-lzl5t_47da3425-29f0-4210-94ce-c6dc07dc9834/router/0.log" Jun 08 08:38:13.127352 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:38:13.127324 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7464d86fc4-kq82r_8ce2c206-f875-4aff-a52c-53cb3c6158d0/kube-auth-proxy/0.log" Jun 08 08:38:13.179525 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:38:13.179501 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5d6f988b67-lzl5t_47da3425-29f0-4210-94ce-c6dc07dc9834/router/0.log" Jun 08 08:38:13.935044 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:38:13.935018 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-7bjsd_f7aa67e2-0ae6-402d-9cab-b798c21b9390/kube-multus/0.log" Jun 08 08:38:14.115325 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:38:14.115290 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7np8s_202c9657-3a36-43ef-88ad-8fdaaba546c0/kube-multus-additional-cni-plugins/0.log" Jun 08 08:38:14.136128 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:38:14.136093 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7np8s_202c9657-3a36-43ef-88ad-8fdaaba546c0/egress-router-binary-copy/0.log" Jun 08 08:38:14.156624 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:38:14.156595 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7np8s_202c9657-3a36-43ef-88ad-8fdaaba546c0/cni-plugins/0.log" Jun 08 08:38:14.180056 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:38:14.180002 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7np8s_202c9657-3a36-43ef-88ad-8fdaaba546c0/bond-cni-plugin/0.log" Jun 08 08:38:14.200071 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:38:14.200011 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7np8s_202c9657-3a36-43ef-88ad-8fdaaba546c0/routeoverride-cni/0.log" Jun 08 08:38:14.219180 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:38:14.219152 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7np8s_202c9657-3a36-43ef-88ad-8fdaaba546c0/whereabouts-cni-bincopy/0.log" Jun 08 08:38:14.239929 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:38:14.239902 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7np8s_202c9657-3a36-43ef-88ad-8fdaaba546c0/whereabouts-cni/0.log" Jun 08 08:38:14.603219 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:38:14.603193 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-zx26n_e0c87538-422c-4356-8983-84c33320ca33/network-metrics-daemon/0.log" Jun 08 08:38:14.663252 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:38:14.663223 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-zx26n_e0c87538-422c-4356-8983-84c33320ca33/kube-rbac-proxy/0.log" Jun 08 08:38:14.751511 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:38:14.751484 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7464d86fc4-kq82r_8ce2c206-f875-4aff-a52c-53cb3c6158d0/kube-auth-proxy/0.log" Jun 08 08:38:14.798216 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:38:14.798188 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5d6f988b67-lzl5t_47da3425-29f0-4210-94ce-c6dc07dc9834/router/0.log" Jun 08 08:38:15.587696 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:38:15.587657 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5s57z_ea083ae5-52f5-4b1a-a730-7690bee17d80/ovn-controller/0.log" Jun 08 08:38:15.605931 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:38:15.605908 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5s57z_ea083ae5-52f5-4b1a-a730-7690bee17d80/ovn-acl-logging/0.log" Jun 08 08:38:15.632175 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:38:15.632146 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5s57z_ea083ae5-52f5-4b1a-a730-7690bee17d80/kube-rbac-proxy-node/0.log" Jun 08 08:38:15.652703 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:38:15.652676 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5s57z_ea083ae5-52f5-4b1a-a730-7690bee17d80/kube-rbac-proxy-ovn-metrics/0.log" Jun 08 08:38:15.671915 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:38:15.671889 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5s57z_ea083ae5-52f5-4b1a-a730-7690bee17d80/northd/0.log" Jun 08 08:38:15.704327 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:38:15.704286 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5s57z_ea083ae5-52f5-4b1a-a730-7690bee17d80/nbdb/0.log" Jun 08 08:38:15.728598 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:38:15.728572 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5s57z_ea083ae5-52f5-4b1a-a730-7690bee17d80/sbdb/0.log" Jun 08 08:38:15.778832 ip-10-0-143-101 kubenswrapper[2570]: I0608 08:38:15.778804 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5s57z_ea083ae5-52f5-4b1a-a730-7690bee17d80/ovnkube-controller/0.log"