Jul 27 09:50:11.728569 ip-10-0-139-140 systemd[1]: Starting Kubernetes Kubelet... Jul 27 09:50:12.160093 ip-10-0-139-140 kubenswrapper[2556]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 27 09:50:12.160093 ip-10-0-139-140 kubenswrapper[2556]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 27 09:50:12.160093 ip-10-0-139-140 kubenswrapper[2556]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 27 09:50:12.160093 ip-10-0-139-140 kubenswrapper[2556]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 27 09:50:12.160093 ip-10-0-139-140 kubenswrapper[2556]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 27 09:50:12.161200 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.161107 2556 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 27 09:50:12.166991 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.166974 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 27 09:50:12.166991 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.166989 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 27 09:50:12.166991 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.166992 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 27 09:50:12.166991 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.166995 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 27 09:50:12.167140 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.166999 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 27 09:50:12.167140 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.167002 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 27 09:50:12.167140 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.167004 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 27 09:50:12.167140 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.167007 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 27 09:50:12.167140 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.167010 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 27 09:50:12.167140 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.167012 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 27 09:50:12.167140 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.167015 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 27 09:50:12.167140 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.167018 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 27 09:50:12.167140 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.167021 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 27 09:50:12.167140 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.167024 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 27 09:50:12.167140 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.167026 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 27 09:50:12.167140 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.167029 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 27 09:50:12.167140 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.167031 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 27 09:50:12.167140 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.167034 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 27 09:50:12.167140 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.167037 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 27 09:50:12.167140 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.167041 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 27 09:50:12.167140 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.167043 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 27 09:50:12.167140 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.167046 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 27 09:50:12.167140 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.167048 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 27 09:50:12.167601 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.167051 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 27 09:50:12.167601 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.167053 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 27 09:50:12.167601 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.167057 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 27 09:50:12.167601 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.167060 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 27 09:50:12.167601 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.167063 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 27 09:50:12.167601 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.167069 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 27 09:50:12.167601 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.167072 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 27 09:50:12.167601 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.167075 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 27 09:50:12.167601 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.167078 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 27 09:50:12.167601 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.167080 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 27 09:50:12.167601 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.167083 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 27 09:50:12.167601 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.167086 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 27 09:50:12.167601 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.167089 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 27 09:50:12.167601 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.167092 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 27 09:50:12.167601 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.167094 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 27 09:50:12.167601 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.167098 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 27 09:50:12.167601 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.167101 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 27 09:50:12.167601 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.167103 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 27 09:50:12.167601 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.167106 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 27 09:50:12.167601 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.167108 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 27 09:50:12.168064 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.167112 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 27 09:50:12.168064 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.167115 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 27 09:50:12.168064 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.167118 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 27 09:50:12.168064 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.167121 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 27 09:50:12.168064 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.167124 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 27 09:50:12.168064 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.167127 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 27 09:50:12.168064 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.167131 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 27 09:50:12.168064 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.167133 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 27 09:50:12.168064 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.167135 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 27 09:50:12.168064 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.167137 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 27 09:50:12.168064 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.167140 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 27 09:50:12.168064 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.167142 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 27 09:50:12.168064 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.167145 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 27 09:50:12.168064 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.167147 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 27 09:50:12.168064 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.167150 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 27 09:50:12.168064 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.167152 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 27 09:50:12.168064 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.167155 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 27 09:50:12.168064 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.167158 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 27 09:50:12.168064 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.167160 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 27 09:50:12.168518 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.167162 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 27 09:50:12.168518 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.167165 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 27 09:50:12.168518 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.167167 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 27 09:50:12.168518 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.167169 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 27 09:50:12.168518 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.167172 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 27 09:50:12.168518 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.167175 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 27 09:50:12.168518 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.167178 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 27 09:50:12.168518 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.167180 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 27 09:50:12.168518 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.167183 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 27 09:50:12.168518 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.167185 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 27 09:50:12.168518 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.167188 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 27 09:50:12.168518 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.167190 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 27 09:50:12.168518 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.167193 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 27 09:50:12.168518 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.167196 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 27 09:50:12.168518 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.167199 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 27 09:50:12.168518 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.167201 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 27 09:50:12.168518 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.167204 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 27 09:50:12.168518 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.167206 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 27 09:50:12.168518 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.167209 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 27 09:50:12.168518 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.167211 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 27 09:50:12.168987 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.167213 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 27 09:50:12.168987 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.167216 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 27 09:50:12.168987 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.167218 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 27 09:50:12.168987 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.167220 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 27 09:50:12.168987 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.167223 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 27 09:50:12.168987 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.167225 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 27 09:50:12.168987 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.167228 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 27 09:50:12.168987 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.167230 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 27 09:50:12.168987 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.167232 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 27 09:50:12.168987 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.167235 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 27 09:50:12.168987 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.167237 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 27 09:50:12.168987 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.167239 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 27 09:50:12.168987 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.167242 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 27 09:50:12.168987 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.167244 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 27 09:50:12.168987 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.167246 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 27 09:50:12.168987 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.167249 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 27 09:50:12.168987 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.167251 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 27 09:50:12.168987 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.167941 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 27 09:50:12.168987 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.167949 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 27 09:50:12.168987 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.167952 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 27 09:50:12.169470 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.167955 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 27 09:50:12.169470 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.167957 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 27 09:50:12.169470 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.167959 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 27 09:50:12.169470 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.167962 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 27 09:50:12.169470 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.167965 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 27 09:50:12.169470 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.167967 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 27 09:50:12.169470 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.167970 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 27 09:50:12.169470 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.167972 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 27 09:50:12.169470 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.167975 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 27 09:50:12.169470 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.167978 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 27 09:50:12.169470 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.167980 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 27 09:50:12.169470 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.167985 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 27 09:50:12.169470 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.167988 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 27 09:50:12.169470 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.167991 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 27 09:50:12.169470 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.167994 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 27 09:50:12.169470 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.167997 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 27 09:50:12.169470 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.167999 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 27 09:50:12.169470 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168002 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 27 09:50:12.169470 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168005 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 27 09:50:12.169960 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168007 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 27 09:50:12.169960 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168010 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 27 09:50:12.169960 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168012 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 27 09:50:12.169960 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168015 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 27 09:50:12.169960 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168017 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 27 09:50:12.169960 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168020 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 27 09:50:12.169960 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168022 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 27 09:50:12.169960 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168024 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 27 09:50:12.169960 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168027 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 27 09:50:12.169960 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168029 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 27 09:50:12.169960 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168032 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 27 09:50:12.169960 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168034 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 27 09:50:12.169960 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168039 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 27 09:50:12.169960 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168042 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 27 09:50:12.169960 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168044 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 27 09:50:12.169960 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168048 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 27 09:50:12.169960 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168050 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 27 09:50:12.169960 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168052 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 27 09:50:12.169960 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168055 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 27 09:50:12.169960 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168058 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 27 09:50:12.170448 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168060 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 27 09:50:12.170448 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168062 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 27 09:50:12.170448 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168065 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 27 09:50:12.170448 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168067 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 27 09:50:12.170448 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168070 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 27 09:50:12.170448 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168073 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 27 09:50:12.170448 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168075 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 27 09:50:12.170448 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168078 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 27 09:50:12.170448 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168080 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 27 09:50:12.170448 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168083 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 27 09:50:12.170448 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168085 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 27 09:50:12.170448 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168087 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 27 09:50:12.170448 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168090 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 27 09:50:12.170448 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168092 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 27 09:50:12.170448 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168094 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 27 09:50:12.170448 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168096 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 27 09:50:12.170448 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168099 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 27 09:50:12.170448 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168101 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 27 09:50:12.170448 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168104 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 27 09:50:12.170448 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168106 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 27 09:50:12.170927 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168109 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 27 09:50:12.170927 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168112 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 27 09:50:12.170927 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168114 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 27 09:50:12.170927 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168117 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 27 09:50:12.170927 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168120 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 27 09:50:12.170927 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168123 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 27 09:50:12.170927 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168125 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 27 09:50:12.170927 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168128 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 27 09:50:12.170927 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168130 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 27 09:50:12.170927 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168132 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 27 09:50:12.170927 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168134 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 27 09:50:12.170927 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168137 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 27 09:50:12.170927 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168139 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 27 09:50:12.170927 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168142 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 27 09:50:12.170927 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168145 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 27 09:50:12.170927 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168148 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 27 09:50:12.170927 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168151 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 27 09:50:12.170927 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168153 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 27 09:50:12.170927 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168157 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 27 09:50:12.171387 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168160 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 27 09:50:12.171387 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168162 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 27 09:50:12.171387 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168165 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 27 09:50:12.171387 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168168 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 27 09:50:12.171387 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168170 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 27 09:50:12.171387 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168172 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 27 09:50:12.171387 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168175 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 27 09:50:12.171387 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168177 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 27 09:50:12.171387 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168179 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 27 09:50:12.171387 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168182 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 27 09:50:12.171387 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168184 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 27 09:50:12.171387 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168186 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 27 09:50:12.171387 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168189 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 27 09:50:12.171387 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168191 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 27 09:50:12.171387 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168194 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 27 09:50:12.171387 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168196 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 27 09:50:12.171387 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168199 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 27 09:50:12.171387 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168202 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 27 09:50:12.171387 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168586 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 27 09:50:12.171387 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168591 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 27 09:50:12.171860 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168595 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 27 09:50:12.171860 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168598 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 27 09:50:12.171860 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168601 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 27 09:50:12.171860 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168603 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 27 09:50:12.171860 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168605 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 27 09:50:12.171860 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168608 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 27 09:50:12.171860 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168610 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 27 09:50:12.171860 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168613 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 27 09:50:12.171860 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168616 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 27 09:50:12.171860 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168618 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 27 09:50:12.171860 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168621 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 27 09:50:12.171860 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168624 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 27 09:50:12.171860 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168626 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 27 09:50:12.171860 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168629 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 27 09:50:12.171860 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168631 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 27 09:50:12.171860 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168634 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 27 09:50:12.171860 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168636 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 27 09:50:12.171860 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168638 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 27 09:50:12.171860 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168641 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 27 09:50:12.171860 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168643 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 27 09:50:12.172362 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168645 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 27 09:50:12.172362 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168648 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 27 09:50:12.172362 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168650 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 27 09:50:12.172362 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168652 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 27 09:50:12.172362 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168655 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 27 09:50:12.172362 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168658 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 27 09:50:12.172362 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168660 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 27 09:50:12.172362 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168665 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 27 09:50:12.172362 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168668 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 27 09:50:12.172362 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168671 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 27 09:50:12.172362 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168673 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 27 09:50:12.172362 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168676 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 27 09:50:12.172362 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168678 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 27 09:50:12.172362 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168680 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 27 09:50:12.172362 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168683 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 27 09:50:12.172362 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168686 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 27 09:50:12.172362 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168689 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 27 09:50:12.172362 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168691 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 27 09:50:12.172362 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168693 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 27 09:50:12.172362 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168695 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 27 09:50:12.172841 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168698 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 27 09:50:12.172841 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168700 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 27 09:50:12.172841 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168702 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 27 09:50:12.172841 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168705 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 27 09:50:12.172841 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168708 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 27 09:50:12.172841 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168710 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 27 09:50:12.172841 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168712 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 27 09:50:12.172841 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168715 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 27 09:50:12.172841 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168717 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 27 09:50:12.172841 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168719 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 27 09:50:12.172841 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168722 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 27 09:50:12.172841 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168724 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 27 09:50:12.172841 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168727 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 27 09:50:12.172841 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168729 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 27 09:50:12.172841 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168733 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 27 09:50:12.172841 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168737 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 27 09:50:12.172841 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168739 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 27 09:50:12.172841 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168742 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 27 09:50:12.172841 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168745 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 27 09:50:12.173298 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168749 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 27 09:50:12.173298 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168752 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 27 09:50:12.173298 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168754 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 27 09:50:12.173298 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168757 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 27 09:50:12.173298 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168760 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 27 09:50:12.173298 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168762 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 27 09:50:12.173298 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168764 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 27 09:50:12.173298 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168767 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 27 09:50:12.173298 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168769 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 27 09:50:12.173298 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168772 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 27 09:50:12.173298 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168774 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 27 09:50:12.173298 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168776 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 27 09:50:12.173298 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168779 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 27 09:50:12.173298 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168781 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 27 09:50:12.173298 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168784 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 27 09:50:12.173298 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168786 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 27 09:50:12.173298 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168788 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 27 09:50:12.173298 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168791 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 27 09:50:12.173298 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168794 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 27 09:50:12.173298 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168796 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 27 09:50:12.173794 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168799 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 27 09:50:12.173794 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168801 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 27 09:50:12.173794 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168805 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 27 09:50:12.173794 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168807 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 27 09:50:12.173794 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168809 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 27 09:50:12.173794 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168812 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 27 09:50:12.173794 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168814 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 27 09:50:12.173794 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168817 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 27 09:50:12.173794 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168819 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 27 09:50:12.173794 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168822 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 27 09:50:12.173794 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168826 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 27 09:50:12.173794 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168829 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 27 09:50:12.173794 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168834 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 27 09:50:12.173794 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168837 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 27 09:50:12.173794 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168841 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 27 09:50:12.173794 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168844 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 27 09:50:12.173794 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168847 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 27 09:50:12.173794 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.168850 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 27 09:50:12.173794 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.168915 2556 flags.go:64] FLAG: --address="0.0.0.0" Jul 27 09:50:12.173794 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.168921 2556 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 27 09:50:12.174255 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.168961 2556 flags.go:64] FLAG: --anonymous-auth="true" Jul 27 09:50:12.174255 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.168965 2556 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 27 09:50:12.174255 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.168969 2556 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 27 09:50:12.174255 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.168972 2556 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 27 09:50:12.174255 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.168976 2556 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 27 09:50:12.174255 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.168980 2556 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 27 09:50:12.174255 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.168982 2556 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 27 09:50:12.174255 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.168985 2556 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 27 09:50:12.174255 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.168989 2556 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 27 09:50:12.174255 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.168992 2556 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 27 09:50:12.174255 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.168995 2556 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 27 09:50:12.174255 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.168999 2556 flags.go:64] FLAG: --cgroup-root="" Jul 27 09:50:12.174255 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169002 2556 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 27 09:50:12.174255 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169005 2556 flags.go:64] FLAG: --client-ca-file="" Jul 27 09:50:12.174255 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169007 2556 flags.go:64] FLAG: --cloud-provider="external" Jul 27 09:50:12.174255 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169010 2556 flags.go:64] FLAG: --cluster-dns="[]" Jul 27 09:50:12.174255 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169014 2556 flags.go:64] FLAG: --cluster-domain="" Jul 27 09:50:12.174255 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169016 2556 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 27 09:50:12.174255 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169019 2556 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 27 09:50:12.174255 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169022 2556 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 27 09:50:12.174255 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169025 2556 flags.go:64] FLAG: --container-log-max-files="5" Jul 27 09:50:12.174255 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169029 2556 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 27 09:50:12.174255 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169031 2556 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 27 09:50:12.174836 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169034 2556 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 27 09:50:12.174836 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169038 2556 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 27 09:50:12.174836 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169041 2556 flags.go:64] FLAG: --contention-profiling="false" Jul 27 09:50:12.174836 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169046 2556 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 27 09:50:12.174836 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169048 2556 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 27 09:50:12.174836 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169051 2556 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 27 09:50:12.174836 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169054 2556 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 27 09:50:12.174836 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169058 2556 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 27 09:50:12.174836 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169061 2556 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 27 09:50:12.174836 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169063 2556 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 27 09:50:12.174836 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169066 2556 flags.go:64] FLAG: --enable-load-reader="false" Jul 27 09:50:12.174836 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169068 2556 flags.go:64] FLAG: --enable-server="true" Jul 27 09:50:12.174836 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169071 2556 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 27 09:50:12.174836 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169075 2556 flags.go:64] FLAG: --event-burst="100" Jul 27 09:50:12.174836 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169078 2556 flags.go:64] FLAG: --event-qps="50" Jul 27 09:50:12.174836 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169080 2556 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 27 09:50:12.174836 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169083 2556 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 27 09:50:12.174836 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169085 2556 flags.go:64] FLAG: --eviction-hard="" Jul 27 09:50:12.174836 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169089 2556 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 27 09:50:12.174836 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169091 2556 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 27 09:50:12.174836 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169094 2556 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 27 09:50:12.174836 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169097 2556 flags.go:64] FLAG: --eviction-soft="" Jul 27 09:50:12.174836 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169100 2556 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 27 09:50:12.174836 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169102 2556 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 27 09:50:12.174836 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169105 2556 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 27 09:50:12.175532 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169108 2556 flags.go:64] FLAG: --experimental-mounter-path="" Jul 27 09:50:12.175532 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169111 2556 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 27 09:50:12.175532 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169113 2556 flags.go:64] FLAG: --fail-swap-on="true" Jul 27 09:50:12.175532 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169116 2556 flags.go:64] FLAG: --feature-gates="" Jul 27 09:50:12.175532 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169119 2556 flags.go:64] FLAG: --file-check-frequency="20s" Jul 27 09:50:12.175532 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169122 2556 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 27 09:50:12.175532 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169125 2556 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 27 09:50:12.175532 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169128 2556 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 27 09:50:12.175532 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169131 2556 flags.go:64] FLAG: --healthz-port="10248" Jul 27 09:50:12.175532 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169134 2556 flags.go:64] FLAG: --help="false" Jul 27 09:50:12.175532 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169138 2556 flags.go:64] FLAG: --hostname-override="ip-10-0-139-140.ec2.internal" Jul 27 09:50:12.175532 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169141 2556 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 27 09:50:12.175532 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169143 2556 flags.go:64] FLAG: --http-check-frequency="20s" Jul 27 09:50:12.175532 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169146 2556 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 27 09:50:12.175532 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169149 2556 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 27 09:50:12.175532 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169152 2556 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 27 09:50:12.175532 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169155 2556 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 27 09:50:12.175532 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169157 2556 flags.go:64] FLAG: --image-service-endpoint="" Jul 27 09:50:12.175532 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169160 2556 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 27 09:50:12.175532 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169162 2556 flags.go:64] FLAG: --kube-api-burst="100" Jul 27 09:50:12.175532 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169165 2556 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 27 09:50:12.175532 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169168 2556 flags.go:64] FLAG: --kube-api-qps="50" Jul 27 09:50:12.175532 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169171 2556 flags.go:64] FLAG: --kube-reserved="" Jul 27 09:50:12.175532 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169174 2556 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 27 09:50:12.176116 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169176 2556 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 27 09:50:12.176116 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169179 2556 flags.go:64] FLAG: --kubelet-cgroups="" Jul 27 09:50:12.176116 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169181 2556 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 27 09:50:12.176116 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169184 2556 flags.go:64] FLAG: --lock-file="" Jul 27 09:50:12.176116 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169186 2556 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 27 09:50:12.176116 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169190 2556 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 27 09:50:12.176116 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169193 2556 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 27 09:50:12.176116 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169198 2556 flags.go:64] FLAG: --log-json-split-stream="false" Jul 27 09:50:12.176116 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169201 2556 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 27 09:50:12.176116 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169203 2556 flags.go:64] FLAG: --log-text-split-stream="false" Jul 27 09:50:12.176116 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169206 2556 flags.go:64] FLAG: --logging-format="text" Jul 27 09:50:12.176116 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169208 2556 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 27 09:50:12.176116 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169211 2556 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 27 09:50:12.176116 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169214 2556 flags.go:64] FLAG: --manifest-url="" Jul 27 09:50:12.176116 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169216 2556 flags.go:64] FLAG: --manifest-url-header="" Jul 27 09:50:12.176116 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169220 2556 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 27 09:50:12.176116 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169224 2556 flags.go:64] FLAG: --max-open-files="1000000" Jul 27 09:50:12.176116 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169228 2556 flags.go:64] FLAG: --max-pods="110" Jul 27 09:50:12.176116 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169232 2556 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 27 09:50:12.176116 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169234 2556 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 27 09:50:12.176116 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169237 2556 flags.go:64] FLAG: --memory-manager-policy="None" Jul 27 09:50:12.176116 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169240 2556 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 27 09:50:12.176116 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169242 2556 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 27 09:50:12.176116 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169245 2556 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 27 09:50:12.176116 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169248 2556 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 27 09:50:12.176748 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169256 2556 flags.go:64] FLAG: --node-status-max-images="50" Jul 27 09:50:12.176748 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169259 2556 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 27 09:50:12.176748 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169262 2556 flags.go:64] FLAG: --oom-score-adj="-999" Jul 27 09:50:12.176748 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169265 2556 flags.go:64] FLAG: --pod-cidr="" Jul 27 09:50:12.176748 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169267 2556 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb" Jul 27 09:50:12.176748 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169290 2556 flags.go:64] FLAG: --pod-manifest-path="" Jul 27 09:50:12.176748 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169295 2556 flags.go:64] FLAG: --pod-max-pids="-1" Jul 27 09:50:12.176748 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169299 2556 flags.go:64] FLAG: --pods-per-core="0" Jul 27 09:50:12.176748 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169303 2556 flags.go:64] FLAG: --port="10250" Jul 27 09:50:12.176748 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169306 2556 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 27 09:50:12.176748 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169309 2556 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-00da681b72211224e" Jul 27 09:50:12.176748 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169312 2556 flags.go:64] FLAG: --qos-reserved="" Jul 27 09:50:12.176748 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169315 2556 flags.go:64] FLAG: --read-only-port="10255" Jul 27 09:50:12.176748 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169319 2556 flags.go:64] FLAG: --register-node="true" Jul 27 09:50:12.176748 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169321 2556 flags.go:64] FLAG: --register-with-taints="" Jul 27 09:50:12.176748 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169325 2556 flags.go:64] FLAG: --registry-burst="10" Jul 27 09:50:12.176748 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169328 2556 flags.go:64] FLAG: --registry-qps="5" Jul 27 09:50:12.176748 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169330 2556 flags.go:64] FLAG: --reserved-cpus="" Jul 27 09:50:12.176748 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169333 2556 flags.go:64] FLAG: --reserved-memory="" Jul 27 09:50:12.176748 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169337 2556 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 27 09:50:12.176748 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169339 2556 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 27 09:50:12.176748 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169342 2556 flags.go:64] FLAG: --rotate-certificates="false" Jul 27 09:50:12.176748 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169345 2556 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 27 09:50:12.176748 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169348 2556 flags.go:64] FLAG: --runonce="false" Jul 27 09:50:12.176748 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169352 2556 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 27 09:50:12.177338 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169356 2556 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 27 09:50:12.177338 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169358 2556 flags.go:64] FLAG: --seccomp-default="false" Jul 27 09:50:12.177338 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169361 2556 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 27 09:50:12.177338 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169364 2556 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 27 09:50:12.177338 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169367 2556 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 27 09:50:12.177338 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169369 2556 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 27 09:50:12.177338 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169372 2556 flags.go:64] FLAG: --storage-driver-password="root" Jul 27 09:50:12.177338 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169375 2556 flags.go:64] FLAG: --storage-driver-secure="false" Jul 27 09:50:12.177338 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169377 2556 flags.go:64] FLAG: --storage-driver-table="stats" Jul 27 09:50:12.177338 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169380 2556 flags.go:64] FLAG: --storage-driver-user="root" Jul 27 09:50:12.177338 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169382 2556 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 27 09:50:12.177338 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169385 2556 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 27 09:50:12.177338 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169388 2556 flags.go:64] FLAG: --system-cgroups="" Jul 27 09:50:12.177338 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169391 2556 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 27 09:50:12.177338 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169396 2556 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 27 09:50:12.177338 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169398 2556 flags.go:64] FLAG: --tls-cert-file="" Jul 27 09:50:12.177338 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169401 2556 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 27 09:50:12.177338 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169404 2556 flags.go:64] FLAG: --tls-min-version="" Jul 27 09:50:12.177338 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169407 2556 flags.go:64] FLAG: --tls-private-key-file="" Jul 27 09:50:12.177338 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169410 2556 flags.go:64] FLAG: --topology-manager-policy="none" Jul 27 09:50:12.177338 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169412 2556 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 27 09:50:12.177338 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169416 2556 flags.go:64] FLAG: --topology-manager-scope="container" Jul 27 09:50:12.177338 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169418 2556 flags.go:64] FLAG: --v="2" Jul 27 09:50:12.177338 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169421 2556 flags.go:64] FLAG: --version="false" Jul 27 09:50:12.177338 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169425 2556 flags.go:64] FLAG: --vmodule="" Jul 27 09:50:12.177929 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169428 2556 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 27 09:50:12.177929 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169431 2556 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 27 09:50:12.177929 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.169534 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 27 09:50:12.177929 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.169537 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 27 09:50:12.177929 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.169540 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 27 09:50:12.177929 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.169543 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 27 09:50:12.177929 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.169546 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 27 09:50:12.177929 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.169550 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 27 09:50:12.177929 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.169552 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 27 09:50:12.177929 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.169555 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 27 09:50:12.177929 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.169557 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 27 09:50:12.177929 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.169560 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 27 09:50:12.177929 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.169562 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 27 09:50:12.177929 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.169565 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 27 09:50:12.177929 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.169568 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 27 09:50:12.177929 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.169572 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 27 09:50:12.177929 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.169575 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 27 09:50:12.177929 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.169578 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 27 09:50:12.177929 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.169580 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 27 09:50:12.177929 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.169583 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 27 09:50:12.178441 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.169586 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 27 09:50:12.178441 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.169588 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 27 09:50:12.178441 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.169590 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 27 09:50:12.178441 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.169593 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 27 09:50:12.178441 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.169595 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 27 09:50:12.178441 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.169598 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 27 09:50:12.178441 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.169600 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 27 09:50:12.178441 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.169602 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 27 09:50:12.178441 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.169605 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 27 09:50:12.178441 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.169607 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 27 09:50:12.178441 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.169610 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 27 09:50:12.178441 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.169612 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 27 09:50:12.178441 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.169614 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 27 09:50:12.178441 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.169617 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 27 09:50:12.178441 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.169619 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 27 09:50:12.178441 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.169622 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 27 09:50:12.178441 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.169624 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 27 09:50:12.178441 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.169626 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 27 09:50:12.178441 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.169630 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 27 09:50:12.178892 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.169634 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 27 09:50:12.178892 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.169636 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 27 09:50:12.178892 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.169639 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 27 09:50:12.178892 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.169641 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 27 09:50:12.178892 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.169643 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 27 09:50:12.178892 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.169646 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 27 09:50:12.178892 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.169648 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 27 09:50:12.178892 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.169651 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 27 09:50:12.178892 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.169653 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 27 09:50:12.178892 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.169656 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 27 09:50:12.178892 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.169658 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 27 09:50:12.178892 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.169661 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 27 09:50:12.178892 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.169663 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 27 09:50:12.178892 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.169665 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 27 09:50:12.178892 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.169668 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 27 09:50:12.178892 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.169671 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 27 09:50:12.178892 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.169673 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 27 09:50:12.178892 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.169675 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 27 09:50:12.178892 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.169677 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 27 09:50:12.179360 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.169681 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 27 09:50:12.179360 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.169684 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 27 09:50:12.179360 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.169687 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 27 09:50:12.179360 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.169689 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 27 09:50:12.179360 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.169692 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 27 09:50:12.179360 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.169694 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 27 09:50:12.179360 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.169697 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 27 09:50:12.179360 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.169699 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 27 09:50:12.179360 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.169701 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 27 09:50:12.179360 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.169703 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 27 09:50:12.179360 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.169706 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 27 09:50:12.179360 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.169708 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 27 09:50:12.179360 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.169712 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 27 09:50:12.179360 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.169716 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 27 09:50:12.179360 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.169718 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 27 09:50:12.179360 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.169721 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 27 09:50:12.179360 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.169723 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 27 09:50:12.179360 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.169725 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 27 09:50:12.179360 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.169728 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 27 09:50:12.179360 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.169730 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 27 09:50:12.179830 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.169732 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 27 09:50:12.179830 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.169735 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 27 09:50:12.179830 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.169737 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 27 09:50:12.179830 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.169740 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 27 09:50:12.179830 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.169742 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 27 09:50:12.179830 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.169745 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 27 09:50:12.179830 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.169747 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 27 09:50:12.179830 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.169749 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 27 09:50:12.179830 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.169752 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 27 09:50:12.179830 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.169754 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 27 09:50:12.179830 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.169757 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 27 09:50:12.179830 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.169759 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 27 09:50:12.179830 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.169761 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 27 09:50:12.179830 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.169763 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 27 09:50:12.179830 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.169765 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 27 09:50:12.179830 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.169769 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 27 09:50:12.179830 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.169772 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 27 09:50:12.179830 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.169775 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 27 09:50:12.179830 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.169777 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 27 09:50:12.180270 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.169780 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 27 09:50:12.180270 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.169782 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 27 09:50:12.180270 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.169785 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 27 09:50:12.180270 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.169787 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 27 09:50:12.180270 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.169794 2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 27 09:50:12.180270 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.176834 2556 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 27 09:50:12.180270 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.176848 2556 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 27 09:50:12.180270 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.176865 2556 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 27 09:50:12.180270 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.176873 2556 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 27 09:50:12.180270 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.176924 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 27 09:50:12.180270 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.176930 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 27 09:50:12.180270 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.176933 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 27 09:50:12.180270 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.176936 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 27 09:50:12.180270 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.176939 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 27 09:50:12.180616 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.176942 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 27 09:50:12.180616 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.176945 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 27 09:50:12.180616 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.176949 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 27 09:50:12.180616 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.176952 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 27 09:50:12.180616 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.176955 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 27 09:50:12.180616 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.176957 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 27 09:50:12.180616 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.176959 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 27 09:50:12.180616 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.176962 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 27 09:50:12.180616 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.176964 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 27 09:50:12.180616 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.176967 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 27 09:50:12.180616 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.176969 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 27 09:50:12.180616 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.176971 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 27 09:50:12.180616 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.176974 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 27 09:50:12.180616 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.176976 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 27 09:50:12.180616 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.176979 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 27 09:50:12.180616 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.176981 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 27 09:50:12.180616 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.176984 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 27 09:50:12.180616 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.176986 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 27 09:50:12.180616 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.176989 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 27 09:50:12.181046 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.176991 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 27 09:50:12.181046 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.176994 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 27 09:50:12.181046 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.176996 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 27 09:50:12.181046 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.176999 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 27 09:50:12.181046 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177001 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 27 09:50:12.181046 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177005 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 27 09:50:12.181046 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177008 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 27 09:50:12.181046 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177010 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 27 09:50:12.181046 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177013 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 27 09:50:12.181046 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177015 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 27 09:50:12.181046 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177018 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 27 09:50:12.181046 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177020 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 27 09:50:12.181046 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177022 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 27 09:50:12.181046 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177025 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 27 09:50:12.181046 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177027 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 27 09:50:12.181046 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177030 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 27 09:50:12.181046 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177032 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 27 09:50:12.181046 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177035 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 27 09:50:12.181046 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177037 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 27 09:50:12.181046 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177040 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 27 09:50:12.181523 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177042 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 27 09:50:12.181523 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177045 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 27 09:50:12.181523 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177047 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 27 09:50:12.181523 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177050 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 27 09:50:12.181523 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177052 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 27 09:50:12.181523 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177054 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 27 09:50:12.181523 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177057 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 27 09:50:12.181523 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177059 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 27 09:50:12.181523 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177061 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 27 09:50:12.181523 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177063 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 27 09:50:12.181523 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177066 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 27 09:50:12.181523 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177069 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 27 09:50:12.181523 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177071 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 27 09:50:12.181523 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177074 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 27 09:50:12.181523 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177076 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 27 09:50:12.181523 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177079 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 27 09:50:12.181523 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177081 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 27 09:50:12.181523 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177084 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 27 09:50:12.181523 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177088 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 27 09:50:12.181523 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177092 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 27 09:50:12.181984 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177095 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 27 09:50:12.181984 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177098 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 27 09:50:12.181984 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177101 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 27 09:50:12.181984 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177104 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 27 09:50:12.181984 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177106 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 27 09:50:12.181984 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177109 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 27 09:50:12.181984 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177111 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 27 09:50:12.181984 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177114 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 27 09:50:12.181984 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177116 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 27 09:50:12.181984 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177120 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 27 09:50:12.181984 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177123 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 27 09:50:12.181984 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177125 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 27 09:50:12.181984 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177128 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 27 09:50:12.181984 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177131 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 27 09:50:12.181984 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177133 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 27 09:50:12.181984 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177136 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 27 09:50:12.181984 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177139 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 27 09:50:12.181984 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177141 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 27 09:50:12.181984 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177144 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 27 09:50:12.181984 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177146 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 27 09:50:12.182464 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177149 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 27 09:50:12.182464 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177151 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 27 09:50:12.182464 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177154 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 27 09:50:12.182464 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177156 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 27 09:50:12.182464 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177158 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 27 09:50:12.182464 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177161 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 27 09:50:12.182464 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177163 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 27 09:50:12.182464 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177166 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 27 09:50:12.182464 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177168 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 27 09:50:12.182464 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177171 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 27 09:50:12.182464 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177173 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 27 09:50:12.182464 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177176 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 27 09:50:12.182464 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177179 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 27 09:50:12.182464 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177181 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 27 09:50:12.182464 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177183 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 27 09:50:12.182813 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.177188 2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 27 09:50:12.182813 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177313 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 27 09:50:12.182813 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177319 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 27 09:50:12.182813 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177321 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 27 09:50:12.182813 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177324 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 27 09:50:12.182813 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177326 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 27 09:50:12.182813 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177329 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 27 09:50:12.182813 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177331 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 27 09:50:12.182813 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177334 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 27 09:50:12.182813 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177336 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 27 09:50:12.182813 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177339 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 27 09:50:12.182813 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177341 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 27 09:50:12.182813 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177344 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 27 09:50:12.182813 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177348 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 27 09:50:12.182813 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177352 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 27 09:50:12.183167 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177354 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 27 09:50:12.183167 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177357 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 27 09:50:12.183167 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177359 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 27 09:50:12.183167 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177362 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 27 09:50:12.183167 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177364 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 27 09:50:12.183167 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177366 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 27 09:50:12.183167 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177369 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 27 09:50:12.183167 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177371 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 27 09:50:12.183167 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177374 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 27 09:50:12.183167 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177376 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 27 09:50:12.183167 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177378 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 27 09:50:12.183167 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177380 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 27 09:50:12.183167 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177383 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 27 09:50:12.183167 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177385 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 27 09:50:12.183167 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177388 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 27 09:50:12.183167 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177390 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 27 09:50:12.183167 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177393 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 27 09:50:12.183167 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177395 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 27 09:50:12.183167 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177397 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 27 09:50:12.183620 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177400 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 27 09:50:12.183620 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177402 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 27 09:50:12.183620 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177404 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 27 09:50:12.183620 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177407 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 27 09:50:12.183620 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177409 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 27 09:50:12.183620 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177412 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 27 09:50:12.183620 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177414 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 27 09:50:12.183620 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177416 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 27 09:50:12.183620 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177419 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 27 09:50:12.183620 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177421 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 27 09:50:12.183620 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177423 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 27 09:50:12.183620 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177425 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 27 09:50:12.183620 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177427 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 27 09:50:12.183620 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177430 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 27 09:50:12.183620 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177432 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 27 09:50:12.183620 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177435 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 27 09:50:12.183620 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177438 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 27 09:50:12.183620 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177441 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 27 09:50:12.183620 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177443 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 27 09:50:12.184055 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177446 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 27 09:50:12.184055 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177448 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 27 09:50:12.184055 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177451 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 27 09:50:12.184055 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177454 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 27 09:50:12.184055 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177457 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 27 09:50:12.184055 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177459 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 27 09:50:12.184055 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177461 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 27 09:50:12.184055 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177464 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 27 09:50:12.184055 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177466 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 27 09:50:12.184055 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177469 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 27 09:50:12.184055 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177471 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 27 09:50:12.184055 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177473 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 27 09:50:12.184055 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177476 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 27 09:50:12.184055 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177479 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 27 09:50:12.184055 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177481 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 27 09:50:12.184055 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177483 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 27 09:50:12.184055 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177486 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 27 09:50:12.184055 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177488 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 27 09:50:12.184055 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177490 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 27 09:50:12.184055 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177492 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 27 09:50:12.184588 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177495 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 27 09:50:12.184588 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177497 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 27 09:50:12.184588 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177499 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 27 09:50:12.184588 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177502 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 27 09:50:12.184588 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177504 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 27 09:50:12.184588 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177506 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 27 09:50:12.184588 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177509 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 27 09:50:12.184588 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177511 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 27 09:50:12.184588 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177513 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 27 09:50:12.184588 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177516 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 27 09:50:12.184588 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177518 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 27 09:50:12.184588 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177520 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 27 09:50:12.184588 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177522 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 27 09:50:12.184588 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177526 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 27 09:50:12.184588 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177529 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 27 09:50:12.184588 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177532 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 27 09:50:12.184588 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177535 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 27 09:50:12.184588 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177537 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 27 09:50:12.184588 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177540 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 27 09:50:12.184588 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177542 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 27 09:50:12.185048 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177545 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 27 09:50:12.185048 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177547 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 27 09:50:12.185048 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177550 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 27 09:50:12.185048 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177552 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 27 09:50:12.185048 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177555 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 27 09:50:12.185048 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177557 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 27 09:50:12.185048 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:12.177559 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 27 09:50:12.185048 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.177564 2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 27 09:50:12.185048 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.177652 2556 server.go:962] "Client rotation is on, will bootstrap in background" Jul 27 09:50:12.185048 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.180699 2556 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 27 09:50:12.185048 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.182369 2556 server.go:1019] "Starting client certificate rotation" Jul 27 09:50:12.185048 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.182460 2556 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 27 09:50:12.185048 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.182488 2556 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 27 09:50:12.185924 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.185911 2556 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 27 09:50:12.187001 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.186985 2556 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 27 09:50:12.201021 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.201005 2556 log.go:25] "Validated CRI v1 runtime API" Jul 27 09:50:12.203407 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.203394 2556 log.go:25] "Validated CRI v1 image API" Jul 27 09:50:12.204161 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.204146 2556 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 27 09:50:12.207614 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.207597 2556 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 dc43bb80-f527-43e0-9d7e-f84e83c81843:/dev/nvme0n1p3 e0256ef5-ebe3-4d15-a01a-bd1752ccce29:/dev/nvme0n1p4] Jul 27 09:50:12.207670 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.207614 2556 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 27 09:50:12.213246 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.213136 2556 manager.go:216] Machine: {Timestamp:2026-07-27 09:50:12.211752801 +0000 UTC m=+0.356276817 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3199492 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ac5559cf143e66014d51a23c3e637 SystemUUID:ec2ac555-9cf1-43e6-6014-d51a23c3e637 BootID:4d87327b-5482-432a-beb7-b6605f430bc0 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:49:3b:9b:fb:3f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:49:3b:9b:fb:3f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:6a:25:7d:59:b6:87 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 27 09:50:12.213246 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.213245 2556 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 27 09:50:12.213362 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.213350 2556 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 27 09:50:12.214954 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.214940 2556 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 27 09:50:12.216994 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.216975 2556 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 27 09:50:12.217117 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.216999 2556 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-140.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 27 09:50:12.217802 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.217792 2556 topology_manager.go:138] "Creating topology manager with none policy" Jul 27 09:50:12.217838 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.217804 2556 container_manager_linux.go:309] "Creating device plugin manager" Jul 27 09:50:12.217838 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.217811 2556 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 27 09:50:12.217838 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.217824 2556 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 27 09:50:12.219051 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.219042 2556 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 27 09:50:12.220709 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.220698 2556 state_mem.go:36] "Initialized new in-memory state store" Jul 27 09:50:12.220824 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.220815 2556 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 27 09:50:12.220855 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.220844 2556 kubelet.go:486] "Attempting to sync node with API server" Jul 27 09:50:12.220855 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.220854 2556 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 27 09:50:12.220910 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.220867 2556 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 27 09:50:12.220910 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.220876 2556 kubelet.go:398] "Adding apiserver pod source" Jul 27 09:50:12.220910 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.220888 2556 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 27 09:50:12.221180 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.221168 2556 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 27 09:50:12.221212 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.221189 2556 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 27 09:50:12.225044 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.225029 2556 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 27 09:50:12.227538 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.227524 2556 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 27 09:50:12.227594 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.227554 2556 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 27 09:50:12.229379 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.229367 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 27 09:50:12.229419 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.229383 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 27 09:50:12.229419 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.229390 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 27 09:50:12.229419 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.229394 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 27 09:50:12.229419 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.229402 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 27 09:50:12.229419 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.229415 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 27 09:50:12.229540 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.229423 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 27 09:50:12.229540 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.229428 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 27 09:50:12.229540 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.229434 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 27 09:50:12.229540 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.229439 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 27 09:50:12.229819 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.229811 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 27 09:50:12.229889 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.229820 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 27 09:50:12.230864 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.230851 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 27 09:50:12.230899 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.230866 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 27 09:50:12.232743 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:12.232720 2556 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 27 09:50:12.232785 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:12.232739 2556 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-140.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 27 09:50:12.232815 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.232785 2556 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-140.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 27 09:50:12.233910 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.233888 2556 server.go:1268] "Started kubelet" Jul 27 09:50:12.233982 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.233949 2556 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 27 09:50:12.234055 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.234012 2556 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 27 09:50:12.234101 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.234076 2556 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 27 09:50:12.234708 ip-10-0-139-140 systemd[1]: Started Kubernetes Kubelet. Jul 27 09:50:12.239520 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.239490 2556 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 27 09:50:12.239826 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.239812 2556 server.go:310] "Adding debug handlers to kubelet server" Jul 27 09:50:12.241344 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:12.241247 2556 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 27 09:50:12.248316 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.248294 2556 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 27 09:50:12.248396 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.248317 2556 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 27 09:50:12.248446 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:12.248411 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-140.ec2.internal\" not found" Jul 27 09:50:12.248987 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.248969 2556 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 27 09:50:12.248987 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.248999 2556 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 27 09:50:12.249292 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.249013 2556 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 27 09:50:12.249292 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.249142 2556 reconstruct.go:97] "Volume reconstruction finished" Jul 27 09:50:12.249292 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.249150 2556 reconciler.go:29] "Reconciler: start to sync state" Jul 27 09:50:12.249292 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.249241 2556 factory.go:55] Registering systemd factory Jul 27 09:50:12.249292 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.249255 2556 factory.go:223] Registration of the systemd container factory successfully Jul 27 09:50:12.249503 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.249460 2556 factory.go:153] Registering CRI-O factory Jul 27 09:50:12.249503 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.249473 2556 factory.go:223] Registration of the crio container factory successfully Jul 27 09:50:12.249582 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.249515 2556 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 27 09:50:12.249582 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.249534 2556 factory.go:103] Registering Raw factory Jul 27 09:50:12.249582 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.249543 2556 manager.go:1196] Started watching for new ooms in manager Jul 27 09:50:12.249908 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.249896 2556 manager.go:349] Starting recovery of all containers Jul 27 09:50:12.250966 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:12.250938 2556 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-139-140.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 27 09:50:12.251053 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:12.250976 2556 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 27 09:50:12.252179 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:12.251005 2556 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-140.ec2.internal.18c61ca87a79af80 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-140.ec2.internal,UID:ip-10-0-139-140.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-140.ec2.internal,},FirstTimestamp:2026-07-27 09:50:12.233858944 +0000 UTC m=+0.378382959,LastTimestamp:2026-07-27 09:50:12.233858944 +0000 UTC m=+0.378382959,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-140.ec2.internal,}" Jul 27 09:50:12.259410 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.259396 2556 manager.go:354] Recovery completed Jul 27 09:50:12.263444 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.263430 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 09:50:12.265066 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.265044 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-140.ec2.internal" event="NodeHasSufficientMemory" Jul 27 09:50:12.265133 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.265077 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-140.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 09:50:12.265133 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.265086 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-140.ec2.internal" event="NodeHasSufficientPID" Jul 27 09:50:12.265542 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.265520 2556 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 27 09:50:12.265542 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.265526 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 09:50:12.265542 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.265532 2556 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 27 09:50:12.265700 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.265548 2556 state_mem.go:36] "Initialized new in-memory state store" Jul 27 09:50:12.266125 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.266111 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-140.ec2.internal" event="NodeHasSufficientMemory" Jul 27 09:50:12.266168 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.266136 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-140.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 09:50:12.266168 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.266146 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-140.ec2.internal" event="NodeHasSufficientPID" Jul 27 09:50:12.267344 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.267332 2556 policy_none.go:49] "None policy: Start" Jul 27 09:50:12.267416 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.267349 2556 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 27 09:50:12.267416 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.267362 2556 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 27 09:50:12.268331 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.268320 2556 policy_none.go:47] "Start" Jul 27 09:50:12.273202 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.273186 2556 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6wxcx" Jul 27 09:50:12.275075 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:12.274999 2556 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-140.ec2.internal.18c61ca87c55dae2 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-140.ec2.internal,UID:ip-10-0-139-140.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-139-140.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-139-140.ec2.internal,},FirstTimestamp:2026-07-27 09:50:12.265065186 +0000 UTC m=+0.409589201,LastTimestamp:2026-07-27 09:50:12.265065186 +0000 UTC m=+0.409589201,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-140.ec2.internal,}" Jul 27 09:50:12.281626 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.281606 2556 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6wxcx" Jul 27 09:50:12.285464 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:12.285385 2556 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-140.ec2.internal.18c61ca87c561acb default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-140.ec2.internal,UID:ip-10-0-139-140.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-139-140.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-139-140.ec2.internal,},FirstTimestamp:2026-07-27 09:50:12.265081547 +0000 UTC m=+0.409605563,LastTimestamp:2026-07-27 09:50:12.265081547 +0000 UTC m=+0.409605563,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-140.ec2.internal,}" Jul 27 09:50:12.302179 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.302041 2556 manager.go:337] "Starting Device Plugin manager" Jul 27 09:50:12.317417 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:12.302197 2556 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 27 09:50:12.317417 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.302207 2556 server.go:87] "Starting device plugin registration server" Jul 27 09:50:12.317417 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.302408 2556 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 27 09:50:12.317417 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.302419 2556 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 27 09:50:12.317417 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.302463 2556 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 27 09:50:12.317417 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.302522 2556 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 27 09:50:12.317417 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.302530 2556 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 27 09:50:12.317417 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:12.303643 2556 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 27 09:50:12.317417 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:12.303698 2556 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-140.ec2.internal\" not found" Jul 27 09:50:12.348977 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.348947 2556 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 27 09:50:12.350146 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.350129 2556 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 27 09:50:12.350209 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.350173 2556 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 27 09:50:12.350209 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.350193 2556 kubelet.go:2448] "Starting kubelet main sync loop" Jul 27 09:50:12.350309 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:12.350228 2556 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 27 09:50:12.352804 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.352782 2556 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 27 09:50:12.402678 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.402649 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 09:50:12.406942 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.406922 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-140.ec2.internal" event="NodeHasSufficientMemory" Jul 27 09:50:12.407019 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.406954 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-140.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 09:50:12.407019 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.406965 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-140.ec2.internal" event="NodeHasSufficientPID" Jul 27 09:50:12.407019 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.406986 2556 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-140.ec2.internal" Jul 27 09:50:12.416287 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.416227 2556 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-140.ec2.internal" Jul 27 09:50:12.416287 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:12.416248 2556 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-140.ec2.internal\": node \"ip-10-0-139-140.ec2.internal\" not found" Jul 27 09:50:12.446004 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:12.445982 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-140.ec2.internal\" not found" Jul 27 09:50:12.451255 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.451240 2556 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-140.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-140.ec2.internal"] Jul 27 09:50:12.451389 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.451316 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 09:50:12.452719 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.452706 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-140.ec2.internal" event="NodeHasSufficientMemory" Jul 27 09:50:12.452778 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.452732 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-140.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 09:50:12.452778 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.452740 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-140.ec2.internal" event="NodeHasSufficientPID" Jul 27 09:50:12.453792 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.453780 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 09:50:12.453903 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.453889 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-140.ec2.internal" Jul 27 09:50:12.453950 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.453916 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 09:50:12.454467 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.454451 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-140.ec2.internal" event="NodeHasSufficientMemory" Jul 27 09:50:12.454532 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.454470 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-140.ec2.internal" event="NodeHasSufficientMemory" Jul 27 09:50:12.454532 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.454478 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-140.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 09:50:12.454532 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.454489 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-140.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 09:50:12.454532 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.454494 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-140.ec2.internal" event="NodeHasSufficientPID" Jul 27 09:50:12.454532 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.454498 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-140.ec2.internal" event="NodeHasSufficientPID" Jul 27 09:50:12.455659 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.455647 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-140.ec2.internal" Jul 27 09:50:12.455699 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.455671 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 09:50:12.456326 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.456312 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-140.ec2.internal" event="NodeHasSufficientMemory" Jul 27 09:50:12.456397 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.456336 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-140.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 09:50:12.456397 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.456349 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-140.ec2.internal" event="NodeHasSufficientPID" Jul 27 09:50:12.471856 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:12.471835 2556 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-140.ec2.internal\" not found" node="ip-10-0-139-140.ec2.internal" Jul 27 09:50:12.476172 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:12.476158 2556 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-140.ec2.internal\" not found" node="ip-10-0-139-140.ec2.internal" Jul 27 09:50:12.547090 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:12.547070 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-140.ec2.internal\" not found" Jul 27 09:50:12.550498 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.550484 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1b03c9b33b3bb819e7a8014427f1b4d7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-140.ec2.internal\" (UID: \"1b03c9b33b3bb819e7a8014427f1b4d7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-140.ec2.internal" Jul 27 09:50:12.550567 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.550506 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1b03c9b33b3bb819e7a8014427f1b4d7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-140.ec2.internal\" (UID: \"1b03c9b33b3bb819e7a8014427f1b4d7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-140.ec2.internal" Jul 27 09:50:12.550567 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.550524 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d53d4fb2319b8a6bcca414fa1eb18354-config\") pod \"kube-apiserver-proxy-ip-10-0-139-140.ec2.internal\" (UID: \"d53d4fb2319b8a6bcca414fa1eb18354\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-140.ec2.internal" Jul 27 09:50:12.647656 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:12.647628 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-140.ec2.internal\" not found" Jul 27 09:50:12.650925 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.650908 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1b03c9b33b3bb819e7a8014427f1b4d7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-140.ec2.internal\" (UID: \"1b03c9b33b3bb819e7a8014427f1b4d7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-140.ec2.internal" Jul 27 09:50:12.650972 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.650934 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1b03c9b33b3bb819e7a8014427f1b4d7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-140.ec2.internal\" (UID: \"1b03c9b33b3bb819e7a8014427f1b4d7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-140.ec2.internal" Jul 27 09:50:12.650972 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.650949 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d53d4fb2319b8a6bcca414fa1eb18354-config\") pod \"kube-apiserver-proxy-ip-10-0-139-140.ec2.internal\" (UID: \"d53d4fb2319b8a6bcca414fa1eb18354\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-140.ec2.internal" Jul 27 09:50:12.651030 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.650990 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d53d4fb2319b8a6bcca414fa1eb18354-config\") pod \"kube-apiserver-proxy-ip-10-0-139-140.ec2.internal\" (UID: \"d53d4fb2319b8a6bcca414fa1eb18354\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-140.ec2.internal" Jul 27 09:50:12.651030 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.651006 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1b03c9b33b3bb819e7a8014427f1b4d7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-140.ec2.internal\" (UID: \"1b03c9b33b3bb819e7a8014427f1b4d7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-140.ec2.internal" Jul 27 09:50:12.651087 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.651023 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1b03c9b33b3bb819e7a8014427f1b4d7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-140.ec2.internal\" (UID: \"1b03c9b33b3bb819e7a8014427f1b4d7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-140.ec2.internal" Jul 27 09:50:12.748303 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:12.748245 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-140.ec2.internal\" not found" Jul 27 09:50:12.774652 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.774638 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-140.ec2.internal" Jul 27 09:50:12.779057 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:12.779038 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-140.ec2.internal" Jul 27 09:50:12.848849 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:12.848816 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-140.ec2.internal\" not found" Jul 27 09:50:12.949265 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:12.949234 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-140.ec2.internal\" not found" Jul 27 09:50:13.049645 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:13.049598 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-140.ec2.internal\" not found" Jul 27 09:50:13.150117 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:13.150090 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-140.ec2.internal\" not found" Jul 27 09:50:13.171817 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.171799 2556 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 27 09:50:13.181619 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.181596 2556 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 27 09:50:13.181720 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.181703 2556 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 27 09:50:13.181773 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.181749 2556 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 27 09:50:13.221900 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.221879 2556 apiserver.go:52] "Watching apiserver" Jul 27 09:50:13.242368 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.242351 2556 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 27 09:50:13.243157 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.243140 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-sxq7r","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7xmw","openshift-cluster-node-tuning-operator/tuned-m9tv9","openshift-dns/node-resolver-4mdxm","openshift-multus/multus-additional-cni-plugins-w2txx","openshift-multus/multus-sxn5x","openshift-multus/network-metrics-daemon-cl9xw","openshift-network-diagnostics/network-check-target-hlhxc","kube-system/global-pull-secret-syncer-qlrkd","openshift-image-registry/node-ca-wgfkj","openshift-network-operator/iptables-alerter-7sb2h","openshift-ovn-kubernetes/ovnkube-node-ph68r"] Jul 27 09:50:13.244529 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.244514 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-sxq7r" Jul 27 09:50:13.245782 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.245769 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7xmw" Jul 27 09:50:13.246914 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.246899 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-m9tv9" Jul 27 09:50:13.247204 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.247189 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-6dgrx\"" Jul 27 09:50:13.247297 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.247247 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 27 09:50:13.247614 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.247601 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 27 09:50:13.247971 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.247958 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4mdxm" Jul 27 09:50:13.248439 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.248419 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 27 09:50:13.248439 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.248434 2556 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 27 09:50:13.248553 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.248547 2556 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-140.ec2.internal" Jul 27 09:50:13.248691 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.248667 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 27 09:50:13.248778 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.248671 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-p5g6h\"" Jul 27 09:50:13.248778 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.248674 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 27 09:50:13.249029 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.249012 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-w2txx" Jul 27 09:50:13.250268 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.250247 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-s2hjb\"" Jul 27 09:50:13.250375 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.250343 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 27 09:50:13.250824 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.250799 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 27 09:50:13.250899 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.250827 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 27 09:50:13.251018 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.250998 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 27 09:50:13.251438 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.251419 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-5xwzb\"" Jul 27 09:50:13.251573 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.251555 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-qtkn9\"" Jul 27 09:50:13.251727 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.251710 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 27 09:50:13.252193 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.252176 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 27 09:50:13.252258 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.252193 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 27 09:50:13.252258 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.252190 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 27 09:50:13.252383 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.252355 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 27 09:50:13.252986 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.252969 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-sxn5x" Jul 27 09:50:13.253420 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.253398 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/be638d62-c9e5-4e50-ac56-253fa74e20c1-konnectivity-ca\") pod \"konnectivity-agent-sxq7r\" (UID: \"be638d62-c9e5-4e50-ac56-253fa74e20c1\") " pod="kube-system/konnectivity-agent-sxq7r" Jul 27 09:50:13.253507 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.253430 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c741cd56-6ff5-43be-aafd-a38247f7f11c-socket-dir\") pod \"aws-ebs-csi-driver-node-k7xmw\" (UID: \"c741cd56-6ff5-43be-aafd-a38247f7f11c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7xmw" Jul 27 09:50:13.253507 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.253451 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/23171641-b4dc-46f0-81c3-a556168b3683-sys\") pod \"tuned-m9tv9\" (UID: \"23171641-b4dc-46f0-81c3-a556168b3683\") " pod="openshift-cluster-node-tuning-operator/tuned-m9tv9" Jul 27 09:50:13.253507 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.253475 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjnh8\" (UniqueName: \"kubernetes.io/projected/23171641-b4dc-46f0-81c3-a556168b3683-kube-api-access-rjnh8\") pod \"tuned-m9tv9\" (UID: \"23171641-b4dc-46f0-81c3-a556168b3683\") " pod="openshift-cluster-node-tuning-operator/tuned-m9tv9" Jul 27 09:50:13.253507 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.253497 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c01da73c-3338-41bb-884a-f7c145421d57-hosts-file\") pod \"node-resolver-4mdxm\" (UID: \"c01da73c-3338-41bb-884a-f7c145421d57\") " pod="openshift-dns/node-resolver-4mdxm" Jul 27 09:50:13.253689 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.253520 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbfmp\" (UniqueName: \"kubernetes.io/projected/c01da73c-3338-41bb-884a-f7c145421d57-kube-api-access-fbfmp\") pod \"node-resolver-4mdxm\" (UID: \"c01da73c-3338-41bb-884a-f7c145421d57\") " pod="openshift-dns/node-resolver-4mdxm" Jul 27 09:50:13.253689 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.253541 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/876d6010-7686-42f7-86e0-773c644257af-cnibin\") pod \"multus-sxn5x\" (UID: \"876d6010-7686-42f7-86e0-773c644257af\") " pod="openshift-multus/multus-sxn5x" Jul 27 09:50:13.253689 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.253564 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/876d6010-7686-42f7-86e0-773c644257af-host-var-lib-kubelet\") pod \"multus-sxn5x\" (UID: \"876d6010-7686-42f7-86e0-773c644257af\") " pod="openshift-multus/multus-sxn5x" Jul 27 09:50:13.253689 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.253587 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/23171641-b4dc-46f0-81c3-a556168b3683-var-lib-kubelet\") pod \"tuned-m9tv9\" (UID: \"23171641-b4dc-46f0-81c3-a556168b3683\") " pod="openshift-cluster-node-tuning-operator/tuned-m9tv9" Jul 27 09:50:13.253689 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.253620 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b4deab12-8c9e-4151-81f3-6c87e474578e-system-cni-dir\") pod \"multus-additional-cni-plugins-w2txx\" (UID: \"b4deab12-8c9e-4151-81f3-6c87e474578e\") " pod="openshift-multus/multus-additional-cni-plugins-w2txx" Jul 27 09:50:13.253689 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.253647 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/876d6010-7686-42f7-86e0-773c644257af-multus-conf-dir\") pod \"multus-sxn5x\" (UID: \"876d6010-7686-42f7-86e0-773c644257af\") " pod="openshift-multus/multus-sxn5x" Jul 27 09:50:13.253689 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.253668 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/876d6010-7686-42f7-86e0-773c644257af-host-run-multus-certs\") pod \"multus-sxn5x\" (UID: \"876d6010-7686-42f7-86e0-773c644257af\") " pod="openshift-multus/multus-sxn5x" Jul 27 09:50:13.253689 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.253689 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnr74\" (UniqueName: \"kubernetes.io/projected/876d6010-7686-42f7-86e0-773c644257af-kube-api-access-fnr74\") pod \"multus-sxn5x\" (UID: \"876d6010-7686-42f7-86e0-773c644257af\") " pod="openshift-multus/multus-sxn5x" Jul 27 09:50:13.253966 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.253714 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c741cd56-6ff5-43be-aafd-a38247f7f11c-registration-dir\") pod \"aws-ebs-csi-driver-node-k7xmw\" (UID: \"c741cd56-6ff5-43be-aafd-a38247f7f11c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7xmw" Jul 27 09:50:13.253966 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.253733 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/23171641-b4dc-46f0-81c3-a556168b3683-etc-modprobe-d\") pod \"tuned-m9tv9\" (UID: \"23171641-b4dc-46f0-81c3-a556168b3683\") " pod="openshift-cluster-node-tuning-operator/tuned-m9tv9" Jul 27 09:50:13.253966 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.253750 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/23171641-b4dc-46f0-81c3-a556168b3683-etc-kubernetes\") pod \"tuned-m9tv9\" (UID: \"23171641-b4dc-46f0-81c3-a556168b3683\") " pod="openshift-cluster-node-tuning-operator/tuned-m9tv9" Jul 27 09:50:13.253966 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.253764 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/23171641-b4dc-46f0-81c3-a556168b3683-etc-sysctl-d\") pod \"tuned-m9tv9\" (UID: \"23171641-b4dc-46f0-81c3-a556168b3683\") " pod="openshift-cluster-node-tuning-operator/tuned-m9tv9" Jul 27 09:50:13.253966 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.253776 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/23171641-b4dc-46f0-81c3-a556168b3683-run\") pod \"tuned-m9tv9\" (UID: \"23171641-b4dc-46f0-81c3-a556168b3683\") " pod="openshift-cluster-node-tuning-operator/tuned-m9tv9" Jul 27 09:50:13.253966 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.253790 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhwr9\" (UniqueName: \"kubernetes.io/projected/b4deab12-8c9e-4151-81f3-6c87e474578e-kube-api-access-dhwr9\") pod \"multus-additional-cni-plugins-w2txx\" (UID: \"b4deab12-8c9e-4151-81f3-6c87e474578e\") " pod="openshift-multus/multus-additional-cni-plugins-w2txx" Jul 27 09:50:13.253966 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.253828 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/876d6010-7686-42f7-86e0-773c644257af-multus-socket-dir-parent\") pod \"multus-sxn5x\" (UID: \"876d6010-7686-42f7-86e0-773c644257af\") " pod="openshift-multus/multus-sxn5x" Jul 27 09:50:13.253966 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.253852 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/23171641-b4dc-46f0-81c3-a556168b3683-etc-sysconfig\") pod \"tuned-m9tv9\" (UID: \"23171641-b4dc-46f0-81c3-a556168b3683\") " pod="openshift-cluster-node-tuning-operator/tuned-m9tv9" Jul 27 09:50:13.253966 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.253868 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/23171641-b4dc-46f0-81c3-a556168b3683-etc-sysctl-conf\") pod \"tuned-m9tv9\" (UID: \"23171641-b4dc-46f0-81c3-a556168b3683\") " pod="openshift-cluster-node-tuning-operator/tuned-m9tv9" Jul 27 09:50:13.253966 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.253887 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/23171641-b4dc-46f0-81c3-a556168b3683-host\") pod \"tuned-m9tv9\" (UID: \"23171641-b4dc-46f0-81c3-a556168b3683\") " pod="openshift-cluster-node-tuning-operator/tuned-m9tv9" Jul 27 09:50:13.253966 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.253906 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/23171641-b4dc-46f0-81c3-a556168b3683-tmp\") pod \"tuned-m9tv9\" (UID: \"23171641-b4dc-46f0-81c3-a556168b3683\") " pod="openshift-cluster-node-tuning-operator/tuned-m9tv9" Jul 27 09:50:13.253966 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.253919 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b4deab12-8c9e-4151-81f3-6c87e474578e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-w2txx\" (UID: \"b4deab12-8c9e-4151-81f3-6c87e474578e\") " pod="openshift-multus/multus-additional-cni-plugins-w2txx" Jul 27 09:50:13.253966 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.253933 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b4deab12-8c9e-4151-81f3-6c87e474578e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-w2txx\" (UID: \"b4deab12-8c9e-4151-81f3-6c87e474578e\") " pod="openshift-multus/multus-additional-cni-plugins-w2txx" Jul 27 09:50:13.253966 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.253949 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/876d6010-7686-42f7-86e0-773c644257af-hostroot\") pod \"multus-sxn5x\" (UID: \"876d6010-7686-42f7-86e0-773c644257af\") " pod="openshift-multus/multus-sxn5x" Jul 27 09:50:13.253966 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.253964 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/876d6010-7686-42f7-86e0-773c644257af-etc-kubernetes\") pod \"multus-sxn5x\" (UID: \"876d6010-7686-42f7-86e0-773c644257af\") " pod="openshift-multus/multus-sxn5x" Jul 27 09:50:13.254544 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.253981 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/be638d62-c9e5-4e50-ac56-253fa74e20c1-agent-certs\") pod \"konnectivity-agent-sxq7r\" (UID: \"be638d62-c9e5-4e50-ac56-253fa74e20c1\") " pod="kube-system/konnectivity-agent-sxq7r" Jul 27 09:50:13.254544 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.253994 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c741cd56-6ff5-43be-aafd-a38247f7f11c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-k7xmw\" (UID: \"c741cd56-6ff5-43be-aafd-a38247f7f11c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7xmw" Jul 27 09:50:13.254544 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.254008 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c741cd56-6ff5-43be-aafd-a38247f7f11c-device-dir\") pod \"aws-ebs-csi-driver-node-k7xmw\" (UID: \"c741cd56-6ff5-43be-aafd-a38247f7f11c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7xmw" Jul 27 09:50:13.254544 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.254021 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c741cd56-6ff5-43be-aafd-a38247f7f11c-etc-selinux\") pod \"aws-ebs-csi-driver-node-k7xmw\" (UID: \"c741cd56-6ff5-43be-aafd-a38247f7f11c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7xmw" Jul 27 09:50:13.254544 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.254036 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/23171641-b4dc-46f0-81c3-a556168b3683-etc-systemd\") pod \"tuned-m9tv9\" (UID: \"23171641-b4dc-46f0-81c3-a556168b3683\") " pod="openshift-cluster-node-tuning-operator/tuned-m9tv9" Jul 27 09:50:13.254544 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.254049 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c01da73c-3338-41bb-884a-f7c145421d57-tmp-dir\") pod \"node-resolver-4mdxm\" (UID: \"c01da73c-3338-41bb-884a-f7c145421d57\") " pod="openshift-dns/node-resolver-4mdxm" Jul 27 09:50:13.254544 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.254063 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b4deab12-8c9e-4151-81f3-6c87e474578e-os-release\") pod \"multus-additional-cni-plugins-w2txx\" (UID: \"b4deab12-8c9e-4151-81f3-6c87e474578e\") " pod="openshift-multus/multus-additional-cni-plugins-w2txx" Jul 27 09:50:13.254544 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.254077 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/23171641-b4dc-46f0-81c3-a556168b3683-lib-modules\") pod \"tuned-m9tv9\" (UID: \"23171641-b4dc-46f0-81c3-a556168b3683\") " pod="openshift-cluster-node-tuning-operator/tuned-m9tv9" Jul 27 09:50:13.254544 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.254112 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b4deab12-8c9e-4151-81f3-6c87e474578e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-w2txx\" (UID: \"b4deab12-8c9e-4151-81f3-6c87e474578e\") " pod="openshift-multus/multus-additional-cni-plugins-w2txx" Jul 27 09:50:13.254544 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.254126 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/876d6010-7686-42f7-86e0-773c644257af-system-cni-dir\") pod \"multus-sxn5x\" (UID: \"876d6010-7686-42f7-86e0-773c644257af\") " pod="openshift-multus/multus-sxn5x" Jul 27 09:50:13.254544 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.254140 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/876d6010-7686-42f7-86e0-773c644257af-multus-cni-dir\") pod \"multus-sxn5x\" (UID: \"876d6010-7686-42f7-86e0-773c644257af\") " pod="openshift-multus/multus-sxn5x" Jul 27 09:50:13.254544 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.254155 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/876d6010-7686-42f7-86e0-773c644257af-os-release\") pod \"multus-sxn5x\" (UID: \"876d6010-7686-42f7-86e0-773c644257af\") " pod="openshift-multus/multus-sxn5x" Jul 27 09:50:13.254544 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.254183 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/876d6010-7686-42f7-86e0-773c644257af-host-run-netns\") pod \"multus-sxn5x\" (UID: \"876d6010-7686-42f7-86e0-773c644257af\") " pod="openshift-multus/multus-sxn5x" Jul 27 09:50:13.254544 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.254212 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/876d6010-7686-42f7-86e0-773c644257af-host-var-lib-cni-bin\") pod \"multus-sxn5x\" (UID: \"876d6010-7686-42f7-86e0-773c644257af\") " pod="openshift-multus/multus-sxn5x" Jul 27 09:50:13.254544 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.254244 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/876d6010-7686-42f7-86e0-773c644257af-host-var-lib-cni-multus\") pod \"multus-sxn5x\" (UID: \"876d6010-7686-42f7-86e0-773c644257af\") " pod="openshift-multus/multus-sxn5x" Jul 27 09:50:13.254544 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.254312 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/23171641-b4dc-46f0-81c3-a556168b3683-etc-tuned\") pod \"tuned-m9tv9\" (UID: \"23171641-b4dc-46f0-81c3-a556168b3683\") " pod="openshift-cluster-node-tuning-operator/tuned-m9tv9" Jul 27 09:50:13.255002 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.254343 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/876d6010-7686-42f7-86e0-773c644257af-cni-binary-copy\") pod \"multus-sxn5x\" (UID: \"876d6010-7686-42f7-86e0-773c644257af\") " pod="openshift-multus/multus-sxn5x" Jul 27 09:50:13.255002 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.254366 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/876d6010-7686-42f7-86e0-773c644257af-multus-daemon-config\") pod \"multus-sxn5x\" (UID: \"876d6010-7686-42f7-86e0-773c644257af\") " pod="openshift-multus/multus-sxn5x" Jul 27 09:50:13.255002 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.254388 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c741cd56-6ff5-43be-aafd-a38247f7f11c-sys-fs\") pod \"aws-ebs-csi-driver-node-k7xmw\" (UID: \"c741cd56-6ff5-43be-aafd-a38247f7f11c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7xmw" Jul 27 09:50:13.255002 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.254411 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tklqt\" (UniqueName: \"kubernetes.io/projected/c741cd56-6ff5-43be-aafd-a38247f7f11c-kube-api-access-tklqt\") pod \"aws-ebs-csi-driver-node-k7xmw\" (UID: \"c741cd56-6ff5-43be-aafd-a38247f7f11c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7xmw" Jul 27 09:50:13.255002 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.254434 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b4deab12-8c9e-4151-81f3-6c87e474578e-cnibin\") pod \"multus-additional-cni-plugins-w2txx\" (UID: \"b4deab12-8c9e-4151-81f3-6c87e474578e\") " pod="openshift-multus/multus-additional-cni-plugins-w2txx" Jul 27 09:50:13.255002 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.254457 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b4deab12-8c9e-4151-81f3-6c87e474578e-cni-binary-copy\") pod \"multus-additional-cni-plugins-w2txx\" (UID: \"b4deab12-8c9e-4151-81f3-6c87e474578e\") " pod="openshift-multus/multus-additional-cni-plugins-w2txx" Jul 27 09:50:13.255002 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.254479 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/876d6010-7686-42f7-86e0-773c644257af-host-run-k8s-cni-cncf-io\") pod \"multus-sxn5x\" (UID: \"876d6010-7686-42f7-86e0-773c644257af\") " pod="openshift-multus/multus-sxn5x" Jul 27 09:50:13.255002 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.254687 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cl9xw" Jul 27 09:50:13.255002 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:13.254743 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cl9xw" podUID="27f2e8fc-173e-43ff-b7a6-0bd6e8b54d40" Jul 27 09:50:13.255628 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.255612 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-rddqg\"" Jul 27 09:50:13.255680 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.255644 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 27 09:50:13.255875 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.255862 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hlhxc" Jul 27 09:50:13.255926 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:13.255912 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hlhxc" podUID="4c375e68-a7a1-414b-9d33-3040925415f4" Jul 27 09:50:13.256904 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.256890 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qlrkd" Jul 27 09:50:13.256961 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:13.256924 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qlrkd" podUID="081653f9-8f80-4844-b67f-7d8965198bb6" Jul 27 09:50:13.257866 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.257854 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wgfkj" Jul 27 09:50:13.258896 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.258882 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7sb2h" Jul 27 09:50:13.259053 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.259033 2556 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 27 09:50:13.259947 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.259934 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ph68r" Jul 27 09:50:13.260262 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.260242 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 27 09:50:13.260372 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.260357 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 27 09:50:13.260427 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.260415 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 27 09:50:13.260471 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.260448 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-28tct\"" Jul 27 09:50:13.261301 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.261261 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 27 09:50:13.261575 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.261559 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 27 09:50:13.261653 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.261562 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 27 09:50:13.261709 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.261562 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-glrxm\"" Jul 27 09:50:13.262427 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.262411 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 27 09:50:13.262510 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.262499 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 27 09:50:13.262619 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.262606 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 27 09:50:13.263945 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.263632 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-cx4zk\"" Jul 27 09:50:13.263945 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.263667 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 27 09:50:13.263945 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.263715 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 27 09:50:13.263945 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.263722 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 27 09:50:13.264985 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.264969 2556 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 27 09:50:13.265066 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.265028 2556 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-140.ec2.internal" Jul 27 09:50:13.265481 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.265463 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-140.ec2.internal"] Jul 27 09:50:13.272482 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.272466 2556 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 27 09:50:13.272586 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.272573 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-139-140.ec2.internal"] Jul 27 09:50:13.281396 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.281382 2556 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-t72mb" Jul 27 09:50:13.286727 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.286689 2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-26 09:45:13 +0000 UTC" deadline="2028-01-01 22:07:17.416872991 +0000 UTC" Jul 27 09:50:13.286788 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.286727 2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12564h17m4.130147938s" Jul 27 09:50:13.288897 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.288883 2556 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-t72mb" Jul 27 09:50:13.350657 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.350636 2556 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 27 09:50:13.354624 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.354605 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e722c870-2401-4465-a42b-c9e3305f15c2-host-cni-netd\") pod \"ovnkube-node-ph68r\" (UID: \"e722c870-2401-4465-a42b-c9e3305f15c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ph68r" Jul 27 09:50:13.354713 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.354630 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e722c870-2401-4465-a42b-c9e3305f15c2-env-overrides\") pod \"ovnkube-node-ph68r\" (UID: \"e722c870-2401-4465-a42b-c9e3305f15c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ph68r" Jul 27 09:50:13.354713 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.354647 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e722c870-2401-4465-a42b-c9e3305f15c2-ovnkube-script-lib\") pod \"ovnkube-node-ph68r\" (UID: \"e722c870-2401-4465-a42b-c9e3305f15c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ph68r" Jul 27 09:50:13.354713 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.354663 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/081653f9-8f80-4844-b67f-7d8965198bb6-kubelet-config\") pod \"global-pull-secret-syncer-qlrkd\" (UID: \"081653f9-8f80-4844-b67f-7d8965198bb6\") " pod="kube-system/global-pull-secret-syncer-qlrkd" Jul 27 09:50:13.354713 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.354686 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/23171641-b4dc-46f0-81c3-a556168b3683-lib-modules\") pod \"tuned-m9tv9\" (UID: \"23171641-b4dc-46f0-81c3-a556168b3683\") " pod="openshift-cluster-node-tuning-operator/tuned-m9tv9" Jul 27 09:50:13.354832 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.354724 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b4deab12-8c9e-4151-81f3-6c87e474578e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-w2txx\" (UID: \"b4deab12-8c9e-4151-81f3-6c87e474578e\") " pod="openshift-multus/multus-additional-cni-plugins-w2txx" Jul 27 09:50:13.354832 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.354797 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxltg\" (UniqueName: \"kubernetes.io/projected/27f2e8fc-173e-43ff-b7a6-0bd6e8b54d40-kube-api-access-vxltg\") pod \"network-metrics-daemon-cl9xw\" (UID: \"27f2e8fc-173e-43ff-b7a6-0bd6e8b54d40\") " pod="openshift-multus/network-metrics-daemon-cl9xw" Jul 27 09:50:13.354832 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.354824 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q76jn\" (UniqueName: \"kubernetes.io/projected/c5018771-30e7-4be6-9603-43580e63bde0-kube-api-access-q76jn\") pod \"iptables-alerter-7sb2h\" (UID: \"c5018771-30e7-4be6-9603-43580e63bde0\") " pod="openshift-network-operator/iptables-alerter-7sb2h" Jul 27 09:50:13.354914 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.354827 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/23171641-b4dc-46f0-81c3-a556168b3683-lib-modules\") pod \"tuned-m9tv9\" (UID: \"23171641-b4dc-46f0-81c3-a556168b3683\") " pod="openshift-cluster-node-tuning-operator/tuned-m9tv9" Jul 27 09:50:13.354914 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.354857 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/876d6010-7686-42f7-86e0-773c644257af-cni-binary-copy\") pod \"multus-sxn5x\" (UID: \"876d6010-7686-42f7-86e0-773c644257af\") " pod="openshift-multus/multus-sxn5x" Jul 27 09:50:13.354914 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.354878 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e722c870-2401-4465-a42b-c9e3305f15c2-host-kubelet\") pod \"ovnkube-node-ph68r\" (UID: \"e722c870-2401-4465-a42b-c9e3305f15c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ph68r" Jul 27 09:50:13.354914 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.354892 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e722c870-2401-4465-a42b-c9e3305f15c2-run-systemd\") pod \"ovnkube-node-ph68r\" (UID: \"e722c870-2401-4465-a42b-c9e3305f15c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ph68r" Jul 27 09:50:13.354914 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.354906 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e722c870-2401-4465-a42b-c9e3305f15c2-ovnkube-config\") pod \"ovnkube-node-ph68r\" (UID: \"e722c870-2401-4465-a42b-c9e3305f15c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ph68r" Jul 27 09:50:13.355135 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.354928 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c741cd56-6ff5-43be-aafd-a38247f7f11c-sys-fs\") pod \"aws-ebs-csi-driver-node-k7xmw\" (UID: \"c741cd56-6ff5-43be-aafd-a38247f7f11c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7xmw" Jul 27 09:50:13.355135 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.354949 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b4deab12-8c9e-4151-81f3-6c87e474578e-cni-binary-copy\") pod \"multus-additional-cni-plugins-w2txx\" (UID: \"b4deab12-8c9e-4151-81f3-6c87e474578e\") " pod="openshift-multus/multus-additional-cni-plugins-w2txx" Jul 27 09:50:13.355135 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.354968 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e722c870-2401-4465-a42b-c9e3305f15c2-systemd-units\") pod \"ovnkube-node-ph68r\" (UID: \"e722c870-2401-4465-a42b-c9e3305f15c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ph68r" Jul 27 09:50:13.355135 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.354975 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c741cd56-6ff5-43be-aafd-a38247f7f11c-sys-fs\") pod \"aws-ebs-csi-driver-node-k7xmw\" (UID: \"c741cd56-6ff5-43be-aafd-a38247f7f11c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7xmw" Jul 27 09:50:13.355135 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.354986 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/be638d62-c9e5-4e50-ac56-253fa74e20c1-konnectivity-ca\") pod \"konnectivity-agent-sxq7r\" (UID: \"be638d62-c9e5-4e50-ac56-253fa74e20c1\") " pod="kube-system/konnectivity-agent-sxq7r" Jul 27 09:50:13.355135 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.355003 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c741cd56-6ff5-43be-aafd-a38247f7f11c-socket-dir\") pod \"aws-ebs-csi-driver-node-k7xmw\" (UID: \"c741cd56-6ff5-43be-aafd-a38247f7f11c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7xmw" Jul 27 09:50:13.355135 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.355025 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/23171641-b4dc-46f0-81c3-a556168b3683-sys\") pod \"tuned-m9tv9\" (UID: \"23171641-b4dc-46f0-81c3-a556168b3683\") " pod="openshift-cluster-node-tuning-operator/tuned-m9tv9" Jul 27 09:50:13.355135 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.355046 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjnh8\" (UniqueName: \"kubernetes.io/projected/23171641-b4dc-46f0-81c3-a556168b3683-kube-api-access-rjnh8\") pod \"tuned-m9tv9\" (UID: \"23171641-b4dc-46f0-81c3-a556168b3683\") " pod="openshift-cluster-node-tuning-operator/tuned-m9tv9" Jul 27 09:50:13.355135 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.355066 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c01da73c-3338-41bb-884a-f7c145421d57-hosts-file\") pod \"node-resolver-4mdxm\" (UID: \"c01da73c-3338-41bb-884a-f7c145421d57\") " pod="openshift-dns/node-resolver-4mdxm" Jul 27 09:50:13.355135 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.355113 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/23171641-b4dc-46f0-81c3-a556168b3683-sys\") pod \"tuned-m9tv9\" (UID: \"23171641-b4dc-46f0-81c3-a556168b3683\") " pod="openshift-cluster-node-tuning-operator/tuned-m9tv9" Jul 27 09:50:13.355135 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.355138 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c01da73c-3338-41bb-884a-f7c145421d57-hosts-file\") pod \"node-resolver-4mdxm\" (UID: \"c01da73c-3338-41bb-884a-f7c145421d57\") " pod="openshift-dns/node-resolver-4mdxm" Jul 27 09:50:13.355633 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.355147 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbfmp\" (UniqueName: \"kubernetes.io/projected/c01da73c-3338-41bb-884a-f7c145421d57-kube-api-access-fbfmp\") pod \"node-resolver-4mdxm\" (UID: \"c01da73c-3338-41bb-884a-f7c145421d57\") " pod="openshift-dns/node-resolver-4mdxm" Jul 27 09:50:13.355633 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.355174 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/23171641-b4dc-46f0-81c3-a556168b3683-var-lib-kubelet\") pod \"tuned-m9tv9\" (UID: \"23171641-b4dc-46f0-81c3-a556168b3683\") " pod="openshift-cluster-node-tuning-operator/tuned-m9tv9" Jul 27 09:50:13.355633 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.355200 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/876d6010-7686-42f7-86e0-773c644257af-multus-conf-dir\") pod \"multus-sxn5x\" (UID: \"876d6010-7686-42f7-86e0-773c644257af\") " pod="openshift-multus/multus-sxn5x" Jul 27 09:50:13.355633 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.355223 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e722c870-2401-4465-a42b-c9e3305f15c2-host-slash\") pod \"ovnkube-node-ph68r\" (UID: \"e722c870-2401-4465-a42b-c9e3305f15c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ph68r" Jul 27 09:50:13.355633 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.355235 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c741cd56-6ff5-43be-aafd-a38247f7f11c-socket-dir\") pod \"aws-ebs-csi-driver-node-k7xmw\" (UID: \"c741cd56-6ff5-43be-aafd-a38247f7f11c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7xmw" Jul 27 09:50:13.355633 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.355247 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e722c870-2401-4465-a42b-c9e3305f15c2-host-run-netns\") pod \"ovnkube-node-ph68r\" (UID: \"e722c870-2401-4465-a42b-c9e3305f15c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ph68r" Jul 27 09:50:13.355633 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.355288 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e722c870-2401-4465-a42b-c9e3305f15c2-host-cni-bin\") pod \"ovnkube-node-ph68r\" (UID: \"e722c870-2401-4465-a42b-c9e3305f15c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ph68r" Jul 27 09:50:13.355633 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.355298 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/23171641-b4dc-46f0-81c3-a556168b3683-var-lib-kubelet\") pod \"tuned-m9tv9\" (UID: \"23171641-b4dc-46f0-81c3-a556168b3683\") " pod="openshift-cluster-node-tuning-operator/tuned-m9tv9" Jul 27 09:50:13.355633 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.355312 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3400c9d3-50c8-4143-83fb-e22dbe5b627a-serviceca\") pod \"node-ca-wgfkj\" (UID: \"3400c9d3-50c8-4143-83fb-e22dbe5b627a\") " pod="openshift-image-registry/node-ca-wgfkj" Jul 27 09:50:13.355633 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.355336 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2jfp\" (UniqueName: \"kubernetes.io/projected/4c375e68-a7a1-414b-9d33-3040925415f4-kube-api-access-r2jfp\") pod \"network-check-target-hlhxc\" (UID: \"4c375e68-a7a1-414b-9d33-3040925415f4\") " pod="openshift-network-diagnostics/network-check-target-hlhxc" Jul 27 09:50:13.355633 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.355345 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/876d6010-7686-42f7-86e0-773c644257af-cni-binary-copy\") pod \"multus-sxn5x\" (UID: \"876d6010-7686-42f7-86e0-773c644257af\") " pod="openshift-multus/multus-sxn5x" Jul 27 09:50:13.355633 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.355355 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b4deab12-8c9e-4151-81f3-6c87e474578e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-w2txx\" (UID: \"b4deab12-8c9e-4151-81f3-6c87e474578e\") " pod="openshift-multus/multus-additional-cni-plugins-w2txx" Jul 27 09:50:13.355633 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.355362 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/23171641-b4dc-46f0-81c3-a556168b3683-etc-sysctl-d\") pod \"tuned-m9tv9\" (UID: \"23171641-b4dc-46f0-81c3-a556168b3683\") " pod="openshift-cluster-node-tuning-operator/tuned-m9tv9" Jul 27 09:50:13.355633 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.355404 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/23171641-b4dc-46f0-81c3-a556168b3683-run\") pod \"tuned-m9tv9\" (UID: \"23171641-b4dc-46f0-81c3-a556168b3683\") " pod="openshift-cluster-node-tuning-operator/tuned-m9tv9" Jul 27 09:50:13.355633 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.355424 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhwr9\" (UniqueName: \"kubernetes.io/projected/b4deab12-8c9e-4151-81f3-6c87e474578e-kube-api-access-dhwr9\") pod \"multus-additional-cni-plugins-w2txx\" (UID: \"b4deab12-8c9e-4151-81f3-6c87e474578e\") " pod="openshift-multus/multus-additional-cni-plugins-w2txx" Jul 27 09:50:13.355633 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.355427 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/876d6010-7686-42f7-86e0-773c644257af-multus-conf-dir\") pod \"multus-sxn5x\" (UID: \"876d6010-7686-42f7-86e0-773c644257af\") " pod="openshift-multus/multus-sxn5x" Jul 27 09:50:13.355633 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.355440 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/876d6010-7686-42f7-86e0-773c644257af-etc-kubernetes\") pod \"multus-sxn5x\" (UID: \"876d6010-7686-42f7-86e0-773c644257af\") " pod="openshift-multus/multus-sxn5x" Jul 27 09:50:13.356232 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.355458 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/23171641-b4dc-46f0-81c3-a556168b3683-etc-sysconfig\") pod \"tuned-m9tv9\" (UID: \"23171641-b4dc-46f0-81c3-a556168b3683\") " pod="openshift-cluster-node-tuning-operator/tuned-m9tv9" Jul 27 09:50:13.356232 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.355508 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b4deab12-8c9e-4151-81f3-6c87e474578e-cni-binary-copy\") pod \"multus-additional-cni-plugins-w2txx\" (UID: \"b4deab12-8c9e-4151-81f3-6c87e474578e\") " pod="openshift-multus/multus-additional-cni-plugins-w2txx" Jul 27 09:50:13.356232 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.355517 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/23171641-b4dc-46f0-81c3-a556168b3683-etc-sysconfig\") pod \"tuned-m9tv9\" (UID: \"23171641-b4dc-46f0-81c3-a556168b3683\") " pod="openshift-cluster-node-tuning-operator/tuned-m9tv9" Jul 27 09:50:13.356232 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.355515 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/876d6010-7686-42f7-86e0-773c644257af-etc-kubernetes\") pod \"multus-sxn5x\" (UID: \"876d6010-7686-42f7-86e0-773c644257af\") " pod="openshift-multus/multus-sxn5x" Jul 27 09:50:13.356232 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.355528 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/23171641-b4dc-46f0-81c3-a556168b3683-etc-sysctl-d\") pod \"tuned-m9tv9\" (UID: \"23171641-b4dc-46f0-81c3-a556168b3683\") " pod="openshift-cluster-node-tuning-operator/tuned-m9tv9" Jul 27 09:50:13.356232 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.355543 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b4deab12-8c9e-4151-81f3-6c87e474578e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-w2txx\" (UID: \"b4deab12-8c9e-4151-81f3-6c87e474578e\") " pod="openshift-multus/multus-additional-cni-plugins-w2txx" Jul 27 09:50:13.356232 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.355580 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/23171641-b4dc-46f0-81c3-a556168b3683-run\") pod \"tuned-m9tv9\" (UID: \"23171641-b4dc-46f0-81c3-a556168b3683\") " pod="openshift-cluster-node-tuning-operator/tuned-m9tv9" Jul 27 09:50:13.356232 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.355580 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/be638d62-c9e5-4e50-ac56-253fa74e20c1-konnectivity-ca\") pod \"konnectivity-agent-sxq7r\" (UID: \"be638d62-c9e5-4e50-ac56-253fa74e20c1\") " pod="kube-system/konnectivity-agent-sxq7r" Jul 27 09:50:13.356232 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.355607 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/876d6010-7686-42f7-86e0-773c644257af-hostroot\") pod \"multus-sxn5x\" (UID: \"876d6010-7686-42f7-86e0-773c644257af\") " pod="openshift-multus/multus-sxn5x" Jul 27 09:50:13.356232 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.355632 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e722c870-2401-4465-a42b-c9e3305f15c2-run-openvswitch\") pod \"ovnkube-node-ph68r\" (UID: \"e722c870-2401-4465-a42b-c9e3305f15c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ph68r" Jul 27 09:50:13.356232 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.355647 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e722c870-2401-4465-a42b-c9e3305f15c2-node-log\") pod \"ovnkube-node-ph68r\" (UID: \"e722c870-2401-4465-a42b-c9e3305f15c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ph68r" Jul 27 09:50:13.356232 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.355648 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/876d6010-7686-42f7-86e0-773c644257af-hostroot\") pod \"multus-sxn5x\" (UID: \"876d6010-7686-42f7-86e0-773c644257af\") " pod="openshift-multus/multus-sxn5x" Jul 27 09:50:13.356232 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.355659 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b4deab12-8c9e-4151-81f3-6c87e474578e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-w2txx\" (UID: \"b4deab12-8c9e-4151-81f3-6c87e474578e\") " pod="openshift-multus/multus-additional-cni-plugins-w2txx" Jul 27 09:50:13.356232 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.355661 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/081653f9-8f80-4844-b67f-7d8965198bb6-original-pull-secret\") pod \"global-pull-secret-syncer-qlrkd\" (UID: \"081653f9-8f80-4844-b67f-7d8965198bb6\") " pod="kube-system/global-pull-secret-syncer-qlrkd" Jul 27 09:50:13.356232 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.355696 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c741cd56-6ff5-43be-aafd-a38247f7f11c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-k7xmw\" (UID: \"c741cd56-6ff5-43be-aafd-a38247f7f11c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7xmw" Jul 27 09:50:13.356232 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.355712 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c741cd56-6ff5-43be-aafd-a38247f7f11c-device-dir\") pod \"aws-ebs-csi-driver-node-k7xmw\" (UID: \"c741cd56-6ff5-43be-aafd-a38247f7f11c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7xmw" Jul 27 09:50:13.356232 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.355726 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c741cd56-6ff5-43be-aafd-a38247f7f11c-etc-selinux\") pod \"aws-ebs-csi-driver-node-k7xmw\" (UID: \"c741cd56-6ff5-43be-aafd-a38247f7f11c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7xmw" Jul 27 09:50:13.356927 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.355747 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c01da73c-3338-41bb-884a-f7c145421d57-tmp-dir\") pod \"node-resolver-4mdxm\" (UID: \"c01da73c-3338-41bb-884a-f7c145421d57\") " pod="openshift-dns/node-resolver-4mdxm" Jul 27 09:50:13.356927 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.355756 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c741cd56-6ff5-43be-aafd-a38247f7f11c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-k7xmw\" (UID: \"c741cd56-6ff5-43be-aafd-a38247f7f11c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7xmw" Jul 27 09:50:13.356927 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.355764 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e722c870-2401-4465-a42b-c9e3305f15c2-etc-openvswitch\") pod \"ovnkube-node-ph68r\" (UID: \"e722c870-2401-4465-a42b-c9e3305f15c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ph68r" Jul 27 09:50:13.356927 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.355779 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/27f2e8fc-173e-43ff-b7a6-0bd6e8b54d40-metrics-certs\") pod \"network-metrics-daemon-cl9xw\" (UID: \"27f2e8fc-173e-43ff-b7a6-0bd6e8b54d40\") " pod="openshift-multus/network-metrics-daemon-cl9xw" Jul 27 09:50:13.356927 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.355799 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/876d6010-7686-42f7-86e0-773c644257af-system-cni-dir\") pod \"multus-sxn5x\" (UID: \"876d6010-7686-42f7-86e0-773c644257af\") " pod="openshift-multus/multus-sxn5x" Jul 27 09:50:13.356927 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.355764 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c741cd56-6ff5-43be-aafd-a38247f7f11c-device-dir\") pod \"aws-ebs-csi-driver-node-k7xmw\" (UID: \"c741cd56-6ff5-43be-aafd-a38247f7f11c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7xmw" Jul 27 09:50:13.356927 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.355805 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c741cd56-6ff5-43be-aafd-a38247f7f11c-etc-selinux\") pod \"aws-ebs-csi-driver-node-k7xmw\" (UID: \"c741cd56-6ff5-43be-aafd-a38247f7f11c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7xmw" Jul 27 09:50:13.356927 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.355821 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/876d6010-7686-42f7-86e0-773c644257af-multus-cni-dir\") pod \"multus-sxn5x\" (UID: \"876d6010-7686-42f7-86e0-773c644257af\") " pod="openshift-multus/multus-sxn5x" Jul 27 09:50:13.356927 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.355844 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/876d6010-7686-42f7-86e0-773c644257af-os-release\") pod \"multus-sxn5x\" (UID: \"876d6010-7686-42f7-86e0-773c644257af\") " pod="openshift-multus/multus-sxn5x" Jul 27 09:50:13.356927 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.355864 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/876d6010-7686-42f7-86e0-773c644257af-host-run-netns\") pod \"multus-sxn5x\" (UID: \"876d6010-7686-42f7-86e0-773c644257af\") " pod="openshift-multus/multus-sxn5x" Jul 27 09:50:13.356927 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.355868 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/876d6010-7686-42f7-86e0-773c644257af-system-cni-dir\") pod \"multus-sxn5x\" (UID: \"876d6010-7686-42f7-86e0-773c644257af\") " pod="openshift-multus/multus-sxn5x" Jul 27 09:50:13.356927 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.355883 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/876d6010-7686-42f7-86e0-773c644257af-host-var-lib-cni-bin\") pod \"multus-sxn5x\" (UID: \"876d6010-7686-42f7-86e0-773c644257af\") " pod="openshift-multus/multus-sxn5x" Jul 27 09:50:13.356927 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.355903 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/876d6010-7686-42f7-86e0-773c644257af-host-var-lib-cni-multus\") pod \"multus-sxn5x\" (UID: \"876d6010-7686-42f7-86e0-773c644257af\") " pod="openshift-multus/multus-sxn5x" Jul 27 09:50:13.356927 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.355919 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/876d6010-7686-42f7-86e0-773c644257af-host-run-netns\") pod \"multus-sxn5x\" (UID: \"876d6010-7686-42f7-86e0-773c644257af\") " pod="openshift-multus/multus-sxn5x" Jul 27 09:50:13.356927 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.355925 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/081653f9-8f80-4844-b67f-7d8965198bb6-dbus\") pod \"global-pull-secret-syncer-qlrkd\" (UID: \"081653f9-8f80-4844-b67f-7d8965198bb6\") " pod="kube-system/global-pull-secret-syncer-qlrkd" Jul 27 09:50:13.356927 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.355931 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/876d6010-7686-42f7-86e0-773c644257af-multus-cni-dir\") pod \"multus-sxn5x\" (UID: \"876d6010-7686-42f7-86e0-773c644257af\") " pod="openshift-multus/multus-sxn5x" Jul 27 09:50:13.356927 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.355947 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/876d6010-7686-42f7-86e0-773c644257af-host-var-lib-cni-multus\") pod \"multus-sxn5x\" (UID: \"876d6010-7686-42f7-86e0-773c644257af\") " pod="openshift-multus/multus-sxn5x" Jul 27 09:50:13.356927 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.355945 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/876d6010-7686-42f7-86e0-773c644257af-host-var-lib-cni-bin\") pod \"multus-sxn5x\" (UID: \"876d6010-7686-42f7-86e0-773c644257af\") " pod="openshift-multus/multus-sxn5x" Jul 27 09:50:13.357470 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.355949 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/23171641-b4dc-46f0-81c3-a556168b3683-etc-tuned\") pod \"tuned-m9tv9\" (UID: \"23171641-b4dc-46f0-81c3-a556168b3683\") " pod="openshift-cluster-node-tuning-operator/tuned-m9tv9" Jul 27 09:50:13.357470 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.355967 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/876d6010-7686-42f7-86e0-773c644257af-os-release\") pod \"multus-sxn5x\" (UID: \"876d6010-7686-42f7-86e0-773c644257af\") " pod="openshift-multus/multus-sxn5x" Jul 27 09:50:13.357470 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.355968 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c01da73c-3338-41bb-884a-f7c145421d57-tmp-dir\") pod \"node-resolver-4mdxm\" (UID: \"c01da73c-3338-41bb-884a-f7c145421d57\") " pod="openshift-dns/node-resolver-4mdxm" Jul 27 09:50:13.357470 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.355993 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/876d6010-7686-42f7-86e0-773c644257af-multus-daemon-config\") pod \"multus-sxn5x\" (UID: \"876d6010-7686-42f7-86e0-773c644257af\") " pod="openshift-multus/multus-sxn5x" Jul 27 09:50:13.357470 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.356021 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tklqt\" (UniqueName: \"kubernetes.io/projected/c741cd56-6ff5-43be-aafd-a38247f7f11c-kube-api-access-tklqt\") pod \"aws-ebs-csi-driver-node-k7xmw\" (UID: \"c741cd56-6ff5-43be-aafd-a38247f7f11c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7xmw" Jul 27 09:50:13.357470 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.356045 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b4deab12-8c9e-4151-81f3-6c87e474578e-cnibin\") pod \"multus-additional-cni-plugins-w2txx\" (UID: \"b4deab12-8c9e-4151-81f3-6c87e474578e\") " pod="openshift-multus/multus-additional-cni-plugins-w2txx" Jul 27 09:50:13.357470 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.356069 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/876d6010-7686-42f7-86e0-773c644257af-host-run-k8s-cni-cncf-io\") pod \"multus-sxn5x\" (UID: \"876d6010-7686-42f7-86e0-773c644257af\") " pod="openshift-multus/multus-sxn5x" Jul 27 09:50:13.357470 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.356093 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/876d6010-7686-42f7-86e0-773c644257af-cnibin\") pod \"multus-sxn5x\" (UID: \"876d6010-7686-42f7-86e0-773c644257af\") " pod="openshift-multus/multus-sxn5x" Jul 27 09:50:13.357470 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.356116 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/876d6010-7686-42f7-86e0-773c644257af-host-var-lib-kubelet\") pod \"multus-sxn5x\" (UID: \"876d6010-7686-42f7-86e0-773c644257af\") " pod="openshift-multus/multus-sxn5x" Jul 27 09:50:13.357470 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.356148 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/876d6010-7686-42f7-86e0-773c644257af-host-run-multus-certs\") pod \"multus-sxn5x\" (UID: \"876d6010-7686-42f7-86e0-773c644257af\") " pod="openshift-multus/multus-sxn5x" Jul 27 09:50:13.357470 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.356155 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b4deab12-8c9e-4151-81f3-6c87e474578e-cnibin\") pod \"multus-additional-cni-plugins-w2txx\" (UID: \"b4deab12-8c9e-4151-81f3-6c87e474578e\") " pod="openshift-multus/multus-additional-cni-plugins-w2txx" Jul 27 09:50:13.357470 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.356175 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/876d6010-7686-42f7-86e0-773c644257af-host-run-multus-certs\") pod \"multus-sxn5x\" (UID: \"876d6010-7686-42f7-86e0-773c644257af\") " pod="openshift-multus/multus-sxn5x" Jul 27 09:50:13.357470 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.356177 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e722c870-2401-4465-a42b-c9e3305f15c2-host-run-ovn-kubernetes\") pod \"ovnkube-node-ph68r\" (UID: \"e722c870-2401-4465-a42b-c9e3305f15c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ph68r" Jul 27 09:50:13.357470 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.356158 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/876d6010-7686-42f7-86e0-773c644257af-host-var-lib-kubelet\") pod \"multus-sxn5x\" (UID: \"876d6010-7686-42f7-86e0-773c644257af\") " pod="openshift-multus/multus-sxn5x" Jul 27 09:50:13.357470 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.356153 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/876d6010-7686-42f7-86e0-773c644257af-cnibin\") pod \"multus-sxn5x\" (UID: \"876d6010-7686-42f7-86e0-773c644257af\") " pod="openshift-multus/multus-sxn5x" Jul 27 09:50:13.357470 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.356184 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/876d6010-7686-42f7-86e0-773c644257af-host-run-k8s-cni-cncf-io\") pod \"multus-sxn5x\" (UID: \"876d6010-7686-42f7-86e0-773c644257af\") " pod="openshift-multus/multus-sxn5x" Jul 27 09:50:13.357470 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.356206 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbkps\" (UniqueName: \"kubernetes.io/projected/e722c870-2401-4465-a42b-c9e3305f15c2-kube-api-access-mbkps\") pod \"ovnkube-node-ph68r\" (UID: \"e722c870-2401-4465-a42b-c9e3305f15c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ph68r" Jul 27 09:50:13.357470 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.356149 2556 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 27 09:50:13.357952 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.356230 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c5018771-30e7-4be6-9603-43580e63bde0-host-slash\") pod \"iptables-alerter-7sb2h\" (UID: \"c5018771-30e7-4be6-9603-43580e63bde0\") " pod="openshift-network-operator/iptables-alerter-7sb2h" Jul 27 09:50:13.357952 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.356295 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b4deab12-8c9e-4151-81f3-6c87e474578e-system-cni-dir\") pod \"multus-additional-cni-plugins-w2txx\" (UID: \"b4deab12-8c9e-4151-81f3-6c87e474578e\") " pod="openshift-multus/multus-additional-cni-plugins-w2txx" Jul 27 09:50:13.357952 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.356312 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnr74\" (UniqueName: \"kubernetes.io/projected/876d6010-7686-42f7-86e0-773c644257af-kube-api-access-fnr74\") pod \"multus-sxn5x\" (UID: \"876d6010-7686-42f7-86e0-773c644257af\") " pod="openshift-multus/multus-sxn5x" Jul 27 09:50:13.357952 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.356330 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b4deab12-8c9e-4151-81f3-6c87e474578e-system-cni-dir\") pod \"multus-additional-cni-plugins-w2txx\" (UID: \"b4deab12-8c9e-4151-81f3-6c87e474578e\") " pod="openshift-multus/multus-additional-cni-plugins-w2txx" Jul 27 09:50:13.357952 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.356329 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e722c870-2401-4465-a42b-c9e3305f15c2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ph68r\" (UID: \"e722c870-2401-4465-a42b-c9e3305f15c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ph68r" Jul 27 09:50:13.357952 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.356364 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e722c870-2401-4465-a42b-c9e3305f15c2-ovn-node-metrics-cert\") pod \"ovnkube-node-ph68r\" (UID: \"e722c870-2401-4465-a42b-c9e3305f15c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ph68r" Jul 27 09:50:13.357952 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.356382 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3400c9d3-50c8-4143-83fb-e22dbe5b627a-host\") pod \"node-ca-wgfkj\" (UID: \"3400c9d3-50c8-4143-83fb-e22dbe5b627a\") " pod="openshift-image-registry/node-ca-wgfkj" Jul 27 09:50:13.357952 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.356400 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c741cd56-6ff5-43be-aafd-a38247f7f11c-registration-dir\") pod \"aws-ebs-csi-driver-node-k7xmw\" (UID: \"c741cd56-6ff5-43be-aafd-a38247f7f11c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7xmw" Jul 27 09:50:13.357952 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.356415 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/23171641-b4dc-46f0-81c3-a556168b3683-etc-modprobe-d\") pod \"tuned-m9tv9\" (UID: \"23171641-b4dc-46f0-81c3-a556168b3683\") " pod="openshift-cluster-node-tuning-operator/tuned-m9tv9" Jul 27 09:50:13.357952 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.356429 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/23171641-b4dc-46f0-81c3-a556168b3683-etc-kubernetes\") pod \"tuned-m9tv9\" (UID: \"23171641-b4dc-46f0-81c3-a556168b3683\") " pod="openshift-cluster-node-tuning-operator/tuned-m9tv9" Jul 27 09:50:13.357952 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.356446 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/876d6010-7686-42f7-86e0-773c644257af-multus-socket-dir-parent\") pod \"multus-sxn5x\" (UID: \"876d6010-7686-42f7-86e0-773c644257af\") " pod="openshift-multus/multus-sxn5x" Jul 27 09:50:13.357952 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.356460 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e722c870-2401-4465-a42b-c9e3305f15c2-run-ovn\") pod \"ovnkube-node-ph68r\" (UID: \"e722c870-2401-4465-a42b-c9e3305f15c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ph68r" Jul 27 09:50:13.357952 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.356477 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/23171641-b4dc-46f0-81c3-a556168b3683-etc-sysctl-conf\") pod \"tuned-m9tv9\" (UID: \"23171641-b4dc-46f0-81c3-a556168b3683\") " pod="openshift-cluster-node-tuning-operator/tuned-m9tv9" Jul 27 09:50:13.357952 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.356478 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c741cd56-6ff5-43be-aafd-a38247f7f11c-registration-dir\") pod \"aws-ebs-csi-driver-node-k7xmw\" (UID: \"c741cd56-6ff5-43be-aafd-a38247f7f11c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7xmw" Jul 27 09:50:13.357952 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.356487 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/23171641-b4dc-46f0-81c3-a556168b3683-etc-kubernetes\") pod \"tuned-m9tv9\" (UID: \"23171641-b4dc-46f0-81c3-a556168b3683\") " pod="openshift-cluster-node-tuning-operator/tuned-m9tv9" Jul 27 09:50:13.357952 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.356490 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/23171641-b4dc-46f0-81c3-a556168b3683-host\") pod \"tuned-m9tv9\" (UID: \"23171641-b4dc-46f0-81c3-a556168b3683\") " pod="openshift-cluster-node-tuning-operator/tuned-m9tv9" Jul 27 09:50:13.357952 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.356513 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/23171641-b4dc-46f0-81c3-a556168b3683-tmp\") pod \"tuned-m9tv9\" (UID: \"23171641-b4dc-46f0-81c3-a556168b3683\") " pod="openshift-cluster-node-tuning-operator/tuned-m9tv9" Jul 27 09:50:13.358421 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.356516 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/23171641-b4dc-46f0-81c3-a556168b3683-host\") pod \"tuned-m9tv9\" (UID: \"23171641-b4dc-46f0-81c3-a556168b3683\") " pod="openshift-cluster-node-tuning-operator/tuned-m9tv9" Jul 27 09:50:13.358421 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.356528 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b4deab12-8c9e-4151-81f3-6c87e474578e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-w2txx\" (UID: \"b4deab12-8c9e-4151-81f3-6c87e474578e\") " pod="openshift-multus/multus-additional-cni-plugins-w2txx" Jul 27 09:50:13.358421 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.356543 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e722c870-2401-4465-a42b-c9e3305f15c2-log-socket\") pod \"ovnkube-node-ph68r\" (UID: \"e722c870-2401-4465-a42b-c9e3305f15c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ph68r" Jul 27 09:50:13.358421 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.356547 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/876d6010-7686-42f7-86e0-773c644257af-multus-socket-dir-parent\") pod \"multus-sxn5x\" (UID: \"876d6010-7686-42f7-86e0-773c644257af\") " pod="openshift-multus/multus-sxn5x" Jul 27 09:50:13.358421 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.356557 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2f6t\" (UniqueName: \"kubernetes.io/projected/3400c9d3-50c8-4143-83fb-e22dbe5b627a-kube-api-access-t2f6t\") pod \"node-ca-wgfkj\" (UID: \"3400c9d3-50c8-4143-83fb-e22dbe5b627a\") " pod="openshift-image-registry/node-ca-wgfkj" Jul 27 09:50:13.358421 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.356571 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c5018771-30e7-4be6-9603-43580e63bde0-iptables-alerter-script\") pod \"iptables-alerter-7sb2h\" (UID: \"c5018771-30e7-4be6-9603-43580e63bde0\") " pod="openshift-network-operator/iptables-alerter-7sb2h" Jul 27 09:50:13.358421 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.356577 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/23171641-b4dc-46f0-81c3-a556168b3683-etc-sysctl-conf\") pod \"tuned-m9tv9\" (UID: \"23171641-b4dc-46f0-81c3-a556168b3683\") " pod="openshift-cluster-node-tuning-operator/tuned-m9tv9" Jul 27 09:50:13.358421 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.356586 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/be638d62-c9e5-4e50-ac56-253fa74e20c1-agent-certs\") pod \"konnectivity-agent-sxq7r\" (UID: \"be638d62-c9e5-4e50-ac56-253fa74e20c1\") " pod="kube-system/konnectivity-agent-sxq7r" Jul 27 09:50:13.358421 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.356600 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/23171641-b4dc-46f0-81c3-a556168b3683-etc-systemd\") pod \"tuned-m9tv9\" (UID: \"23171641-b4dc-46f0-81c3-a556168b3683\") " pod="openshift-cluster-node-tuning-operator/tuned-m9tv9" Jul 27 09:50:13.358421 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.356617 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b4deab12-8c9e-4151-81f3-6c87e474578e-os-release\") pod \"multus-additional-cni-plugins-w2txx\" (UID: \"b4deab12-8c9e-4151-81f3-6c87e474578e\") " pod="openshift-multus/multus-additional-cni-plugins-w2txx" Jul 27 09:50:13.358421 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.356638 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e722c870-2401-4465-a42b-c9e3305f15c2-var-lib-openvswitch\") pod \"ovnkube-node-ph68r\" (UID: \"e722c870-2401-4465-a42b-c9e3305f15c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ph68r" Jul 27 09:50:13.358421 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.356643 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/23171641-b4dc-46f0-81c3-a556168b3683-etc-modprobe-d\") pod \"tuned-m9tv9\" (UID: \"23171641-b4dc-46f0-81c3-a556168b3683\") " pod="openshift-cluster-node-tuning-operator/tuned-m9tv9" Jul 27 09:50:13.358421 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.356723 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/23171641-b4dc-46f0-81c3-a556168b3683-etc-systemd\") pod \"tuned-m9tv9\" (UID: \"23171641-b4dc-46f0-81c3-a556168b3683\") " pod="openshift-cluster-node-tuning-operator/tuned-m9tv9" Jul 27 09:50:13.358421 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.356869 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b4deab12-8c9e-4151-81f3-6c87e474578e-os-release\") pod \"multus-additional-cni-plugins-w2txx\" (UID: \"b4deab12-8c9e-4151-81f3-6c87e474578e\") " pod="openshift-multus/multus-additional-cni-plugins-w2txx" Jul 27 09:50:13.358421 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.356901 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/876d6010-7686-42f7-86e0-773c644257af-multus-daemon-config\") pod \"multus-sxn5x\" (UID: \"876d6010-7686-42f7-86e0-773c644257af\") " pod="openshift-multus/multus-sxn5x" Jul 27 09:50:13.358421 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.357165 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b4deab12-8c9e-4151-81f3-6c87e474578e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-w2txx\" (UID: \"b4deab12-8c9e-4151-81f3-6c87e474578e\") " pod="openshift-multus/multus-additional-cni-plugins-w2txx" Jul 27 09:50:13.358967 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.358948 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/23171641-b4dc-46f0-81c3-a556168b3683-tmp\") pod \"tuned-m9tv9\" (UID: \"23171641-b4dc-46f0-81c3-a556168b3683\") " pod="openshift-cluster-node-tuning-operator/tuned-m9tv9" Jul 27 09:50:13.359025 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.358986 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/23171641-b4dc-46f0-81c3-a556168b3683-etc-tuned\") pod \"tuned-m9tv9\" (UID: \"23171641-b4dc-46f0-81c3-a556168b3683\") " pod="openshift-cluster-node-tuning-operator/tuned-m9tv9" Jul 27 09:50:13.359147 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.359132 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/be638d62-c9e5-4e50-ac56-253fa74e20c1-agent-certs\") pod \"konnectivity-agent-sxq7r\" (UID: \"be638d62-c9e5-4e50-ac56-253fa74e20c1\") " pod="kube-system/konnectivity-agent-sxq7r" Jul 27 09:50:13.364152 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.364134 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjnh8\" (UniqueName: \"kubernetes.io/projected/23171641-b4dc-46f0-81c3-a556168b3683-kube-api-access-rjnh8\") pod \"tuned-m9tv9\" (UID: \"23171641-b4dc-46f0-81c3-a556168b3683\") " pod="openshift-cluster-node-tuning-operator/tuned-m9tv9" Jul 27 09:50:13.364340 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.364321 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhwr9\" (UniqueName: \"kubernetes.io/projected/b4deab12-8c9e-4151-81f3-6c87e474578e-kube-api-access-dhwr9\") pod \"multus-additional-cni-plugins-w2txx\" (UID: \"b4deab12-8c9e-4151-81f3-6c87e474578e\") " pod="openshift-multus/multus-additional-cni-plugins-w2txx" Jul 27 09:50:13.364493 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.364477 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tklqt\" (UniqueName: \"kubernetes.io/projected/c741cd56-6ff5-43be-aafd-a38247f7f11c-kube-api-access-tklqt\") pod \"aws-ebs-csi-driver-node-k7xmw\" (UID: \"c741cd56-6ff5-43be-aafd-a38247f7f11c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7xmw" Jul 27 09:50:13.364818 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.364803 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbfmp\" (UniqueName: \"kubernetes.io/projected/c01da73c-3338-41bb-884a-f7c145421d57-kube-api-access-fbfmp\") pod \"node-resolver-4mdxm\" (UID: \"c01da73c-3338-41bb-884a-f7c145421d57\") " pod="openshift-dns/node-resolver-4mdxm" Jul 27 09:50:13.365006 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.364992 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnr74\" (UniqueName: \"kubernetes.io/projected/876d6010-7686-42f7-86e0-773c644257af-kube-api-access-fnr74\") pod \"multus-sxn5x\" (UID: \"876d6010-7686-42f7-86e0-773c644257af\") " pod="openshift-multus/multus-sxn5x" Jul 27 09:50:13.423098 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:13.423066 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd53d4fb2319b8a6bcca414fa1eb18354.slice/crio-226883c7edb0dcccbeb9afd5de6d100c0beae58df85e827816fa8ab79ad647e3 WatchSource:0}: Error finding container 226883c7edb0dcccbeb9afd5de6d100c0beae58df85e827816fa8ab79ad647e3: Status 404 returned error can't find the container with id 226883c7edb0dcccbeb9afd5de6d100c0beae58df85e827816fa8ab79ad647e3 Jul 27 09:50:13.424661 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:13.424641 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b03c9b33b3bb819e7a8014427f1b4d7.slice/crio-59fbdb423b597d6814a8b95ad6cddaad035f966e836ad31e08eb4999557b0630 WatchSource:0}: Error finding container 59fbdb423b597d6814a8b95ad6cddaad035f966e836ad31e08eb4999557b0630: Status 404 returned error can't find the container with id 59fbdb423b597d6814a8b95ad6cddaad035f966e836ad31e08eb4999557b0630 Jul 27 09:50:13.429267 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.429254 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 27 09:50:13.456898 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.456878 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q76jn\" (UniqueName: \"kubernetes.io/projected/c5018771-30e7-4be6-9603-43580e63bde0-kube-api-access-q76jn\") pod \"iptables-alerter-7sb2h\" (UID: \"c5018771-30e7-4be6-9603-43580e63bde0\") " pod="openshift-network-operator/iptables-alerter-7sb2h" Jul 27 09:50:13.456995 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.456906 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e722c870-2401-4465-a42b-c9e3305f15c2-host-kubelet\") pod \"ovnkube-node-ph68r\" (UID: \"e722c870-2401-4465-a42b-c9e3305f15c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ph68r" Jul 27 09:50:13.456995 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.456923 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e722c870-2401-4465-a42b-c9e3305f15c2-run-systemd\") pod \"ovnkube-node-ph68r\" (UID: \"e722c870-2401-4465-a42b-c9e3305f15c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ph68r" Jul 27 09:50:13.456995 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.456946 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e722c870-2401-4465-a42b-c9e3305f15c2-ovnkube-config\") pod \"ovnkube-node-ph68r\" (UID: \"e722c870-2401-4465-a42b-c9e3305f15c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ph68r" Jul 27 09:50:13.456995 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.456980 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e722c870-2401-4465-a42b-c9e3305f15c2-host-kubelet\") pod \"ovnkube-node-ph68r\" (UID: \"e722c870-2401-4465-a42b-c9e3305f15c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ph68r" Jul 27 09:50:13.457222 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.457004 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e722c870-2401-4465-a42b-c9e3305f15c2-run-systemd\") pod \"ovnkube-node-ph68r\" (UID: \"e722c870-2401-4465-a42b-c9e3305f15c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ph68r" Jul 27 09:50:13.457222 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.457048 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e722c870-2401-4465-a42b-c9e3305f15c2-systemd-units\") pod \"ovnkube-node-ph68r\" (UID: \"e722c870-2401-4465-a42b-c9e3305f15c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ph68r" Jul 27 09:50:13.457222 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.457077 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e722c870-2401-4465-a42b-c9e3305f15c2-host-slash\") pod \"ovnkube-node-ph68r\" (UID: \"e722c870-2401-4465-a42b-c9e3305f15c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ph68r" Jul 27 09:50:13.457222 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.457091 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e722c870-2401-4465-a42b-c9e3305f15c2-host-run-netns\") pod \"ovnkube-node-ph68r\" (UID: \"e722c870-2401-4465-a42b-c9e3305f15c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ph68r" Jul 27 09:50:13.457222 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.457105 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e722c870-2401-4465-a42b-c9e3305f15c2-host-cni-bin\") pod \"ovnkube-node-ph68r\" (UID: \"e722c870-2401-4465-a42b-c9e3305f15c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ph68r" Jul 27 09:50:13.457222 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.457121 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3400c9d3-50c8-4143-83fb-e22dbe5b627a-serviceca\") pod \"node-ca-wgfkj\" (UID: \"3400c9d3-50c8-4143-83fb-e22dbe5b627a\") " pod="openshift-image-registry/node-ca-wgfkj" Jul 27 09:50:13.457222 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.457131 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e722c870-2401-4465-a42b-c9e3305f15c2-systemd-units\") pod \"ovnkube-node-ph68r\" (UID: \"e722c870-2401-4465-a42b-c9e3305f15c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ph68r" Jul 27 09:50:13.457222 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.457143 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2jfp\" (UniqueName: \"kubernetes.io/projected/4c375e68-a7a1-414b-9d33-3040925415f4-kube-api-access-r2jfp\") pod \"network-check-target-hlhxc\" (UID: \"4c375e68-a7a1-414b-9d33-3040925415f4\") " pod="openshift-network-diagnostics/network-check-target-hlhxc" Jul 27 09:50:13.457222 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.457163 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e722c870-2401-4465-a42b-c9e3305f15c2-host-slash\") pod \"ovnkube-node-ph68r\" (UID: \"e722c870-2401-4465-a42b-c9e3305f15c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ph68r" Jul 27 09:50:13.457222 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.457175 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e722c870-2401-4465-a42b-c9e3305f15c2-host-cni-bin\") pod \"ovnkube-node-ph68r\" (UID: \"e722c870-2401-4465-a42b-c9e3305f15c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ph68r" Jul 27 09:50:13.457222 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.457176 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e722c870-2401-4465-a42b-c9e3305f15c2-run-openvswitch\") pod \"ovnkube-node-ph68r\" (UID: \"e722c870-2401-4465-a42b-c9e3305f15c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ph68r" Jul 27 09:50:13.457222 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.457204 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e722c870-2401-4465-a42b-c9e3305f15c2-host-run-netns\") pod \"ovnkube-node-ph68r\" (UID: \"e722c870-2401-4465-a42b-c9e3305f15c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ph68r" Jul 27 09:50:13.457222 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.457211 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e722c870-2401-4465-a42b-c9e3305f15c2-run-openvswitch\") pod \"ovnkube-node-ph68r\" (UID: \"e722c870-2401-4465-a42b-c9e3305f15c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ph68r" Jul 27 09:50:13.457222 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.457213 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e722c870-2401-4465-a42b-c9e3305f15c2-node-log\") pod \"ovnkube-node-ph68r\" (UID: \"e722c870-2401-4465-a42b-c9e3305f15c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ph68r" Jul 27 09:50:13.457874 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.457244 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e722c870-2401-4465-a42b-c9e3305f15c2-node-log\") pod \"ovnkube-node-ph68r\" (UID: \"e722c870-2401-4465-a42b-c9e3305f15c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ph68r" Jul 27 09:50:13.457874 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.457246 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/081653f9-8f80-4844-b67f-7d8965198bb6-original-pull-secret\") pod \"global-pull-secret-syncer-qlrkd\" (UID: \"081653f9-8f80-4844-b67f-7d8965198bb6\") " pod="kube-system/global-pull-secret-syncer-qlrkd" Jul 27 09:50:13.457874 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.457302 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e722c870-2401-4465-a42b-c9e3305f15c2-etc-openvswitch\") pod \"ovnkube-node-ph68r\" (UID: \"e722c870-2401-4465-a42b-c9e3305f15c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ph68r" Jul 27 09:50:13.457874 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.457330 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/27f2e8fc-173e-43ff-b7a6-0bd6e8b54d40-metrics-certs\") pod \"network-metrics-daemon-cl9xw\" (UID: \"27f2e8fc-173e-43ff-b7a6-0bd6e8b54d40\") " pod="openshift-multus/network-metrics-daemon-cl9xw" Jul 27 09:50:13.457874 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:13.457352 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 09:50:13.457874 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.457357 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/081653f9-8f80-4844-b67f-7d8965198bb6-dbus\") pod \"global-pull-secret-syncer-qlrkd\" (UID: \"081653f9-8f80-4844-b67f-7d8965198bb6\") " pod="kube-system/global-pull-secret-syncer-qlrkd" Jul 27 09:50:13.457874 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.457386 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e722c870-2401-4465-a42b-c9e3305f15c2-host-run-ovn-kubernetes\") pod \"ovnkube-node-ph68r\" (UID: \"e722c870-2401-4465-a42b-c9e3305f15c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ph68r" Jul 27 09:50:13.457874 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:13.457405 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/081653f9-8f80-4844-b67f-7d8965198bb6-original-pull-secret podName:081653f9-8f80-4844-b67f-7d8965198bb6 nodeName:}" failed. No retries permitted until 2026-07-27 09:50:13.957385674 +0000 UTC m=+2.101909696 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/081653f9-8f80-4844-b67f-7d8965198bb6-original-pull-secret") pod "global-pull-secret-syncer-qlrkd" (UID: "081653f9-8f80-4844-b67f-7d8965198bb6") : object "kube-system"/"original-pull-secret" not registered Jul 27 09:50:13.457874 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.457421 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e722c870-2401-4465-a42b-c9e3305f15c2-host-run-ovn-kubernetes\") pod \"ovnkube-node-ph68r\" (UID: \"e722c870-2401-4465-a42b-c9e3305f15c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ph68r" Jul 27 09:50:13.457874 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.457433 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbkps\" (UniqueName: \"kubernetes.io/projected/e722c870-2401-4465-a42b-c9e3305f15c2-kube-api-access-mbkps\") pod \"ovnkube-node-ph68r\" (UID: \"e722c870-2401-4465-a42b-c9e3305f15c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ph68r" Jul 27 09:50:13.457874 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.457458 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c5018771-30e7-4be6-9603-43580e63bde0-host-slash\") pod \"iptables-alerter-7sb2h\" (UID: \"c5018771-30e7-4be6-9603-43580e63bde0\") " pod="openshift-network-operator/iptables-alerter-7sb2h" Jul 27 09:50:13.457874 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:13.457465 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 09:50:13.457874 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.457469 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/081653f9-8f80-4844-b67f-7d8965198bb6-dbus\") pod \"global-pull-secret-syncer-qlrkd\" (UID: \"081653f9-8f80-4844-b67f-7d8965198bb6\") " pod="kube-system/global-pull-secret-syncer-qlrkd" Jul 27 09:50:13.457874 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.457477 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e722c870-2401-4465-a42b-c9e3305f15c2-ovnkube-config\") pod \"ovnkube-node-ph68r\" (UID: \"e722c870-2401-4465-a42b-c9e3305f15c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ph68r" Jul 27 09:50:13.457874 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.457485 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e722c870-2401-4465-a42b-c9e3305f15c2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ph68r\" (UID: \"e722c870-2401-4465-a42b-c9e3305f15c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ph68r" Jul 27 09:50:13.457874 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.457403 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e722c870-2401-4465-a42b-c9e3305f15c2-etc-openvswitch\") pod \"ovnkube-node-ph68r\" (UID: \"e722c870-2401-4465-a42b-c9e3305f15c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ph68r" Jul 27 09:50:13.458471 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:13.457507 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27f2e8fc-173e-43ff-b7a6-0bd6e8b54d40-metrics-certs podName:27f2e8fc-173e-43ff-b7a6-0bd6e8b54d40 nodeName:}" failed. No retries permitted until 2026-07-27 09:50:13.957496548 +0000 UTC m=+2.102020550 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/27f2e8fc-173e-43ff-b7a6-0bd6e8b54d40-metrics-certs") pod "network-metrics-daemon-cl9xw" (UID: "27f2e8fc-173e-43ff-b7a6-0bd6e8b54d40") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 09:50:13.458471 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.457522 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e722c870-2401-4465-a42b-c9e3305f15c2-ovn-node-metrics-cert\") pod \"ovnkube-node-ph68r\" (UID: \"e722c870-2401-4465-a42b-c9e3305f15c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ph68r" Jul 27 09:50:13.458471 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.457531 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3400c9d3-50c8-4143-83fb-e22dbe5b627a-serviceca\") pod \"node-ca-wgfkj\" (UID: \"3400c9d3-50c8-4143-83fb-e22dbe5b627a\") " pod="openshift-image-registry/node-ca-wgfkj" Jul 27 09:50:13.458471 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.457546 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3400c9d3-50c8-4143-83fb-e22dbe5b627a-host\") pod \"node-ca-wgfkj\" (UID: \"3400c9d3-50c8-4143-83fb-e22dbe5b627a\") " pod="openshift-image-registry/node-ca-wgfkj" Jul 27 09:50:13.458471 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.457574 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e722c870-2401-4465-a42b-c9e3305f15c2-run-ovn\") pod \"ovnkube-node-ph68r\" (UID: \"e722c870-2401-4465-a42b-c9e3305f15c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ph68r" Jul 27 09:50:13.458471 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.457597 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e722c870-2401-4465-a42b-c9e3305f15c2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ph68r\" (UID: \"e722c870-2401-4465-a42b-c9e3305f15c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ph68r" Jul 27 09:50:13.458471 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.457599 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e722c870-2401-4465-a42b-c9e3305f15c2-log-socket\") pod \"ovnkube-node-ph68r\" (UID: \"e722c870-2401-4465-a42b-c9e3305f15c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ph68r" Jul 27 09:50:13.458471 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.457621 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2f6t\" (UniqueName: \"kubernetes.io/projected/3400c9d3-50c8-4143-83fb-e22dbe5b627a-kube-api-access-t2f6t\") pod \"node-ca-wgfkj\" (UID: \"3400c9d3-50c8-4143-83fb-e22dbe5b627a\") " pod="openshift-image-registry/node-ca-wgfkj" Jul 27 09:50:13.458471 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.457638 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c5018771-30e7-4be6-9603-43580e63bde0-iptables-alerter-script\") pod \"iptables-alerter-7sb2h\" (UID: \"c5018771-30e7-4be6-9603-43580e63bde0\") " pod="openshift-network-operator/iptables-alerter-7sb2h" Jul 27 09:50:13.458471 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.457576 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c5018771-30e7-4be6-9603-43580e63bde0-host-slash\") pod \"iptables-alerter-7sb2h\" (UID: \"c5018771-30e7-4be6-9603-43580e63bde0\") " pod="openshift-network-operator/iptables-alerter-7sb2h" Jul 27 09:50:13.458471 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.457646 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e722c870-2401-4465-a42b-c9e3305f15c2-run-ovn\") pod \"ovnkube-node-ph68r\" (UID: \"e722c870-2401-4465-a42b-c9e3305f15c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ph68r" Jul 27 09:50:13.458471 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.457655 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e722c870-2401-4465-a42b-c9e3305f15c2-var-lib-openvswitch\") pod \"ovnkube-node-ph68r\" (UID: \"e722c870-2401-4465-a42b-c9e3305f15c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ph68r" Jul 27 09:50:13.458471 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.457675 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e722c870-2401-4465-a42b-c9e3305f15c2-var-lib-openvswitch\") pod \"ovnkube-node-ph68r\" (UID: \"e722c870-2401-4465-a42b-c9e3305f15c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ph68r" Jul 27 09:50:13.458471 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.457674 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3400c9d3-50c8-4143-83fb-e22dbe5b627a-host\") pod \"node-ca-wgfkj\" (UID: \"3400c9d3-50c8-4143-83fb-e22dbe5b627a\") " pod="openshift-image-registry/node-ca-wgfkj" Jul 27 09:50:13.458471 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.457680 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e722c870-2401-4465-a42b-c9e3305f15c2-host-cni-netd\") pod \"ovnkube-node-ph68r\" (UID: \"e722c870-2401-4465-a42b-c9e3305f15c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ph68r" Jul 27 09:50:13.458471 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.457706 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e722c870-2401-4465-a42b-c9e3305f15c2-env-overrides\") pod \"ovnkube-node-ph68r\" (UID: \"e722c870-2401-4465-a42b-c9e3305f15c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ph68r" Jul 27 09:50:13.458471 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.457727 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e722c870-2401-4465-a42b-c9e3305f15c2-ovnkube-script-lib\") pod \"ovnkube-node-ph68r\" (UID: \"e722c870-2401-4465-a42b-c9e3305f15c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ph68r" Jul 27 09:50:13.458918 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.457638 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e722c870-2401-4465-a42b-c9e3305f15c2-log-socket\") pod \"ovnkube-node-ph68r\" (UID: \"e722c870-2401-4465-a42b-c9e3305f15c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ph68r" Jul 27 09:50:13.458918 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.457778 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e722c870-2401-4465-a42b-c9e3305f15c2-host-cni-netd\") pod \"ovnkube-node-ph68r\" (UID: \"e722c870-2401-4465-a42b-c9e3305f15c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ph68r" Jul 27 09:50:13.458918 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.457810 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/081653f9-8f80-4844-b67f-7d8965198bb6-kubelet-config\") pod \"global-pull-secret-syncer-qlrkd\" (UID: \"081653f9-8f80-4844-b67f-7d8965198bb6\") " pod="kube-system/global-pull-secret-syncer-qlrkd" Jul 27 09:50:13.458918 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.457835 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxltg\" (UniqueName: \"kubernetes.io/projected/27f2e8fc-173e-43ff-b7a6-0bd6e8b54d40-kube-api-access-vxltg\") pod \"network-metrics-daemon-cl9xw\" (UID: \"27f2e8fc-173e-43ff-b7a6-0bd6e8b54d40\") " pod="openshift-multus/network-metrics-daemon-cl9xw" Jul 27 09:50:13.458918 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.457914 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/081653f9-8f80-4844-b67f-7d8965198bb6-kubelet-config\") pod \"global-pull-secret-syncer-qlrkd\" (UID: \"081653f9-8f80-4844-b67f-7d8965198bb6\") " pod="kube-system/global-pull-secret-syncer-qlrkd" Jul 27 09:50:13.458918 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.458115 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e722c870-2401-4465-a42b-c9e3305f15c2-env-overrides\") pod \"ovnkube-node-ph68r\" (UID: \"e722c870-2401-4465-a42b-c9e3305f15c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ph68r" Jul 27 09:50:13.458918 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.458140 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e722c870-2401-4465-a42b-c9e3305f15c2-ovnkube-script-lib\") pod \"ovnkube-node-ph68r\" (UID: \"e722c870-2401-4465-a42b-c9e3305f15c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ph68r" Jul 27 09:50:13.458918 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.458168 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c5018771-30e7-4be6-9603-43580e63bde0-iptables-alerter-script\") pod \"iptables-alerter-7sb2h\" (UID: \"c5018771-30e7-4be6-9603-43580e63bde0\") " pod="openshift-network-operator/iptables-alerter-7sb2h" Jul 27 09:50:13.459726 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.459711 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e722c870-2401-4465-a42b-c9e3305f15c2-ovn-node-metrics-cert\") pod \"ovnkube-node-ph68r\" (UID: \"e722c870-2401-4465-a42b-c9e3305f15c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ph68r" Jul 27 09:50:13.464852 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:13.464837 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 09:50:13.464852 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:13.464852 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 09:50:13.464966 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:13.464862 2556 projected.go:196] Error preparing data for projected volume kube-api-access-r2jfp for pod openshift-network-diagnostics/network-check-target-hlhxc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 09:50:13.464966 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:13.464910 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4c375e68-a7a1-414b-9d33-3040925415f4-kube-api-access-r2jfp podName:4c375e68-a7a1-414b-9d33-3040925415f4 nodeName:}" failed. No retries permitted until 2026-07-27 09:50:13.964897034 +0000 UTC m=+2.109421038 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-r2jfp" (UniqueName: "kubernetes.io/projected/4c375e68-a7a1-414b-9d33-3040925415f4-kube-api-access-r2jfp") pod "network-check-target-hlhxc" (UID: "4c375e68-a7a1-414b-9d33-3040925415f4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 09:50:13.466793 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.466760 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbkps\" (UniqueName: \"kubernetes.io/projected/e722c870-2401-4465-a42b-c9e3305f15c2-kube-api-access-mbkps\") pod \"ovnkube-node-ph68r\" (UID: \"e722c870-2401-4465-a42b-c9e3305f15c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ph68r" Jul 27 09:50:13.466858 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.466811 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q76jn\" (UniqueName: \"kubernetes.io/projected/c5018771-30e7-4be6-9603-43580e63bde0-kube-api-access-q76jn\") pod \"iptables-alerter-7sb2h\" (UID: \"c5018771-30e7-4be6-9603-43580e63bde0\") " pod="openshift-network-operator/iptables-alerter-7sb2h" Jul 27 09:50:13.467165 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.467146 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2f6t\" (UniqueName: \"kubernetes.io/projected/3400c9d3-50c8-4143-83fb-e22dbe5b627a-kube-api-access-t2f6t\") pod \"node-ca-wgfkj\" (UID: \"3400c9d3-50c8-4143-83fb-e22dbe5b627a\") " pod="openshift-image-registry/node-ca-wgfkj" Jul 27 09:50:13.467620 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.467606 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxltg\" (UniqueName: \"kubernetes.io/projected/27f2e8fc-173e-43ff-b7a6-0bd6e8b54d40-kube-api-access-vxltg\") pod \"network-metrics-daemon-cl9xw\" (UID: \"27f2e8fc-173e-43ff-b7a6-0bd6e8b54d40\") " pod="openshift-multus/network-metrics-daemon-cl9xw" Jul 27 09:50:13.569114 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.569071 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-sxq7r" Jul 27 09:50:13.574206 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.574192 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7xmw" Jul 27 09:50:13.575927 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:13.575909 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe638d62_c9e5_4e50_ac56_253fa74e20c1.slice/crio-24562b95dc9e0bb39d2672ec5d7019df6cbee5c7316bff62aa4e21c9cfa04e5f WatchSource:0}: Error finding container 24562b95dc9e0bb39d2672ec5d7019df6cbee5c7316bff62aa4e21c9cfa04e5f: Status 404 returned error can't find the container with id 24562b95dc9e0bb39d2672ec5d7019df6cbee5c7316bff62aa4e21c9cfa04e5f Jul 27 09:50:13.581158 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:13.581140 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc741cd56_6ff5_43be_aafd_a38247f7f11c.slice/crio-142968a1508d366cab1a3c01b782f1078eac4f80a00cb2975963fd93a74996a9 WatchSource:0}: Error finding container 142968a1508d366cab1a3c01b782f1078eac4f80a00cb2975963fd93a74996a9: Status 404 returned error can't find the container with id 142968a1508d366cab1a3c01b782f1078eac4f80a00cb2975963fd93a74996a9 Jul 27 09:50:13.605989 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.605971 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-m9tv9" Jul 27 09:50:13.612486 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:13.612467 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23171641_b4dc_46f0_81c3_a556168b3683.slice/crio-da0c30e47c7b045a0cc93744fca209508f1e1b5d29328fd994c2212ea23b02d9 WatchSource:0}: Error finding container da0c30e47c7b045a0cc93744fca209508f1e1b5d29328fd994c2212ea23b02d9: Status 404 returned error can't find the container with id da0c30e47c7b045a0cc93744fca209508f1e1b5d29328fd994c2212ea23b02d9 Jul 27 09:50:13.616228 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.616212 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4mdxm" Jul 27 09:50:13.622567 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:13.622546 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc01da73c_3338_41bb_884a_f7c145421d57.slice/crio-3c6fa370da27a4f9c16b1c9a338d9b453a6d07462b1d197f563ddf3ac68b95d8 WatchSource:0}: Error finding container 3c6fa370da27a4f9c16b1c9a338d9b453a6d07462b1d197f563ddf3ac68b95d8: Status 404 returned error can't find the container with id 3c6fa370da27a4f9c16b1c9a338d9b453a6d07462b1d197f563ddf3ac68b95d8 Jul 27 09:50:13.629480 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.629465 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-w2txx" Jul 27 09:50:13.635370 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.635355 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-sxn5x" Jul 27 09:50:13.635667 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:13.635651 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4deab12_8c9e_4151_81f3_6c87e474578e.slice/crio-7477b7608e938322fac2a02830c7835f3cbfc072c0ffcfea731ce16c1f9f3e6a WatchSource:0}: Error finding container 7477b7608e938322fac2a02830c7835f3cbfc072c0ffcfea731ce16c1f9f3e6a: Status 404 returned error can't find the container with id 7477b7608e938322fac2a02830c7835f3cbfc072c0ffcfea731ce16c1f9f3e6a Jul 27 09:50:13.642818 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:13.642799 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod876d6010_7686_42f7_86e0_773c644257af.slice/crio-e35a9e5024515a9632177ae1a622f6ce0dbf301eb1da5d834694a85c0b82d44b WatchSource:0}: Error finding container e35a9e5024515a9632177ae1a622f6ce0dbf301eb1da5d834694a85c0b82d44b: Status 404 returned error can't find the container with id e35a9e5024515a9632177ae1a622f6ce0dbf301eb1da5d834694a85c0b82d44b Jul 27 09:50:13.666056 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.666039 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wgfkj" Jul 27 09:50:13.671795 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:13.671778 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3400c9d3_50c8_4143_83fb_e22dbe5b627a.slice/crio-59fc103d24aaa58af0a259a164e672cc1950043814d0b965e967d459b37e6290 WatchSource:0}: Error finding container 59fc103d24aaa58af0a259a164e672cc1950043814d0b965e967d459b37e6290: Status 404 returned error can't find the container with id 59fc103d24aaa58af0a259a164e672cc1950043814d0b965e967d459b37e6290 Jul 27 09:50:13.685947 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.685925 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7sb2h" Jul 27 09:50:13.690458 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.690441 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ph68r" Jul 27 09:50:13.691727 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:13.691710 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5018771_30e7_4be6_9603_43580e63bde0.slice/crio-b29e8dd777318e2188f41b97a45595dacbaf483a31972d1fc2677c6a421a0a5c WatchSource:0}: Error finding container b29e8dd777318e2188f41b97a45595dacbaf483a31972d1fc2677c6a421a0a5c: Status 404 returned error can't find the container with id b29e8dd777318e2188f41b97a45595dacbaf483a31972d1fc2677c6a421a0a5c Jul 27 09:50:13.697160 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:13.697142 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode722c870_2401_4465_a42b_c9e3305f15c2.slice/crio-e3b6486ec835d815e42f32af395d2aef4339b06ca26b9f15781aabefef5bde89 WatchSource:0}: Error finding container e3b6486ec835d815e42f32af395d2aef4339b06ca26b9f15781aabefef5bde89: Status 404 returned error can't find the container with id e3b6486ec835d815e42f32af395d2aef4339b06ca26b9f15781aabefef5bde89 Jul 27 09:50:13.759935 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.759914 2556 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 27 09:50:13.846264 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.846218 2556 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 27 09:50:13.960993 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.960962 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/081653f9-8f80-4844-b67f-7d8965198bb6-original-pull-secret\") pod \"global-pull-secret-syncer-qlrkd\" (UID: \"081653f9-8f80-4844-b67f-7d8965198bb6\") " pod="kube-system/global-pull-secret-syncer-qlrkd" Jul 27 09:50:13.961132 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:13.961008 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/27f2e8fc-173e-43ff-b7a6-0bd6e8b54d40-metrics-certs\") pod \"network-metrics-daemon-cl9xw\" (UID: \"27f2e8fc-173e-43ff-b7a6-0bd6e8b54d40\") " pod="openshift-multus/network-metrics-daemon-cl9xw" Jul 27 09:50:13.961132 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:13.961112 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 09:50:13.961132 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:13.961114 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 09:50:13.961292 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:13.961162 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27f2e8fc-173e-43ff-b7a6-0bd6e8b54d40-metrics-certs podName:27f2e8fc-173e-43ff-b7a6-0bd6e8b54d40 nodeName:}" failed. No retries permitted until 2026-07-27 09:50:14.961143859 +0000 UTC m=+3.105667862 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/27f2e8fc-173e-43ff-b7a6-0bd6e8b54d40-metrics-certs") pod "network-metrics-daemon-cl9xw" (UID: "27f2e8fc-173e-43ff-b7a6-0bd6e8b54d40") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 09:50:13.961292 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:13.961180 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/081653f9-8f80-4844-b67f-7d8965198bb6-original-pull-secret podName:081653f9-8f80-4844-b67f-7d8965198bb6 nodeName:}" failed. No retries permitted until 2026-07-27 09:50:14.961171103 +0000 UTC m=+3.105695112 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/081653f9-8f80-4844-b67f-7d8965198bb6-original-pull-secret") pod "global-pull-secret-syncer-qlrkd" (UID: "081653f9-8f80-4844-b67f-7d8965198bb6") : object "kube-system"/"original-pull-secret" not registered Jul 27 09:50:14.061358 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:14.061321 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2jfp\" (UniqueName: \"kubernetes.io/projected/4c375e68-a7a1-414b-9d33-3040925415f4-kube-api-access-r2jfp\") pod \"network-check-target-hlhxc\" (UID: \"4c375e68-a7a1-414b-9d33-3040925415f4\") " pod="openshift-network-diagnostics/network-check-target-hlhxc" Jul 27 09:50:14.061556 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:14.061539 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 09:50:14.061622 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:14.061565 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 09:50:14.061622 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:14.061578 2556 projected.go:196] Error preparing data for projected volume kube-api-access-r2jfp for pod openshift-network-diagnostics/network-check-target-hlhxc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 09:50:14.061727 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:14.061633 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4c375e68-a7a1-414b-9d33-3040925415f4-kube-api-access-r2jfp podName:4c375e68-a7a1-414b-9d33-3040925415f4 nodeName:}" failed. No retries permitted until 2026-07-27 09:50:15.061615825 +0000 UTC m=+3.206139841 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-r2jfp" (UniqueName: "kubernetes.io/projected/4c375e68-a7a1-414b-9d33-3040925415f4-kube-api-access-r2jfp") pod "network-check-target-hlhxc" (UID: "4c375e68-a7a1-414b-9d33-3040925415f4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 09:50:15.844580 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:15.844518 2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-26 09:45:14 +0000 UTC" deadline="2028-03-19 12:34:28.235200783 +0000 UTC" Jul 27 09:50:15.844580 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:15.844578 2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14426h44m12.390626886s" Jul 27 09:50:15.921638 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:15.921489 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ph68r" event={"ID":"e722c870-2401-4465-a42b-c9e3305f15c2","Type":"ContainerStarted","Data":"e3b6486ec835d815e42f32af395d2aef4339b06ca26b9f15781aabefef5bde89"} Jul 27 09:50:15.934382 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:15.934265 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7sb2h" event={"ID":"c5018771-30e7-4be6-9603-43580e63bde0","Type":"ContainerStarted","Data":"b29e8dd777318e2188f41b97a45595dacbaf483a31972d1fc2677c6a421a0a5c"} Jul 27 09:50:15.941321 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:15.941271 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-sxn5x" event={"ID":"876d6010-7686-42f7-86e0-773c644257af","Type":"ContainerStarted","Data":"e35a9e5024515a9632177ae1a622f6ce0dbf301eb1da5d834694a85c0b82d44b"} Jul 27 09:50:15.948160 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:15.948093 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w2txx" event={"ID":"b4deab12-8c9e-4151-81f3-6c87e474578e","Type":"ContainerStarted","Data":"7477b7608e938322fac2a02830c7835f3cbfc072c0ffcfea731ce16c1f9f3e6a"} Jul 27 09:50:15.954169 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:15.954138 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4mdxm" event={"ID":"c01da73c-3338-41bb-884a-f7c145421d57","Type":"ContainerStarted","Data":"3c6fa370da27a4f9c16b1c9a338d9b453a6d07462b1d197f563ddf3ac68b95d8"} Jul 27 09:50:15.975877 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:15.975778 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-m9tv9" event={"ID":"23171641-b4dc-46f0-81c3-a556168b3683","Type":"ContainerStarted","Data":"da0c30e47c7b045a0cc93744fca209508f1e1b5d29328fd994c2212ea23b02d9"} Jul 27 09:50:15.977909 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:15.977876 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7xmw" event={"ID":"c741cd56-6ff5-43be-aafd-a38247f7f11c","Type":"ContainerStarted","Data":"142968a1508d366cab1a3c01b782f1078eac4f80a00cb2975963fd93a74996a9"} Jul 27 09:50:15.986702 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:15.986664 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-sxq7r" event={"ID":"be638d62-c9e5-4e50-ac56-253fa74e20c1","Type":"ContainerStarted","Data":"24562b95dc9e0bb39d2672ec5d7019df6cbee5c7316bff62aa4e21c9cfa04e5f"} Jul 27 09:50:15.989862 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:15.989694 2556 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 27 09:50:15.995639 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:15.995610 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wgfkj" event={"ID":"3400c9d3-50c8-4143-83fb-e22dbe5b627a","Type":"ContainerStarted","Data":"59fc103d24aaa58af0a259a164e672cc1950043814d0b965e967d459b37e6290"} Jul 27 09:50:16.005796 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:16.005740 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-140.ec2.internal" event={"ID":"d53d4fb2319b8a6bcca414fa1eb18354","Type":"ContainerStarted","Data":"226883c7edb0dcccbeb9afd5de6d100c0beae58df85e827816fa8ab79ad647e3"} Jul 27 09:50:16.017115 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:16.017092 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-140.ec2.internal" event={"ID":"1b03c9b33b3bb819e7a8014427f1b4d7","Type":"ContainerStarted","Data":"59fbdb423b597d6814a8b95ad6cddaad035f966e836ad31e08eb4999557b0630"} Jul 27 09:50:16.521206 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:16.521173 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/081653f9-8f80-4844-b67f-7d8965198bb6-original-pull-secret\") pod \"global-pull-secret-syncer-qlrkd\" (UID: \"081653f9-8f80-4844-b67f-7d8965198bb6\") " pod="kube-system/global-pull-secret-syncer-qlrkd" Jul 27 09:50:16.521379 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:16.521226 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/27f2e8fc-173e-43ff-b7a6-0bd6e8b54d40-metrics-certs\") pod \"network-metrics-daemon-cl9xw\" (UID: \"27f2e8fc-173e-43ff-b7a6-0bd6e8b54d40\") " pod="openshift-multus/network-metrics-daemon-cl9xw" Jul 27 09:50:16.521451 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:16.521381 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 09:50:16.521451 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:16.521442 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27f2e8fc-173e-43ff-b7a6-0bd6e8b54d40-metrics-certs podName:27f2e8fc-173e-43ff-b7a6-0bd6e8b54d40 nodeName:}" failed. No retries permitted until 2026-07-27 09:50:18.521422082 +0000 UTC m=+5.111919311 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/27f2e8fc-173e-43ff-b7a6-0bd6e8b54d40-metrics-certs") pod "network-metrics-daemon-cl9xw" (UID: "27f2e8fc-173e-43ff-b7a6-0bd6e8b54d40") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 09:50:16.521574 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:16.521503 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 09:50:16.521574 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:16.521543 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/081653f9-8f80-4844-b67f-7d8965198bb6-original-pull-secret podName:081653f9-8f80-4844-b67f-7d8965198bb6 nodeName:}" failed. No retries permitted until 2026-07-27 09:50:18.521532406 +0000 UTC m=+5.112029632 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/081653f9-8f80-4844-b67f-7d8965198bb6-original-pull-secret") pod "global-pull-secret-syncer-qlrkd" (UID: "081653f9-8f80-4844-b67f-7d8965198bb6") : object "kube-system"/"original-pull-secret" not registered Jul 27 09:50:16.622055 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:16.622021 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2jfp\" (UniqueName: \"kubernetes.io/projected/4c375e68-a7a1-414b-9d33-3040925415f4-kube-api-access-r2jfp\") pod \"network-check-target-hlhxc\" (UID: \"4c375e68-a7a1-414b-9d33-3040925415f4\") " pod="openshift-network-diagnostics/network-check-target-hlhxc" Jul 27 09:50:16.622259 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:16.622242 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 09:50:16.622368 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:16.622267 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 09:50:16.622368 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:16.622280 2556 projected.go:196] Error preparing data for projected volume kube-api-access-r2jfp for pod openshift-network-diagnostics/network-check-target-hlhxc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 09:50:16.622480 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:16.622391 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4c375e68-a7a1-414b-9d33-3040925415f4-kube-api-access-r2jfp podName:4c375e68-a7a1-414b-9d33-3040925415f4 nodeName:}" failed. No retries permitted until 2026-07-27 09:50:18.622373348 +0000 UTC m=+5.212870561 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-r2jfp" (UniqueName: "kubernetes.io/projected/4c375e68-a7a1-414b-9d33-3040925415f4-kube-api-access-r2jfp") pod "network-check-target-hlhxc" (UID: "4c375e68-a7a1-414b-9d33-3040925415f4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 09:50:16.845505 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:16.845373 2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-26 09:45:14 +0000 UTC" deadline="2028-05-02 14:21:55.73036326 +0000 UTC" Jul 27 09:50:16.845505 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:16.845430 2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15484h31m38.884936536s" Jul 27 09:50:16.905396 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:16.904580 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hlhxc" Jul 27 09:50:16.905396 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:16.904701 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hlhxc" podUID="4c375e68-a7a1-414b-9d33-3040925415f4" Jul 27 09:50:16.905396 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:16.905086 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qlrkd" Jul 27 09:50:16.905396 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:16.905183 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qlrkd" podUID="081653f9-8f80-4844-b67f-7d8965198bb6" Jul 27 09:50:16.905396 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:16.905254 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cl9xw" Jul 27 09:50:16.905396 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:16.905352 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cl9xw" podUID="27f2e8fc-173e-43ff-b7a6-0bd6e8b54d40" Jul 27 09:50:17.548746 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:17.548442 2556 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 27 09:50:18.536885 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:18.536573 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/081653f9-8f80-4844-b67f-7d8965198bb6-original-pull-secret\") pod \"global-pull-secret-syncer-qlrkd\" (UID: \"081653f9-8f80-4844-b67f-7d8965198bb6\") " pod="kube-system/global-pull-secret-syncer-qlrkd" Jul 27 09:50:18.536885 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:18.536624 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/27f2e8fc-173e-43ff-b7a6-0bd6e8b54d40-metrics-certs\") pod \"network-metrics-daemon-cl9xw\" (UID: \"27f2e8fc-173e-43ff-b7a6-0bd6e8b54d40\") " pod="openshift-multus/network-metrics-daemon-cl9xw" Jul 27 09:50:18.536885 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:18.536736 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 09:50:18.536885 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:18.536751 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 09:50:18.536885 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:18.536803 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27f2e8fc-173e-43ff-b7a6-0bd6e8b54d40-metrics-certs podName:27f2e8fc-173e-43ff-b7a6-0bd6e8b54d40 nodeName:}" failed. No retries permitted until 2026-07-27 09:50:22.536786283 +0000 UTC m=+9.127283499 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/27f2e8fc-173e-43ff-b7a6-0bd6e8b54d40-metrics-certs") pod "network-metrics-daemon-cl9xw" (UID: "27f2e8fc-173e-43ff-b7a6-0bd6e8b54d40") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 09:50:18.536885 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:18.536820 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/081653f9-8f80-4844-b67f-7d8965198bb6-original-pull-secret podName:081653f9-8f80-4844-b67f-7d8965198bb6 nodeName:}" failed. No retries permitted until 2026-07-27 09:50:22.536810983 +0000 UTC m=+9.127308195 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/081653f9-8f80-4844-b67f-7d8965198bb6-original-pull-secret") pod "global-pull-secret-syncer-qlrkd" (UID: "081653f9-8f80-4844-b67f-7d8965198bb6") : object "kube-system"/"original-pull-secret" not registered Jul 27 09:50:18.637974 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:18.637929 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2jfp\" (UniqueName: \"kubernetes.io/projected/4c375e68-a7a1-414b-9d33-3040925415f4-kube-api-access-r2jfp\") pod \"network-check-target-hlhxc\" (UID: \"4c375e68-a7a1-414b-9d33-3040925415f4\") " pod="openshift-network-diagnostics/network-check-target-hlhxc" Jul 27 09:50:18.638327 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:18.638154 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 09:50:18.638327 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:18.638177 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 09:50:18.638327 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:18.638190 2556 projected.go:196] Error preparing data for projected volume kube-api-access-r2jfp for pod openshift-network-diagnostics/network-check-target-hlhxc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 09:50:18.638327 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:18.638243 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4c375e68-a7a1-414b-9d33-3040925415f4-kube-api-access-r2jfp podName:4c375e68-a7a1-414b-9d33-3040925415f4 nodeName:}" failed. No retries permitted until 2026-07-27 09:50:22.638225741 +0000 UTC m=+9.228722975 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-r2jfp" (UniqueName: "kubernetes.io/projected/4c375e68-a7a1-414b-9d33-3040925415f4-kube-api-access-r2jfp") pod "network-check-target-hlhxc" (UID: "4c375e68-a7a1-414b-9d33-3040925415f4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 09:50:18.905563 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:18.904986 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hlhxc" Jul 27 09:50:18.905563 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:18.905119 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hlhxc" podUID="4c375e68-a7a1-414b-9d33-3040925415f4" Jul 27 09:50:18.905563 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:18.905204 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qlrkd" Jul 27 09:50:18.905563 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:18.905272 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cl9xw" Jul 27 09:50:18.905563 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:18.905393 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cl9xw" podUID="27f2e8fc-173e-43ff-b7a6-0bd6e8b54d40" Jul 27 09:50:18.905563 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:18.905479 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qlrkd" podUID="081653f9-8f80-4844-b67f-7d8965198bb6" Jul 27 09:50:20.905314 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:20.905262 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cl9xw" Jul 27 09:50:20.905746 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:20.905268 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qlrkd" Jul 27 09:50:20.905746 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:20.905400 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hlhxc" Jul 27 09:50:20.905746 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:20.905393 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cl9xw" podUID="27f2e8fc-173e-43ff-b7a6-0bd6e8b54d40" Jul 27 09:50:20.905746 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:20.905486 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qlrkd" podUID="081653f9-8f80-4844-b67f-7d8965198bb6" Jul 27 09:50:20.905746 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:20.905574 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hlhxc" podUID="4c375e68-a7a1-414b-9d33-3040925415f4" Jul 27 09:50:22.569899 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:22.569245 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/081653f9-8f80-4844-b67f-7d8965198bb6-original-pull-secret\") pod \"global-pull-secret-syncer-qlrkd\" (UID: \"081653f9-8f80-4844-b67f-7d8965198bb6\") " pod="kube-system/global-pull-secret-syncer-qlrkd" Jul 27 09:50:22.569899 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:22.569289 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/27f2e8fc-173e-43ff-b7a6-0bd6e8b54d40-metrics-certs\") pod \"network-metrics-daemon-cl9xw\" (UID: \"27f2e8fc-173e-43ff-b7a6-0bd6e8b54d40\") " pod="openshift-multus/network-metrics-daemon-cl9xw" Jul 27 09:50:22.569899 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:22.569434 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 09:50:22.569899 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:22.569487 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27f2e8fc-173e-43ff-b7a6-0bd6e8b54d40-metrics-certs podName:27f2e8fc-173e-43ff-b7a6-0bd6e8b54d40 nodeName:}" failed. No retries permitted until 2026-07-27 09:50:30.569469245 +0000 UTC m=+17.159966461 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/27f2e8fc-173e-43ff-b7a6-0bd6e8b54d40-metrics-certs") pod "network-metrics-daemon-cl9xw" (UID: "27f2e8fc-173e-43ff-b7a6-0bd6e8b54d40") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 09:50:22.569899 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:22.569814 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 09:50:22.569899 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:22.569867 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/081653f9-8f80-4844-b67f-7d8965198bb6-original-pull-secret podName:081653f9-8f80-4844-b67f-7d8965198bb6 nodeName:}" failed. No retries permitted until 2026-07-27 09:50:30.569851863 +0000 UTC m=+17.160349090 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/081653f9-8f80-4844-b67f-7d8965198bb6-original-pull-secret") pod "global-pull-secret-syncer-qlrkd" (UID: "081653f9-8f80-4844-b67f-7d8965198bb6") : object "kube-system"/"original-pull-secret" not registered Jul 27 09:50:22.670243 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:22.670205 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2jfp\" (UniqueName: \"kubernetes.io/projected/4c375e68-a7a1-414b-9d33-3040925415f4-kube-api-access-r2jfp\") pod \"network-check-target-hlhxc\" (UID: \"4c375e68-a7a1-414b-9d33-3040925415f4\") " pod="openshift-network-diagnostics/network-check-target-hlhxc" Jul 27 09:50:22.670437 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:22.670421 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 09:50:22.670498 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:22.670444 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 09:50:22.670498 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:22.670457 2556 projected.go:196] Error preparing data for projected volume kube-api-access-r2jfp for pod openshift-network-diagnostics/network-check-target-hlhxc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 09:50:22.670613 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:22.670514 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4c375e68-a7a1-414b-9d33-3040925415f4-kube-api-access-r2jfp podName:4c375e68-a7a1-414b-9d33-3040925415f4 nodeName:}" failed. No retries permitted until 2026-07-27 09:50:30.670496196 +0000 UTC m=+17.260993410 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-r2jfp" (UniqueName: "kubernetes.io/projected/4c375e68-a7a1-414b-9d33-3040925415f4-kube-api-access-r2jfp") pod "network-check-target-hlhxc" (UID: "4c375e68-a7a1-414b-9d33-3040925415f4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 09:50:22.905529 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:22.905399 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qlrkd" Jul 27 09:50:22.905529 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:22.905485 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hlhxc" Jul 27 09:50:22.905529 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:22.905455 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cl9xw" Jul 27 09:50:22.905781 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:22.905602 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hlhxc" podUID="4c375e68-a7a1-414b-9d33-3040925415f4" Jul 27 09:50:22.905976 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:22.905951 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qlrkd" podUID="081653f9-8f80-4844-b67f-7d8965198bb6" Jul 27 09:50:22.906094 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:22.906050 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cl9xw" podUID="27f2e8fc-173e-43ff-b7a6-0bd6e8b54d40" Jul 27 09:50:24.905001 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:24.904957 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hlhxc" Jul 27 09:50:24.905001 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:24.904982 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qlrkd" Jul 27 09:50:24.905493 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:24.904957 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cl9xw" Jul 27 09:50:24.905493 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:24.905089 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hlhxc" podUID="4c375e68-a7a1-414b-9d33-3040925415f4" Jul 27 09:50:24.905493 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:24.905163 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qlrkd" podUID="081653f9-8f80-4844-b67f-7d8965198bb6" Jul 27 09:50:24.905493 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:24.905249 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cl9xw" podUID="27f2e8fc-173e-43ff-b7a6-0bd6e8b54d40" Jul 27 09:50:26.904514 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:26.904480 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cl9xw" Jul 27 09:50:26.904952 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:26.904603 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hlhxc" Jul 27 09:50:26.904952 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:26.904611 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cl9xw" podUID="27f2e8fc-173e-43ff-b7a6-0bd6e8b54d40" Jul 27 09:50:26.904952 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:26.904649 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qlrkd" Jul 27 09:50:26.904952 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:26.904741 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hlhxc" podUID="4c375e68-a7a1-414b-9d33-3040925415f4" Jul 27 09:50:26.904952 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:26.904817 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qlrkd" podUID="081653f9-8f80-4844-b67f-7d8965198bb6" Jul 27 09:50:28.904654 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:28.904618 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hlhxc" Jul 27 09:50:28.904654 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:28.904654 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qlrkd" Jul 27 09:50:28.905084 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:28.904729 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cl9xw" Jul 27 09:50:28.905084 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:28.904737 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hlhxc" podUID="4c375e68-a7a1-414b-9d33-3040925415f4" Jul 27 09:50:28.905084 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:28.904818 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qlrkd" podUID="081653f9-8f80-4844-b67f-7d8965198bb6" Jul 27 09:50:28.905084 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:28.904905 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cl9xw" podUID="27f2e8fc-173e-43ff-b7a6-0bd6e8b54d40" Jul 27 09:50:30.634661 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:30.634629 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/081653f9-8f80-4844-b67f-7d8965198bb6-original-pull-secret\") pod \"global-pull-secret-syncer-qlrkd\" (UID: \"081653f9-8f80-4844-b67f-7d8965198bb6\") " pod="kube-system/global-pull-secret-syncer-qlrkd" Jul 27 09:50:30.635182 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:30.634671 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/27f2e8fc-173e-43ff-b7a6-0bd6e8b54d40-metrics-certs\") pod \"network-metrics-daemon-cl9xw\" (UID: \"27f2e8fc-173e-43ff-b7a6-0bd6e8b54d40\") " pod="openshift-multus/network-metrics-daemon-cl9xw" Jul 27 09:50:30.635182 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:30.634817 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 09:50:30.635182 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:30.634820 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 09:50:30.635182 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:30.634881 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27f2e8fc-173e-43ff-b7a6-0bd6e8b54d40-metrics-certs podName:27f2e8fc-173e-43ff-b7a6-0bd6e8b54d40 nodeName:}" failed. No retries permitted until 2026-07-27 09:50:46.63486074 +0000 UTC m=+33.225357968 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/27f2e8fc-173e-43ff-b7a6-0bd6e8b54d40-metrics-certs") pod "network-metrics-daemon-cl9xw" (UID: "27f2e8fc-173e-43ff-b7a6-0bd6e8b54d40") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 09:50:30.635182 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:30.634902 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/081653f9-8f80-4844-b67f-7d8965198bb6-original-pull-secret podName:081653f9-8f80-4844-b67f-7d8965198bb6 nodeName:}" failed. No retries permitted until 2026-07-27 09:50:46.634891588 +0000 UTC m=+33.225388810 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/081653f9-8f80-4844-b67f-7d8965198bb6-original-pull-secret") pod "global-pull-secret-syncer-qlrkd" (UID: "081653f9-8f80-4844-b67f-7d8965198bb6") : object "kube-system"/"original-pull-secret" not registered Jul 27 09:50:30.735291 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:30.735257 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2jfp\" (UniqueName: \"kubernetes.io/projected/4c375e68-a7a1-414b-9d33-3040925415f4-kube-api-access-r2jfp\") pod \"network-check-target-hlhxc\" (UID: \"4c375e68-a7a1-414b-9d33-3040925415f4\") " pod="openshift-network-diagnostics/network-check-target-hlhxc" Jul 27 09:50:30.735470 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:30.735442 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 09:50:30.735470 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:30.735459 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 09:50:30.735470 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:30.735469 2556 projected.go:196] Error preparing data for projected volume kube-api-access-r2jfp for pod openshift-network-diagnostics/network-check-target-hlhxc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 09:50:30.735615 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:30.735524 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4c375e68-a7a1-414b-9d33-3040925415f4-kube-api-access-r2jfp podName:4c375e68-a7a1-414b-9d33-3040925415f4 nodeName:}" failed. No retries permitted until 2026-07-27 09:50:46.735505568 +0000 UTC m=+33.326002803 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-r2jfp" (UniqueName: "kubernetes.io/projected/4c375e68-a7a1-414b-9d33-3040925415f4-kube-api-access-r2jfp") pod "network-check-target-hlhxc" (UID: "4c375e68-a7a1-414b-9d33-3040925415f4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 09:50:30.904974 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:30.904889 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cl9xw" Jul 27 09:50:30.905115 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:30.905014 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cl9xw" podUID="27f2e8fc-173e-43ff-b7a6-0bd6e8b54d40" Jul 27 09:50:30.905115 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:30.904905 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hlhxc" Jul 27 09:50:30.905233 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:30.905127 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hlhxc" podUID="4c375e68-a7a1-414b-9d33-3040925415f4" Jul 27 09:50:30.905233 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:30.905152 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qlrkd" Jul 27 09:50:30.905233 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:30.905213 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qlrkd" podUID="081653f9-8f80-4844-b67f-7d8965198bb6" Jul 27 09:50:32.904831 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:32.904795 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hlhxc" Jul 27 09:50:32.905236 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:32.904842 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qlrkd" Jul 27 09:50:32.905379 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:32.905347 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hlhxc" podUID="4c375e68-a7a1-414b-9d33-3040925415f4" Jul 27 09:50:32.905815 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:32.905798 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cl9xw" Jul 27 09:50:32.905965 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:32.905945 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cl9xw" podUID="27f2e8fc-173e-43ff-b7a6-0bd6e8b54d40" Jul 27 09:50:32.906079 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:32.906062 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qlrkd" podUID="081653f9-8f80-4844-b67f-7d8965198bb6" Jul 27 09:50:34.904777 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:34.904727 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hlhxc" Jul 27 09:50:34.905163 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:34.904826 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qlrkd" Jul 27 09:50:34.905163 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:34.904837 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hlhxc" podUID="4c375e68-a7a1-414b-9d33-3040925415f4" Jul 27 09:50:34.905163 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:34.904850 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cl9xw" Jul 27 09:50:34.905163 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:34.904905 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qlrkd" podUID="081653f9-8f80-4844-b67f-7d8965198bb6" Jul 27 09:50:34.905163 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:34.904964 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cl9xw" podUID="27f2e8fc-173e-43ff-b7a6-0bd6e8b54d40" Jul 27 09:50:35.074144 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:35.074114 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-sxn5x" event={"ID":"876d6010-7686-42f7-86e0-773c644257af","Type":"ContainerStarted","Data":"ffdcfc5af24ac6ff7423702c384ba1bd5251d090f2ac0c4167bf8f5acbfac351"} Jul 27 09:50:35.075568 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:35.075541 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-m9tv9" event={"ID":"23171641-b4dc-46f0-81c3-a556168b3683","Type":"ContainerStarted","Data":"9edbe58ae156f831dc8b876b54f16a930b2e43bb5db6a1ddaa097a9235ed6798"} Jul 27 09:50:35.076751 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:35.076730 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-140.ec2.internal" event={"ID":"d53d4fb2319b8a6bcca414fa1eb18354","Type":"ContainerStarted","Data":"ae0722aae8ae7002ba6b5af8d2ffdbc8afdf416848582a7a4640abc279a5c584"} Jul 27 09:50:35.094442 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:35.094403 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-sxn5x" podStartSLOduration=1.6474255530000002 podStartE2EDuration="21.094391652s" totalImagesPullingTime="19.446966099s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 09:50:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 09:50:35.094015532 +0000 UTC m=+21.684512763" watchObservedRunningTime="2026-07-27 09:50:35.094391652 +0000 UTC m=+21.684888884" Jul 27 09:50:35.130376 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:35.130337 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-140.ec2.internal" podStartSLOduration=21.130324198 podStartE2EDuration="21.130324198s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 09:50:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 09:50:35.130093136 +0000 UTC m=+21.720590369" watchObservedRunningTime="2026-07-27 09:50:35.130324198 +0000 UTC m=+21.720821421" Jul 27 09:50:35.130494 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:35.130475 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-m9tv9" podStartSLOduration=1.681528452 podStartE2EDuration="21.130468625s" totalImagesPullingTime="19.448940173s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 09:50:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 09:50:35.113558466 +0000 UTC m=+21.704055709" watchObservedRunningTime="2026-07-27 09:50:35.130468625 +0000 UTC m=+21.720965859" Jul 27 09:50:36.080663 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:36.080334 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7xmw" event={"ID":"c741cd56-6ff5-43be-aafd-a38247f7f11c","Type":"ContainerStarted","Data":"1742beb0a4c81bce7b703cb70cd2fc7c52f914de6214e5bd432f2f96ea2725d3"} Jul 27 09:50:36.081686 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:36.081661 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-sxq7r" event={"ID":"be638d62-c9e5-4e50-ac56-253fa74e20c1","Type":"ContainerStarted","Data":"af0985b34a9421f61b40d510b0623b0fd03daea14ccf59f6a30acbd31a2173b8"} Jul 27 09:50:36.082908 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:36.082887 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wgfkj" event={"ID":"3400c9d3-50c8-4143-83fb-e22dbe5b627a","Type":"ContainerStarted","Data":"3f46fa7b07fdb6f082f64d17e37da2435f870a7728e5c7b1a88cfd03b3a6eb36"} Jul 27 09:50:36.084113 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:36.084094 2556 generic.go:356] "Generic (PLEG): container finished" podID="1b03c9b33b3bb819e7a8014427f1b4d7" containerID="ff0d30eed62574e9ce7429d134f0c38d3cb6a079294c97c9fa25592eae659ca4" exitCode=0 Jul 27 09:50:36.084204 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:36.084171 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-140.ec2.internal" event={"ID":"1b03c9b33b3bb819e7a8014427f1b4d7","Type":"ContainerDied","Data":"ff0d30eed62574e9ce7429d134f0c38d3cb6a079294c97c9fa25592eae659ca4"} Jul 27 09:50:36.087085 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:36.087065 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ph68r" event={"ID":"e722c870-2401-4465-a42b-c9e3305f15c2","Type":"ContainerStarted","Data":"33a30255f1b923c57e3155765a9ea5c47a7219430579fb7133eb2a6f2f854a86"} Jul 27 09:50:36.087154 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:36.087139 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ph68r" event={"ID":"e722c870-2401-4465-a42b-c9e3305f15c2","Type":"ContainerStarted","Data":"40e985f1463cbc622126ed91909439c28ca1e25293b12291a30ecc3927f057ef"} Jul 27 09:50:36.087204 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:36.087192 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ph68r" event={"ID":"e722c870-2401-4465-a42b-c9e3305f15c2","Type":"ContainerStarted","Data":"8cd97f1ce219bd5aa4828c09a10267935198db5f9ba2542142f6f76276581075"} Jul 27 09:50:36.087255 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:36.087240 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ph68r" event={"ID":"e722c870-2401-4465-a42b-c9e3305f15c2","Type":"ContainerStarted","Data":"157af387694d3e33218f7668019d27714638bdae5f63b37200d54a0f8a5a2a04"} Jul 27 09:50:36.087322 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:36.087294 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ph68r" event={"ID":"e722c870-2401-4465-a42b-c9e3305f15c2","Type":"ContainerStarted","Data":"cef41b63954b1444e056a82c62e75a8d0c4ed5affe2cd70260ecd45f83c782a1"} Jul 27 09:50:36.087374 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:36.087360 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ph68r" event={"ID":"e722c870-2401-4465-a42b-c9e3305f15c2","Type":"ContainerStarted","Data":"98b45bf994c33e3900edf458a091968216eae22b76b6893adb54a755bdf9358d"} Jul 27 09:50:36.088481 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:36.088453 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7sb2h" event={"ID":"c5018771-30e7-4be6-9603-43580e63bde0","Type":"ContainerStarted","Data":"48b992fdbc881a01ff331b4c6bac7764205e966177d4238c7fc8a6ef40902c28"} Jul 27 09:50:36.089759 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:36.089742 2556 generic.go:356] "Generic (PLEG): container finished" podID="b4deab12-8c9e-4151-81f3-6c87e474578e" containerID="a9ff603229a38cd557b219ac40c5b6219a2eba674c6384d5c5e211f1a72e19c4" exitCode=0 Jul 27 09:50:36.089833 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:36.089797 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w2txx" event={"ID":"b4deab12-8c9e-4151-81f3-6c87e474578e","Type":"ContainerDied","Data":"a9ff603229a38cd557b219ac40c5b6219a2eba674c6384d5c5e211f1a72e19c4"} Jul 27 09:50:36.091098 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:36.091078 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4mdxm" event={"ID":"c01da73c-3338-41bb-884a-f7c145421d57","Type":"ContainerStarted","Data":"2a18286f3c45dccf1a0c2373f7a4d0095cec06882671b6c4a76583d9bb299ab4"} Jul 27 09:50:36.102563 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:36.102532 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-sxq7r" podStartSLOduration=3.618939147 podStartE2EDuration="23.102520366s" totalImagesPullingTime="19.483581219s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 09:50:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 09:50:36.102047336 +0000 UTC m=+22.692544568" watchObservedRunningTime="2026-07-27 09:50:36.102520366 +0000 UTC m=+22.693017601" Jul 27 09:50:36.118875 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:36.118843 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-7sb2h" podStartSLOduration=2.7824706409999997 podStartE2EDuration="22.118833415s" totalImagesPullingTime="19.336362774s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 09:50:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 09:50:36.118253513 +0000 UTC m=+22.708750758" watchObservedRunningTime="2026-07-27 09:50:36.118833415 +0000 UTC m=+22.709330646" Jul 27 09:50:36.139702 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:36.139654 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-4mdxm" podStartSLOduration=2.701979692 podStartE2EDuration="22.139641601s" totalImagesPullingTime="19.437661909s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 09:50:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 09:50:36.139567576 +0000 UTC m=+22.730064809" watchObservedRunningTime="2026-07-27 09:50:36.139641601 +0000 UTC m=+22.730138833" Jul 27 09:50:36.641217 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:36.641195 2556 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 27 09:50:36.748846 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:36.748817 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-sxq7r" Jul 27 09:50:36.749420 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:36.749402 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-sxq7r" Jul 27 09:50:36.768398 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:36.768355 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-wgfkj" podStartSLOduration=11.489981155 podStartE2EDuration="22.768341622s" totalImagesPullingTime="11.278360467s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 09:50:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 09:50:36.19708441 +0000 UTC m=+22.787581644" watchObservedRunningTime="2026-07-27 09:50:36.768341622 +0000 UTC m=+23.358838856" Jul 27 09:50:36.870197 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:36.870093 2556 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-27T09:50:36.641212255Z","UUID":"f3c8e348-8c47-4188-a632-3dc97cc0cc55","Handler":null,"Name":"","Endpoint":""} Jul 27 09:50:36.871863 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:36.871842 2556 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 27 09:50:36.871961 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:36.871886 2556 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 27 09:50:36.905202 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:36.905181 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hlhxc" Jul 27 09:50:36.905338 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:36.905251 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qlrkd" Jul 27 09:50:36.905396 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:36.905355 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cl9xw" Jul 27 09:50:36.905396 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:36.905368 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hlhxc" podUID="4c375e68-a7a1-414b-9d33-3040925415f4" Jul 27 09:50:36.905499 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:36.905475 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cl9xw" podUID="27f2e8fc-173e-43ff-b7a6-0bd6e8b54d40" Jul 27 09:50:36.905569 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:36.905553 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qlrkd" podUID="081653f9-8f80-4844-b67f-7d8965198bb6" Jul 27 09:50:37.095121 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:37.095090 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7xmw" event={"ID":"c741cd56-6ff5-43be-aafd-a38247f7f11c","Type":"ContainerStarted","Data":"c9c9c9631b136c32f0bb021d04bbe01b472652509eaa7421cd12d51afcad680c"} Jul 27 09:50:37.096896 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:37.096859 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-140.ec2.internal" event={"ID":"1b03c9b33b3bb819e7a8014427f1b4d7","Type":"ContainerStarted","Data":"0a0ce8e3cf22d0513d564391f77175d645e1d5e4d5577b3ab8d76e2d033b0777"} Jul 27 09:50:37.097113 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:37.097100 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-sxq7r" Jul 27 09:50:37.097562 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:37.097537 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-sxq7r" Jul 27 09:50:37.114949 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:37.114905 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-140.ec2.internal" podStartSLOduration=23.114888014 podStartE2EDuration="23.114888014s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 09:50:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 09:50:37.114408985 +0000 UTC m=+23.704906220" watchObservedRunningTime="2026-07-27 09:50:37.114888014 +0000 UTC m=+23.705385248" Jul 27 09:50:38.103514 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:38.103435 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ph68r" event={"ID":"e722c870-2401-4465-a42b-c9e3305f15c2","Type":"ContainerStarted","Data":"5ffe0d4e15cc77cd9bd056bad11e5d6847aceb253e01ddb88aaf6ce99335a2eb"} Jul 27 09:50:38.105650 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:38.105605 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7xmw" event={"ID":"c741cd56-6ff5-43be-aafd-a38247f7f11c","Type":"ContainerStarted","Data":"b1d610fe63758523d2588349b794135bda86cfa4a8e3b14471ef3e7babaf9cf9"} Jul 27 09:50:38.905077 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:38.905050 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hlhxc" Jul 27 09:50:38.905372 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:38.905151 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qlrkd" Jul 27 09:50:38.905372 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:38.905163 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hlhxc" podUID="4c375e68-a7a1-414b-9d33-3040925415f4" Jul 27 09:50:38.905372 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:38.905184 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cl9xw" Jul 27 09:50:38.905372 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:38.905280 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qlrkd" podUID="081653f9-8f80-4844-b67f-7d8965198bb6" Jul 27 09:50:38.905591 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:38.905381 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cl9xw" podUID="27f2e8fc-173e-43ff-b7a6-0bd6e8b54d40" Jul 27 09:50:40.904949 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:40.904757 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hlhxc" Jul 27 09:50:40.905612 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:40.904815 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qlrkd" Jul 27 09:50:40.905612 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:40.904976 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hlhxc" podUID="4c375e68-a7a1-414b-9d33-3040925415f4" Jul 27 09:50:40.905612 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:40.905052 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qlrkd" podUID="081653f9-8f80-4844-b67f-7d8965198bb6" Jul 27 09:50:40.905612 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:40.904820 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cl9xw" Jul 27 09:50:40.905612 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:40.905110 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cl9xw" podUID="27f2e8fc-173e-43ff-b7a6-0bd6e8b54d40" Jul 27 09:50:41.113926 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:41.113901 2556 generic.go:356] "Generic (PLEG): container finished" podID="b4deab12-8c9e-4151-81f3-6c87e474578e" containerID="c64ba72389b62cb9a6b70e18b91d1c0b3e8bce0649fbd1eea57dd6cbda4ffb1d" exitCode=0 Jul 27 09:50:41.114069 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:41.113931 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w2txx" event={"ID":"b4deab12-8c9e-4151-81f3-6c87e474578e","Type":"ContainerDied","Data":"c64ba72389b62cb9a6b70e18b91d1c0b3e8bce0649fbd1eea57dd6cbda4ffb1d"} Jul 27 09:50:41.117551 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:41.117530 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ph68r" event={"ID":"e722c870-2401-4465-a42b-c9e3305f15c2","Type":"ContainerStarted","Data":"2d266432a70b2bcd849704d02fdc8bfa9974e644382ca643ea44fa411e45719f"} Jul 27 09:50:41.117780 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:41.117765 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ph68r" Jul 27 09:50:41.117858 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:41.117810 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ph68r" Jul 27 09:50:41.117858 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:41.117852 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ph68r" Jul 27 09:50:41.132945 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:41.132928 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ph68r" Jul 27 09:50:41.133130 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:41.133120 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ph68r" Jul 27 09:50:41.148190 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:41.146611 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7xmw" podStartSLOduration=6.234842745 podStartE2EDuration="28.146594328s" totalImagesPullingTime="21.911751583s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 09:50:13 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 09:50:38.12572414 +0000 UTC m=+24.716221373" watchObservedRunningTime="2026-07-27 09:50:41.146594328 +0000 UTC m=+27.737091564" Jul 27 09:50:41.184708 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:41.184645 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-ph68r" podStartSLOduration=7.28335439 podStartE2EDuration="27.184633655s" totalImagesPullingTime="19.901279265s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 09:50:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 09:50:41.184425338 +0000 UTC m=+27.774922570" watchObservedRunningTime="2026-07-27 09:50:41.184633655 +0000 UTC m=+27.775130886" Jul 27 09:50:42.699100 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:42.698871 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qlrkd"] Jul 27 09:50:42.699479 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:42.699119 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qlrkd" Jul 27 09:50:42.699479 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:42.699200 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qlrkd" podUID="081653f9-8f80-4844-b67f-7d8965198bb6" Jul 27 09:50:42.702166 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:42.702145 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hlhxc"] Jul 27 09:50:42.702287 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:42.702240 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hlhxc" Jul 27 09:50:42.702367 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:42.702349 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hlhxc" podUID="4c375e68-a7a1-414b-9d33-3040925415f4" Jul 27 09:50:42.705389 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:42.705368 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-cl9xw"] Jul 27 09:50:42.705458 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:42.705451 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cl9xw" Jul 27 09:50:42.705554 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:42.705537 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cl9xw" podUID="27f2e8fc-173e-43ff-b7a6-0bd6e8b54d40" Jul 27 09:50:43.123453 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:43.123423 2556 generic.go:356] "Generic (PLEG): container finished" podID="b4deab12-8c9e-4151-81f3-6c87e474578e" containerID="d4bc5cc8e54436cee898bc4a1e7d30850afd443fa407463ec20b2e944222d758" exitCode=0 Jul 27 09:50:43.123594 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:43.123484 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w2txx" event={"ID":"b4deab12-8c9e-4151-81f3-6c87e474578e","Type":"ContainerDied","Data":"d4bc5cc8e54436cee898bc4a1e7d30850afd443fa407463ec20b2e944222d758"} Jul 27 09:50:43.905912 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:43.905880 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cl9xw" Jul 27 09:50:43.906352 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:43.905999 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hlhxc" Jul 27 09:50:43.906352 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:43.906013 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cl9xw" podUID="27f2e8fc-173e-43ff-b7a6-0bd6e8b54d40" Jul 27 09:50:43.906352 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:43.906048 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qlrkd" Jul 27 09:50:43.906352 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:43.906135 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hlhxc" podUID="4c375e68-a7a1-414b-9d33-3040925415f4" Jul 27 09:50:43.906352 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:43.906246 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qlrkd" podUID="081653f9-8f80-4844-b67f-7d8965198bb6" Jul 27 09:50:45.130124 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:45.130096 2556 generic.go:356] "Generic (PLEG): container finished" podID="b4deab12-8c9e-4151-81f3-6c87e474578e" containerID="a54c03847e75b0824656293a15bbc5f597675effd9111b06f16933b485993ac0" exitCode=0 Jul 27 09:50:45.130571 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:45.130153 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w2txx" event={"ID":"b4deab12-8c9e-4151-81f3-6c87e474578e","Type":"ContainerDied","Data":"a54c03847e75b0824656293a15bbc5f597675effd9111b06f16933b485993ac0"} Jul 27 09:50:45.905264 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:45.905227 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qlrkd" Jul 27 09:50:45.905441 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:45.905231 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cl9xw" Jul 27 09:50:45.905441 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:45.905366 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qlrkd" podUID="081653f9-8f80-4844-b67f-7d8965198bb6" Jul 27 09:50:45.905441 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:45.905243 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hlhxc" Jul 27 09:50:45.905441 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:45.905421 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cl9xw" podUID="27f2e8fc-173e-43ff-b7a6-0bd6e8b54d40" Jul 27 09:50:45.905648 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:45.905466 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hlhxc" podUID="4c375e68-a7a1-414b-9d33-3040925415f4" Jul 27 09:50:46.666133 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:46.666103 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/081653f9-8f80-4844-b67f-7d8965198bb6-original-pull-secret\") pod \"global-pull-secret-syncer-qlrkd\" (UID: \"081653f9-8f80-4844-b67f-7d8965198bb6\") " pod="kube-system/global-pull-secret-syncer-qlrkd" Jul 27 09:50:46.666518 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:46.666148 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/27f2e8fc-173e-43ff-b7a6-0bd6e8b54d40-metrics-certs\") pod \"network-metrics-daemon-cl9xw\" (UID: \"27f2e8fc-173e-43ff-b7a6-0bd6e8b54d40\") " pod="openshift-multus/network-metrics-daemon-cl9xw" Jul 27 09:50:46.666518 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:46.666245 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 09:50:46.666518 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:46.666250 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 09:50:46.666518 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:46.666293 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27f2e8fc-173e-43ff-b7a6-0bd6e8b54d40-metrics-certs podName:27f2e8fc-173e-43ff-b7a6-0bd6e8b54d40 nodeName:}" failed. No retries permitted until 2026-07-27 09:51:18.666281872 +0000 UTC m=+65.256779083 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/27f2e8fc-173e-43ff-b7a6-0bd6e8b54d40-metrics-certs") pod "network-metrics-daemon-cl9xw" (UID: "27f2e8fc-173e-43ff-b7a6-0bd6e8b54d40") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 09:50:46.666518 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:46.666320 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/081653f9-8f80-4844-b67f-7d8965198bb6-original-pull-secret podName:081653f9-8f80-4844-b67f-7d8965198bb6 nodeName:}" failed. No retries permitted until 2026-07-27 09:51:18.666313489 +0000 UTC m=+65.256810704 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/081653f9-8f80-4844-b67f-7d8965198bb6-original-pull-secret") pod "global-pull-secret-syncer-qlrkd" (UID: "081653f9-8f80-4844-b67f-7d8965198bb6") : object "kube-system"/"original-pull-secret" not registered Jul 27 09:50:46.766607 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:46.766572 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2jfp\" (UniqueName: \"kubernetes.io/projected/4c375e68-a7a1-414b-9d33-3040925415f4-kube-api-access-r2jfp\") pod \"network-check-target-hlhxc\" (UID: \"4c375e68-a7a1-414b-9d33-3040925415f4\") " pod="openshift-network-diagnostics/network-check-target-hlhxc" Jul 27 09:50:46.766766 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:46.766728 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 09:50:46.766766 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:46.766754 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 09:50:46.766766 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:46.766767 2556 projected.go:196] Error preparing data for projected volume kube-api-access-r2jfp for pod openshift-network-diagnostics/network-check-target-hlhxc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 09:50:46.766914 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:46.766823 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4c375e68-a7a1-414b-9d33-3040925415f4-kube-api-access-r2jfp podName:4c375e68-a7a1-414b-9d33-3040925415f4 nodeName:}" failed. No retries permitted until 2026-07-27 09:51:18.766803931 +0000 UTC m=+65.357301162 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-r2jfp" (UniqueName: "kubernetes.io/projected/4c375e68-a7a1-414b-9d33-3040925415f4-kube-api-access-r2jfp") pod "network-check-target-hlhxc" (UID: "4c375e68-a7a1-414b-9d33-3040925415f4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 09:50:47.905272 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:47.905239 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hlhxc" Jul 27 09:50:47.905272 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:47.905279 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qlrkd" Jul 27 09:50:47.905708 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:47.905239 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cl9xw" Jul 27 09:50:47.905708 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:47.905373 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hlhxc" podUID="4c375e68-a7a1-414b-9d33-3040925415f4" Jul 27 09:50:47.905708 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:47.905461 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cl9xw" podUID="27f2e8fc-173e-43ff-b7a6-0bd6e8b54d40" Jul 27 09:50:47.905708 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:47.905549 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qlrkd" podUID="081653f9-8f80-4844-b67f-7d8965198bb6" Jul 27 09:50:48.769656 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:48.769437 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-140.ec2.internal" event="NodeReady" Jul 27 09:50:48.769800 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:48.769711 2556 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 27 09:50:48.806926 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:48.806889 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-dsz8p"] Jul 27 09:50:48.811655 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:48.811629 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-65fb7b8f98-flrh7"] Jul 27 09:50:48.811798 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:48.811778 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-dsz8p" Jul 27 09:50:48.815282 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:48.814763 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-dpjwc\"" Jul 27 09:50:48.815282 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:48.814863 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65fb7b8f98-flrh7" Jul 27 09:50:48.815282 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:48.814943 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 27 09:50:48.815282 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:48.814963 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 27 09:50:48.817406 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:48.817387 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 27 09:50:48.817672 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:48.817655 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 27 09:50:48.817757 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:48.817718 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 27 09:50:48.818055 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:48.818026 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-5qft4\"" Jul 27 09:50:48.823419 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:48.823207 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-dsz8p"] Jul 27 09:50:48.824354 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:48.824338 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-p5w7g"] Jul 27 09:50:48.824447 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:48.824371 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 27 09:50:48.829020 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:48.828859 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-hbcw9"] Jul 27 09:50:48.831912 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:48.830048 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-p5w7g" Jul 27 09:50:48.833591 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:48.833566 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 27 09:50:48.833686 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:48.833664 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-r9nsb\"" Jul 27 09:50:48.833757 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:48.833703 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 27 09:50:48.835131 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:48.835110 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-65fb7b8f98-flrh7"] Jul 27 09:50:48.835223 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:48.835195 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hbcw9" Jul 27 09:50:48.837843 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:48.837826 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-hlctp\"" Jul 27 09:50:48.838051 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:48.838032 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 27 09:50:48.838277 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:48.838220 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 27 09:50:48.839200 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:48.839179 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hbcw9"] Jul 27 09:50:48.839406 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:48.839372 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 27 09:50:48.842723 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:48.842039 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-p5w7g"] Jul 27 09:50:48.986745 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:48.986710 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6b9360ad-3b69-4a8d-b35f-cb88207a26d0-image-registry-private-configuration\") pod \"image-registry-65fb7b8f98-flrh7\" (UID: \"6b9360ad-3b69-4a8d-b35f-cb88207a26d0\") " pod="openshift-image-registry/image-registry-65fb7b8f98-flrh7" Jul 27 09:50:48.987160 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:48.986750 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6b9360ad-3b69-4a8d-b35f-cb88207a26d0-installation-pull-secrets\") pod \"image-registry-65fb7b8f98-flrh7\" (UID: \"6b9360ad-3b69-4a8d-b35f-cb88207a26d0\") " pod="openshift-image-registry/image-registry-65fb7b8f98-flrh7" Jul 27 09:50:48.987160 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:48.986774 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3de4b7d7-40ed-495d-b81a-fecb048d11c0-tmp-dir\") pod \"dns-default-p5w7g\" (UID: \"3de4b7d7-40ed-495d-b81a-fecb048d11c0\") " pod="openshift-dns/dns-default-p5w7g" Jul 27 09:50:48.987160 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:48.986800 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6b9360ad-3b69-4a8d-b35f-cb88207a26d0-trusted-ca\") pod \"image-registry-65fb7b8f98-flrh7\" (UID: \"6b9360ad-3b69-4a8d-b35f-cb88207a26d0\") " pod="openshift-image-registry/image-registry-65fb7b8f98-flrh7" Jul 27 09:50:48.987160 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:48.986871 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8t6q\" (UniqueName: \"kubernetes.io/projected/6b9360ad-3b69-4a8d-b35f-cb88207a26d0-kube-api-access-r8t6q\") pod \"image-registry-65fb7b8f98-flrh7\" (UID: \"6b9360ad-3b69-4a8d-b35f-cb88207a26d0\") " pod="openshift-image-registry/image-registry-65fb7b8f98-flrh7" Jul 27 09:50:48.987160 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:48.986907 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3de4b7d7-40ed-495d-b81a-fecb048d11c0-metrics-tls\") pod \"dns-default-p5w7g\" (UID: \"3de4b7d7-40ed-495d-b81a-fecb048d11c0\") " pod="openshift-dns/dns-default-p5w7g" Jul 27 09:50:48.987160 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:48.986955 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2daea300-7a7e-412b-a226-b0214ffe75a3-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-dsz8p\" (UID: \"2daea300-7a7e-412b-a226-b0214ffe75a3\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-dsz8p" Jul 27 09:50:48.987160 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:48.986982 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fcn67\" (UniqueName: \"kubernetes.io/projected/96a91a1b-f1c8-4710-9473-3c032767f309-kube-api-access-fcn67\") pod \"ingress-canary-hbcw9\" (UID: \"96a91a1b-f1c8-4710-9473-3c032767f309\") " pod="openshift-ingress-canary/ingress-canary-hbcw9" Jul 27 09:50:48.987160 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:48.987046 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6b9360ad-3b69-4a8d-b35f-cb88207a26d0-registry-tls\") pod \"image-registry-65fb7b8f98-flrh7\" (UID: \"6b9360ad-3b69-4a8d-b35f-cb88207a26d0\") " pod="openshift-image-registry/image-registry-65fb7b8f98-flrh7" Jul 27 09:50:48.987160 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:48.987102 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3de4b7d7-40ed-495d-b81a-fecb048d11c0-config-volume\") pod \"dns-default-p5w7g\" (UID: \"3de4b7d7-40ed-495d-b81a-fecb048d11c0\") " pod="openshift-dns/dns-default-p5w7g" Jul 27 09:50:48.987160 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:48.987128 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2daea300-7a7e-412b-a226-b0214ffe75a3-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-dsz8p\" (UID: \"2daea300-7a7e-412b-a226-b0214ffe75a3\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-dsz8p" Jul 27 09:50:48.987160 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:48.987151 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6b9360ad-3b69-4a8d-b35f-cb88207a26d0-registry-certificates\") pod \"image-registry-65fb7b8f98-flrh7\" (UID: \"6b9360ad-3b69-4a8d-b35f-cb88207a26d0\") " pod="openshift-image-registry/image-registry-65fb7b8f98-flrh7" Jul 27 09:50:48.987572 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:48.987176 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7znn\" (UniqueName: \"kubernetes.io/projected/3de4b7d7-40ed-495d-b81a-fecb048d11c0-kube-api-access-w7znn\") pod \"dns-default-p5w7g\" (UID: \"3de4b7d7-40ed-495d-b81a-fecb048d11c0\") " pod="openshift-dns/dns-default-p5w7g" Jul 27 09:50:48.987572 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:48.987249 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6b9360ad-3b69-4a8d-b35f-cb88207a26d0-ca-trust-extracted\") pod \"image-registry-65fb7b8f98-flrh7\" (UID: \"6b9360ad-3b69-4a8d-b35f-cb88207a26d0\") " pod="openshift-image-registry/image-registry-65fb7b8f98-flrh7" Jul 27 09:50:48.987572 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:48.987287 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/96a91a1b-f1c8-4710-9473-3c032767f309-cert\") pod \"ingress-canary-hbcw9\" (UID: \"96a91a1b-f1c8-4710-9473-3c032767f309\") " pod="openshift-ingress-canary/ingress-canary-hbcw9" Jul 27 09:50:48.987572 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:48.987337 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6b9360ad-3b69-4a8d-b35f-cb88207a26d0-bound-sa-token\") pod \"image-registry-65fb7b8f98-flrh7\" (UID: \"6b9360ad-3b69-4a8d-b35f-cb88207a26d0\") " pod="openshift-image-registry/image-registry-65fb7b8f98-flrh7" Jul 27 09:50:49.087972 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:49.087940 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6b9360ad-3b69-4a8d-b35f-cb88207a26d0-trusted-ca\") pod \"image-registry-65fb7b8f98-flrh7\" (UID: \"6b9360ad-3b69-4a8d-b35f-cb88207a26d0\") " pod="openshift-image-registry/image-registry-65fb7b8f98-flrh7" Jul 27 09:50:49.087972 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:49.087974 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8t6q\" (UniqueName: \"kubernetes.io/projected/6b9360ad-3b69-4a8d-b35f-cb88207a26d0-kube-api-access-r8t6q\") pod \"image-registry-65fb7b8f98-flrh7\" (UID: \"6b9360ad-3b69-4a8d-b35f-cb88207a26d0\") " pod="openshift-image-registry/image-registry-65fb7b8f98-flrh7" Jul 27 09:50:49.088199 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:49.087989 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3de4b7d7-40ed-495d-b81a-fecb048d11c0-metrics-tls\") pod \"dns-default-p5w7g\" (UID: \"3de4b7d7-40ed-495d-b81a-fecb048d11c0\") " pod="openshift-dns/dns-default-p5w7g" Jul 27 09:50:49.088199 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:49.088012 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2daea300-7a7e-412b-a226-b0214ffe75a3-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-dsz8p\" (UID: \"2daea300-7a7e-412b-a226-b0214ffe75a3\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-dsz8p" Jul 27 09:50:49.088199 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:49.088035 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcn67\" (UniqueName: \"kubernetes.io/projected/96a91a1b-f1c8-4710-9473-3c032767f309-kube-api-access-fcn67\") pod \"ingress-canary-hbcw9\" (UID: \"96a91a1b-f1c8-4710-9473-3c032767f309\") " pod="openshift-ingress-canary/ingress-canary-hbcw9" Jul 27 09:50:49.088199 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:49.088088 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6b9360ad-3b69-4a8d-b35f-cb88207a26d0-registry-tls\") pod \"image-registry-65fb7b8f98-flrh7\" (UID: \"6b9360ad-3b69-4a8d-b35f-cb88207a26d0\") " pod="openshift-image-registry/image-registry-65fb7b8f98-flrh7" Jul 27 09:50:49.088199 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:49.088123 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3de4b7d7-40ed-495d-b81a-fecb048d11c0-config-volume\") pod \"dns-default-p5w7g\" (UID: \"3de4b7d7-40ed-495d-b81a-fecb048d11c0\") " pod="openshift-dns/dns-default-p5w7g" Jul 27 09:50:49.088199 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:49.088127 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 27 09:50:49.088199 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:49.088196 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3de4b7d7-40ed-495d-b81a-fecb048d11c0-metrics-tls podName:3de4b7d7-40ed-495d-b81a-fecb048d11c0 nodeName:}" failed. No retries permitted until 2026-07-27 09:50:49.5881744 +0000 UTC m=+36.178671611 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3de4b7d7-40ed-495d-b81a-fecb048d11c0-metrics-tls") pod "dns-default-p5w7g" (UID: "3de4b7d7-40ed-495d-b81a-fecb048d11c0") : secret "dns-default-metrics-tls" not found Jul 27 09:50:49.088566 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:49.088200 2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 27 09:50:49.088566 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:49.088133 2556 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 27 09:50:49.088566 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:49.088216 2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65fb7b8f98-flrh7: secret "image-registry-tls" not found Jul 27 09:50:49.088566 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:49.088242 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2daea300-7a7e-412b-a226-b0214ffe75a3-networking-console-plugin-cert podName:2daea300-7a7e-412b-a226-b0214ffe75a3 nodeName:}" failed. No retries permitted until 2026-07-27 09:50:49.588231915 +0000 UTC m=+36.178729133 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2daea300-7a7e-412b-a226-b0214ffe75a3-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-dsz8p" (UID: "2daea300-7a7e-412b-a226-b0214ffe75a3") : secret "networking-console-plugin-cert" not found Jul 27 09:50:49.088566 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:49.088265 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6b9360ad-3b69-4a8d-b35f-cb88207a26d0-registry-tls podName:6b9360ad-3b69-4a8d-b35f-cb88207a26d0 nodeName:}" failed. No retries permitted until 2026-07-27 09:50:49.588249794 +0000 UTC m=+36.178747007 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6b9360ad-3b69-4a8d-b35f-cb88207a26d0-registry-tls") pod "image-registry-65fb7b8f98-flrh7" (UID: "6b9360ad-3b69-4a8d-b35f-cb88207a26d0") : secret "image-registry-tls" not found Jul 27 09:50:49.088566 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:49.088286 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2daea300-7a7e-412b-a226-b0214ffe75a3-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-dsz8p\" (UID: \"2daea300-7a7e-412b-a226-b0214ffe75a3\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-dsz8p" Jul 27 09:50:49.088566 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:49.088341 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6b9360ad-3b69-4a8d-b35f-cb88207a26d0-registry-certificates\") pod \"image-registry-65fb7b8f98-flrh7\" (UID: \"6b9360ad-3b69-4a8d-b35f-cb88207a26d0\") " pod="openshift-image-registry/image-registry-65fb7b8f98-flrh7" Jul 27 09:50:49.088566 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:49.088367 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7znn\" (UniqueName: \"kubernetes.io/projected/3de4b7d7-40ed-495d-b81a-fecb048d11c0-kube-api-access-w7znn\") pod \"dns-default-p5w7g\" (UID: \"3de4b7d7-40ed-495d-b81a-fecb048d11c0\") " pod="openshift-dns/dns-default-p5w7g" Jul 27 09:50:49.088566 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:49.088462 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6b9360ad-3b69-4a8d-b35f-cb88207a26d0-ca-trust-extracted\") pod \"image-registry-65fb7b8f98-flrh7\" (UID: \"6b9360ad-3b69-4a8d-b35f-cb88207a26d0\") " pod="openshift-image-registry/image-registry-65fb7b8f98-flrh7" Jul 27 09:50:49.088566 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:49.088496 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/96a91a1b-f1c8-4710-9473-3c032767f309-cert\") pod \"ingress-canary-hbcw9\" (UID: \"96a91a1b-f1c8-4710-9473-3c032767f309\") " pod="openshift-ingress-canary/ingress-canary-hbcw9" Jul 27 09:50:49.088566 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:49.088522 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6b9360ad-3b69-4a8d-b35f-cb88207a26d0-bound-sa-token\") pod \"image-registry-65fb7b8f98-flrh7\" (UID: \"6b9360ad-3b69-4a8d-b35f-cb88207a26d0\") " pod="openshift-image-registry/image-registry-65fb7b8f98-flrh7" Jul 27 09:50:49.088566 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:49.088564 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6b9360ad-3b69-4a8d-b35f-cb88207a26d0-image-registry-private-configuration\") pod \"image-registry-65fb7b8f98-flrh7\" (UID: \"6b9360ad-3b69-4a8d-b35f-cb88207a26d0\") " pod="openshift-image-registry/image-registry-65fb7b8f98-flrh7" Jul 27 09:50:49.089118 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:49.088591 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6b9360ad-3b69-4a8d-b35f-cb88207a26d0-installation-pull-secrets\") pod \"image-registry-65fb7b8f98-flrh7\" (UID: \"6b9360ad-3b69-4a8d-b35f-cb88207a26d0\") " pod="openshift-image-registry/image-registry-65fb7b8f98-flrh7" Jul 27 09:50:49.089118 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:49.088615 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3de4b7d7-40ed-495d-b81a-fecb048d11c0-tmp-dir\") pod \"dns-default-p5w7g\" (UID: \"3de4b7d7-40ed-495d-b81a-fecb048d11c0\") " pod="openshift-dns/dns-default-p5w7g" Jul 27 09:50:49.089118 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:49.088848 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6b9360ad-3b69-4a8d-b35f-cb88207a26d0-ca-trust-extracted\") pod \"image-registry-65fb7b8f98-flrh7\" (UID: \"6b9360ad-3b69-4a8d-b35f-cb88207a26d0\") " pod="openshift-image-registry/image-registry-65fb7b8f98-flrh7" Jul 27 09:50:49.089118 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:49.088902 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3de4b7d7-40ed-495d-b81a-fecb048d11c0-tmp-dir\") pod \"dns-default-p5w7g\" (UID: \"3de4b7d7-40ed-495d-b81a-fecb048d11c0\") " pod="openshift-dns/dns-default-p5w7g" Jul 27 09:50:49.089118 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:49.088945 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3de4b7d7-40ed-495d-b81a-fecb048d11c0-config-volume\") pod \"dns-default-p5w7g\" (UID: \"3de4b7d7-40ed-495d-b81a-fecb048d11c0\") " pod="openshift-dns/dns-default-p5w7g" Jul 27 09:50:49.089118 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:49.088989 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6b9360ad-3b69-4a8d-b35f-cb88207a26d0-registry-certificates\") pod \"image-registry-65fb7b8f98-flrh7\" (UID: \"6b9360ad-3b69-4a8d-b35f-cb88207a26d0\") " pod="openshift-image-registry/image-registry-65fb7b8f98-flrh7" Jul 27 09:50:49.089118 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:49.089105 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2daea300-7a7e-412b-a226-b0214ffe75a3-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-dsz8p\" (UID: \"2daea300-7a7e-412b-a226-b0214ffe75a3\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-dsz8p" Jul 27 09:50:49.089551 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:49.089530 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6b9360ad-3b69-4a8d-b35f-cb88207a26d0-trusted-ca\") pod \"image-registry-65fb7b8f98-flrh7\" (UID: \"6b9360ad-3b69-4a8d-b35f-cb88207a26d0\") " pod="openshift-image-registry/image-registry-65fb7b8f98-flrh7" Jul 27 09:50:49.092822 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:49.092799 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6b9360ad-3b69-4a8d-b35f-cb88207a26d0-installation-pull-secrets\") pod \"image-registry-65fb7b8f98-flrh7\" (UID: \"6b9360ad-3b69-4a8d-b35f-cb88207a26d0\") " pod="openshift-image-registry/image-registry-65fb7b8f98-flrh7" Jul 27 09:50:49.092822 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:49.092810 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/96a91a1b-f1c8-4710-9473-3c032767f309-cert\") pod \"ingress-canary-hbcw9\" (UID: \"96a91a1b-f1c8-4710-9473-3c032767f309\") " pod="openshift-ingress-canary/ingress-canary-hbcw9" Jul 27 09:50:49.092980 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:49.092844 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6b9360ad-3b69-4a8d-b35f-cb88207a26d0-image-registry-private-configuration\") pod \"image-registry-65fb7b8f98-flrh7\" (UID: \"6b9360ad-3b69-4a8d-b35f-cb88207a26d0\") " pod="openshift-image-registry/image-registry-65fb7b8f98-flrh7" Jul 27 09:50:49.101367 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:49.101347 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8t6q\" (UniqueName: \"kubernetes.io/projected/6b9360ad-3b69-4a8d-b35f-cb88207a26d0-kube-api-access-r8t6q\") pod \"image-registry-65fb7b8f98-flrh7\" (UID: \"6b9360ad-3b69-4a8d-b35f-cb88207a26d0\") " pod="openshift-image-registry/image-registry-65fb7b8f98-flrh7" Jul 27 09:50:49.101475 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:49.101408 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fcn67\" (UniqueName: \"kubernetes.io/projected/96a91a1b-f1c8-4710-9473-3c032767f309-kube-api-access-fcn67\") pod \"ingress-canary-hbcw9\" (UID: \"96a91a1b-f1c8-4710-9473-3c032767f309\") " pod="openshift-ingress-canary/ingress-canary-hbcw9" Jul 27 09:50:49.101682 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:49.101661 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7znn\" (UniqueName: \"kubernetes.io/projected/3de4b7d7-40ed-495d-b81a-fecb048d11c0-kube-api-access-w7znn\") pod \"dns-default-p5w7g\" (UID: \"3de4b7d7-40ed-495d-b81a-fecb048d11c0\") " pod="openshift-dns/dns-default-p5w7g" Jul 27 09:50:49.101886 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:49.101867 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6b9360ad-3b69-4a8d-b35f-cb88207a26d0-bound-sa-token\") pod \"image-registry-65fb7b8f98-flrh7\" (UID: \"6b9360ad-3b69-4a8d-b35f-cb88207a26d0\") " pod="openshift-image-registry/image-registry-65fb7b8f98-flrh7" Jul 27 09:50:49.149358 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:49.149331 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hbcw9" Jul 27 09:50:49.448111 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:49.448087 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hbcw9"] Jul 27 09:50:49.451151 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:50:49.451129 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96a91a1b_f1c8_4710_9473_3c032767f309.slice/crio-40a2d16c1979b2f11adc6a7abc01207a7561c8dc7b6f848d75ac392fd8e8ada5 WatchSource:0}: Error finding container 40a2d16c1979b2f11adc6a7abc01207a7561c8dc7b6f848d75ac392fd8e8ada5: Status 404 returned error can't find the container with id 40a2d16c1979b2f11adc6a7abc01207a7561c8dc7b6f848d75ac392fd8e8ada5 Jul 27 09:50:49.593158 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:49.593134 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3de4b7d7-40ed-495d-b81a-fecb048d11c0-metrics-tls\") pod \"dns-default-p5w7g\" (UID: \"3de4b7d7-40ed-495d-b81a-fecb048d11c0\") " pod="openshift-dns/dns-default-p5w7g" Jul 27 09:50:49.593292 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:49.593168 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2daea300-7a7e-412b-a226-b0214ffe75a3-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-dsz8p\" (UID: \"2daea300-7a7e-412b-a226-b0214ffe75a3\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-dsz8p" Jul 27 09:50:49.593292 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:49.593228 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6b9360ad-3b69-4a8d-b35f-cb88207a26d0-registry-tls\") pod \"image-registry-65fb7b8f98-flrh7\" (UID: \"6b9360ad-3b69-4a8d-b35f-cb88207a26d0\") " pod="openshift-image-registry/image-registry-65fb7b8f98-flrh7" Jul 27 09:50:49.593402 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:49.593296 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 27 09:50:49.593402 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:49.593355 2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 27 09:50:49.593402 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:49.593366 2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65fb7b8f98-flrh7: secret "image-registry-tls" not found Jul 27 09:50:49.593402 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:49.593369 2556 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 27 09:50:49.593558 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:49.593413 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3de4b7d7-40ed-495d-b81a-fecb048d11c0-metrics-tls podName:3de4b7d7-40ed-495d-b81a-fecb048d11c0 nodeName:}" failed. No retries permitted until 2026-07-27 09:50:50.593394424 +0000 UTC m=+37.183891635 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3de4b7d7-40ed-495d-b81a-fecb048d11c0-metrics-tls") pod "dns-default-p5w7g" (UID: "3de4b7d7-40ed-495d-b81a-fecb048d11c0") : secret "dns-default-metrics-tls" not found Jul 27 09:50:49.593558 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:49.593427 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6b9360ad-3b69-4a8d-b35f-cb88207a26d0-registry-tls podName:6b9360ad-3b69-4a8d-b35f-cb88207a26d0 nodeName:}" failed. No retries permitted until 2026-07-27 09:50:50.59342083 +0000 UTC m=+37.183918041 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6b9360ad-3b69-4a8d-b35f-cb88207a26d0-registry-tls") pod "image-registry-65fb7b8f98-flrh7" (UID: "6b9360ad-3b69-4a8d-b35f-cb88207a26d0") : secret "image-registry-tls" not found Jul 27 09:50:49.593558 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:49.593436 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2daea300-7a7e-412b-a226-b0214ffe75a3-networking-console-plugin-cert podName:2daea300-7a7e-412b-a226-b0214ffe75a3 nodeName:}" failed. No retries permitted until 2026-07-27 09:50:50.593431309 +0000 UTC m=+37.183928520 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2daea300-7a7e-412b-a226-b0214ffe75a3-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-dsz8p" (UID: "2daea300-7a7e-412b-a226-b0214ffe75a3") : secret "networking-console-plugin-cert" not found Jul 27 09:50:49.905238 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:49.905212 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hlhxc" Jul 27 09:50:49.905238 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:49.905226 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qlrkd" Jul 27 09:50:49.905498 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:49.905229 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cl9xw" Jul 27 09:50:49.910123 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:49.909979 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ngfpk\"" Jul 27 09:50:49.910123 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:49.909978 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 27 09:50:49.910123 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:49.909983 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 27 09:50:49.910123 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:49.910016 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 27 09:50:49.910123 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:49.910027 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 27 09:50:49.910123 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:49.909980 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-66rjs\"" Jul 27 09:50:50.144242 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:50.144208 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hbcw9" event={"ID":"96a91a1b-f1c8-4710-9473-3c032767f309","Type":"ContainerStarted","Data":"40a2d16c1979b2f11adc6a7abc01207a7561c8dc7b6f848d75ac392fd8e8ada5"} Jul 27 09:50:50.147754 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:50.147728 2556 generic.go:356] "Generic (PLEG): container finished" podID="b4deab12-8c9e-4151-81f3-6c87e474578e" containerID="326aa5c992f9e4707bf2828929ada269d971f9c81f5c07cba5d9fdd3f750b0ac" exitCode=0 Jul 27 09:50:50.147874 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:50.147764 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w2txx" event={"ID":"b4deab12-8c9e-4151-81f3-6c87e474578e","Type":"ContainerDied","Data":"326aa5c992f9e4707bf2828929ada269d971f9c81f5c07cba5d9fdd3f750b0ac"} Jul 27 09:50:50.602982 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:50.602805 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6b9360ad-3b69-4a8d-b35f-cb88207a26d0-registry-tls\") pod \"image-registry-65fb7b8f98-flrh7\" (UID: \"6b9360ad-3b69-4a8d-b35f-cb88207a26d0\") " pod="openshift-image-registry/image-registry-65fb7b8f98-flrh7" Jul 27 09:50:50.603159 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:50.602951 2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 27 09:50:50.603159 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:50.603052 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3de4b7d7-40ed-495d-b81a-fecb048d11c0-metrics-tls\") pod \"dns-default-p5w7g\" (UID: \"3de4b7d7-40ed-495d-b81a-fecb048d11c0\") " pod="openshift-dns/dns-default-p5w7g" Jul 27 09:50:50.603159 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:50.603065 2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65fb7b8f98-flrh7: secret "image-registry-tls" not found Jul 27 09:50:50.603159 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:50.603082 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2daea300-7a7e-412b-a226-b0214ffe75a3-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-dsz8p\" (UID: \"2daea300-7a7e-412b-a226-b0214ffe75a3\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-dsz8p" Jul 27 09:50:50.603159 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:50.603127 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6b9360ad-3b69-4a8d-b35f-cb88207a26d0-registry-tls podName:6b9360ad-3b69-4a8d-b35f-cb88207a26d0 nodeName:}" failed. No retries permitted until 2026-07-27 09:50:52.60310735 +0000 UTC m=+39.193604565 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6b9360ad-3b69-4a8d-b35f-cb88207a26d0-registry-tls") pod "image-registry-65fb7b8f98-flrh7" (UID: "6b9360ad-3b69-4a8d-b35f-cb88207a26d0") : secret "image-registry-tls" not found Jul 27 09:50:50.603422 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:50.603190 2556 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 27 09:50:50.603422 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:50.603235 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 27 09:50:50.603422 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:50.603239 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2daea300-7a7e-412b-a226-b0214ffe75a3-networking-console-plugin-cert podName:2daea300-7a7e-412b-a226-b0214ffe75a3 nodeName:}" failed. No retries permitted until 2026-07-27 09:50:52.603227652 +0000 UTC m=+39.193724863 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2daea300-7a7e-412b-a226-b0214ffe75a3-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-dsz8p" (UID: "2daea300-7a7e-412b-a226-b0214ffe75a3") : secret "networking-console-plugin-cert" not found Jul 27 09:50:50.603422 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:50.603326 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3de4b7d7-40ed-495d-b81a-fecb048d11c0-metrics-tls podName:3de4b7d7-40ed-495d-b81a-fecb048d11c0 nodeName:}" failed. No retries permitted until 2026-07-27 09:50:52.603290674 +0000 UTC m=+39.193787884 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3de4b7d7-40ed-495d-b81a-fecb048d11c0-metrics-tls") pod "dns-default-p5w7g" (UID: "3de4b7d7-40ed-495d-b81a-fecb048d11c0") : secret "dns-default-metrics-tls" not found Jul 27 09:50:51.153887 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:51.153857 2556 generic.go:356] "Generic (PLEG): container finished" podID="b4deab12-8c9e-4151-81f3-6c87e474578e" containerID="e5e35a67755795825d7f5a4cf261b6138a1615e832baf9fb65236e765eebc415" exitCode=0 Jul 27 09:50:51.154365 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:51.153922 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w2txx" event={"ID":"b4deab12-8c9e-4151-81f3-6c87e474578e","Type":"ContainerDied","Data":"e5e35a67755795825d7f5a4cf261b6138a1615e832baf9fb65236e765eebc415"} Jul 27 09:50:52.159008 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:52.158983 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w2txx" event={"ID":"b4deab12-8c9e-4151-81f3-6c87e474578e","Type":"ContainerStarted","Data":"3333a3703b7018dc4fb17eeef12a63065ec15b08c7aa0fdf021c8af9012350af"} Jul 27 09:50:52.184757 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:52.184703 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-w2txx" podStartSLOduration=7.698037712 podStartE2EDuration="38.184687709s" totalImagesPullingTime="30.486649997s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 09:50:14 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 09:50:52.183226477 +0000 UTC m=+38.773723724" watchObservedRunningTime="2026-07-27 09:50:52.184687709 +0000 UTC m=+38.775184941" Jul 27 09:50:52.619970 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:52.619935 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3de4b7d7-40ed-495d-b81a-fecb048d11c0-metrics-tls\") pod \"dns-default-p5w7g\" (UID: \"3de4b7d7-40ed-495d-b81a-fecb048d11c0\") " pod="openshift-dns/dns-default-p5w7g" Jul 27 09:50:52.620146 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:52.619977 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2daea300-7a7e-412b-a226-b0214ffe75a3-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-dsz8p\" (UID: \"2daea300-7a7e-412b-a226-b0214ffe75a3\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-dsz8p" Jul 27 09:50:52.620146 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:52.620070 2556 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 27 09:50:52.620146 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:52.620080 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 27 09:50:52.620146 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:52.620105 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6b9360ad-3b69-4a8d-b35f-cb88207a26d0-registry-tls\") pod \"image-registry-65fb7b8f98-flrh7\" (UID: \"6b9360ad-3b69-4a8d-b35f-cb88207a26d0\") " pod="openshift-image-registry/image-registry-65fb7b8f98-flrh7" Jul 27 09:50:52.620146 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:52.620116 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2daea300-7a7e-412b-a226-b0214ffe75a3-networking-console-plugin-cert podName:2daea300-7a7e-412b-a226-b0214ffe75a3 nodeName:}" failed. No retries permitted until 2026-07-27 09:50:56.620104006 +0000 UTC m=+43.210601217 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2daea300-7a7e-412b-a226-b0214ffe75a3-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-dsz8p" (UID: "2daea300-7a7e-412b-a226-b0214ffe75a3") : secret "networking-console-plugin-cert" not found Jul 27 09:50:52.620146 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:52.620143 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3de4b7d7-40ed-495d-b81a-fecb048d11c0-metrics-tls podName:3de4b7d7-40ed-495d-b81a-fecb048d11c0 nodeName:}" failed. No retries permitted until 2026-07-27 09:50:56.620125062 +0000 UTC m=+43.210622289 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3de4b7d7-40ed-495d-b81a-fecb048d11c0-metrics-tls") pod "dns-default-p5w7g" (UID: "3de4b7d7-40ed-495d-b81a-fecb048d11c0") : secret "dns-default-metrics-tls" not found Jul 27 09:50:52.620437 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:52.620172 2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 27 09:50:52.620437 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:52.620181 2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65fb7b8f98-flrh7: secret "image-registry-tls" not found Jul 27 09:50:52.620437 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:52.620215 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6b9360ad-3b69-4a8d-b35f-cb88207a26d0-registry-tls podName:6b9360ad-3b69-4a8d-b35f-cb88207a26d0 nodeName:}" failed. No retries permitted until 2026-07-27 09:50:56.620205909 +0000 UTC m=+43.210703121 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6b9360ad-3b69-4a8d-b35f-cb88207a26d0-registry-tls") pod "image-registry-65fb7b8f98-flrh7" (UID: "6b9360ad-3b69-4a8d-b35f-cb88207a26d0") : secret "image-registry-tls" not found Jul 27 09:50:53.163009 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:53.162979 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hbcw9" event={"ID":"96a91a1b-f1c8-4710-9473-3c032767f309","Type":"ContainerStarted","Data":"f7ad130680604c0c24560470b9df3effa05fc0383e61d1075b4f5ae12dd90057"} Jul 27 09:50:53.184922 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:53.184882 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-hbcw9" podStartSLOduration=2.5144072360000003 podStartE2EDuration="5.184868316s" totalImagesPullingTime="2.67046108s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 09:50:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 09:50:53.184790981 +0000 UTC m=+39.775288244" watchObservedRunningTime="2026-07-27 09:50:53.184868316 +0000 UTC m=+39.775365549" Jul 27 09:50:56.649656 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:56.649620 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3de4b7d7-40ed-495d-b81a-fecb048d11c0-metrics-tls\") pod \"dns-default-p5w7g\" (UID: \"3de4b7d7-40ed-495d-b81a-fecb048d11c0\") " pod="openshift-dns/dns-default-p5w7g" Jul 27 09:50:56.649656 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:56.649658 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2daea300-7a7e-412b-a226-b0214ffe75a3-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-dsz8p\" (UID: \"2daea300-7a7e-412b-a226-b0214ffe75a3\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-dsz8p" Jul 27 09:50:56.650108 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:50:56.649707 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6b9360ad-3b69-4a8d-b35f-cb88207a26d0-registry-tls\") pod \"image-registry-65fb7b8f98-flrh7\" (UID: \"6b9360ad-3b69-4a8d-b35f-cb88207a26d0\") " pod="openshift-image-registry/image-registry-65fb7b8f98-flrh7" Jul 27 09:50:56.650108 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:56.649775 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 27 09:50:56.650108 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:56.649826 2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 27 09:50:56.650108 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:56.649837 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3de4b7d7-40ed-495d-b81a-fecb048d11c0-metrics-tls podName:3de4b7d7-40ed-495d-b81a-fecb048d11c0 nodeName:}" failed. No retries permitted until 2026-07-27 09:51:04.64981909 +0000 UTC m=+51.240316301 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3de4b7d7-40ed-495d-b81a-fecb048d11c0-metrics-tls") pod "dns-default-p5w7g" (UID: "3de4b7d7-40ed-495d-b81a-fecb048d11c0") : secret "dns-default-metrics-tls" not found Jul 27 09:50:56.650108 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:56.649838 2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65fb7b8f98-flrh7: secret "image-registry-tls" not found Jul 27 09:50:56.650108 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:56.649865 2556 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 27 09:50:56.650108 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:56.649873 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6b9360ad-3b69-4a8d-b35f-cb88207a26d0-registry-tls podName:6b9360ad-3b69-4a8d-b35f-cb88207a26d0 nodeName:}" failed. No retries permitted until 2026-07-27 09:51:04.649864304 +0000 UTC m=+51.240361515 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6b9360ad-3b69-4a8d-b35f-cb88207a26d0-registry-tls") pod "image-registry-65fb7b8f98-flrh7" (UID: "6b9360ad-3b69-4a8d-b35f-cb88207a26d0") : secret "image-registry-tls" not found Jul 27 09:50:56.650108 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:50:56.649952 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2daea300-7a7e-412b-a226-b0214ffe75a3-networking-console-plugin-cert podName:2daea300-7a7e-412b-a226-b0214ffe75a3 nodeName:}" failed. No retries permitted until 2026-07-27 09:51:04.649933329 +0000 UTC m=+51.240430540 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2daea300-7a7e-412b-a226-b0214ffe75a3-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-dsz8p" (UID: "2daea300-7a7e-412b-a226-b0214ffe75a3") : secret "networking-console-plugin-cert" not found Jul 27 09:51:04.703270 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:51:04.703236 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3de4b7d7-40ed-495d-b81a-fecb048d11c0-metrics-tls\") pod \"dns-default-p5w7g\" (UID: \"3de4b7d7-40ed-495d-b81a-fecb048d11c0\") " pod="openshift-dns/dns-default-p5w7g" Jul 27 09:51:04.703270 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:51:04.703273 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2daea300-7a7e-412b-a226-b0214ffe75a3-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-dsz8p\" (UID: \"2daea300-7a7e-412b-a226-b0214ffe75a3\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-dsz8p" Jul 27 09:51:04.703803 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:51:04.703378 2556 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 27 09:51:04.703803 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:51:04.703379 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 27 09:51:04.703803 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:51:04.703419 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6b9360ad-3b69-4a8d-b35f-cb88207a26d0-registry-tls\") pod \"image-registry-65fb7b8f98-flrh7\" (UID: \"6b9360ad-3b69-4a8d-b35f-cb88207a26d0\") " pod="openshift-image-registry/image-registry-65fb7b8f98-flrh7" Jul 27 09:51:04.703803 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:51:04.703429 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2daea300-7a7e-412b-a226-b0214ffe75a3-networking-console-plugin-cert podName:2daea300-7a7e-412b-a226-b0214ffe75a3 nodeName:}" failed. No retries permitted until 2026-07-27 09:51:20.703416267 +0000 UTC m=+67.293913510 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2daea300-7a7e-412b-a226-b0214ffe75a3-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-dsz8p" (UID: "2daea300-7a7e-412b-a226-b0214ffe75a3") : secret "networking-console-plugin-cert" not found Jul 27 09:51:04.703803 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:51:04.703484 2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 27 09:51:04.703803 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:51:04.703494 2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65fb7b8f98-flrh7: secret "image-registry-tls" not found Jul 27 09:51:04.703803 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:51:04.703528 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3de4b7d7-40ed-495d-b81a-fecb048d11c0-metrics-tls podName:3de4b7d7-40ed-495d-b81a-fecb048d11c0 nodeName:}" failed. No retries permitted until 2026-07-27 09:51:20.703500576 +0000 UTC m=+67.293997801 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3de4b7d7-40ed-495d-b81a-fecb048d11c0-metrics-tls") pod "dns-default-p5w7g" (UID: "3de4b7d7-40ed-495d-b81a-fecb048d11c0") : secret "dns-default-metrics-tls" not found Jul 27 09:51:04.703803 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:51:04.703564 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6b9360ad-3b69-4a8d-b35f-cb88207a26d0-registry-tls podName:6b9360ad-3b69-4a8d-b35f-cb88207a26d0 nodeName:}" failed. No retries permitted until 2026-07-27 09:51:20.703552808 +0000 UTC m=+67.294050020 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6b9360ad-3b69-4a8d-b35f-cb88207a26d0-registry-tls") pod "image-registry-65fb7b8f98-flrh7" (UID: "6b9360ad-3b69-4a8d-b35f-cb88207a26d0") : secret "image-registry-tls" not found Jul 27 09:51:13.141181 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:51:13.141155 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ph68r" Jul 27 09:51:18.696882 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:51:18.696850 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/081653f9-8f80-4844-b67f-7d8965198bb6-original-pull-secret\") pod \"global-pull-secret-syncer-qlrkd\" (UID: \"081653f9-8f80-4844-b67f-7d8965198bb6\") " pod="kube-system/global-pull-secret-syncer-qlrkd" Jul 27 09:51:18.696882 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:51:18.696888 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/27f2e8fc-173e-43ff-b7a6-0bd6e8b54d40-metrics-certs\") pod \"network-metrics-daemon-cl9xw\" (UID: \"27f2e8fc-173e-43ff-b7a6-0bd6e8b54d40\") " pod="openshift-multus/network-metrics-daemon-cl9xw" Jul 27 09:51:18.699963 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:51:18.699943 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 27 09:51:18.700014 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:51:18.699943 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 27 09:51:18.707427 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:51:18.707406 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 27 09:51:18.707555 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:51:18.707457 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27f2e8fc-173e-43ff-b7a6-0bd6e8b54d40-metrics-certs podName:27f2e8fc-173e-43ff-b7a6-0bd6e8b54d40 nodeName:}" failed. No retries permitted until 2026-07-27 09:52:22.707443308 +0000 UTC m=+129.297940520 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/27f2e8fc-173e-43ff-b7a6-0bd6e8b54d40-metrics-certs") pod "network-metrics-daemon-cl9xw" (UID: "27f2e8fc-173e-43ff-b7a6-0bd6e8b54d40") : secret "metrics-daemon-secret" not found Jul 27 09:51:18.710722 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:51:18.710702 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/081653f9-8f80-4844-b67f-7d8965198bb6-original-pull-secret\") pod \"global-pull-secret-syncer-qlrkd\" (UID: \"081653f9-8f80-4844-b67f-7d8965198bb6\") " pod="kube-system/global-pull-secret-syncer-qlrkd" Jul 27 09:51:18.719880 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:51:18.719864 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qlrkd" Jul 27 09:51:18.797790 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:51:18.797761 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2jfp\" (UniqueName: \"kubernetes.io/projected/4c375e68-a7a1-414b-9d33-3040925415f4-kube-api-access-r2jfp\") pod \"network-check-target-hlhxc\" (UID: \"4c375e68-a7a1-414b-9d33-3040925415f4\") " pod="openshift-network-diagnostics/network-check-target-hlhxc" Jul 27 09:51:18.801496 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:51:18.801472 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 27 09:51:18.810953 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:51:18.810933 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 27 09:51:18.821474 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:51:18.821456 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2jfp\" (UniqueName: \"kubernetes.io/projected/4c375e68-a7a1-414b-9d33-3040925415f4-kube-api-access-r2jfp\") pod \"network-check-target-hlhxc\" (UID: \"4c375e68-a7a1-414b-9d33-3040925415f4\") " pod="openshift-network-diagnostics/network-check-target-hlhxc" Jul 27 09:51:18.839110 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:51:18.839087 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qlrkd"] Jul 27 09:51:18.842496 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:51:18.842474 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod081653f9_8f80_4844_b67f_7d8965198bb6.slice/crio-2a3386bb7969d4242c863ac2162128ccdc8a12eebbc7e2e2f41dc1de46b42a10 WatchSource:0}: Error finding container 2a3386bb7969d4242c863ac2162128ccdc8a12eebbc7e2e2f41dc1de46b42a10: Status 404 returned error can't find the container with id 2a3386bb7969d4242c863ac2162128ccdc8a12eebbc7e2e2f41dc1de46b42a10 Jul 27 09:51:19.017867 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:51:19.017823 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-66rjs\"" Jul 27 09:51:19.025480 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:51:19.025464 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hlhxc" Jul 27 09:51:19.166782 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:51:19.166751 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hlhxc"] Jul 27 09:51:19.169707 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:51:19.169685 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c375e68_a7a1_414b_9d33_3040925415f4.slice/crio-a104f3a146f3c9b2faf764e15dc52da134f73221c71681d27d701e51f42e10ef WatchSource:0}: Error finding container a104f3a146f3c9b2faf764e15dc52da134f73221c71681d27d701e51f42e10ef: Status 404 returned error can't find the container with id a104f3a146f3c9b2faf764e15dc52da134f73221c71681d27d701e51f42e10ef Jul 27 09:51:19.218766 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:51:19.218734 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hlhxc" event={"ID":"4c375e68-a7a1-414b-9d33-3040925415f4","Type":"ContainerStarted","Data":"a104f3a146f3c9b2faf764e15dc52da134f73221c71681d27d701e51f42e10ef"} Jul 27 09:51:19.219737 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:51:19.219714 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qlrkd" event={"ID":"081653f9-8f80-4844-b67f-7d8965198bb6","Type":"ContainerStarted","Data":"2a3386bb7969d4242c863ac2162128ccdc8a12eebbc7e2e2f41dc1de46b42a10"} Jul 27 09:51:20.711974 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:51:20.711937 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3de4b7d7-40ed-495d-b81a-fecb048d11c0-metrics-tls\") pod \"dns-default-p5w7g\" (UID: \"3de4b7d7-40ed-495d-b81a-fecb048d11c0\") " pod="openshift-dns/dns-default-p5w7g" Jul 27 09:51:20.712410 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:51:20.711989 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2daea300-7a7e-412b-a226-b0214ffe75a3-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-dsz8p\" (UID: \"2daea300-7a7e-412b-a226-b0214ffe75a3\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-dsz8p" Jul 27 09:51:20.712410 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:51:20.712029 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6b9360ad-3b69-4a8d-b35f-cb88207a26d0-registry-tls\") pod \"image-registry-65fb7b8f98-flrh7\" (UID: \"6b9360ad-3b69-4a8d-b35f-cb88207a26d0\") " pod="openshift-image-registry/image-registry-65fb7b8f98-flrh7" Jul 27 09:51:20.712410 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:51:20.712109 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 27 09:51:20.712410 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:51:20.712154 2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 27 09:51:20.712410 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:51:20.712168 2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65fb7b8f98-flrh7: secret "image-registry-tls" not found Jul 27 09:51:20.712410 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:51:20.712193 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3de4b7d7-40ed-495d-b81a-fecb048d11c0-metrics-tls podName:3de4b7d7-40ed-495d-b81a-fecb048d11c0 nodeName:}" failed. No retries permitted until 2026-07-27 09:51:52.712173016 +0000 UTC m=+99.302670242 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3de4b7d7-40ed-495d-b81a-fecb048d11c0-metrics-tls") pod "dns-default-p5w7g" (UID: "3de4b7d7-40ed-495d-b81a-fecb048d11c0") : secret "dns-default-metrics-tls" not found Jul 27 09:51:20.712410 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:51:20.712212 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6b9360ad-3b69-4a8d-b35f-cb88207a26d0-registry-tls podName:6b9360ad-3b69-4a8d-b35f-cb88207a26d0 nodeName:}" failed. No retries permitted until 2026-07-27 09:51:52.712203319 +0000 UTC m=+99.302700530 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6b9360ad-3b69-4a8d-b35f-cb88207a26d0-registry-tls") pod "image-registry-65fb7b8f98-flrh7" (UID: "6b9360ad-3b69-4a8d-b35f-cb88207a26d0") : secret "image-registry-tls" not found Jul 27 09:51:20.712410 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:51:20.712247 2556 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 27 09:51:20.712410 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:51:20.712282 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2daea300-7a7e-412b-a226-b0214ffe75a3-networking-console-plugin-cert podName:2daea300-7a7e-412b-a226-b0214ffe75a3 nodeName:}" failed. No retries permitted until 2026-07-27 09:51:52.712267418 +0000 UTC m=+99.302764635 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2daea300-7a7e-412b-a226-b0214ffe75a3-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-dsz8p" (UID: "2daea300-7a7e-412b-a226-b0214ffe75a3") : secret "networking-console-plugin-cert" not found Jul 27 09:51:24.233987 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:51:24.233950 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hlhxc" event={"ID":"4c375e68-a7a1-414b-9d33-3040925415f4","Type":"ContainerStarted","Data":"6e0496492e08d70bbc83a728dd15839973b4d2c8ad00c7038f2e94ef7d764ac5"} Jul 27 09:51:24.234502 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:51:24.234075 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-hlhxc" Jul 27 09:51:24.235239 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:51:24.235215 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qlrkd" event={"ID":"081653f9-8f80-4844-b67f-7d8965198bb6","Type":"ContainerStarted","Data":"96b6e82812a5d0f5188110e8d12f2a8d63681001b8490ecc35daf7c11498da68"} Jul 27 09:51:24.253212 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:51:24.253168 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-hlhxc" podStartSLOduration=65.996935641 podStartE2EDuration="1m10.25315518s" totalImagesPullingTime="4.256219539s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 09:50:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 09:51:24.252733661 +0000 UTC m=+70.843230893" watchObservedRunningTime="2026-07-27 09:51:24.25315518 +0000 UTC m=+70.843652411" Jul 27 09:51:24.268587 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:51:24.268547 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-qlrkd" podStartSLOduration=65.652599494 podStartE2EDuration="1m10.268537163s" totalImagesPullingTime="4.615937669s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 09:50:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 09:51:24.26825805 +0000 UTC m=+70.858755294" watchObservedRunningTime="2026-07-27 09:51:24.268537163 +0000 UTC m=+70.859034395" Jul 27 09:51:52.728125 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:51:52.728093 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3de4b7d7-40ed-495d-b81a-fecb048d11c0-metrics-tls\") pod \"dns-default-p5w7g\" (UID: \"3de4b7d7-40ed-495d-b81a-fecb048d11c0\") " pod="openshift-dns/dns-default-p5w7g" Jul 27 09:51:52.728125 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:51:52.728128 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2daea300-7a7e-412b-a226-b0214ffe75a3-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-dsz8p\" (UID: \"2daea300-7a7e-412b-a226-b0214ffe75a3\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-dsz8p" Jul 27 09:51:52.728559 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:51:52.728156 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6b9360ad-3b69-4a8d-b35f-cb88207a26d0-registry-tls\") pod \"image-registry-65fb7b8f98-flrh7\" (UID: \"6b9360ad-3b69-4a8d-b35f-cb88207a26d0\") " pod="openshift-image-registry/image-registry-65fb7b8f98-flrh7" Jul 27 09:51:52.728559 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:51:52.728237 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 27 09:51:52.728559 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:51:52.728258 2556 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 27 09:51:52.728559 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:51:52.728271 2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 27 09:51:52.728559 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:51:52.728282 2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65fb7b8f98-flrh7: secret "image-registry-tls" not found Jul 27 09:51:52.728559 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:51:52.728335 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3de4b7d7-40ed-495d-b81a-fecb048d11c0-metrics-tls podName:3de4b7d7-40ed-495d-b81a-fecb048d11c0 nodeName:}" failed. No retries permitted until 2026-07-27 09:52:56.728318258 +0000 UTC m=+163.318815484 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3de4b7d7-40ed-495d-b81a-fecb048d11c0-metrics-tls") pod "dns-default-p5w7g" (UID: "3de4b7d7-40ed-495d-b81a-fecb048d11c0") : secret "dns-default-metrics-tls" not found Jul 27 09:51:52.728559 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:51:52.728350 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2daea300-7a7e-412b-a226-b0214ffe75a3-networking-console-plugin-cert podName:2daea300-7a7e-412b-a226-b0214ffe75a3 nodeName:}" failed. No retries permitted until 2026-07-27 09:52:56.728343994 +0000 UTC m=+163.318841205 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2daea300-7a7e-412b-a226-b0214ffe75a3-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-dsz8p" (UID: "2daea300-7a7e-412b-a226-b0214ffe75a3") : secret "networking-console-plugin-cert" not found Jul 27 09:51:52.728559 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:51:52.728361 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6b9360ad-3b69-4a8d-b35f-cb88207a26d0-registry-tls podName:6b9360ad-3b69-4a8d-b35f-cb88207a26d0 nodeName:}" failed. No retries permitted until 2026-07-27 09:52:56.728355059 +0000 UTC m=+163.318852270 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6b9360ad-3b69-4a8d-b35f-cb88207a26d0-registry-tls") pod "image-registry-65fb7b8f98-flrh7" (UID: "6b9360ad-3b69-4a8d-b35f-cb88207a26d0") : secret "image-registry-tls" not found Jul 27 09:51:55.239272 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:51:55.239241 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-hlhxc" Jul 27 09:52:22.732232 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:52:22.732198 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/27f2e8fc-173e-43ff-b7a6-0bd6e8b54d40-metrics-certs\") pod \"network-metrics-daemon-cl9xw\" (UID: \"27f2e8fc-173e-43ff-b7a6-0bd6e8b54d40\") " pod="openshift-multus/network-metrics-daemon-cl9xw" Jul 27 09:52:22.732693 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:52:22.732350 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 27 09:52:22.732693 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:52:22.732411 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27f2e8fc-173e-43ff-b7a6-0bd6e8b54d40-metrics-certs podName:27f2e8fc-173e-43ff-b7a6-0bd6e8b54d40 nodeName:}" failed. No retries permitted until 2026-07-27 09:54:24.732393127 +0000 UTC m=+251.322890351 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/27f2e8fc-173e-43ff-b7a6-0bd6e8b54d40-metrics-certs") pod "network-metrics-daemon-cl9xw" (UID: "27f2e8fc-173e-43ff-b7a6-0bd6e8b54d40") : secret "metrics-daemon-secret" not found Jul 27 09:52:51.826769 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:52:51.826734 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-74c9f884b7-dsz8p" podUID="2daea300-7a7e-412b-a226-b0214ffe75a3" Jul 27 09:52:51.833899 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:52:51.833866 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-65fb7b8f98-flrh7" podUID="6b9360ad-3b69-4a8d-b35f-cb88207a26d0" Jul 27 09:52:51.842065 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:52:51.842047 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-p5w7g" podUID="3de4b7d7-40ed-495d-b81a-fecb048d11c0" Jul 27 09:52:52.424801 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:52:52.424727 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65fb7b8f98-flrh7" Jul 27 09:52:52.424801 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:52:52.424756 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-dsz8p" Jul 27 09:52:52.424996 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:52:52.424821 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-p5w7g" Jul 27 09:52:52.924718 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:52:52.924682 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-cl9xw" podUID="27f2e8fc-173e-43ff-b7a6-0bd6e8b54d40" Jul 27 09:52:56.746374 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:52:56.746339 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2daea300-7a7e-412b-a226-b0214ffe75a3-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-dsz8p\" (UID: \"2daea300-7a7e-412b-a226-b0214ffe75a3\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-dsz8p" Jul 27 09:52:56.746374 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:52:56.746380 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6b9360ad-3b69-4a8d-b35f-cb88207a26d0-registry-tls\") pod \"image-registry-65fb7b8f98-flrh7\" (UID: \"6b9360ad-3b69-4a8d-b35f-cb88207a26d0\") " pod="openshift-image-registry/image-registry-65fb7b8f98-flrh7" Jul 27 09:52:56.746773 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:52:56.746426 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3de4b7d7-40ed-495d-b81a-fecb048d11c0-metrics-tls\") pod \"dns-default-p5w7g\" (UID: \"3de4b7d7-40ed-495d-b81a-fecb048d11c0\") " pod="openshift-dns/dns-default-p5w7g" Jul 27 09:52:56.746773 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:52:56.746483 2556 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 27 09:52:56.746773 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:52:56.746501 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 27 09:52:56.746773 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:52:56.746534 2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 27 09:52:56.746773 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:52:56.746546 2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65fb7b8f98-flrh7: secret "image-registry-tls" not found Jul 27 09:52:56.746773 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:52:56.746556 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2daea300-7a7e-412b-a226-b0214ffe75a3-networking-console-plugin-cert podName:2daea300-7a7e-412b-a226-b0214ffe75a3 nodeName:}" failed. No retries permitted until 2026-07-27 09:54:58.74653512 +0000 UTC m=+285.337032331 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2daea300-7a7e-412b-a226-b0214ffe75a3-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-dsz8p" (UID: "2daea300-7a7e-412b-a226-b0214ffe75a3") : secret "networking-console-plugin-cert" not found Jul 27 09:52:56.746773 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:52:56.746574 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3de4b7d7-40ed-495d-b81a-fecb048d11c0-metrics-tls podName:3de4b7d7-40ed-495d-b81a-fecb048d11c0 nodeName:}" failed. No retries permitted until 2026-07-27 09:54:58.746564763 +0000 UTC m=+285.337061975 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3de4b7d7-40ed-495d-b81a-fecb048d11c0-metrics-tls") pod "dns-default-p5w7g" (UID: "3de4b7d7-40ed-495d-b81a-fecb048d11c0") : secret "dns-default-metrics-tls" not found Jul 27 09:52:56.746773 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:52:56.746590 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6b9360ad-3b69-4a8d-b35f-cb88207a26d0-registry-tls podName:6b9360ad-3b69-4a8d-b35f-cb88207a26d0 nodeName:}" failed. No retries permitted until 2026-07-27 09:54:58.746579804 +0000 UTC m=+285.337077053 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6b9360ad-3b69-4a8d-b35f-cb88207a26d0-registry-tls") pod "image-registry-65fb7b8f98-flrh7" (UID: "6b9360ad-3b69-4a8d-b35f-cb88207a26d0") : secret "image-registry-tls" not found Jul 27 09:53:06.905064 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:53:06.904992 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cl9xw" Jul 27 09:54:24.813455 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:24.813417 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/27f2e8fc-173e-43ff-b7a6-0bd6e8b54d40-metrics-certs\") pod \"network-metrics-daemon-cl9xw\" (UID: \"27f2e8fc-173e-43ff-b7a6-0bd6e8b54d40\") " pod="openshift-multus/network-metrics-daemon-cl9xw" Jul 27 09:54:24.813945 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:54:24.813562 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 27 09:54:24.813945 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:54:24.813627 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27f2e8fc-173e-43ff-b7a6-0bd6e8b54d40-metrics-certs podName:27f2e8fc-173e-43ff-b7a6-0bd6e8b54d40 nodeName:}" failed. No retries permitted until 2026-07-27 09:56:26.813613277 +0000 UTC m=+373.404110488 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/27f2e8fc-173e-43ff-b7a6-0bd6e8b54d40-metrics-certs") pod "network-metrics-daemon-cl9xw" (UID: "27f2e8fc-173e-43ff-b7a6-0bd6e8b54d40") : secret "metrics-daemon-secret" not found Jul 27 09:54:27.045626 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:27.045591 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-24h5q"] Jul 27 09:54:27.047426 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:27.047405 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-gqgcx"] Jul 27 09:54:27.047557 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:27.047523 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-24h5q" Jul 27 09:54:27.048990 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:27.048972 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-9st6k"] Jul 27 09:54:27.049112 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:27.049080 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-gqgcx" Jul 27 09:54:27.050553 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:27.050533 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-9st6k" Jul 27 09:54:27.050689 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:27.050592 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 27 09:54:27.050761 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:27.050694 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 27 09:54:27.050988 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:27.050971 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-p2b2w\"" Jul 27 09:54:27.050988 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:27.050983 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 27 09:54:27.051546 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:27.051529 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 27 09:54:27.052460 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:27.052444 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 27 09:54:27.052541 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:27.052474 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-gzqw2\"" Jul 27 09:54:27.052965 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:27.052942 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 27 09:54:27.053029 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:27.052976 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 27 09:54:27.056398 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:27.056380 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 27 09:54:27.056492 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:27.056409 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 27 09:54:27.056492 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:27.056469 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 27 09:54:27.057974 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:27.057955 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-8kbp9\"" Jul 27 09:54:27.058058 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:27.057996 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 27 09:54:27.062078 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:27.062047 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-24h5q"] Jul 27 09:54:27.062975 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:27.062957 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 27 09:54:27.065878 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:27.065845 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-gqgcx"] Jul 27 09:54:27.075752 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:27.075729 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-9st6k"] Jul 27 09:54:27.127266 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:27.127245 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-957gb\" (UniqueName: \"kubernetes.io/projected/2f427709-8cba-45c3-9434-ab21cbd1fa4c-kube-api-access-957gb\") pod \"cluster-samples-operator-6748489656-24h5q\" (UID: \"2f427709-8cba-45c3-9434-ab21cbd1fa4c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-24h5q" Jul 27 09:54:27.127376 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:27.127276 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a7a42a0d-f7e2-49ba-a366-88d424f60c20-config\") pod \"console-operator-584dcb6b54-gqgcx\" (UID: \"a7a42a0d-f7e2-49ba-a366-88d424f60c20\") " pod="openshift-console-operator/console-operator-584dcb6b54-gqgcx" Jul 27 09:54:27.127376 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:27.127297 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/c7ee9b6a-d070-4453-b366-4366d0949b35-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-9st6k\" (UID: \"c7ee9b6a-d070-4453-b366-4366d0949b35\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-9st6k" Jul 27 09:54:27.127456 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:27.127388 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a7a42a0d-f7e2-49ba-a366-88d424f60c20-serving-cert\") pod \"console-operator-584dcb6b54-gqgcx\" (UID: \"a7a42a0d-f7e2-49ba-a366-88d424f60c20\") " pod="openshift-console-operator/console-operator-584dcb6b54-gqgcx" Jul 27 09:54:27.127456 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:27.127421 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a7a42a0d-f7e2-49ba-a366-88d424f60c20-trusted-ca\") pod \"console-operator-584dcb6b54-gqgcx\" (UID: \"a7a42a0d-f7e2-49ba-a366-88d424f60c20\") " pod="openshift-console-operator/console-operator-584dcb6b54-gqgcx" Jul 27 09:54:27.127456 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:27.127441 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2f427709-8cba-45c3-9434-ab21cbd1fa4c-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-24h5q\" (UID: \"2f427709-8cba-45c3-9434-ab21cbd1fa4c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-24h5q" Jul 27 09:54:27.127597 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:27.127458 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7cblp\" (UniqueName: \"kubernetes.io/projected/a7a42a0d-f7e2-49ba-a366-88d424f60c20-kube-api-access-7cblp\") pod \"console-operator-584dcb6b54-gqgcx\" (UID: \"a7a42a0d-f7e2-49ba-a366-88d424f60c20\") " pod="openshift-console-operator/console-operator-584dcb6b54-gqgcx" Jul 27 09:54:27.127597 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:27.127483 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvnd9\" (UniqueName: \"kubernetes.io/projected/c7ee9b6a-d070-4453-b366-4366d0949b35-kube-api-access-qvnd9\") pod \"cluster-monitoring-operator-548b489cb8-9st6k\" (UID: \"c7ee9b6a-d070-4453-b366-4366d0949b35\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-9st6k" Jul 27 09:54:27.127597 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:27.127541 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c7ee9b6a-d070-4453-b366-4366d0949b35-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-9st6k\" (UID: \"c7ee9b6a-d070-4453-b366-4366d0949b35\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-9st6k" Jul 27 09:54:27.143170 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:27.143149 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-t4c46"] Jul 27 09:54:27.144896 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:27.144879 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-t4c46" Jul 27 09:54:27.145159 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:27.145136 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5885fdb759-msdf9"] Jul 27 09:54:27.146700 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:27.146683 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-msdf9" Jul 27 09:54:27.148403 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:27.148386 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 27 09:54:27.148403 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:27.148398 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 27 09:54:27.148518 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:27.148400 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-wmvwh\"" Jul 27 09:54:27.149346 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:27.149332 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 27 09:54:27.149477 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:27.149461 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 27 09:54:27.150146 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:27.150132 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 27 09:54:27.152706 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:27.152687 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-8j8cc\"" Jul 27 09:54:27.154628 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:27.154612 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 27 09:54:27.159874 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:27.159849 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-t4c46"] Jul 27 09:54:27.164096 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:27.164077 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 27 09:54:27.167506 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:27.167485 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-msdf9"] Jul 27 09:54:27.228271 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:27.228246 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8fa28813-be68-4170-845e-069e6c14689d-tmp\") pod \"insights-operator-5885fdb759-msdf9\" (UID: \"8fa28813-be68-4170-845e-069e6c14689d\") " pod="openshift-insights/insights-operator-5885fdb759-msdf9" Jul 27 09:54:27.228381 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:27.228286 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c7ee9b6a-d070-4453-b366-4366d0949b35-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-9st6k\" (UID: \"c7ee9b6a-d070-4453-b366-4366d0949b35\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-9st6k" Jul 27 09:54:27.228381 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:27.228327 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvnd9\" (UniqueName: \"kubernetes.io/projected/c7ee9b6a-d070-4453-b366-4366d0949b35-kube-api-access-qvnd9\") pod \"cluster-monitoring-operator-548b489cb8-9st6k\" (UID: \"c7ee9b6a-d070-4453-b366-4366d0949b35\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-9st6k" Jul 27 09:54:27.228381 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:27.228359 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-957gb\" (UniqueName: \"kubernetes.io/projected/2f427709-8cba-45c3-9434-ab21cbd1fa4c-kube-api-access-957gb\") pod \"cluster-samples-operator-6748489656-24h5q\" (UID: \"2f427709-8cba-45c3-9434-ab21cbd1fa4c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-24h5q" Jul 27 09:54:27.228523 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:27.228387 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a7a42a0d-f7e2-49ba-a366-88d424f60c20-config\") pod \"console-operator-584dcb6b54-gqgcx\" (UID: \"a7a42a0d-f7e2-49ba-a366-88d424f60c20\") " pod="openshift-console-operator/console-operator-584dcb6b54-gqgcx" Jul 27 09:54:27.228523 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:27.228404 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8fa28813-be68-4170-845e-069e6c14689d-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-msdf9\" (UID: \"8fa28813-be68-4170-845e-069e6c14689d\") " pod="openshift-insights/insights-operator-5885fdb759-msdf9" Jul 27 09:54:27.228523 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:54:27.228410 2556 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 27 09:54:27.228523 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:27.228425 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q97b5\" (UniqueName: \"kubernetes.io/projected/8fa28813-be68-4170-845e-069e6c14689d-kube-api-access-q97b5\") pod \"insights-operator-5885fdb759-msdf9\" (UID: \"8fa28813-be68-4170-845e-069e6c14689d\") " pod="openshift-insights/insights-operator-5885fdb759-msdf9" Jul 27 09:54:27.228523 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:27.228445 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a7a42a0d-f7e2-49ba-a366-88d424f60c20-serving-cert\") pod \"console-operator-584dcb6b54-gqgcx\" (UID: \"a7a42a0d-f7e2-49ba-a366-88d424f60c20\") " pod="openshift-console-operator/console-operator-584dcb6b54-gqgcx" Jul 27 09:54:27.228523 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:54:27.228480 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7ee9b6a-d070-4453-b366-4366d0949b35-cluster-monitoring-operator-tls podName:c7ee9b6a-d070-4453-b366-4366d0949b35 nodeName:}" failed. No retries permitted until 2026-07-27 09:54:27.728460919 +0000 UTC m=+254.318958134 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c7ee9b6a-d070-4453-b366-4366d0949b35-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-9st6k" (UID: "c7ee9b6a-d070-4453-b366-4366d0949b35") : secret "cluster-monitoring-operator-tls" not found Jul 27 09:54:27.228807 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:27.228528 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a7a42a0d-f7e2-49ba-a366-88d424f60c20-trusted-ca\") pod \"console-operator-584dcb6b54-gqgcx\" (UID: \"a7a42a0d-f7e2-49ba-a366-88d424f60c20\") " pod="openshift-console-operator/console-operator-584dcb6b54-gqgcx" Jul 27 09:54:27.228807 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:27.228561 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/8fa28813-be68-4170-845e-069e6c14689d-snapshots\") pod \"insights-operator-5885fdb759-msdf9\" (UID: \"8fa28813-be68-4170-845e-069e6c14689d\") " pod="openshift-insights/insights-operator-5885fdb759-msdf9" Jul 27 09:54:27.228807 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:27.228585 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2f427709-8cba-45c3-9434-ab21cbd1fa4c-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-24h5q\" (UID: \"2f427709-8cba-45c3-9434-ab21cbd1fa4c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-24h5q" Jul 27 09:54:27.228807 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:27.228613 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7cblp\" (UniqueName: \"kubernetes.io/projected/a7a42a0d-f7e2-49ba-a366-88d424f60c20-kube-api-access-7cblp\") pod \"console-operator-584dcb6b54-gqgcx\" (UID: \"a7a42a0d-f7e2-49ba-a366-88d424f60c20\") " pod="openshift-console-operator/console-operator-584dcb6b54-gqgcx" Jul 27 09:54:27.228807 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:27.228671 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8fa28813-be68-4170-845e-069e6c14689d-service-ca-bundle\") pod \"insights-operator-5885fdb759-msdf9\" (UID: \"8fa28813-be68-4170-845e-069e6c14689d\") " pod="openshift-insights/insights-operator-5885fdb759-msdf9" Jul 27 09:54:27.228807 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:54:27.228676 2556 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 27 09:54:27.228807 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:27.228708 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8fa28813-be68-4170-845e-069e6c14689d-serving-cert\") pod \"insights-operator-5885fdb759-msdf9\" (UID: \"8fa28813-be68-4170-845e-069e6c14689d\") " pod="openshift-insights/insights-operator-5885fdb759-msdf9" Jul 27 09:54:27.228807 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:54:27.228738 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f427709-8cba-45c3-9434-ab21cbd1fa4c-samples-operator-tls podName:2f427709-8cba-45c3-9434-ab21cbd1fa4c nodeName:}" failed. No retries permitted until 2026-07-27 09:54:27.728720121 +0000 UTC m=+254.319217352 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2f427709-8cba-45c3-9434-ab21cbd1fa4c-samples-operator-tls") pod "cluster-samples-operator-6748489656-24h5q" (UID: "2f427709-8cba-45c3-9434-ab21cbd1fa4c") : secret "samples-operator-tls" not found Jul 27 09:54:27.228807 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:27.228760 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2p856\" (UniqueName: \"kubernetes.io/projected/c8455d96-d25b-4d6a-af5d-2c2091b8e78a-kube-api-access-2p856\") pod \"volume-data-source-validator-549c6d54cf-t4c46\" (UID: \"c8455d96-d25b-4d6a-af5d-2c2091b8e78a\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-t4c46" Jul 27 09:54:27.228807 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:27.228798 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/c7ee9b6a-d070-4453-b366-4366d0949b35-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-9st6k\" (UID: \"c7ee9b6a-d070-4453-b366-4366d0949b35\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-9st6k" Jul 27 09:54:27.229241 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:27.229101 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a7a42a0d-f7e2-49ba-a366-88d424f60c20-config\") pod \"console-operator-584dcb6b54-gqgcx\" (UID: \"a7a42a0d-f7e2-49ba-a366-88d424f60c20\") " pod="openshift-console-operator/console-operator-584dcb6b54-gqgcx" Jul 27 09:54:27.229708 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:27.229687 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/c7ee9b6a-d070-4453-b366-4366d0949b35-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-9st6k\" (UID: \"c7ee9b6a-d070-4453-b366-4366d0949b35\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-9st6k" Jul 27 09:54:27.229748 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:27.229712 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a7a42a0d-f7e2-49ba-a366-88d424f60c20-trusted-ca\") pod \"console-operator-584dcb6b54-gqgcx\" (UID: \"a7a42a0d-f7e2-49ba-a366-88d424f60c20\") " pod="openshift-console-operator/console-operator-584dcb6b54-gqgcx" Jul 27 09:54:27.230899 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:27.230885 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a7a42a0d-f7e2-49ba-a366-88d424f60c20-serving-cert\") pod \"console-operator-584dcb6b54-gqgcx\" (UID: \"a7a42a0d-f7e2-49ba-a366-88d424f60c20\") " pod="openshift-console-operator/console-operator-584dcb6b54-gqgcx" Jul 27 09:54:27.239791 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:27.239771 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7cblp\" (UniqueName: \"kubernetes.io/projected/a7a42a0d-f7e2-49ba-a366-88d424f60c20-kube-api-access-7cblp\") pod \"console-operator-584dcb6b54-gqgcx\" (UID: \"a7a42a0d-f7e2-49ba-a366-88d424f60c20\") " pod="openshift-console-operator/console-operator-584dcb6b54-gqgcx" Jul 27 09:54:27.239791 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:27.239783 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvnd9\" (UniqueName: \"kubernetes.io/projected/c7ee9b6a-d070-4453-b366-4366d0949b35-kube-api-access-qvnd9\") pod \"cluster-monitoring-operator-548b489cb8-9st6k\" (UID: \"c7ee9b6a-d070-4453-b366-4366d0949b35\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-9st6k" Jul 27 09:54:27.242083 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:27.242066 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-957gb\" (UniqueName: \"kubernetes.io/projected/2f427709-8cba-45c3-9434-ab21cbd1fa4c-kube-api-access-957gb\") pod \"cluster-samples-operator-6748489656-24h5q\" (UID: \"2f427709-8cba-45c3-9434-ab21cbd1fa4c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-24h5q" Jul 27 09:54:27.329927 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:27.329906 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8fa28813-be68-4170-845e-069e6c14689d-tmp\") pod \"insights-operator-5885fdb759-msdf9\" (UID: \"8fa28813-be68-4170-845e-069e6c14689d\") " pod="openshift-insights/insights-operator-5885fdb759-msdf9" Jul 27 09:54:27.330019 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:27.329960 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8fa28813-be68-4170-845e-069e6c14689d-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-msdf9\" (UID: \"8fa28813-be68-4170-845e-069e6c14689d\") " pod="openshift-insights/insights-operator-5885fdb759-msdf9" Jul 27 09:54:27.330019 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:27.329979 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q97b5\" (UniqueName: \"kubernetes.io/projected/8fa28813-be68-4170-845e-069e6c14689d-kube-api-access-q97b5\") pod \"insights-operator-5885fdb759-msdf9\" (UID: \"8fa28813-be68-4170-845e-069e6c14689d\") " pod="openshift-insights/insights-operator-5885fdb759-msdf9" Jul 27 09:54:27.330138 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:27.330095 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/8fa28813-be68-4170-845e-069e6c14689d-snapshots\") pod \"insights-operator-5885fdb759-msdf9\" (UID: \"8fa28813-be68-4170-845e-069e6c14689d\") " pod="openshift-insights/insights-operator-5885fdb759-msdf9" Jul 27 09:54:27.330191 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:27.330176 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8fa28813-be68-4170-845e-069e6c14689d-service-ca-bundle\") pod \"insights-operator-5885fdb759-msdf9\" (UID: \"8fa28813-be68-4170-845e-069e6c14689d\") " pod="openshift-insights/insights-operator-5885fdb759-msdf9" Jul 27 09:54:27.330245 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:27.330214 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8fa28813-be68-4170-845e-069e6c14689d-serving-cert\") pod \"insights-operator-5885fdb759-msdf9\" (UID: \"8fa28813-be68-4170-845e-069e6c14689d\") " pod="openshift-insights/insights-operator-5885fdb759-msdf9" Jul 27 09:54:27.330245 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:27.330238 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2p856\" (UniqueName: \"kubernetes.io/projected/c8455d96-d25b-4d6a-af5d-2c2091b8e78a-kube-api-access-2p856\") pod \"volume-data-source-validator-549c6d54cf-t4c46\" (UID: \"c8455d96-d25b-4d6a-af5d-2c2091b8e78a\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-t4c46" Jul 27 09:54:27.330380 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:27.330276 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8fa28813-be68-4170-845e-069e6c14689d-tmp\") pod \"insights-operator-5885fdb759-msdf9\" (UID: \"8fa28813-be68-4170-845e-069e6c14689d\") " pod="openshift-insights/insights-operator-5885fdb759-msdf9" Jul 27 09:54:27.330582 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:27.330561 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/8fa28813-be68-4170-845e-069e6c14689d-snapshots\") pod \"insights-operator-5885fdb759-msdf9\" (UID: \"8fa28813-be68-4170-845e-069e6c14689d\") " pod="openshift-insights/insights-operator-5885fdb759-msdf9" Jul 27 09:54:27.330707 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:27.330690 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8fa28813-be68-4170-845e-069e6c14689d-service-ca-bundle\") pod \"insights-operator-5885fdb759-msdf9\" (UID: \"8fa28813-be68-4170-845e-069e6c14689d\") " pod="openshift-insights/insights-operator-5885fdb759-msdf9" Jul 27 09:54:27.330766 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:27.330733 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8fa28813-be68-4170-845e-069e6c14689d-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-msdf9\" (UID: \"8fa28813-be68-4170-845e-069e6c14689d\") " pod="openshift-insights/insights-operator-5885fdb759-msdf9" Jul 27 09:54:27.332264 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:27.332249 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8fa28813-be68-4170-845e-069e6c14689d-serving-cert\") pod \"insights-operator-5885fdb759-msdf9\" (UID: \"8fa28813-be68-4170-845e-069e6c14689d\") " pod="openshift-insights/insights-operator-5885fdb759-msdf9" Jul 27 09:54:27.339112 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:27.339090 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2p856\" (UniqueName: \"kubernetes.io/projected/c8455d96-d25b-4d6a-af5d-2c2091b8e78a-kube-api-access-2p856\") pod \"volume-data-source-validator-549c6d54cf-t4c46\" (UID: \"c8455d96-d25b-4d6a-af5d-2c2091b8e78a\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-t4c46" Jul 27 09:54:27.340167 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:27.340149 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q97b5\" (UniqueName: \"kubernetes.io/projected/8fa28813-be68-4170-845e-069e6c14689d-kube-api-access-q97b5\") pod \"insights-operator-5885fdb759-msdf9\" (UID: \"8fa28813-be68-4170-845e-069e6c14689d\") " pod="openshift-insights/insights-operator-5885fdb759-msdf9" Jul 27 09:54:27.363125 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:27.363104 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-gqgcx" Jul 27 09:54:27.453592 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:27.453561 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-t4c46" Jul 27 09:54:27.459361 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:27.459341 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-msdf9" Jul 27 09:54:27.487145 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:27.487120 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-gqgcx"] Jul 27 09:54:27.490477 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:54:27.490451 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7a42a0d_f7e2_49ba_a366_88d424f60c20.slice/crio-58f672e75ea2551eddb632f9301ce05c56c8ccfe675a9e904d5dafbdb3d26f3f WatchSource:0}: Error finding container 58f672e75ea2551eddb632f9301ce05c56c8ccfe675a9e904d5dafbdb3d26f3f: Status 404 returned error can't find the container with id 58f672e75ea2551eddb632f9301ce05c56c8ccfe675a9e904d5dafbdb3d26f3f Jul 27 09:54:27.584204 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:27.584053 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-t4c46"] Jul 27 09:54:27.586425 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:54:27.586400 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8455d96_d25b_4d6a_af5d_2c2091b8e78a.slice/crio-1160750acc3988c623f145ddf5ce4a068436b667af026e15d303aff337769173 WatchSource:0}: Error finding container 1160750acc3988c623f145ddf5ce4a068436b667af026e15d303aff337769173: Status 404 returned error can't find the container with id 1160750acc3988c623f145ddf5ce4a068436b667af026e15d303aff337769173 Jul 27 09:54:27.600968 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:27.600939 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-msdf9"] Jul 27 09:54:27.603781 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:54:27.603757 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fa28813_be68_4170_845e_069e6c14689d.slice/crio-9b52340356227d28290a9e7a25ac4c24694d94fd0d86793e1e9f4ee99176aeea WatchSource:0}: Error finding container 9b52340356227d28290a9e7a25ac4c24694d94fd0d86793e1e9f4ee99176aeea: Status 404 returned error can't find the container with id 9b52340356227d28290a9e7a25ac4c24694d94fd0d86793e1e9f4ee99176aeea Jul 27 09:54:27.634323 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:27.634279 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-gqgcx" event={"ID":"a7a42a0d-f7e2-49ba-a366-88d424f60c20","Type":"ContainerStarted","Data":"58f672e75ea2551eddb632f9301ce05c56c8ccfe675a9e904d5dafbdb3d26f3f"} Jul 27 09:54:27.635196 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:27.635177 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-msdf9" event={"ID":"8fa28813-be68-4170-845e-069e6c14689d","Type":"ContainerStarted","Data":"9b52340356227d28290a9e7a25ac4c24694d94fd0d86793e1e9f4ee99176aeea"} Jul 27 09:54:27.636110 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:27.636089 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-t4c46" event={"ID":"c8455d96-d25b-4d6a-af5d-2c2091b8e78a","Type":"ContainerStarted","Data":"1160750acc3988c623f145ddf5ce4a068436b667af026e15d303aff337769173"} Jul 27 09:54:27.733446 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:27.733423 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2f427709-8cba-45c3-9434-ab21cbd1fa4c-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-24h5q\" (UID: \"2f427709-8cba-45c3-9434-ab21cbd1fa4c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-24h5q" Jul 27 09:54:27.733535 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:27.733489 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c7ee9b6a-d070-4453-b366-4366d0949b35-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-9st6k\" (UID: \"c7ee9b6a-d070-4453-b366-4366d0949b35\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-9st6k" Jul 27 09:54:27.733583 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:54:27.733570 2556 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 27 09:54:27.733583 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:54:27.733570 2556 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 27 09:54:27.733655 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:54:27.733626 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7ee9b6a-d070-4453-b366-4366d0949b35-cluster-monitoring-operator-tls podName:c7ee9b6a-d070-4453-b366-4366d0949b35 nodeName:}" failed. No retries permitted until 2026-07-27 09:54:28.73360907 +0000 UTC m=+255.324106295 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c7ee9b6a-d070-4453-b366-4366d0949b35-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-9st6k" (UID: "c7ee9b6a-d070-4453-b366-4366d0949b35") : secret "cluster-monitoring-operator-tls" not found Jul 27 09:54:27.733655 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:54:27.733643 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f427709-8cba-45c3-9434-ab21cbd1fa4c-samples-operator-tls podName:2f427709-8cba-45c3-9434-ab21cbd1fa4c nodeName:}" failed. No retries permitted until 2026-07-27 09:54:28.73363354 +0000 UTC m=+255.324130757 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2f427709-8cba-45c3-9434-ab21cbd1fa4c-samples-operator-tls") pod "cluster-samples-operator-6748489656-24h5q" (UID: "2f427709-8cba-45c3-9434-ab21cbd1fa4c") : secret "samples-operator-tls" not found Jul 27 09:54:28.742609 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:28.742574 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c7ee9b6a-d070-4453-b366-4366d0949b35-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-9st6k\" (UID: \"c7ee9b6a-d070-4453-b366-4366d0949b35\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-9st6k" Jul 27 09:54:28.743057 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:28.742675 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2f427709-8cba-45c3-9434-ab21cbd1fa4c-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-24h5q\" (UID: \"2f427709-8cba-45c3-9434-ab21cbd1fa4c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-24h5q" Jul 27 09:54:28.743057 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:54:28.742727 2556 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 27 09:54:28.743057 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:54:28.742787 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7ee9b6a-d070-4453-b366-4366d0949b35-cluster-monitoring-operator-tls podName:c7ee9b6a-d070-4453-b366-4366d0949b35 nodeName:}" failed. No retries permitted until 2026-07-27 09:54:30.742770391 +0000 UTC m=+257.333267619 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c7ee9b6a-d070-4453-b366-4366d0949b35-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-9st6k" (UID: "c7ee9b6a-d070-4453-b366-4366d0949b35") : secret "cluster-monitoring-operator-tls" not found Jul 27 09:54:28.743057 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:54:28.742805 2556 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 27 09:54:28.743057 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:54:28.742835 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f427709-8cba-45c3-9434-ab21cbd1fa4c-samples-operator-tls podName:2f427709-8cba-45c3-9434-ab21cbd1fa4c nodeName:}" failed. No retries permitted until 2026-07-27 09:54:30.742826018 +0000 UTC m=+257.333323236 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2f427709-8cba-45c3-9434-ab21cbd1fa4c-samples-operator-tls") pod "cluster-samples-operator-6748489656-24h5q" (UID: "2f427709-8cba-45c3-9434-ab21cbd1fa4c") : secret "samples-operator-tls" not found Jul 27 09:54:30.646338 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:30.646289 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-gqgcx_a7a42a0d-f7e2-49ba-a366-88d424f60c20/console-operator/0.log" Jul 27 09:54:30.646698 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:30.646356 2556 generic.go:356] "Generic (PLEG): container finished" podID="a7a42a0d-f7e2-49ba-a366-88d424f60c20" containerID="59d657eff6d3be32c77d463b0e63fdb9d63ab83074115cfb58ef07bae6b47b5a" exitCode=255 Jul 27 09:54:30.646698 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:30.646448 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-gqgcx" event={"ID":"a7a42a0d-f7e2-49ba-a366-88d424f60c20","Type":"ContainerDied","Data":"59d657eff6d3be32c77d463b0e63fdb9d63ab83074115cfb58ef07bae6b47b5a"} Jul 27 09:54:30.646698 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:30.646609 2556 scope.go:117] "RemoveContainer" containerID="59d657eff6d3be32c77d463b0e63fdb9d63ab83074115cfb58ef07bae6b47b5a" Jul 27 09:54:30.647981 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:30.647962 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-msdf9" event={"ID":"8fa28813-be68-4170-845e-069e6c14689d","Type":"ContainerStarted","Data":"c11091bbcddc079e11a28c9d446ece27c92ef4bf5b2034bd2a5ae32f446660b6"} Jul 27 09:54:30.649338 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:30.649316 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-t4c46" event={"ID":"c8455d96-d25b-4d6a-af5d-2c2091b8e78a","Type":"ContainerStarted","Data":"3cada934bc7e7fe377362385236c0207758aec4f62345c5e2655dbeb06765919"} Jul 27 09:54:30.690193 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:30.690153 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5885fdb759-msdf9" podStartSLOduration=1.080722396 podStartE2EDuration="3.690139433s" totalImagesPullingTime="2.609417037s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 09:54:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 09:54:30.689108743 +0000 UTC m=+257.279605980" watchObservedRunningTime="2026-07-27 09:54:30.690139433 +0000 UTC m=+257.280636645" Jul 27 09:54:30.708611 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:30.708559 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-t4c46" podStartSLOduration=1.082555641 podStartE2EDuration="3.708540041s" totalImagesPullingTime="2.6259844s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 09:54:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 09:54:30.708084897 +0000 UTC m=+257.298582131" watchObservedRunningTime="2026-07-27 09:54:30.708540041 +0000 UTC m=+257.299037276" Jul 27 09:54:30.760160 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:30.760129 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c7ee9b6a-d070-4453-b366-4366d0949b35-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-9st6k\" (UID: \"c7ee9b6a-d070-4453-b366-4366d0949b35\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-9st6k" Jul 27 09:54:30.760764 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:54:30.760342 2556 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 27 09:54:30.760764 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:54:30.760417 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7ee9b6a-d070-4453-b366-4366d0949b35-cluster-monitoring-operator-tls podName:c7ee9b6a-d070-4453-b366-4366d0949b35 nodeName:}" failed. No retries permitted until 2026-07-27 09:54:34.760401248 +0000 UTC m=+261.350898460 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c7ee9b6a-d070-4453-b366-4366d0949b35-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-9st6k" (UID: "c7ee9b6a-d070-4453-b366-4366d0949b35") : secret "cluster-monitoring-operator-tls" not found Jul 27 09:54:30.760764 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:30.760572 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2f427709-8cba-45c3-9434-ab21cbd1fa4c-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-24h5q\" (UID: \"2f427709-8cba-45c3-9434-ab21cbd1fa4c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-24h5q" Jul 27 09:54:30.760764 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:54:30.760714 2556 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 27 09:54:30.760764 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:54:30.760747 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f427709-8cba-45c3-9434-ab21cbd1fa4c-samples-operator-tls podName:2f427709-8cba-45c3-9434-ab21cbd1fa4c nodeName:}" failed. No retries permitted until 2026-07-27 09:54:34.760736809 +0000 UTC m=+261.351234052 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2f427709-8cba-45c3-9434-ab21cbd1fa4c-samples-operator-tls") pod "cluster-samples-operator-6748489656-24h5q" (UID: "2f427709-8cba-45c3-9434-ab21cbd1fa4c") : secret "samples-operator-tls" not found Jul 27 09:54:31.479204 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:31.479166 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-rmdcz"] Jul 27 09:54:31.482442 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:31.482424 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rmdcz" Jul 27 09:54:31.485572 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:31.485524 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 27 09:54:31.485720 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:31.485617 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-dqlrd\"" Jul 27 09:54:31.486729 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:31.486710 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 27 09:54:31.497708 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:31.497688 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rmdcz"] Jul 27 09:54:31.565972 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:31.565950 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a7160ea4-3ff4-4f76-b373-bc30be56f1f9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rmdcz\" (UID: \"a7160ea4-3ff4-4f76-b373-bc30be56f1f9\") " pod="openshift-insights/insights-runtime-extractor-rmdcz" Jul 27 09:54:31.566063 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:31.566001 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a7160ea4-3ff4-4f76-b373-bc30be56f1f9-data-volume\") pod \"insights-runtime-extractor-rmdcz\" (UID: \"a7160ea4-3ff4-4f76-b373-bc30be56f1f9\") " pod="openshift-insights/insights-runtime-extractor-rmdcz" Jul 27 09:54:31.566063 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:31.566047 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a7160ea4-3ff4-4f76-b373-bc30be56f1f9-crio-socket\") pod \"insights-runtime-extractor-rmdcz\" (UID: \"a7160ea4-3ff4-4f76-b373-bc30be56f1f9\") " pod="openshift-insights/insights-runtime-extractor-rmdcz" Jul 27 09:54:31.566137 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:31.566074 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7tr8\" (UniqueName: \"kubernetes.io/projected/a7160ea4-3ff4-4f76-b373-bc30be56f1f9-kube-api-access-l7tr8\") pod \"insights-runtime-extractor-rmdcz\" (UID: \"a7160ea4-3ff4-4f76-b373-bc30be56f1f9\") " pod="openshift-insights/insights-runtime-extractor-rmdcz" Jul 27 09:54:31.566137 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:31.566133 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a7160ea4-3ff4-4f76-b373-bc30be56f1f9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rmdcz\" (UID: \"a7160ea4-3ff4-4f76-b373-bc30be56f1f9\") " pod="openshift-insights/insights-runtime-extractor-rmdcz" Jul 27 09:54:31.653883 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:31.653867 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-gqgcx_a7a42a0d-f7e2-49ba-a366-88d424f60c20/console-operator/1.log" Jul 27 09:54:31.654258 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:31.654246 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-gqgcx_a7a42a0d-f7e2-49ba-a366-88d424f60c20/console-operator/0.log" Jul 27 09:54:31.654315 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:31.654275 2556 generic.go:356] "Generic (PLEG): container finished" podID="a7a42a0d-f7e2-49ba-a366-88d424f60c20" containerID="49f5522486ef4e649c4a7e8024df2c7d7e68e20c06c90eca73cb1ceabbd921fc" exitCode=255 Jul 27 09:54:31.654347 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:31.654319 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-gqgcx" event={"ID":"a7a42a0d-f7e2-49ba-a366-88d424f60c20","Type":"ContainerDied","Data":"49f5522486ef4e649c4a7e8024df2c7d7e68e20c06c90eca73cb1ceabbd921fc"} Jul 27 09:54:31.654380 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:31.654373 2556 scope.go:117] "RemoveContainer" containerID="59d657eff6d3be32c77d463b0e63fdb9d63ab83074115cfb58ef07bae6b47b5a" Jul 27 09:54:31.654600 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:31.654581 2556 scope.go:117] "RemoveContainer" containerID="49f5522486ef4e649c4a7e8024df2c7d7e68e20c06c90eca73cb1ceabbd921fc" Jul 27 09:54:31.654798 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:54:31.654779 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-gqgcx_openshift-console-operator(a7a42a0d-f7e2-49ba-a366-88d424f60c20)\"" pod="openshift-console-operator/console-operator-584dcb6b54-gqgcx" podUID="a7a42a0d-f7e2-49ba-a366-88d424f60c20" Jul 27 09:54:31.666663 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:31.666646 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a7160ea4-3ff4-4f76-b373-bc30be56f1f9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rmdcz\" (UID: \"a7160ea4-3ff4-4f76-b373-bc30be56f1f9\") " pod="openshift-insights/insights-runtime-extractor-rmdcz" Jul 27 09:54:31.666738 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:31.666689 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a7160ea4-3ff4-4f76-b373-bc30be56f1f9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rmdcz\" (UID: \"a7160ea4-3ff4-4f76-b373-bc30be56f1f9\") " pod="openshift-insights/insights-runtime-extractor-rmdcz" Jul 27 09:54:31.666776 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:31.666738 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a7160ea4-3ff4-4f76-b373-bc30be56f1f9-data-volume\") pod \"insights-runtime-extractor-rmdcz\" (UID: \"a7160ea4-3ff4-4f76-b373-bc30be56f1f9\") " pod="openshift-insights/insights-runtime-extractor-rmdcz" Jul 27 09:54:31.666776 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:54:31.666754 2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 27 09:54:31.666874 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:31.666783 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a7160ea4-3ff4-4f76-b373-bc30be56f1f9-crio-socket\") pod \"insights-runtime-extractor-rmdcz\" (UID: \"a7160ea4-3ff4-4f76-b373-bc30be56f1f9\") " pod="openshift-insights/insights-runtime-extractor-rmdcz" Jul 27 09:54:31.666874 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:54:31.666808 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a7160ea4-3ff4-4f76-b373-bc30be56f1f9-kube-rbac-proxy-cm podName:a7160ea4-3ff4-4f76-b373-bc30be56f1f9 nodeName:}" failed. No retries permitted until 2026-07-27 09:54:32.166792999 +0000 UTC m=+258.757290230 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a7160ea4-3ff4-4f76-b373-bc30be56f1f9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rmdcz" (UID: "a7160ea4-3ff4-4f76-b373-bc30be56f1f9") : configmap "kube-rbac-proxy" not found Jul 27 09:54:31.666874 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:31.666835 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a7160ea4-3ff4-4f76-b373-bc30be56f1f9-crio-socket\") pod \"insights-runtime-extractor-rmdcz\" (UID: \"a7160ea4-3ff4-4f76-b373-bc30be56f1f9\") " pod="openshift-insights/insights-runtime-extractor-rmdcz" Jul 27 09:54:31.666874 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:54:31.666841 2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 27 09:54:31.666874 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:31.666849 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7tr8\" (UniqueName: \"kubernetes.io/projected/a7160ea4-3ff4-4f76-b373-bc30be56f1f9-kube-api-access-l7tr8\") pod \"insights-runtime-extractor-rmdcz\" (UID: \"a7160ea4-3ff4-4f76-b373-bc30be56f1f9\") " pod="openshift-insights/insights-runtime-extractor-rmdcz" Jul 27 09:54:31.667103 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:54:31.666902 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7160ea4-3ff4-4f76-b373-bc30be56f1f9-insights-runtime-extractor-tls podName:a7160ea4-3ff4-4f76-b373-bc30be56f1f9 nodeName:}" failed. No retries permitted until 2026-07-27 09:54:32.166891997 +0000 UTC m=+258.757389208 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a7160ea4-3ff4-4f76-b373-bc30be56f1f9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rmdcz" (UID: "a7160ea4-3ff4-4f76-b373-bc30be56f1f9") : secret "insights-runtime-extractor-tls" not found Jul 27 09:54:31.667103 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:31.667053 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a7160ea4-3ff4-4f76-b373-bc30be56f1f9-data-volume\") pod \"insights-runtime-extractor-rmdcz\" (UID: \"a7160ea4-3ff4-4f76-b373-bc30be56f1f9\") " pod="openshift-insights/insights-runtime-extractor-rmdcz" Jul 27 09:54:31.678228 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:31.678205 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7tr8\" (UniqueName: \"kubernetes.io/projected/a7160ea4-3ff4-4f76-b373-bc30be56f1f9-kube-api-access-l7tr8\") pod \"insights-runtime-extractor-rmdcz\" (UID: \"a7160ea4-3ff4-4f76-b373-bc30be56f1f9\") " pod="openshift-insights/insights-runtime-extractor-rmdcz" Jul 27 09:54:32.170514 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:32.170483 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a7160ea4-3ff4-4f76-b373-bc30be56f1f9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rmdcz\" (UID: \"a7160ea4-3ff4-4f76-b373-bc30be56f1f9\") " pod="openshift-insights/insights-runtime-extractor-rmdcz" Jul 27 09:54:32.170668 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:32.170566 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a7160ea4-3ff4-4f76-b373-bc30be56f1f9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rmdcz\" (UID: \"a7160ea4-3ff4-4f76-b373-bc30be56f1f9\") " pod="openshift-insights/insights-runtime-extractor-rmdcz" Jul 27 09:54:32.170668 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:54:32.170620 2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 27 09:54:32.170733 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:54:32.170677 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7160ea4-3ff4-4f76-b373-bc30be56f1f9-insights-runtime-extractor-tls podName:a7160ea4-3ff4-4f76-b373-bc30be56f1f9 nodeName:}" failed. No retries permitted until 2026-07-27 09:54:33.170663423 +0000 UTC m=+259.761160634 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a7160ea4-3ff4-4f76-b373-bc30be56f1f9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rmdcz" (UID: "a7160ea4-3ff4-4f76-b373-bc30be56f1f9") : secret "insights-runtime-extractor-tls" not found Jul 27 09:54:32.170733 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:54:32.170622 2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 27 09:54:32.170800 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:54:32.170746 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a7160ea4-3ff4-4f76-b373-bc30be56f1f9-kube-rbac-proxy-cm podName:a7160ea4-3ff4-4f76-b373-bc30be56f1f9 nodeName:}" failed. No retries permitted until 2026-07-27 09:54:33.170734816 +0000 UTC m=+259.761232061 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a7160ea4-3ff4-4f76-b373-bc30be56f1f9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rmdcz" (UID: "a7160ea4-3ff4-4f76-b373-bc30be56f1f9") : configmap "kube-rbac-proxy" not found Jul 27 09:54:32.659394 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:32.659367 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-gqgcx_a7a42a0d-f7e2-49ba-a366-88d424f60c20/console-operator/1.log" Jul 27 09:54:32.659778 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:32.659644 2556 scope.go:117] "RemoveContainer" containerID="49f5522486ef4e649c4a7e8024df2c7d7e68e20c06c90eca73cb1ceabbd921fc" Jul 27 09:54:32.659842 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:54:32.659776 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-gqgcx_openshift-console-operator(a7a42a0d-f7e2-49ba-a366-88d424f60c20)\"" pod="openshift-console-operator/console-operator-584dcb6b54-gqgcx" podUID="a7a42a0d-f7e2-49ba-a366-88d424f60c20" Jul 27 09:54:32.777995 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:32.777969 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-vzhdc"] Jul 27 09:54:32.782069 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:32.782055 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-vzhdc" Jul 27 09:54:32.784929 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:32.784901 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-r57ns\"" Jul 27 09:54:32.785040 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:32.784932 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 27 09:54:32.785040 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:32.784966 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 27 09:54:32.790799 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:32.790777 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-vzhdc"] Jul 27 09:54:32.876350 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:32.876326 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnrh2\" (UniqueName: \"kubernetes.io/projected/2e6cbabb-aed7-441b-8c0b-1e95cafd32a4-kube-api-access-xnrh2\") pod \"migrator-6865c9967-vzhdc\" (UID: \"2e6cbabb-aed7-441b-8c0b-1e95cafd32a4\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-vzhdc" Jul 27 09:54:32.976916 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:32.976858 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnrh2\" (UniqueName: \"kubernetes.io/projected/2e6cbabb-aed7-441b-8c0b-1e95cafd32a4-kube-api-access-xnrh2\") pod \"migrator-6865c9967-vzhdc\" (UID: \"2e6cbabb-aed7-441b-8c0b-1e95cafd32a4\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-vzhdc" Jul 27 09:54:32.986900 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:32.986877 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnrh2\" (UniqueName: \"kubernetes.io/projected/2e6cbabb-aed7-441b-8c0b-1e95cafd32a4-kube-api-access-xnrh2\") pod \"migrator-6865c9967-vzhdc\" (UID: \"2e6cbabb-aed7-441b-8c0b-1e95cafd32a4\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-vzhdc" Jul 27 09:54:33.090251 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:33.090227 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-vzhdc" Jul 27 09:54:33.177799 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:33.177777 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a7160ea4-3ff4-4f76-b373-bc30be56f1f9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rmdcz\" (UID: \"a7160ea4-3ff4-4f76-b373-bc30be56f1f9\") " pod="openshift-insights/insights-runtime-extractor-rmdcz" Jul 27 09:54:33.177915 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:33.177887 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a7160ea4-3ff4-4f76-b373-bc30be56f1f9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rmdcz\" (UID: \"a7160ea4-3ff4-4f76-b373-bc30be56f1f9\") " pod="openshift-insights/insights-runtime-extractor-rmdcz" Jul 27 09:54:33.177962 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:54:33.177936 2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 27 09:54:33.178018 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:54:33.177972 2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 27 09:54:33.178018 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:54:33.177997 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7160ea4-3ff4-4f76-b373-bc30be56f1f9-insights-runtime-extractor-tls podName:a7160ea4-3ff4-4f76-b373-bc30be56f1f9 nodeName:}" failed. No retries permitted until 2026-07-27 09:54:35.177980656 +0000 UTC m=+261.768477870 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a7160ea4-3ff4-4f76-b373-bc30be56f1f9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rmdcz" (UID: "a7160ea4-3ff4-4f76-b373-bc30be56f1f9") : secret "insights-runtime-extractor-tls" not found Jul 27 09:54:33.178018 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:54:33.178013 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a7160ea4-3ff4-4f76-b373-bc30be56f1f9-kube-rbac-proxy-cm podName:a7160ea4-3ff4-4f76-b373-bc30be56f1f9 nodeName:}" failed. No retries permitted until 2026-07-27 09:54:35.178004499 +0000 UTC m=+261.768501711 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a7160ea4-3ff4-4f76-b373-bc30be56f1f9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rmdcz" (UID: "a7160ea4-3ff4-4f76-b373-bc30be56f1f9") : configmap "kube-rbac-proxy" not found Jul 27 09:54:33.208007 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:33.207986 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-vzhdc"] Jul 27 09:54:33.210134 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:54:33.210105 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e6cbabb_aed7_441b_8c0b_1e95cafd32a4.slice/crio-ea7cb08c8b6cb7e6dfb4e5456d5698baf4285177cc100ce8ca4460563f4e201c WatchSource:0}: Error finding container ea7cb08c8b6cb7e6dfb4e5456d5698baf4285177cc100ce8ca4460563f4e201c: Status 404 returned error can't find the container with id ea7cb08c8b6cb7e6dfb4e5456d5698baf4285177cc100ce8ca4460563f4e201c Jul 27 09:54:33.263342 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:33.263271 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4mdxm_c01da73c-3338-41bb-884a-f7c145421d57/dns-node-resolver/0.log" Jul 27 09:54:33.663288 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:33.663263 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-vzhdc" event={"ID":"2e6cbabb-aed7-441b-8c0b-1e95cafd32a4","Type":"ContainerStarted","Data":"ea7cb08c8b6cb7e6dfb4e5456d5698baf4285177cc100ce8ca4460563f4e201c"} Jul 27 09:54:34.663172 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:34.663148 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wgfkj_3400c9d3-50c8-4143-83fb-e22dbe5b627a/node-ca/0.log" Jul 27 09:54:34.667886 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:34.667856 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-vzhdc" event={"ID":"2e6cbabb-aed7-441b-8c0b-1e95cafd32a4","Type":"ContainerStarted","Data":"b37ddf827293b3681b0d43c917655f9e78507f84bc136bf09176c6f1cd827a77"} Jul 27 09:54:34.668224 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:34.667907 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-vzhdc" event={"ID":"2e6cbabb-aed7-441b-8c0b-1e95cafd32a4","Type":"ContainerStarted","Data":"8af671f80f30ed82d65623713b9f6c01a2e5b3f5681193812ce27368a3995766"} Jul 27 09:54:34.792155 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:34.792122 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2f427709-8cba-45c3-9434-ab21cbd1fa4c-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-24h5q\" (UID: \"2f427709-8cba-45c3-9434-ab21cbd1fa4c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-24h5q" Jul 27 09:54:34.792266 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:34.792213 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c7ee9b6a-d070-4453-b366-4366d0949b35-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-9st6k\" (UID: \"c7ee9b6a-d070-4453-b366-4366d0949b35\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-9st6k" Jul 27 09:54:34.792266 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:54:34.792254 2556 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 27 09:54:34.792353 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:54:34.792316 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f427709-8cba-45c3-9434-ab21cbd1fa4c-samples-operator-tls podName:2f427709-8cba-45c3-9434-ab21cbd1fa4c nodeName:}" failed. No retries permitted until 2026-07-27 09:54:42.792292061 +0000 UTC m=+269.382789272 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2f427709-8cba-45c3-9434-ab21cbd1fa4c-samples-operator-tls") pod "cluster-samples-operator-6748489656-24h5q" (UID: "2f427709-8cba-45c3-9434-ab21cbd1fa4c") : secret "samples-operator-tls" not found Jul 27 09:54:34.792353 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:54:34.792343 2556 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 27 09:54:34.792432 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:54:34.792389 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7ee9b6a-d070-4453-b366-4366d0949b35-cluster-monitoring-operator-tls podName:c7ee9b6a-d070-4453-b366-4366d0949b35 nodeName:}" failed. No retries permitted until 2026-07-27 09:54:42.792376058 +0000 UTC m=+269.382873282 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c7ee9b6a-d070-4453-b366-4366d0949b35-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-9st6k" (UID: "c7ee9b6a-d070-4453-b366-4366d0949b35") : secret "cluster-monitoring-operator-tls" not found Jul 27 09:54:35.195818 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:35.195791 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a7160ea4-3ff4-4f76-b373-bc30be56f1f9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rmdcz\" (UID: \"a7160ea4-3ff4-4f76-b373-bc30be56f1f9\") " pod="openshift-insights/insights-runtime-extractor-rmdcz" Jul 27 09:54:35.195946 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:35.195842 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a7160ea4-3ff4-4f76-b373-bc30be56f1f9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rmdcz\" (UID: \"a7160ea4-3ff4-4f76-b373-bc30be56f1f9\") " pod="openshift-insights/insights-runtime-extractor-rmdcz" Jul 27 09:54:35.195946 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:54:35.195914 2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 27 09:54:35.195946 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:54:35.195936 2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 27 09:54:35.196040 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:54:35.195977 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a7160ea4-3ff4-4f76-b373-bc30be56f1f9-kube-rbac-proxy-cm podName:a7160ea4-3ff4-4f76-b373-bc30be56f1f9 nodeName:}" failed. No retries permitted until 2026-07-27 09:54:39.195960933 +0000 UTC m=+265.786458144 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a7160ea4-3ff4-4f76-b373-bc30be56f1f9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rmdcz" (UID: "a7160ea4-3ff4-4f76-b373-bc30be56f1f9") : configmap "kube-rbac-proxy" not found Jul 27 09:54:35.196040 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:54:35.195990 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7160ea4-3ff4-4f76-b373-bc30be56f1f9-insights-runtime-extractor-tls podName:a7160ea4-3ff4-4f76-b373-bc30be56f1f9 nodeName:}" failed. No retries permitted until 2026-07-27 09:54:39.195984209 +0000 UTC m=+265.786481420 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a7160ea4-3ff4-4f76-b373-bc30be56f1f9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rmdcz" (UID: "a7160ea4-3ff4-4f76-b373-bc30be56f1f9") : secret "insights-runtime-extractor-tls" not found Jul 27 09:54:35.267847 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:35.267792 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hbcw9_96a91a1b-f1c8-4710-9473-3c032767f309/serve-healthcheck-canary/0.log" Jul 27 09:54:37.363505 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:37.363429 2556 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-584dcb6b54-gqgcx" Jul 27 09:54:37.363505 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:37.363487 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-gqgcx" Jul 27 09:54:37.363835 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:37.363778 2556 scope.go:117] "RemoveContainer" containerID="49f5522486ef4e649c4a7e8024df2c7d7e68e20c06c90eca73cb1ceabbd921fc" Jul 27 09:54:37.363918 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:54:37.363899 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-gqgcx_openshift-console-operator(a7a42a0d-f7e2-49ba-a366-88d424f60c20)\"" pod="openshift-console-operator/console-operator-584dcb6b54-gqgcx" podUID="a7a42a0d-f7e2-49ba-a366-88d424f60c20" Jul 27 09:54:39.227075 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:39.227036 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a7160ea4-3ff4-4f76-b373-bc30be56f1f9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rmdcz\" (UID: \"a7160ea4-3ff4-4f76-b373-bc30be56f1f9\") " pod="openshift-insights/insights-runtime-extractor-rmdcz" Jul 27 09:54:39.227469 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:39.227116 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a7160ea4-3ff4-4f76-b373-bc30be56f1f9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rmdcz\" (UID: \"a7160ea4-3ff4-4f76-b373-bc30be56f1f9\") " pod="openshift-insights/insights-runtime-extractor-rmdcz" Jul 27 09:54:39.227469 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:54:39.227160 2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 27 09:54:39.227469 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:54:39.227200 2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 27 09:54:39.227469 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:54:39.227239 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a7160ea4-3ff4-4f76-b373-bc30be56f1f9-kube-rbac-proxy-cm podName:a7160ea4-3ff4-4f76-b373-bc30be56f1f9 nodeName:}" failed. No retries permitted until 2026-07-27 09:54:47.227219595 +0000 UTC m=+273.817716807 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a7160ea4-3ff4-4f76-b373-bc30be56f1f9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rmdcz" (UID: "a7160ea4-3ff4-4f76-b373-bc30be56f1f9") : configmap "kube-rbac-proxy" not found Jul 27 09:54:39.227469 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:54:39.227289 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7160ea4-3ff4-4f76-b373-bc30be56f1f9-insights-runtime-extractor-tls podName:a7160ea4-3ff4-4f76-b373-bc30be56f1f9 nodeName:}" failed. No retries permitted until 2026-07-27 09:54:47.227273808 +0000 UTC m=+273.817771022 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a7160ea4-3ff4-4f76-b373-bc30be56f1f9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rmdcz" (UID: "a7160ea4-3ff4-4f76-b373-bc30be56f1f9") : secret "insights-runtime-extractor-tls" not found Jul 27 09:54:42.851999 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:42.851969 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2f427709-8cba-45c3-9434-ab21cbd1fa4c-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-24h5q\" (UID: \"2f427709-8cba-45c3-9434-ab21cbd1fa4c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-24h5q" Jul 27 09:54:42.852390 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:42.852050 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c7ee9b6a-d070-4453-b366-4366d0949b35-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-9st6k\" (UID: \"c7ee9b6a-d070-4453-b366-4366d0949b35\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-9st6k" Jul 27 09:54:42.854568 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:42.854535 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c7ee9b6a-d070-4453-b366-4366d0949b35-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-9st6k\" (UID: \"c7ee9b6a-d070-4453-b366-4366d0949b35\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-9st6k" Jul 27 09:54:42.854568 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:42.854541 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2f427709-8cba-45c3-9434-ab21cbd1fa4c-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-24h5q\" (UID: \"2f427709-8cba-45c3-9434-ab21cbd1fa4c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-24h5q" Jul 27 09:54:42.957765 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:42.957739 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-24h5q" Jul 27 09:54:42.969630 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:42.969606 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-9st6k" Jul 27 09:54:43.097507 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:43.097452 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-vzhdc" podStartSLOduration=10.020575007 podStartE2EDuration="11.097421976s" totalImagesPullingTime="1.076846969s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 09:54:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 09:54:34.688994666 +0000 UTC m=+261.279491899" watchObservedRunningTime="2026-07-27 09:54:43.097421976 +0000 UTC m=+269.687919210" Jul 27 09:54:43.097898 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:43.097879 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-24h5q"] Jul 27 09:54:43.113209 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:43.113159 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-9st6k"] Jul 27 09:54:43.115251 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:54:43.115226 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7ee9b6a_d070_4453_b366_4366d0949b35.slice/crio-3665aede9f19ea2b2fd452f87ee65b8f2d5a12e64192398200fced641ff3e48d WatchSource:0}: Error finding container 3665aede9f19ea2b2fd452f87ee65b8f2d5a12e64192398200fced641ff3e48d: Status 404 returned error can't find the container with id 3665aede9f19ea2b2fd452f87ee65b8f2d5a12e64192398200fced641ff3e48d Jul 27 09:54:43.696883 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:43.696855 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-9st6k" event={"ID":"c7ee9b6a-d070-4453-b366-4366d0949b35","Type":"ContainerStarted","Data":"3665aede9f19ea2b2fd452f87ee65b8f2d5a12e64192398200fced641ff3e48d"} Jul 27 09:54:43.697869 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:43.697851 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-24h5q" event={"ID":"2f427709-8cba-45c3-9434-ab21cbd1fa4c","Type":"ContainerStarted","Data":"8fcba8e449ea245b05db50b9d388260dfc5e0fc952755aa5fe7611c06d0b18a1"} Jul 27 09:54:45.706571 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:45.706488 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-9st6k" event={"ID":"c7ee9b6a-d070-4453-b366-4366d0949b35","Type":"ContainerStarted","Data":"a9ff026f7df20b6558b4826dd494f49b01297a2bbc0a73c0927893acaebc8b15"} Jul 27 09:54:45.708417 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:45.708391 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-24h5q" event={"ID":"2f427709-8cba-45c3-9434-ab21cbd1fa4c","Type":"ContainerStarted","Data":"b2bb42d7b591763fc31c839f6a3afd7469476c72238c8f4b8a458d3ca9fcdba0"} Jul 27 09:54:45.708526 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:45.708432 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-24h5q" event={"ID":"2f427709-8cba-45c3-9434-ab21cbd1fa4c","Type":"ContainerStarted","Data":"04a1d1350c84232951720e5fa9786d307418168aa86bf3a8e895959b78632e37"} Jul 27 09:54:45.730197 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:45.730155 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-9st6k" podStartSLOduration=16.497877235 podStartE2EDuration="18.730141843s" totalImagesPullingTime="2.232264608s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 09:54:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 09:54:45.728834703 +0000 UTC m=+272.319331935" watchObservedRunningTime="2026-07-27 09:54:45.730141843 +0000 UTC m=+272.320639076" Jul 27 09:54:45.749279 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:45.749237 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-24h5q" podStartSLOduration=16.547464903 podStartE2EDuration="18.749224464s" totalImagesPullingTime="2.201759561s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 09:54:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 09:54:45.747733245 +0000 UTC m=+272.338230481" watchObservedRunningTime="2026-07-27 09:54:45.749224464 +0000 UTC m=+272.339721696" Jul 27 09:54:47.285970 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:47.285930 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a7160ea4-3ff4-4f76-b373-bc30be56f1f9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rmdcz\" (UID: \"a7160ea4-3ff4-4f76-b373-bc30be56f1f9\") " pod="openshift-insights/insights-runtime-extractor-rmdcz" Jul 27 09:54:47.286331 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:47.286027 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a7160ea4-3ff4-4f76-b373-bc30be56f1f9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rmdcz\" (UID: \"a7160ea4-3ff4-4f76-b373-bc30be56f1f9\") " pod="openshift-insights/insights-runtime-extractor-rmdcz" Jul 27 09:54:47.286509 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:47.286491 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a7160ea4-3ff4-4f76-b373-bc30be56f1f9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rmdcz\" (UID: \"a7160ea4-3ff4-4f76-b373-bc30be56f1f9\") " pod="openshift-insights/insights-runtime-extractor-rmdcz" Jul 27 09:54:47.288217 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:47.288197 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a7160ea4-3ff4-4f76-b373-bc30be56f1f9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rmdcz\" (UID: \"a7160ea4-3ff4-4f76-b373-bc30be56f1f9\") " pod="openshift-insights/insights-runtime-extractor-rmdcz" Jul 27 09:54:47.391267 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:47.391246 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rmdcz" Jul 27 09:54:47.520236 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:47.520198 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rmdcz"] Jul 27 09:54:47.522786 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:54:47.522757 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7160ea4_3ff4_4f76_b373_bc30be56f1f9.slice/crio-f94a4262ea48c28674cf6a742646d532b8f72dbbd15c265361e11e46cb216b96 WatchSource:0}: Error finding container f94a4262ea48c28674cf6a742646d532b8f72dbbd15c265361e11e46cb216b96: Status 404 returned error can't find the container with id f94a4262ea48c28674cf6a742646d532b8f72dbbd15c265361e11e46cb216b96 Jul 27 09:54:47.714973 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:47.714943 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rmdcz" event={"ID":"a7160ea4-3ff4-4f76-b373-bc30be56f1f9","Type":"ContainerStarted","Data":"f94a4262ea48c28674cf6a742646d532b8f72dbbd15c265361e11e46cb216b96"} Jul 27 09:54:49.904956 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:49.904914 2556 scope.go:117] "RemoveContainer" containerID="49f5522486ef4e649c4a7e8024df2c7d7e68e20c06c90eca73cb1ceabbd921fc" Jul 27 09:54:52.736661 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:52.736624 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rmdcz" event={"ID":"a7160ea4-3ff4-4f76-b373-bc30be56f1f9","Type":"ContainerStarted","Data":"c75992d63694d274b1ed05c0bda87d059e19155f961dca72bb21819c199b510e"} Jul 27 09:54:52.739238 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:52.739215 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-gqgcx_a7a42a0d-f7e2-49ba-a366-88d424f60c20/console-operator/1.log" Jul 27 09:54:52.739372 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:52.739269 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-gqgcx" event={"ID":"a7a42a0d-f7e2-49ba-a366-88d424f60c20","Type":"ContainerStarted","Data":"0839f2c8d7f13c00c2730c49a642871b6ad7580988e92d43ea4f8a1d36cbcf6e"} Jul 27 09:54:52.739825 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:52.739786 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-gqgcx" Jul 27 09:54:52.760348 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:52.760283 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-584dcb6b54-gqgcx" podStartSLOduration=23.041384122 podStartE2EDuration="25.760271007s" totalImagesPullingTime="2.718886885s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 09:54:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 09:54:52.759801595 +0000 UTC m=+279.350298829" watchObservedRunningTime="2026-07-27 09:54:52.760271007 +0000 UTC m=+279.350768242" Jul 27 09:54:53.347654 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:53.347623 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-584dcb6b54-gqgcx" Jul 27 09:54:55.425609 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:54:55.425578 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-74c9f884b7-dsz8p" podUID="2daea300-7a7e-412b-a226-b0214ffe75a3" Jul 27 09:54:55.425609 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:54:55.425596 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-p5w7g" podUID="3de4b7d7-40ed-495d-b81a-fecb048d11c0" Jul 27 09:54:55.425609 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:54:55.425605 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-65fb7b8f98-flrh7" podUID="6b9360ad-3b69-4a8d-b35f-cb88207a26d0" Jul 27 09:54:55.750991 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:55.750926 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rmdcz" event={"ID":"a7160ea4-3ff4-4f76-b373-bc30be56f1f9","Type":"ContainerStarted","Data":"06a34f6c28102b69cbd7b2579b4d8c5d81ebd72766f7985aa8f0e660f0055cab"} Jul 27 09:54:55.750991 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:55.750944 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-p5w7g" Jul 27 09:54:55.750991 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:55.750932 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65fb7b8f98-flrh7" Jul 27 09:54:55.751249 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:55.750935 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-dsz8p" Jul 27 09:54:58.787968 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:58.787937 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2daea300-7a7e-412b-a226-b0214ffe75a3-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-dsz8p\" (UID: \"2daea300-7a7e-412b-a226-b0214ffe75a3\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-dsz8p" Jul 27 09:54:58.788413 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:58.787984 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6b9360ad-3b69-4a8d-b35f-cb88207a26d0-registry-tls\") pod \"image-registry-65fb7b8f98-flrh7\" (UID: \"6b9360ad-3b69-4a8d-b35f-cb88207a26d0\") " pod="openshift-image-registry/image-registry-65fb7b8f98-flrh7" Jul 27 09:54:58.788413 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:58.788028 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3de4b7d7-40ed-495d-b81a-fecb048d11c0-metrics-tls\") pod \"dns-default-p5w7g\" (UID: \"3de4b7d7-40ed-495d-b81a-fecb048d11c0\") " pod="openshift-dns/dns-default-p5w7g" Jul 27 09:54:58.790710 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:58.790677 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2daea300-7a7e-412b-a226-b0214ffe75a3-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-dsz8p\" (UID: \"2daea300-7a7e-412b-a226-b0214ffe75a3\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-dsz8p" Jul 27 09:54:58.790846 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:58.790819 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3de4b7d7-40ed-495d-b81a-fecb048d11c0-metrics-tls\") pod \"dns-default-p5w7g\" (UID: \"3de4b7d7-40ed-495d-b81a-fecb048d11c0\") " pod="openshift-dns/dns-default-p5w7g" Jul 27 09:54:58.790905 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:58.790883 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6b9360ad-3b69-4a8d-b35f-cb88207a26d0-registry-tls\") pod \"image-registry-65fb7b8f98-flrh7\" (UID: \"6b9360ad-3b69-4a8d-b35f-cb88207a26d0\") " pod="openshift-image-registry/image-registry-65fb7b8f98-flrh7" Jul 27 09:54:58.959446 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:58.959413 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-kx4n6"] Jul 27 09:54:58.986709 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:58.986676 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-kx4n6"] Jul 27 09:54:58.986870 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:58.986769 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-kx4n6" Jul 27 09:54:58.990346 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:58.990322 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 27 09:54:58.990481 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:58.990345 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-2g84c\"" Jul 27 09:54:58.991724 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:58.991706 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 27 09:54:58.991944 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:58.991930 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 27 09:54:59.054778 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:59.054580 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-dpjwc\"" Jul 27 09:54:59.055264 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:59.054960 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-5qft4\"" Jul 27 09:54:59.055264 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:59.055146 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-r9nsb\"" Jul 27 09:54:59.062689 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:59.062502 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-dsz8p" Jul 27 09:54:59.062913 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:59.062840 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-p5w7g" Jul 27 09:54:59.063076 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:59.063033 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65fb7b8f98-flrh7" Jul 27 09:54:59.090427 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:59.090408 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/24614231-7a34-435d-99ef-fa43d72bfc1f-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-kx4n6\" (UID: \"24614231-7a34-435d-99ef-fa43d72bfc1f\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-kx4n6" Jul 27 09:54:59.090523 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:59.090437 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/24614231-7a34-435d-99ef-fa43d72bfc1f-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-kx4n6\" (UID: \"24614231-7a34-435d-99ef-fa43d72bfc1f\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-kx4n6" Jul 27 09:54:59.090523 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:59.090458 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gn7j\" (UniqueName: \"kubernetes.io/projected/24614231-7a34-435d-99ef-fa43d72bfc1f-kube-api-access-2gn7j\") pod \"prometheus-operator-84d69f794d-kx4n6\" (UID: \"24614231-7a34-435d-99ef-fa43d72bfc1f\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-kx4n6" Jul 27 09:54:59.090523 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:59.090493 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/24614231-7a34-435d-99ef-fa43d72bfc1f-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-kx4n6\" (UID: \"24614231-7a34-435d-99ef-fa43d72bfc1f\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-kx4n6" Jul 27 09:54:59.191798 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:59.191773 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/24614231-7a34-435d-99ef-fa43d72bfc1f-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-kx4n6\" (UID: \"24614231-7a34-435d-99ef-fa43d72bfc1f\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-kx4n6" Jul 27 09:54:59.191917 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:59.191818 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/24614231-7a34-435d-99ef-fa43d72bfc1f-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-kx4n6\" (UID: \"24614231-7a34-435d-99ef-fa43d72bfc1f\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-kx4n6" Jul 27 09:54:59.191917 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:59.191854 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gn7j\" (UniqueName: \"kubernetes.io/projected/24614231-7a34-435d-99ef-fa43d72bfc1f-kube-api-access-2gn7j\") pod \"prometheus-operator-84d69f794d-kx4n6\" (UID: \"24614231-7a34-435d-99ef-fa43d72bfc1f\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-kx4n6" Jul 27 09:54:59.191917 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:59.191892 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/24614231-7a34-435d-99ef-fa43d72bfc1f-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-kx4n6\" (UID: \"24614231-7a34-435d-99ef-fa43d72bfc1f\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-kx4n6" Jul 27 09:54:59.192954 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:59.192909 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/24614231-7a34-435d-99ef-fa43d72bfc1f-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-kx4n6\" (UID: \"24614231-7a34-435d-99ef-fa43d72bfc1f\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-kx4n6" Jul 27 09:54:59.194526 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:59.194508 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/24614231-7a34-435d-99ef-fa43d72bfc1f-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-kx4n6\" (UID: \"24614231-7a34-435d-99ef-fa43d72bfc1f\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-kx4n6" Jul 27 09:54:59.194763 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:59.194739 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/24614231-7a34-435d-99ef-fa43d72bfc1f-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-kx4n6\" (UID: \"24614231-7a34-435d-99ef-fa43d72bfc1f\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-kx4n6" Jul 27 09:54:59.204400 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:59.204376 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gn7j\" (UniqueName: \"kubernetes.io/projected/24614231-7a34-435d-99ef-fa43d72bfc1f-kube-api-access-2gn7j\") pod \"prometheus-operator-84d69f794d-kx4n6\" (UID: \"24614231-7a34-435d-99ef-fa43d72bfc1f\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-kx4n6" Jul 27 09:54:59.229862 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:59.229837 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-dsz8p"] Jul 27 09:54:59.236406 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:54:59.236374 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2daea300_7a7e_412b_a226_b0214ffe75a3.slice/crio-6c08962bce1c3fac443f6e9f52c05eed337079b46fcdf57f07706efc968da5ea WatchSource:0}: Error finding container 6c08962bce1c3fac443f6e9f52c05eed337079b46fcdf57f07706efc968da5ea: Status 404 returned error can't find the container with id 6c08962bce1c3fac443f6e9f52c05eed337079b46fcdf57f07706efc968da5ea Jul 27 09:54:59.250750 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:59.250730 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-p5w7g"] Jul 27 09:54:59.253012 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:54:59.252989 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3de4b7d7_40ed_495d_b81a_fecb048d11c0.slice/crio-a1434324104dd6456f4529ec99859e449fedfadfe9cab07bff86dbac3f03f96c WatchSource:0}: Error finding container a1434324104dd6456f4529ec99859e449fedfadfe9cab07bff86dbac3f03f96c: Status 404 returned error can't find the container with id a1434324104dd6456f4529ec99859e449fedfadfe9cab07bff86dbac3f03f96c Jul 27 09:54:59.269701 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:59.269683 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-65fb7b8f98-flrh7"] Jul 27 09:54:59.271165 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:54:59.271143 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b9360ad_3b69_4a8d_b35f_cb88207a26d0.slice/crio-bf971aef529244d828e584db59f46fe1408d232c8faae37917f98b2a35305af1 WatchSource:0}: Error finding container bf971aef529244d828e584db59f46fe1408d232c8faae37917f98b2a35305af1: Status 404 returned error can't find the container with id bf971aef529244d828e584db59f46fe1408d232c8faae37917f98b2a35305af1 Jul 27 09:54:59.295923 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:59.295906 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-kx4n6" Jul 27 09:54:59.420432 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:59.420271 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-kx4n6"] Jul 27 09:54:59.422316 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:54:59.422275 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24614231_7a34_435d_99ef_fa43d72bfc1f.slice/crio-8817a98700b9b3deb5a7972d05b8aefa3b305c96d41d3794e42027b6eabd51f2 WatchSource:0}: Error finding container 8817a98700b9b3deb5a7972d05b8aefa3b305c96d41d3794e42027b6eabd51f2: Status 404 returned error can't find the container with id 8817a98700b9b3deb5a7972d05b8aefa3b305c96d41d3794e42027b6eabd51f2 Jul 27 09:54:59.765264 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:59.765173 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rmdcz" event={"ID":"a7160ea4-3ff4-4f76-b373-bc30be56f1f9","Type":"ContainerStarted","Data":"f9264ed818d6a4e755c7c9219abd28ae46595076b00184858aaaa87729815249"} Jul 27 09:54:59.766279 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:59.766258 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-kx4n6" event={"ID":"24614231-7a34-435d-99ef-fa43d72bfc1f","Type":"ContainerStarted","Data":"8817a98700b9b3deb5a7972d05b8aefa3b305c96d41d3794e42027b6eabd51f2"} Jul 27 09:54:59.767246 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:59.767225 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-dsz8p" event={"ID":"2daea300-7a7e-412b-a226-b0214ffe75a3","Type":"ContainerStarted","Data":"6c08962bce1c3fac443f6e9f52c05eed337079b46fcdf57f07706efc968da5ea"} Jul 27 09:54:59.768548 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:59.768527 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-65fb7b8f98-flrh7" event={"ID":"6b9360ad-3b69-4a8d-b35f-cb88207a26d0","Type":"ContainerStarted","Data":"b7827f0088da531d414988c1bbb0bf8f22b904bcc9493ba354e013b14218cd41"} Jul 27 09:54:59.768614 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:59.768565 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-65fb7b8f98-flrh7" event={"ID":"6b9360ad-3b69-4a8d-b35f-cb88207a26d0","Type":"ContainerStarted","Data":"bf971aef529244d828e584db59f46fe1408d232c8faae37917f98b2a35305af1"} Jul 27 09:54:59.768614 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:59.768594 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-65fb7b8f98-flrh7" Jul 27 09:54:59.769533 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:59.769515 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-p5w7g" event={"ID":"3de4b7d7-40ed-495d-b81a-fecb048d11c0","Type":"ContainerStarted","Data":"a1434324104dd6456f4529ec99859e449fedfadfe9cab07bff86dbac3f03f96c"} Jul 27 09:54:59.786630 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:59.786591 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-rmdcz" podStartSLOduration=17.330625407 podStartE2EDuration="28.786578824s" totalImagesPullingTime="11.455953417s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 09:54:31 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 09:54:59.786158258 +0000 UTC m=+286.376655494" watchObservedRunningTime="2026-07-27 09:54:59.786578824 +0000 UTC m=+286.377076056" Jul 27 09:54:59.809726 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:54:59.809691 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-65fb7b8f98-flrh7" podStartSLOduration=285.809681043 podStartE2EDuration="4m45.809681043s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 09:50:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 09:54:59.808898555 +0000 UTC m=+286.399395788" watchObservedRunningTime="2026-07-27 09:54:59.809681043 +0000 UTC m=+286.400178271" Jul 27 09:55:01.779969 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:01.779936 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-kx4n6" event={"ID":"24614231-7a34-435d-99ef-fa43d72bfc1f","Type":"ContainerStarted","Data":"35e91a5ba1d592cadcd8021719a315a7187ab0a6871d58163c6ea9d23f44e401"} Jul 27 09:55:01.780323 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:01.780031 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-kx4n6" event={"ID":"24614231-7a34-435d-99ef-fa43d72bfc1f","Type":"ContainerStarted","Data":"86ac735484f4059d14054a9661f3917068717e1836ca8144062a27c422cba15a"} Jul 27 09:55:01.781569 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:01.781542 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-dsz8p" event={"ID":"2daea300-7a7e-412b-a226-b0214ffe75a3","Type":"ContainerStarted","Data":"1ee76f21166d51636df445526c36c86453c6b2b7db62c8d5d61abe2e8578cd69"} Jul 27 09:55:01.785631 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:01.785603 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-p5w7g" event={"ID":"3de4b7d7-40ed-495d-b81a-fecb048d11c0","Type":"ContainerStarted","Data":"bde1546d45ddee2aa0bb5678802e1a5ca88f27030eafe61c9c264fd02d5e3908"} Jul 27 09:55:01.804227 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:01.804184 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-84d69f794d-kx4n6" podStartSLOduration=2.480803001 podStartE2EDuration="3.804167887s" totalImagesPullingTime="1.323364886s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 09:54:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 09:55:01.804062939 +0000 UTC m=+288.394560202" watchObservedRunningTime="2026-07-27 09:55:01.804167887 +0000 UTC m=+288.394665122" Jul 27 09:55:01.824723 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:01.824681 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-74c9f884b7-dsz8p" podStartSLOduration=268.317454154 podStartE2EDuration="4m29.824664903s" totalImagesPullingTime="1.507210749s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 09:50:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 09:55:01.823347323 +0000 UTC m=+288.413844556" watchObservedRunningTime="2026-07-27 09:55:01.824664903 +0000 UTC m=+288.415162138" Jul 27 09:55:02.664935 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:02.664899 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6fdbf597d-h7cv6"] Jul 27 09:55:02.667881 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:02.667862 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fdbf597d-h7cv6" Jul 27 09:55:02.671881 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:02.671855 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 27 09:55:02.672030 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:02.672008 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 27 09:55:02.672158 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:02.672100 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 27 09:55:02.672158 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:02.672116 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 27 09:55:02.672321 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:02.672162 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 27 09:55:02.672321 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:02.672116 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-kwfvc\"" Jul 27 09:55:02.672487 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:02.672472 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 27 09:55:02.672539 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:02.672524 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 27 09:55:02.679071 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:02.679053 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6fdbf597d-h7cv6"] Jul 27 09:55:02.723314 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:02.723277 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3e356a42-6808-4abf-ad23-188baa1eef2d-oauth-serving-cert\") pod \"console-6fdbf597d-h7cv6\" (UID: \"3e356a42-6808-4abf-ad23-188baa1eef2d\") " pod="openshift-console/console-6fdbf597d-h7cv6" Jul 27 09:55:02.723400 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:02.723330 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3e356a42-6808-4abf-ad23-188baa1eef2d-console-serving-cert\") pod \"console-6fdbf597d-h7cv6\" (UID: \"3e356a42-6808-4abf-ad23-188baa1eef2d\") " pod="openshift-console/console-6fdbf597d-h7cv6" Jul 27 09:55:02.723400 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:02.723377 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3e356a42-6808-4abf-ad23-188baa1eef2d-console-config\") pod \"console-6fdbf597d-h7cv6\" (UID: \"3e356a42-6808-4abf-ad23-188baa1eef2d\") " pod="openshift-console/console-6fdbf597d-h7cv6" Jul 27 09:55:02.723400 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:02.723394 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3e356a42-6808-4abf-ad23-188baa1eef2d-service-ca\") pod \"console-6fdbf597d-h7cv6\" (UID: \"3e356a42-6808-4abf-ad23-188baa1eef2d\") " pod="openshift-console/console-6fdbf597d-h7cv6" Jul 27 09:55:02.723544 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:02.723415 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcn6r\" (UniqueName: \"kubernetes.io/projected/3e356a42-6808-4abf-ad23-188baa1eef2d-kube-api-access-tcn6r\") pod \"console-6fdbf597d-h7cv6\" (UID: \"3e356a42-6808-4abf-ad23-188baa1eef2d\") " pod="openshift-console/console-6fdbf597d-h7cv6" Jul 27 09:55:02.723544 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:02.723462 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3e356a42-6808-4abf-ad23-188baa1eef2d-console-oauth-config\") pod \"console-6fdbf597d-h7cv6\" (UID: \"3e356a42-6808-4abf-ad23-188baa1eef2d\") " pod="openshift-console/console-6fdbf597d-h7cv6" Jul 27 09:55:02.790459 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:02.790434 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-p5w7g" event={"ID":"3de4b7d7-40ed-495d-b81a-fecb048d11c0","Type":"ContainerStarted","Data":"9b99b466a12a92dd45aa0857d00f153a601ea41e68b25597d73bc990061960c4"} Jul 27 09:55:02.811718 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:02.811681 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-p5w7g" podStartSLOduration=252.378933656 podStartE2EDuration="4m14.811667297s" totalImagesPullingTime="2.432733641s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 09:50:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 09:55:02.810782846 +0000 UTC m=+289.401280077" watchObservedRunningTime="2026-07-27 09:55:02.811667297 +0000 UTC m=+289.402164508" Jul 27 09:55:02.824352 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:02.824327 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3e356a42-6808-4abf-ad23-188baa1eef2d-console-serving-cert\") pod \"console-6fdbf597d-h7cv6\" (UID: \"3e356a42-6808-4abf-ad23-188baa1eef2d\") " pod="openshift-console/console-6fdbf597d-h7cv6" Jul 27 09:55:02.824471 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:02.824406 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3e356a42-6808-4abf-ad23-188baa1eef2d-console-config\") pod \"console-6fdbf597d-h7cv6\" (UID: \"3e356a42-6808-4abf-ad23-188baa1eef2d\") " pod="openshift-console/console-6fdbf597d-h7cv6" Jul 27 09:55:02.824471 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:02.824427 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3e356a42-6808-4abf-ad23-188baa1eef2d-service-ca\") pod \"console-6fdbf597d-h7cv6\" (UID: \"3e356a42-6808-4abf-ad23-188baa1eef2d\") " pod="openshift-console/console-6fdbf597d-h7cv6" Jul 27 09:55:02.824471 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:02.824460 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcn6r\" (UniqueName: \"kubernetes.io/projected/3e356a42-6808-4abf-ad23-188baa1eef2d-kube-api-access-tcn6r\") pod \"console-6fdbf597d-h7cv6\" (UID: \"3e356a42-6808-4abf-ad23-188baa1eef2d\") " pod="openshift-console/console-6fdbf597d-h7cv6" Jul 27 09:55:02.824631 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:02.824485 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3e356a42-6808-4abf-ad23-188baa1eef2d-console-oauth-config\") pod \"console-6fdbf597d-h7cv6\" (UID: \"3e356a42-6808-4abf-ad23-188baa1eef2d\") " pod="openshift-console/console-6fdbf597d-h7cv6" Jul 27 09:55:02.824631 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:02.824558 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3e356a42-6808-4abf-ad23-188baa1eef2d-oauth-serving-cert\") pod \"console-6fdbf597d-h7cv6\" (UID: \"3e356a42-6808-4abf-ad23-188baa1eef2d\") " pod="openshift-console/console-6fdbf597d-h7cv6" Jul 27 09:55:02.825365 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:02.825344 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3e356a42-6808-4abf-ad23-188baa1eef2d-oauth-serving-cert\") pod \"console-6fdbf597d-h7cv6\" (UID: \"3e356a42-6808-4abf-ad23-188baa1eef2d\") " pod="openshift-console/console-6fdbf597d-h7cv6" Jul 27 09:55:02.825438 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:02.825374 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3e356a42-6808-4abf-ad23-188baa1eef2d-console-config\") pod \"console-6fdbf597d-h7cv6\" (UID: \"3e356a42-6808-4abf-ad23-188baa1eef2d\") " pod="openshift-console/console-6fdbf597d-h7cv6" Jul 27 09:55:02.825610 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:02.825591 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3e356a42-6808-4abf-ad23-188baa1eef2d-service-ca\") pod \"console-6fdbf597d-h7cv6\" (UID: \"3e356a42-6808-4abf-ad23-188baa1eef2d\") " pod="openshift-console/console-6fdbf597d-h7cv6" Jul 27 09:55:02.826893 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:02.826875 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3e356a42-6808-4abf-ad23-188baa1eef2d-console-serving-cert\") pod \"console-6fdbf597d-h7cv6\" (UID: \"3e356a42-6808-4abf-ad23-188baa1eef2d\") " pod="openshift-console/console-6fdbf597d-h7cv6" Jul 27 09:55:02.827088 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:02.827069 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3e356a42-6808-4abf-ad23-188baa1eef2d-console-oauth-config\") pod \"console-6fdbf597d-h7cv6\" (UID: \"3e356a42-6808-4abf-ad23-188baa1eef2d\") " pod="openshift-console/console-6fdbf597d-h7cv6" Jul 27 09:55:02.834996 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:02.834971 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcn6r\" (UniqueName: \"kubernetes.io/projected/3e356a42-6808-4abf-ad23-188baa1eef2d-kube-api-access-tcn6r\") pod \"console-6fdbf597d-h7cv6\" (UID: \"3e356a42-6808-4abf-ad23-188baa1eef2d\") " pod="openshift-console/console-6fdbf597d-h7cv6" Jul 27 09:55:02.976599 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:02.976525 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fdbf597d-h7cv6" Jul 27 09:55:03.123603 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:03.123581 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6fdbf597d-h7cv6"] Jul 27 09:55:03.125743 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:55:03.125719 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e356a42_6808_4abf_ad23_188baa1eef2d.slice/crio-9d41eb9dd8b17674e75d8fdb753cec3653ad69f75a0df6c8c23f9c7b962dbbe4 WatchSource:0}: Error finding container 9d41eb9dd8b17674e75d8fdb753cec3653ad69f75a0df6c8c23f9c7b962dbbe4: Status 404 returned error can't find the container with id 9d41eb9dd8b17674e75d8fdb753cec3653ad69f75a0df6c8c23f9c7b962dbbe4 Jul 27 09:55:03.384685 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:03.384658 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-56vkh"] Jul 27 09:55:03.391464 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:03.391443 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-56vkh" Jul 27 09:55:03.395892 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:03.395873 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 27 09:55:03.396017 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:03.395893 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 27 09:55:03.396017 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:03.395956 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-x4xgs\"" Jul 27 09:55:03.396196 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:03.396183 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 27 09:55:03.401906 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:03.401888 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-kf8w8"] Jul 27 09:55:03.405779 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:03.405763 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-56vkh"] Jul 27 09:55:03.405889 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:03.405874 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kf8w8" Jul 27 09:55:03.409042 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:03.409025 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 27 09:55:03.409160 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:03.409142 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-qzqw7\"" Jul 27 09:55:03.409621 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:03.409605 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 27 09:55:03.409968 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:03.409952 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 27 09:55:03.429607 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:03.429589 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjlqw\" (UniqueName: \"kubernetes.io/projected/db463516-9278-439a-bbbc-a7637a20ee85-kube-api-access-mjlqw\") pod \"kube-state-metrics-56d9f944b4-56vkh\" (UID: \"db463516-9278-439a-bbbc-a7637a20ee85\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-56vkh" Jul 27 09:55:03.429711 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:03.429619 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/db463516-9278-439a-bbbc-a7637a20ee85-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-56vkh\" (UID: \"db463516-9278-439a-bbbc-a7637a20ee85\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-56vkh" Jul 27 09:55:03.429711 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:03.429637 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/db463516-9278-439a-bbbc-a7637a20ee85-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-56vkh\" (UID: \"db463516-9278-439a-bbbc-a7637a20ee85\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-56vkh" Jul 27 09:55:03.429711 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:03.429660 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/426dd32e-ebd6-4471-bfa7-232df29b03bf-node-exporter-wtmp\") pod \"node-exporter-kf8w8\" (UID: \"426dd32e-ebd6-4471-bfa7-232df29b03bf\") " pod="openshift-monitoring/node-exporter-kf8w8" Jul 27 09:55:03.429711 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:03.429677 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/db463516-9278-439a-bbbc-a7637a20ee85-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-56vkh\" (UID: \"db463516-9278-439a-bbbc-a7637a20ee85\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-56vkh" Jul 27 09:55:03.429861 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:03.429738 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/426dd32e-ebd6-4471-bfa7-232df29b03bf-root\") pod \"node-exporter-kf8w8\" (UID: \"426dd32e-ebd6-4471-bfa7-232df29b03bf\") " pod="openshift-monitoring/node-exporter-kf8w8" Jul 27 09:55:03.429861 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:03.429795 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/426dd32e-ebd6-4471-bfa7-232df29b03bf-node-exporter-tls\") pod \"node-exporter-kf8w8\" (UID: \"426dd32e-ebd6-4471-bfa7-232df29b03bf\") " pod="openshift-monitoring/node-exporter-kf8w8" Jul 27 09:55:03.429861 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:03.429820 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/426dd32e-ebd6-4471-bfa7-232df29b03bf-node-exporter-textfile\") pod \"node-exporter-kf8w8\" (UID: \"426dd32e-ebd6-4471-bfa7-232df29b03bf\") " pod="openshift-monitoring/node-exporter-kf8w8" Jul 27 09:55:03.429861 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:03.429839 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/db463516-9278-439a-bbbc-a7637a20ee85-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-56vkh\" (UID: \"db463516-9278-439a-bbbc-a7637a20ee85\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-56vkh" Jul 27 09:55:03.430004 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:03.429867 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/426dd32e-ebd6-4471-bfa7-232df29b03bf-metrics-client-ca\") pod \"node-exporter-kf8w8\" (UID: \"426dd32e-ebd6-4471-bfa7-232df29b03bf\") " pod="openshift-monitoring/node-exporter-kf8w8" Jul 27 09:55:03.430004 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:03.429883 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/426dd32e-ebd6-4471-bfa7-232df29b03bf-node-exporter-accelerators-collector-config\") pod \"node-exporter-kf8w8\" (UID: \"426dd32e-ebd6-4471-bfa7-232df29b03bf\") " pod="openshift-monitoring/node-exporter-kf8w8" Jul 27 09:55:03.430004 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:03.429924 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/426dd32e-ebd6-4471-bfa7-232df29b03bf-sys\") pod \"node-exporter-kf8w8\" (UID: \"426dd32e-ebd6-4471-bfa7-232df29b03bf\") " pod="openshift-monitoring/node-exporter-kf8w8" Jul 27 09:55:03.430004 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:03.429964 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ql49j\" (UniqueName: \"kubernetes.io/projected/426dd32e-ebd6-4471-bfa7-232df29b03bf-kube-api-access-ql49j\") pod \"node-exporter-kf8w8\" (UID: \"426dd32e-ebd6-4471-bfa7-232df29b03bf\") " pod="openshift-monitoring/node-exporter-kf8w8" Jul 27 09:55:03.430004 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:03.429986 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/426dd32e-ebd6-4471-bfa7-232df29b03bf-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kf8w8\" (UID: \"426dd32e-ebd6-4471-bfa7-232df29b03bf\") " pod="openshift-monitoring/node-exporter-kf8w8" Jul 27 09:55:03.430004 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:03.430000 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/db463516-9278-439a-bbbc-a7637a20ee85-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-56vkh\" (UID: \"db463516-9278-439a-bbbc-a7637a20ee85\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-56vkh" Jul 27 09:55:03.532172 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:03.531145 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjlqw\" (UniqueName: \"kubernetes.io/projected/db463516-9278-439a-bbbc-a7637a20ee85-kube-api-access-mjlqw\") pod \"kube-state-metrics-56d9f944b4-56vkh\" (UID: \"db463516-9278-439a-bbbc-a7637a20ee85\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-56vkh" Jul 27 09:55:03.532172 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:03.531258 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/db463516-9278-439a-bbbc-a7637a20ee85-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-56vkh\" (UID: \"db463516-9278-439a-bbbc-a7637a20ee85\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-56vkh" Jul 27 09:55:03.532172 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:03.531296 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/db463516-9278-439a-bbbc-a7637a20ee85-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-56vkh\" (UID: \"db463516-9278-439a-bbbc-a7637a20ee85\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-56vkh" Jul 27 09:55:03.532172 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:03.531368 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/426dd32e-ebd6-4471-bfa7-232df29b03bf-node-exporter-wtmp\") pod \"node-exporter-kf8w8\" (UID: \"426dd32e-ebd6-4471-bfa7-232df29b03bf\") " pod="openshift-monitoring/node-exporter-kf8w8" Jul 27 09:55:03.532172 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:03.531396 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/db463516-9278-439a-bbbc-a7637a20ee85-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-56vkh\" (UID: \"db463516-9278-439a-bbbc-a7637a20ee85\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-56vkh" Jul 27 09:55:03.532172 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:03.531430 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/426dd32e-ebd6-4471-bfa7-232df29b03bf-root\") pod \"node-exporter-kf8w8\" (UID: \"426dd32e-ebd6-4471-bfa7-232df29b03bf\") " pod="openshift-monitoring/node-exporter-kf8w8" Jul 27 09:55:03.532172 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:03.531486 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/426dd32e-ebd6-4471-bfa7-232df29b03bf-node-exporter-tls\") pod \"node-exporter-kf8w8\" (UID: \"426dd32e-ebd6-4471-bfa7-232df29b03bf\") " pod="openshift-monitoring/node-exporter-kf8w8" Jul 27 09:55:03.532172 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:03.531511 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/426dd32e-ebd6-4471-bfa7-232df29b03bf-node-exporter-textfile\") pod \"node-exporter-kf8w8\" (UID: \"426dd32e-ebd6-4471-bfa7-232df29b03bf\") " pod="openshift-monitoring/node-exporter-kf8w8" Jul 27 09:55:03.532172 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:03.531548 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/db463516-9278-439a-bbbc-a7637a20ee85-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-56vkh\" (UID: \"db463516-9278-439a-bbbc-a7637a20ee85\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-56vkh" Jul 27 09:55:03.532172 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:03.531597 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/426dd32e-ebd6-4471-bfa7-232df29b03bf-metrics-client-ca\") pod \"node-exporter-kf8w8\" (UID: \"426dd32e-ebd6-4471-bfa7-232df29b03bf\") " pod="openshift-monitoring/node-exporter-kf8w8" Jul 27 09:55:03.532172 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:03.531626 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/426dd32e-ebd6-4471-bfa7-232df29b03bf-node-exporter-accelerators-collector-config\") pod \"node-exporter-kf8w8\" (UID: \"426dd32e-ebd6-4471-bfa7-232df29b03bf\") " pod="openshift-monitoring/node-exporter-kf8w8" Jul 27 09:55:03.532172 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:03.531657 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/426dd32e-ebd6-4471-bfa7-232df29b03bf-sys\") pod \"node-exporter-kf8w8\" (UID: \"426dd32e-ebd6-4471-bfa7-232df29b03bf\") " pod="openshift-monitoring/node-exporter-kf8w8" Jul 27 09:55:03.532172 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:03.531679 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ql49j\" (UniqueName: \"kubernetes.io/projected/426dd32e-ebd6-4471-bfa7-232df29b03bf-kube-api-access-ql49j\") pod \"node-exporter-kf8w8\" (UID: \"426dd32e-ebd6-4471-bfa7-232df29b03bf\") " pod="openshift-monitoring/node-exporter-kf8w8" Jul 27 09:55:03.532172 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:03.531712 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/426dd32e-ebd6-4471-bfa7-232df29b03bf-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kf8w8\" (UID: \"426dd32e-ebd6-4471-bfa7-232df29b03bf\") " pod="openshift-monitoring/node-exporter-kf8w8" Jul 27 09:55:03.532172 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:03.531742 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/db463516-9278-439a-bbbc-a7637a20ee85-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-56vkh\" (UID: \"db463516-9278-439a-bbbc-a7637a20ee85\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-56vkh" Jul 27 09:55:03.535088 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:03.534780 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/426dd32e-ebd6-4471-bfa7-232df29b03bf-sys\") pod \"node-exporter-kf8w8\" (UID: \"426dd32e-ebd6-4471-bfa7-232df29b03bf\") " pod="openshift-monitoring/node-exporter-kf8w8" Jul 27 09:55:03.535211 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:03.535128 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/426dd32e-ebd6-4471-bfa7-232df29b03bf-node-exporter-textfile\") pod \"node-exporter-kf8w8\" (UID: \"426dd32e-ebd6-4471-bfa7-232df29b03bf\") " pod="openshift-monitoring/node-exporter-kf8w8" Jul 27 09:55:03.535539 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:03.535515 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/db463516-9278-439a-bbbc-a7637a20ee85-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-56vkh\" (UID: \"db463516-9278-439a-bbbc-a7637a20ee85\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-56vkh" Jul 27 09:55:03.535539 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:03.535524 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/426dd32e-ebd6-4471-bfa7-232df29b03bf-node-exporter-wtmp\") pod \"node-exporter-kf8w8\" (UID: \"426dd32e-ebd6-4471-bfa7-232df29b03bf\") " pod="openshift-monitoring/node-exporter-kf8w8" Jul 27 09:55:03.535717 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:03.535523 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/426dd32e-ebd6-4471-bfa7-232df29b03bf-metrics-client-ca\") pod \"node-exporter-kf8w8\" (UID: \"426dd32e-ebd6-4471-bfa7-232df29b03bf\") " pod="openshift-monitoring/node-exporter-kf8w8" Jul 27 09:55:03.535717 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:03.535625 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/426dd32e-ebd6-4471-bfa7-232df29b03bf-root\") pod \"node-exporter-kf8w8\" (UID: \"426dd32e-ebd6-4471-bfa7-232df29b03bf\") " pod="openshift-monitoring/node-exporter-kf8w8" Jul 27 09:55:03.535717 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:55:03.535689 2556 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 27 09:55:03.536004 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:55:03.535754 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/426dd32e-ebd6-4471-bfa7-232df29b03bf-node-exporter-tls podName:426dd32e-ebd6-4471-bfa7-232df29b03bf nodeName:}" failed. No retries permitted until 2026-07-27 09:55:04.035736415 +0000 UTC m=+290.626233626 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/426dd32e-ebd6-4471-bfa7-232df29b03bf-node-exporter-tls") pod "node-exporter-kf8w8" (UID: "426dd32e-ebd6-4471-bfa7-232df29b03bf") : secret "node-exporter-tls" not found Jul 27 09:55:03.536004 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:03.535827 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/db463516-9278-439a-bbbc-a7637a20ee85-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-56vkh\" (UID: \"db463516-9278-439a-bbbc-a7637a20ee85\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-56vkh" Jul 27 09:55:03.536636 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:03.536609 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/db463516-9278-439a-bbbc-a7637a20ee85-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-56vkh\" (UID: \"db463516-9278-439a-bbbc-a7637a20ee85\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-56vkh" Jul 27 09:55:03.536734 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:03.536693 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/db463516-9278-439a-bbbc-a7637a20ee85-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-56vkh\" (UID: \"db463516-9278-439a-bbbc-a7637a20ee85\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-56vkh" Jul 27 09:55:03.536734 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:03.536699 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/426dd32e-ebd6-4471-bfa7-232df29b03bf-node-exporter-accelerators-collector-config\") pod \"node-exporter-kf8w8\" (UID: \"426dd32e-ebd6-4471-bfa7-232df29b03bf\") " pod="openshift-monitoring/node-exporter-kf8w8" Jul 27 09:55:03.537619 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:03.537601 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/426dd32e-ebd6-4471-bfa7-232df29b03bf-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kf8w8\" (UID: \"426dd32e-ebd6-4471-bfa7-232df29b03bf\") " pod="openshift-monitoring/node-exporter-kf8w8" Jul 27 09:55:03.537962 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:03.537946 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/db463516-9278-439a-bbbc-a7637a20ee85-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-56vkh\" (UID: \"db463516-9278-439a-bbbc-a7637a20ee85\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-56vkh" Jul 27 09:55:03.542314 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:03.542281 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjlqw\" (UniqueName: \"kubernetes.io/projected/db463516-9278-439a-bbbc-a7637a20ee85-kube-api-access-mjlqw\") pod \"kube-state-metrics-56d9f944b4-56vkh\" (UID: \"db463516-9278-439a-bbbc-a7637a20ee85\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-56vkh" Jul 27 09:55:03.545247 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:03.545230 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ql49j\" (UniqueName: \"kubernetes.io/projected/426dd32e-ebd6-4471-bfa7-232df29b03bf-kube-api-access-ql49j\") pod \"node-exporter-kf8w8\" (UID: \"426dd32e-ebd6-4471-bfa7-232df29b03bf\") " pod="openshift-monitoring/node-exporter-kf8w8" Jul 27 09:55:03.701182 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:03.701107 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-56vkh" Jul 27 09:55:03.795742 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:03.795671 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fdbf597d-h7cv6" event={"ID":"3e356a42-6808-4abf-ad23-188baa1eef2d","Type":"ContainerStarted","Data":"9d41eb9dd8b17674e75d8fdb753cec3653ad69f75a0df6c8c23f9c7b962dbbe4"} Jul 27 09:55:03.796899 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:03.796284 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-p5w7g" Jul 27 09:55:03.862550 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:03.862392 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-56vkh"] Jul 27 09:55:03.864892 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:55:03.864841 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb463516_9278_439a_bbbc_a7637a20ee85.slice/crio-a8b523e41842855df776f2b1b891c123cb6483ecbc92b59962052af09d98b728 WatchSource:0}: Error finding container a8b523e41842855df776f2b1b891c123cb6483ecbc92b59962052af09d98b728: Status 404 returned error can't find the container with id a8b523e41842855df776f2b1b891c123cb6483ecbc92b59962052af09d98b728 Jul 27 09:55:04.035963 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:04.035867 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/426dd32e-ebd6-4471-bfa7-232df29b03bf-node-exporter-tls\") pod \"node-exporter-kf8w8\" (UID: \"426dd32e-ebd6-4471-bfa7-232df29b03bf\") " pod="openshift-monitoring/node-exporter-kf8w8" Jul 27 09:55:04.038759 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:04.038730 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/426dd32e-ebd6-4471-bfa7-232df29b03bf-node-exporter-tls\") pod \"node-exporter-kf8w8\" (UID: \"426dd32e-ebd6-4471-bfa7-232df29b03bf\") " pod="openshift-monitoring/node-exporter-kf8w8" Jul 27 09:55:04.314694 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:04.314667 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kf8w8" Jul 27 09:55:04.337148 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:55:04.337117 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod426dd32e_ebd6_4471_bfa7_232df29b03bf.slice/crio-2d86fabb80a90a692bbdcb341a84207dc8b54f5916248ce5f86ccef7d074bed4 WatchSource:0}: Error finding container 2d86fabb80a90a692bbdcb341a84207dc8b54f5916248ce5f86ccef7d074bed4: Status 404 returned error can't find the container with id 2d86fabb80a90a692bbdcb341a84207dc8b54f5916248ce5f86ccef7d074bed4 Jul 27 09:55:04.448869 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:04.448831 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 27 09:55:04.466355 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:04.466327 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:55:04.472477 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:04.472455 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 27 09:55:04.473200 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:04.472917 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 27 09:55:04.473200 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:04.472955 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 27 09:55:04.473200 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:04.472970 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 27 09:55:04.473200 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:04.472966 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 27 09:55:04.473200 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:04.473003 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 27 09:55:04.473200 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:04.472923 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 27 09:55:04.473744 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:04.473695 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-7fmqk\"" Jul 27 09:55:04.474127 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:04.473884 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 27 09:55:04.474216 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:04.474199 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 27 09:55:04.475252 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:04.475092 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 27 09:55:04.539618 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:04.539588 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d57c307c-8976-488d-804a-7dc01f98c08d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d57c307c-8976-488d-804a-7dc01f98c08d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:55:04.539791 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:04.539645 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d57c307c-8976-488d-804a-7dc01f98c08d-config-out\") pod \"alertmanager-main-0\" (UID: \"d57c307c-8976-488d-804a-7dc01f98c08d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:55:04.539791 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:04.539674 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d57c307c-8976-488d-804a-7dc01f98c08d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d57c307c-8976-488d-804a-7dc01f98c08d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:55:04.539791 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:04.539702 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d57c307c-8976-488d-804a-7dc01f98c08d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d57c307c-8976-488d-804a-7dc01f98c08d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:55:04.539791 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:04.539734 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d57c307c-8976-488d-804a-7dc01f98c08d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d57c307c-8976-488d-804a-7dc01f98c08d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:55:04.539791 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:04.539759 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d57c307c-8976-488d-804a-7dc01f98c08d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d57c307c-8976-488d-804a-7dc01f98c08d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:55:04.539791 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:04.539782 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d57c307c-8976-488d-804a-7dc01f98c08d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d57c307c-8976-488d-804a-7dc01f98c08d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:55:04.540107 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:04.539811 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d57c307c-8976-488d-804a-7dc01f98c08d-config-volume\") pod \"alertmanager-main-0\" (UID: \"d57c307c-8976-488d-804a-7dc01f98c08d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:55:04.540107 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:04.539870 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d57c307c-8976-488d-804a-7dc01f98c08d-web-config\") pod \"alertmanager-main-0\" (UID: \"d57c307c-8976-488d-804a-7dc01f98c08d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:55:04.540107 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:04.539908 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cp8kk\" (UniqueName: \"kubernetes.io/projected/d57c307c-8976-488d-804a-7dc01f98c08d-kube-api-access-cp8kk\") pod \"alertmanager-main-0\" (UID: \"d57c307c-8976-488d-804a-7dc01f98c08d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:55:04.540107 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:04.539939 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d57c307c-8976-488d-804a-7dc01f98c08d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d57c307c-8976-488d-804a-7dc01f98c08d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:55:04.540107 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:04.539967 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d57c307c-8976-488d-804a-7dc01f98c08d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d57c307c-8976-488d-804a-7dc01f98c08d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:55:04.540107 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:04.540018 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d57c307c-8976-488d-804a-7dc01f98c08d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d57c307c-8976-488d-804a-7dc01f98c08d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:55:04.641045 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:04.640967 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d57c307c-8976-488d-804a-7dc01f98c08d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d57c307c-8976-488d-804a-7dc01f98c08d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:55:04.641045 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:04.641034 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d57c307c-8976-488d-804a-7dc01f98c08d-config-out\") pod \"alertmanager-main-0\" (UID: \"d57c307c-8976-488d-804a-7dc01f98c08d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:55:04.641291 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:04.641066 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d57c307c-8976-488d-804a-7dc01f98c08d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d57c307c-8976-488d-804a-7dc01f98c08d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:55:04.641291 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:04.641097 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d57c307c-8976-488d-804a-7dc01f98c08d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d57c307c-8976-488d-804a-7dc01f98c08d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:55:04.641291 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:04.641130 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d57c307c-8976-488d-804a-7dc01f98c08d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d57c307c-8976-488d-804a-7dc01f98c08d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:55:04.641291 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:04.641159 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d57c307c-8976-488d-804a-7dc01f98c08d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d57c307c-8976-488d-804a-7dc01f98c08d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:55:04.641291 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:04.641184 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d57c307c-8976-488d-804a-7dc01f98c08d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d57c307c-8976-488d-804a-7dc01f98c08d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:55:04.641291 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:04.641216 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d57c307c-8976-488d-804a-7dc01f98c08d-config-volume\") pod \"alertmanager-main-0\" (UID: \"d57c307c-8976-488d-804a-7dc01f98c08d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:55:04.641291 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:04.641243 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d57c307c-8976-488d-804a-7dc01f98c08d-web-config\") pod \"alertmanager-main-0\" (UID: \"d57c307c-8976-488d-804a-7dc01f98c08d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:55:04.641291 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:04.641257 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cp8kk\" (UniqueName: \"kubernetes.io/projected/d57c307c-8976-488d-804a-7dc01f98c08d-kube-api-access-cp8kk\") pod \"alertmanager-main-0\" (UID: \"d57c307c-8976-488d-804a-7dc01f98c08d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:55:04.641291 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:04.641273 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d57c307c-8976-488d-804a-7dc01f98c08d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d57c307c-8976-488d-804a-7dc01f98c08d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:55:04.641291 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:04.641290 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d57c307c-8976-488d-804a-7dc01f98c08d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d57c307c-8976-488d-804a-7dc01f98c08d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:55:04.641784 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:04.641337 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d57c307c-8976-488d-804a-7dc01f98c08d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d57c307c-8976-488d-804a-7dc01f98c08d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:55:04.641784 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:55:04.641576 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d57c307c-8976-488d-804a-7dc01f98c08d-alertmanager-trusted-ca-bundle podName:d57c307c-8976-488d-804a-7dc01f98c08d nodeName:}" failed. No retries permitted until 2026-07-27 09:55:05.141554338 +0000 UTC m=+291.732051552 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/d57c307c-8976-488d-804a-7dc01f98c08d-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "d57c307c-8976-488d-804a-7dc01f98c08d") : configmap references non-existent config key: ca-bundle.crt Jul 27 09:55:04.642679 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:04.642254 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d57c307c-8976-488d-804a-7dc01f98c08d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d57c307c-8976-488d-804a-7dc01f98c08d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:55:04.643228 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:04.642889 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d57c307c-8976-488d-804a-7dc01f98c08d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d57c307c-8976-488d-804a-7dc01f98c08d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:55:04.645418 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:04.645375 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d57c307c-8976-488d-804a-7dc01f98c08d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d57c307c-8976-488d-804a-7dc01f98c08d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:55:04.645927 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:04.645905 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d57c307c-8976-488d-804a-7dc01f98c08d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d57c307c-8976-488d-804a-7dc01f98c08d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:55:04.647661 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:04.647603 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d57c307c-8976-488d-804a-7dc01f98c08d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d57c307c-8976-488d-804a-7dc01f98c08d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:55:04.647919 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:04.647752 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d57c307c-8976-488d-804a-7dc01f98c08d-config-volume\") pod \"alertmanager-main-0\" (UID: \"d57c307c-8976-488d-804a-7dc01f98c08d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:55:04.648243 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:04.648225 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d57c307c-8976-488d-804a-7dc01f98c08d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d57c307c-8976-488d-804a-7dc01f98c08d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:55:04.648449 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:04.648286 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d57c307c-8976-488d-804a-7dc01f98c08d-config-out\") pod \"alertmanager-main-0\" (UID: \"d57c307c-8976-488d-804a-7dc01f98c08d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:55:04.648997 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:04.648958 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d57c307c-8976-488d-804a-7dc01f98c08d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d57c307c-8976-488d-804a-7dc01f98c08d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:55:04.650020 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:04.649927 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d57c307c-8976-488d-804a-7dc01f98c08d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d57c307c-8976-488d-804a-7dc01f98c08d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:55:04.650554 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:04.650519 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d57c307c-8976-488d-804a-7dc01f98c08d-web-config\") pod \"alertmanager-main-0\" (UID: \"d57c307c-8976-488d-804a-7dc01f98c08d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:55:04.667379 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:04.667333 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cp8kk\" (UniqueName: \"kubernetes.io/projected/d57c307c-8976-488d-804a-7dc01f98c08d-kube-api-access-cp8kk\") pod \"alertmanager-main-0\" (UID: \"d57c307c-8976-488d-804a-7dc01f98c08d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:55:04.803322 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:04.803253 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-56vkh" event={"ID":"db463516-9278-439a-bbbc-a7637a20ee85","Type":"ContainerStarted","Data":"a8b523e41842855df776f2b1b891c123cb6483ecbc92b59962052af09d98b728"} Jul 27 09:55:04.806115 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:04.806006 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kf8w8" event={"ID":"426dd32e-ebd6-4471-bfa7-232df29b03bf","Type":"ContainerStarted","Data":"2d86fabb80a90a692bbdcb341a84207dc8b54f5916248ce5f86ccef7d074bed4"} Jul 27 09:55:04.864599 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:04.864570 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-797f989d75-vx45l"] Jul 27 09:55:04.887723 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:04.887696 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-797f989d75-vx45l"] Jul 27 09:55:04.887876 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:04.887806 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-797f989d75-vx45l" Jul 27 09:55:04.899151 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:04.899126 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 27 09:55:04.947327 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:04.946932 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ec43c5d4-5e58-4800-92e6-637c1fe1478b-service-ca\") pod \"console-797f989d75-vx45l\" (UID: \"ec43c5d4-5e58-4800-92e6-637c1fe1478b\") " pod="openshift-console/console-797f989d75-vx45l" Jul 27 09:55:04.947327 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:04.947013 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ec43c5d4-5e58-4800-92e6-637c1fe1478b-console-config\") pod \"console-797f989d75-vx45l\" (UID: \"ec43c5d4-5e58-4800-92e6-637c1fe1478b\") " pod="openshift-console/console-797f989d75-vx45l" Jul 27 09:55:04.947327 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:04.947038 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mpmwz\" (UniqueName: \"kubernetes.io/projected/ec43c5d4-5e58-4800-92e6-637c1fe1478b-kube-api-access-mpmwz\") pod \"console-797f989d75-vx45l\" (UID: \"ec43c5d4-5e58-4800-92e6-637c1fe1478b\") " pod="openshift-console/console-797f989d75-vx45l" Jul 27 09:55:04.947327 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:04.947095 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ec43c5d4-5e58-4800-92e6-637c1fe1478b-console-serving-cert\") pod \"console-797f989d75-vx45l\" (UID: \"ec43c5d4-5e58-4800-92e6-637c1fe1478b\") " pod="openshift-console/console-797f989d75-vx45l" Jul 27 09:55:04.947327 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:04.947115 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ec43c5d4-5e58-4800-92e6-637c1fe1478b-oauth-serving-cert\") pod \"console-797f989d75-vx45l\" (UID: \"ec43c5d4-5e58-4800-92e6-637c1fe1478b\") " pod="openshift-console/console-797f989d75-vx45l" Jul 27 09:55:04.947327 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:04.947157 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ec43c5d4-5e58-4800-92e6-637c1fe1478b-console-oauth-config\") pod \"console-797f989d75-vx45l\" (UID: \"ec43c5d4-5e58-4800-92e6-637c1fe1478b\") " pod="openshift-console/console-797f989d75-vx45l" Jul 27 09:55:04.947327 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:04.947193 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec43c5d4-5e58-4800-92e6-637c1fe1478b-trusted-ca-bundle\") pod \"console-797f989d75-vx45l\" (UID: \"ec43c5d4-5e58-4800-92e6-637c1fe1478b\") " pod="openshift-console/console-797f989d75-vx45l" Jul 27 09:55:05.047761 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:05.047728 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ec43c5d4-5e58-4800-92e6-637c1fe1478b-console-config\") pod \"console-797f989d75-vx45l\" (UID: \"ec43c5d4-5e58-4800-92e6-637c1fe1478b\") " pod="openshift-console/console-797f989d75-vx45l" Jul 27 09:55:05.047928 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:05.047771 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mpmwz\" (UniqueName: \"kubernetes.io/projected/ec43c5d4-5e58-4800-92e6-637c1fe1478b-kube-api-access-mpmwz\") pod \"console-797f989d75-vx45l\" (UID: \"ec43c5d4-5e58-4800-92e6-637c1fe1478b\") " pod="openshift-console/console-797f989d75-vx45l" Jul 27 09:55:05.047928 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:05.047836 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ec43c5d4-5e58-4800-92e6-637c1fe1478b-console-serving-cert\") pod \"console-797f989d75-vx45l\" (UID: \"ec43c5d4-5e58-4800-92e6-637c1fe1478b\") " pod="openshift-console/console-797f989d75-vx45l" Jul 27 09:55:05.047928 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:05.047859 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ec43c5d4-5e58-4800-92e6-637c1fe1478b-oauth-serving-cert\") pod \"console-797f989d75-vx45l\" (UID: \"ec43c5d4-5e58-4800-92e6-637c1fe1478b\") " pod="openshift-console/console-797f989d75-vx45l" Jul 27 09:55:05.047928 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:05.047897 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ec43c5d4-5e58-4800-92e6-637c1fe1478b-console-oauth-config\") pod \"console-797f989d75-vx45l\" (UID: \"ec43c5d4-5e58-4800-92e6-637c1fe1478b\") " pod="openshift-console/console-797f989d75-vx45l" Jul 27 09:55:05.048118 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:05.047936 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec43c5d4-5e58-4800-92e6-637c1fe1478b-trusted-ca-bundle\") pod \"console-797f989d75-vx45l\" (UID: \"ec43c5d4-5e58-4800-92e6-637c1fe1478b\") " pod="openshift-console/console-797f989d75-vx45l" Jul 27 09:55:05.048118 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:05.047987 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ec43c5d4-5e58-4800-92e6-637c1fe1478b-service-ca\") pod \"console-797f989d75-vx45l\" (UID: \"ec43c5d4-5e58-4800-92e6-637c1fe1478b\") " pod="openshift-console/console-797f989d75-vx45l" Jul 27 09:55:05.049326 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:05.048758 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ec43c5d4-5e58-4800-92e6-637c1fe1478b-service-ca\") pod \"console-797f989d75-vx45l\" (UID: \"ec43c5d4-5e58-4800-92e6-637c1fe1478b\") " pod="openshift-console/console-797f989d75-vx45l" Jul 27 09:55:05.049326 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:05.048777 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ec43c5d4-5e58-4800-92e6-637c1fe1478b-console-config\") pod \"console-797f989d75-vx45l\" (UID: \"ec43c5d4-5e58-4800-92e6-637c1fe1478b\") " pod="openshift-console/console-797f989d75-vx45l" Jul 27 09:55:05.049603 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:05.049557 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ec43c5d4-5e58-4800-92e6-637c1fe1478b-oauth-serving-cert\") pod \"console-797f989d75-vx45l\" (UID: \"ec43c5d4-5e58-4800-92e6-637c1fe1478b\") " pod="openshift-console/console-797f989d75-vx45l" Jul 27 09:55:05.049679 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:05.049618 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec43c5d4-5e58-4800-92e6-637c1fe1478b-trusted-ca-bundle\") pod \"console-797f989d75-vx45l\" (UID: \"ec43c5d4-5e58-4800-92e6-637c1fe1478b\") " pod="openshift-console/console-797f989d75-vx45l" Jul 27 09:55:05.051918 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:05.051060 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ec43c5d4-5e58-4800-92e6-637c1fe1478b-console-oauth-config\") pod \"console-797f989d75-vx45l\" (UID: \"ec43c5d4-5e58-4800-92e6-637c1fe1478b\") " pod="openshift-console/console-797f989d75-vx45l" Jul 27 09:55:05.052710 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:05.052688 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ec43c5d4-5e58-4800-92e6-637c1fe1478b-console-serving-cert\") pod \"console-797f989d75-vx45l\" (UID: \"ec43c5d4-5e58-4800-92e6-637c1fe1478b\") " pod="openshift-console/console-797f989d75-vx45l" Jul 27 09:55:05.058662 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:05.058641 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mpmwz\" (UniqueName: \"kubernetes.io/projected/ec43c5d4-5e58-4800-92e6-637c1fe1478b-kube-api-access-mpmwz\") pod \"console-797f989d75-vx45l\" (UID: \"ec43c5d4-5e58-4800-92e6-637c1fe1478b\") " pod="openshift-console/console-797f989d75-vx45l" Jul 27 09:55:05.149964 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:05.149879 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d57c307c-8976-488d-804a-7dc01f98c08d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d57c307c-8976-488d-804a-7dc01f98c08d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:55:05.151210 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:05.151182 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d57c307c-8976-488d-804a-7dc01f98c08d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d57c307c-8976-488d-804a-7dc01f98c08d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:55:05.201290 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:05.201256 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-797f989d75-vx45l" Jul 27 09:55:05.380807 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:05.380775 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:55:07.226135 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:07.226076 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-797f989d75-vx45l"] Jul 27 09:55:07.228966 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:55:07.228939 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec43c5d4_5e58_4800_92e6_637c1fe1478b.slice/crio-746b02b7c862b75a2e7551760f6724724bdee61dd0e3c0cb36871c2e0ad29cc0 WatchSource:0}: Error finding container 746b02b7c862b75a2e7551760f6724724bdee61dd0e3c0cb36871c2e0ad29cc0: Status 404 returned error can't find the container with id 746b02b7c862b75a2e7551760f6724724bdee61dd0e3c0cb36871c2e0ad29cc0 Jul 27 09:55:07.273757 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:07.273733 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 27 09:55:07.817786 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:07.817746 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fdbf597d-h7cv6" event={"ID":"3e356a42-6808-4abf-ad23-188baa1eef2d","Type":"ContainerStarted","Data":"d6bac4bc4729036c30dbaf6d105dba2986c9908caeff350b03fac5135eb30305"} Jul 27 09:55:07.819741 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:07.819711 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-56vkh" event={"ID":"db463516-9278-439a-bbbc-a7637a20ee85","Type":"ContainerStarted","Data":"846ac427cefe0fc6155d7c9ae0ca899344e1977514935ebe6bcea683f4f1b153"} Jul 27 09:55:07.819855 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:07.819772 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-56vkh" event={"ID":"db463516-9278-439a-bbbc-a7637a20ee85","Type":"ContainerStarted","Data":"acd5e9b2281e48165d13ada700c88cb66fe6f1dcfa3f4a44fc13384b1622b424"} Jul 27 09:55:07.819855 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:07.819805 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-56vkh" event={"ID":"db463516-9278-439a-bbbc-a7637a20ee85","Type":"ContainerStarted","Data":"2615f5ba0115ede95b65d7625b13bd5dd782ac5867d5a404c77472828dc8be1e"} Jul 27 09:55:07.820754 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:07.820730 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d57c307c-8976-488d-804a-7dc01f98c08d","Type":"ContainerStarted","Data":"8107330784e7e8cd6846a51fcc463a661c8cf3f1bdf04353ffa812e69b0c55e4"} Jul 27 09:55:07.822094 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:07.822071 2556 generic.go:356] "Generic (PLEG): container finished" podID="426dd32e-ebd6-4471-bfa7-232df29b03bf" containerID="5596cda73219e8dc78b6d6b99a4f145fb555fc402310e7a9d2f05b6c1aec75a0" exitCode=0 Jul 27 09:55:07.822201 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:07.822147 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kf8w8" event={"ID":"426dd32e-ebd6-4471-bfa7-232df29b03bf","Type":"ContainerDied","Data":"5596cda73219e8dc78b6d6b99a4f145fb555fc402310e7a9d2f05b6c1aec75a0"} Jul 27 09:55:07.823557 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:07.823537 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-797f989d75-vx45l" event={"ID":"ec43c5d4-5e58-4800-92e6-637c1fe1478b","Type":"ContainerStarted","Data":"eaf868e7c0adf17b5eee782b2dc8e2d41537788c7cfccc38ba4b0e8f49068f5c"} Jul 27 09:55:07.823652 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:07.823574 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-797f989d75-vx45l" event={"ID":"ec43c5d4-5e58-4800-92e6-637c1fe1478b","Type":"ContainerStarted","Data":"746b02b7c862b75a2e7551760f6724724bdee61dd0e3c0cb36871c2e0ad29cc0"} Jul 27 09:55:07.845905 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:07.845864 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6fdbf597d-h7cv6" podStartSLOduration=1.883967282 podStartE2EDuration="5.845850272s" totalImagesPullingTime="3.96188299s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 09:55:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 09:55:07.84405087 +0000 UTC m=+294.434548105" watchObservedRunningTime="2026-07-27 09:55:07.845850272 +0000 UTC m=+294.436347504" Jul 27 09:55:07.892486 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:07.892450 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-797f989d75-vx45l" podStartSLOduration=3.892437434 podStartE2EDuration="3.892437434s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 09:55:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 09:55:07.891880172 +0000 UTC m=+294.482377406" watchObservedRunningTime="2026-07-27 09:55:07.892437434 +0000 UTC m=+294.482934663" Jul 27 09:55:07.892897 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:07.892875 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-56vkh" podStartSLOduration=1.6720374900000001 podStartE2EDuration="4.892866756s" totalImagesPullingTime="3.220829266s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 09:55:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 09:55:07.867571132 +0000 UTC m=+294.458068358" watchObservedRunningTime="2026-07-27 09:55:07.892866756 +0000 UTC m=+294.483363988" Jul 27 09:55:08.116543 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:08.116475 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6fdbf597d-h7cv6"] Jul 27 09:55:08.830745 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:08.829941 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kf8w8" event={"ID":"426dd32e-ebd6-4471-bfa7-232df29b03bf","Type":"ContainerStarted","Data":"6e10ecc71c277afd69c669782218971a7a530229e6c17b85eeb2539d155f8461"} Jul 27 09:55:08.830745 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:08.829999 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kf8w8" event={"ID":"426dd32e-ebd6-4471-bfa7-232df29b03bf","Type":"ContainerStarted","Data":"b667cafdf5417371ce931c87d4543b8c76b92af37a58467875227078a1375559"} Jul 27 09:55:08.853639 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:08.853594 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-kf8w8" podStartSLOduration=2.987773926 podStartE2EDuration="5.853580275s" totalImagesPullingTime="2.751704911s" totalInitContainerRuntime="114.101438ms" isStatefulPod=true podCreationTimestamp="2026-07-27 09:55:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 09:55:08.852726819 +0000 UTC m=+295.443224054" watchObservedRunningTime="2026-07-27 09:55:08.853580275 +0000 UTC m=+295.444077508" Jul 27 09:55:09.836878 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:09.836848 2556 generic.go:356] "Generic (PLEG): container finished" podID="d57c307c-8976-488d-804a-7dc01f98c08d" containerID="f92c4606f1e401005ddf9ed1ddd5b1a8aa195bf8fab54fc7ae311ca6f97284df" exitCode=0 Jul 27 09:55:09.837410 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:09.836941 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d57c307c-8976-488d-804a-7dc01f98c08d","Type":"ContainerDied","Data":"f92c4606f1e401005ddf9ed1ddd5b1a8aa195bf8fab54fc7ae311ca6f97284df"} Jul 27 09:55:09.906086 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:55:09.906049 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-cl9xw" podUID="27f2e8fc-173e-43ff-b7a6-0bd6e8b54d40" Jul 27 09:55:11.846203 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:11.846174 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d57c307c-8976-488d-804a-7dc01f98c08d","Type":"ContainerStarted","Data":"5fb1ac53962a989415bc613ad6d4d84960c6b3cbd384092032f752ab96fdb204"} Jul 27 09:55:12.852828 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:12.852799 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d57c307c-8976-488d-804a-7dc01f98c08d","Type":"ContainerStarted","Data":"1b159ead42d5df8b4903b75b95cb3ac74ba036f64ecfea15bd7f6d0b6a3cd25b"} Jul 27 09:55:12.853148 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:12.852861 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d57c307c-8976-488d-804a-7dc01f98c08d","Type":"ContainerStarted","Data":"a59d78ab47869e99f24281f54dfab2126277a560bb57a779f2342e9bea274ae2"} Jul 27 09:55:12.853148 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:12.852886 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d57c307c-8976-488d-804a-7dc01f98c08d","Type":"ContainerStarted","Data":"ffb524565bb2489cd4c9932f060252d294774383cb35e9f19eb16b5771934232"} Jul 27 09:55:12.853148 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:12.852908 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d57c307c-8976-488d-804a-7dc01f98c08d","Type":"ContainerStarted","Data":"614ca7e2c22ae7e9296b7aab31a8c5a23a294d51445ac9f5a228dde1bcab442a"} Jul 27 09:55:12.976936 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:12.976903 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6fdbf597d-h7cv6" Jul 27 09:55:13.809603 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:13.807756 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-p5w7g" Jul 27 09:55:13.827681 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:13.827652 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-gqgcx_a7a42a0d-f7e2-49ba-a366-88d424f60c20/console-operator/1.log" Jul 27 09:55:13.828596 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:13.828576 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-gqgcx_a7a42a0d-f7e2-49ba-a366-88d424f60c20/console-operator/1.log" Jul 27 09:55:13.839439 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:13.839422 2556 kubelet.go:1648] "Image garbage collection succeeded" Jul 27 09:55:13.860197 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:13.860066 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d57c307c-8976-488d-804a-7dc01f98c08d","Type":"ContainerStarted","Data":"1e7aaa3ce4650f997f4c8dc380411cc64731adcadadaf9dbea0596b8194018af"} Jul 27 09:55:13.891208 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:13.891165 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=5.629789519 podStartE2EDuration="9.891150964s" totalImagesPullingTime="4.248738s" totalInitContainerRuntime="12.623445ms" isStatefulPod=false podCreationTimestamp="2026-07-27 09:55:04 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 09:55:13.888721788 +0000 UTC m=+300.479219047" watchObservedRunningTime="2026-07-27 09:55:13.891150964 +0000 UTC m=+300.481648196" Jul 27 09:55:15.202124 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:15.202091 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-797f989d75-vx45l" Jul 27 09:55:15.202567 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:15.202149 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-797f989d75-vx45l" Jul 27 09:55:15.203453 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:15.203428 2556 patch_prober.go:28] interesting pod/console-797f989d75-vx45l container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.21:8443/health\": dial tcp 10.132.0.21:8443: connect: connection refused" start-of-body= Jul 27 09:55:15.203570 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:15.203468 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-797f989d75-vx45l" podUID="ec43c5d4-5e58-4800-92e6-637c1fe1478b" containerName="console" probeResult="failure" output="Get \"https://10.132.0.21:8443/health\": dial tcp 10.132.0.21:8443: connect: connection refused" Jul 27 09:55:18.850871 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:18.850836 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-65fb7b8f98-flrh7"] Jul 27 09:55:18.855191 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:18.855165 2556 patch_prober.go:28] interesting pod/image-registry-65fb7b8f98-flrh7 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 27 09:55:18.855338 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:18.855212 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-65fb7b8f98-flrh7" podUID="6b9360ad-3b69-4a8d-b35f-cb88207a26d0" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 27 09:55:18.931977 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:18.931941 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-797f989d75-vx45l"] Jul 27 09:55:21.904659 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:21.904636 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cl9xw" Jul 27 09:55:28.855618 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:28.855593 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-65fb7b8f98-flrh7" Jul 27 09:55:34.859675 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:34.859632 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6fdbf597d-h7cv6" podUID="3e356a42-6808-4abf-ad23-188baa1eef2d" containerName="console" containerID="cri-o://d6bac4bc4729036c30dbaf6d105dba2986c9908caeff350b03fac5135eb30305" gracePeriod=15 Jul 27 09:55:35.101173 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:35.101150 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fdbf597d-h7cv6" Jul 27 09:55:35.200642 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:35.200583 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tcn6r\" (UniqueName: \"kubernetes.io/projected/3e356a42-6808-4abf-ad23-188baa1eef2d-kube-api-access-tcn6r\") pod \"3e356a42-6808-4abf-ad23-188baa1eef2d\" (UID: \"3e356a42-6808-4abf-ad23-188baa1eef2d\") " Jul 27 09:55:35.200642 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:35.200635 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3e356a42-6808-4abf-ad23-188baa1eef2d-console-serving-cert\") pod \"3e356a42-6808-4abf-ad23-188baa1eef2d\" (UID: \"3e356a42-6808-4abf-ad23-188baa1eef2d\") " Jul 27 09:55:35.200833 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:35.200671 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3e356a42-6808-4abf-ad23-188baa1eef2d-console-config\") pod \"3e356a42-6808-4abf-ad23-188baa1eef2d\" (UID: \"3e356a42-6808-4abf-ad23-188baa1eef2d\") " Jul 27 09:55:35.200833 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:35.200691 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3e356a42-6808-4abf-ad23-188baa1eef2d-service-ca\") pod \"3e356a42-6808-4abf-ad23-188baa1eef2d\" (UID: \"3e356a42-6808-4abf-ad23-188baa1eef2d\") " Jul 27 09:55:35.200833 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:35.200732 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3e356a42-6808-4abf-ad23-188baa1eef2d-oauth-serving-cert\") pod \"3e356a42-6808-4abf-ad23-188baa1eef2d\" (UID: \"3e356a42-6808-4abf-ad23-188baa1eef2d\") " Jul 27 09:55:35.200833 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:35.200755 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3e356a42-6808-4abf-ad23-188baa1eef2d-console-oauth-config\") pod \"3e356a42-6808-4abf-ad23-188baa1eef2d\" (UID: \"3e356a42-6808-4abf-ad23-188baa1eef2d\") " Jul 27 09:55:35.201106 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:35.201082 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e356a42-6808-4abf-ad23-188baa1eef2d-console-config" (OuterVolumeSpecName: "console-config") pod "3e356a42-6808-4abf-ad23-188baa1eef2d" (UID: "3e356a42-6808-4abf-ad23-188baa1eef2d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 09:55:35.201171 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:35.201109 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e356a42-6808-4abf-ad23-188baa1eef2d-service-ca" (OuterVolumeSpecName: "service-ca") pod "3e356a42-6808-4abf-ad23-188baa1eef2d" (UID: "3e356a42-6808-4abf-ad23-188baa1eef2d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 09:55:35.201171 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:35.201118 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e356a42-6808-4abf-ad23-188baa1eef2d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3e356a42-6808-4abf-ad23-188baa1eef2d" (UID: "3e356a42-6808-4abf-ad23-188baa1eef2d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 09:55:35.202968 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:35.202942 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e356a42-6808-4abf-ad23-188baa1eef2d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3e356a42-6808-4abf-ad23-188baa1eef2d" (UID: "3e356a42-6808-4abf-ad23-188baa1eef2d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 09:55:35.203071 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:35.202989 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e356a42-6808-4abf-ad23-188baa1eef2d-kube-api-access-tcn6r" (OuterVolumeSpecName: "kube-api-access-tcn6r") pod "3e356a42-6808-4abf-ad23-188baa1eef2d" (UID: "3e356a42-6808-4abf-ad23-188baa1eef2d"). InnerVolumeSpecName "kube-api-access-tcn6r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 09:55:35.203071 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:35.202994 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e356a42-6808-4abf-ad23-188baa1eef2d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3e356a42-6808-4abf-ad23-188baa1eef2d" (UID: "3e356a42-6808-4abf-ad23-188baa1eef2d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 09:55:35.301798 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:35.301771 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tcn6r\" (UniqueName: \"kubernetes.io/projected/3e356a42-6808-4abf-ad23-188baa1eef2d-kube-api-access-tcn6r\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\"" Jul 27 09:55:35.301798 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:35.301794 2556 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3e356a42-6808-4abf-ad23-188baa1eef2d-console-serving-cert\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\"" Jul 27 09:55:35.301798 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:35.301803 2556 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3e356a42-6808-4abf-ad23-188baa1eef2d-console-config\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\"" Jul 27 09:55:35.301970 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:35.301811 2556 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3e356a42-6808-4abf-ad23-188baa1eef2d-service-ca\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\"" Jul 27 09:55:35.301970 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:35.301819 2556 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3e356a42-6808-4abf-ad23-188baa1eef2d-oauth-serving-cert\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\"" Jul 27 09:55:35.301970 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:35.301826 2556 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3e356a42-6808-4abf-ad23-188baa1eef2d-console-oauth-config\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\"" Jul 27 09:55:35.941566 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:35.941535 2556 generic.go:356] "Generic (PLEG): container finished" podID="3e356a42-6808-4abf-ad23-188baa1eef2d" containerID="d6bac4bc4729036c30dbaf6d105dba2986c9908caeff350b03fac5135eb30305" exitCode=0 Jul 27 09:55:35.941864 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:35.941583 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fdbf597d-h7cv6" Jul 27 09:55:35.941864 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:35.941614 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fdbf597d-h7cv6" event={"ID":"3e356a42-6808-4abf-ad23-188baa1eef2d","Type":"ContainerDied","Data":"d6bac4bc4729036c30dbaf6d105dba2986c9908caeff350b03fac5135eb30305"} Jul 27 09:55:35.941864 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:35.941660 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fdbf597d-h7cv6" event={"ID":"3e356a42-6808-4abf-ad23-188baa1eef2d","Type":"ContainerDied","Data":"9d41eb9dd8b17674e75d8fdb753cec3653ad69f75a0df6c8c23f9c7b962dbbe4"} Jul 27 09:55:35.941864 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:35.941682 2556 scope.go:117] "RemoveContainer" containerID="d6bac4bc4729036c30dbaf6d105dba2986c9908caeff350b03fac5135eb30305" Jul 27 09:55:35.949463 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:35.949442 2556 scope.go:117] "RemoveContainer" containerID="d6bac4bc4729036c30dbaf6d105dba2986c9908caeff350b03fac5135eb30305" Jul 27 09:55:35.949720 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:55:35.949699 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d6bac4bc4729036c30dbaf6d105dba2986c9908caeff350b03fac5135eb30305\": container with ID starting with d6bac4bc4729036c30dbaf6d105dba2986c9908caeff350b03fac5135eb30305 not found: ID does not exist" containerID="d6bac4bc4729036c30dbaf6d105dba2986c9908caeff350b03fac5135eb30305" Jul 27 09:55:35.949771 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:35.949728 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6bac4bc4729036c30dbaf6d105dba2986c9908caeff350b03fac5135eb30305"} err="failed to get container status \"d6bac4bc4729036c30dbaf6d105dba2986c9908caeff350b03fac5135eb30305\": rpc error: code = NotFound desc = could not find container \"d6bac4bc4729036c30dbaf6d105dba2986c9908caeff350b03fac5135eb30305\": container with ID starting with d6bac4bc4729036c30dbaf6d105dba2986c9908caeff350b03fac5135eb30305 not found: ID does not exist" Jul 27 09:55:35.961567 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:35.961543 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6fdbf597d-h7cv6"] Jul 27 09:55:35.966338 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:35.966319 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6fdbf597d-h7cv6"] Jul 27 09:55:37.909831 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:37.909804 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3e356a42-6808-4abf-ad23-188baa1eef2d" path="/var/lib/kubelet/pods/3e356a42-6808-4abf-ad23-188baa1eef2d/volumes" Jul 27 09:55:43.869766 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:43.869713 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-65fb7b8f98-flrh7" podUID="6b9360ad-3b69-4a8d-b35f-cb88207a26d0" containerName="registry" containerID="cri-o://b7827f0088da531d414988c1bbb0bf8f22b904bcc9493ba354e013b14218cd41" gracePeriod=30 Jul 27 09:55:43.950561 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:43.950525 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-797f989d75-vx45l" podUID="ec43c5d4-5e58-4800-92e6-637c1fe1478b" containerName="console" containerID="cri-o://eaf868e7c0adf17b5eee782b2dc8e2d41537788c7cfccc38ba4b0e8f49068f5c" gracePeriod=15 Jul 27 09:55:44.203101 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:44.203081 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65fb7b8f98-flrh7" Jul 27 09:55:44.205985 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:44.205967 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-797f989d75-vx45l" Jul 27 09:55:44.367977 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:44.367947 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec43c5d4-5e58-4800-92e6-637c1fe1478b-trusted-ca-bundle\") pod \"ec43c5d4-5e58-4800-92e6-637c1fe1478b\" (UID: \"ec43c5d4-5e58-4800-92e6-637c1fe1478b\") " Jul 27 09:55:44.367977 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:44.367978 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6b9360ad-3b69-4a8d-b35f-cb88207a26d0-bound-sa-token\") pod \"6b9360ad-3b69-4a8d-b35f-cb88207a26d0\" (UID: \"6b9360ad-3b69-4a8d-b35f-cb88207a26d0\") " Jul 27 09:55:44.368169 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:44.368008 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mpmwz\" (UniqueName: \"kubernetes.io/projected/ec43c5d4-5e58-4800-92e6-637c1fe1478b-kube-api-access-mpmwz\") pod \"ec43c5d4-5e58-4800-92e6-637c1fe1478b\" (UID: \"ec43c5d4-5e58-4800-92e6-637c1fe1478b\") " Jul 27 09:55:44.368169 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:44.368028 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ec43c5d4-5e58-4800-92e6-637c1fe1478b-console-serving-cert\") pod \"ec43c5d4-5e58-4800-92e6-637c1fe1478b\" (UID: \"ec43c5d4-5e58-4800-92e6-637c1fe1478b\") " Jul 27 09:55:44.368169 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:44.368060 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6b9360ad-3b69-4a8d-b35f-cb88207a26d0-image-registry-private-configuration\") pod \"6b9360ad-3b69-4a8d-b35f-cb88207a26d0\" (UID: \"6b9360ad-3b69-4a8d-b35f-cb88207a26d0\") " Jul 27 09:55:44.368169 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:44.368095 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6b9360ad-3b69-4a8d-b35f-cb88207a26d0-ca-trust-extracted\") pod \"6b9360ad-3b69-4a8d-b35f-cb88207a26d0\" (UID: \"6b9360ad-3b69-4a8d-b35f-cb88207a26d0\") " Jul 27 09:55:44.368169 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:44.368128 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6b9360ad-3b69-4a8d-b35f-cb88207a26d0-installation-pull-secrets\") pod \"6b9360ad-3b69-4a8d-b35f-cb88207a26d0\" (UID: \"6b9360ad-3b69-4a8d-b35f-cb88207a26d0\") " Jul 27 09:55:44.368169 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:44.368166 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ec43c5d4-5e58-4800-92e6-637c1fe1478b-service-ca\") pod \"ec43c5d4-5e58-4800-92e6-637c1fe1478b\" (UID: \"ec43c5d4-5e58-4800-92e6-637c1fe1478b\") " Jul 27 09:55:44.368479 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:44.368205 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ec43c5d4-5e58-4800-92e6-637c1fe1478b-oauth-serving-cert\") pod \"ec43c5d4-5e58-4800-92e6-637c1fe1478b\" (UID: \"ec43c5d4-5e58-4800-92e6-637c1fe1478b\") " Jul 27 09:55:44.368479 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:44.368268 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ec43c5d4-5e58-4800-92e6-637c1fe1478b-console-oauth-config\") pod \"ec43c5d4-5e58-4800-92e6-637c1fe1478b\" (UID: \"ec43c5d4-5e58-4800-92e6-637c1fe1478b\") " Jul 27 09:55:44.368479 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:44.368368 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6b9360ad-3b69-4a8d-b35f-cb88207a26d0-registry-certificates\") pod \"6b9360ad-3b69-4a8d-b35f-cb88207a26d0\" (UID: \"6b9360ad-3b69-4a8d-b35f-cb88207a26d0\") " Jul 27 09:55:44.368479 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:44.368403 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r8t6q\" (UniqueName: \"kubernetes.io/projected/6b9360ad-3b69-4a8d-b35f-cb88207a26d0-kube-api-access-r8t6q\") pod \"6b9360ad-3b69-4a8d-b35f-cb88207a26d0\" (UID: \"6b9360ad-3b69-4a8d-b35f-cb88207a26d0\") " Jul 27 09:55:44.368479 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:44.368430 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec43c5d4-5e58-4800-92e6-637c1fe1478b-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "ec43c5d4-5e58-4800-92e6-637c1fe1478b" (UID: "ec43c5d4-5e58-4800-92e6-637c1fe1478b"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 09:55:44.368479 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:44.368444 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6b9360ad-3b69-4a8d-b35f-cb88207a26d0-registry-tls\") pod \"6b9360ad-3b69-4a8d-b35f-cb88207a26d0\" (UID: \"6b9360ad-3b69-4a8d-b35f-cb88207a26d0\") " Jul 27 09:55:44.368767 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:44.368575 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ec43c5d4-5e58-4800-92e6-637c1fe1478b-console-config\") pod \"ec43c5d4-5e58-4800-92e6-637c1fe1478b\" (UID: \"ec43c5d4-5e58-4800-92e6-637c1fe1478b\") " Jul 27 09:55:44.368767 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:44.368606 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6b9360ad-3b69-4a8d-b35f-cb88207a26d0-trusted-ca\") pod \"6b9360ad-3b69-4a8d-b35f-cb88207a26d0\" (UID: \"6b9360ad-3b69-4a8d-b35f-cb88207a26d0\") " Jul 27 09:55:44.368767 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:44.368636 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec43c5d4-5e58-4800-92e6-637c1fe1478b-service-ca" (OuterVolumeSpecName: "service-ca") pod "ec43c5d4-5e58-4800-92e6-637c1fe1478b" (UID: "ec43c5d4-5e58-4800-92e6-637c1fe1478b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 09:55:44.369697 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:44.369015 2556 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ec43c5d4-5e58-4800-92e6-637c1fe1478b-service-ca\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\"" Jul 27 09:55:44.369697 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:44.369038 2556 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec43c5d4-5e58-4800-92e6-637c1fe1478b-trusted-ca-bundle\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\"" Jul 27 09:55:44.369697 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:44.369495 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b9360ad-3b69-4a8d-b35f-cb88207a26d0-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "6b9360ad-3b69-4a8d-b35f-cb88207a26d0" (UID: "6b9360ad-3b69-4a8d-b35f-cb88207a26d0"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 09:55:44.369697 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:44.369588 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec43c5d4-5e58-4800-92e6-637c1fe1478b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ec43c5d4-5e58-4800-92e6-637c1fe1478b" (UID: "ec43c5d4-5e58-4800-92e6-637c1fe1478b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 09:55:44.369969 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:44.369769 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec43c5d4-5e58-4800-92e6-637c1fe1478b-console-config" (OuterVolumeSpecName: "console-config") pod "ec43c5d4-5e58-4800-92e6-637c1fe1478b" (UID: "ec43c5d4-5e58-4800-92e6-637c1fe1478b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 09:55:44.369969 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:44.369813 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b9360ad-3b69-4a8d-b35f-cb88207a26d0-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "6b9360ad-3b69-4a8d-b35f-cb88207a26d0" (UID: "6b9360ad-3b69-4a8d-b35f-cb88207a26d0"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 09:55:44.371022 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:44.370985 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec43c5d4-5e58-4800-92e6-637c1fe1478b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ec43c5d4-5e58-4800-92e6-637c1fe1478b" (UID: "ec43c5d4-5e58-4800-92e6-637c1fe1478b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 09:55:44.371117 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:44.371086 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b9360ad-3b69-4a8d-b35f-cb88207a26d0-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "6b9360ad-3b69-4a8d-b35f-cb88207a26d0" (UID: "6b9360ad-3b69-4a8d-b35f-cb88207a26d0"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 09:55:44.371117 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:44.371086 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b9360ad-3b69-4a8d-b35f-cb88207a26d0-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "6b9360ad-3b69-4a8d-b35f-cb88207a26d0" (UID: "6b9360ad-3b69-4a8d-b35f-cb88207a26d0"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 09:55:44.371373 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:44.371349 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec43c5d4-5e58-4800-92e6-637c1fe1478b-kube-api-access-mpmwz" (OuterVolumeSpecName: "kube-api-access-mpmwz") pod "ec43c5d4-5e58-4800-92e6-637c1fe1478b" (UID: "ec43c5d4-5e58-4800-92e6-637c1fe1478b"). InnerVolumeSpecName "kube-api-access-mpmwz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 09:55:44.371794 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:44.371773 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec43c5d4-5e58-4800-92e6-637c1fe1478b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ec43c5d4-5e58-4800-92e6-637c1fe1478b" (UID: "ec43c5d4-5e58-4800-92e6-637c1fe1478b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 09:55:44.371930 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:44.371914 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b9360ad-3b69-4a8d-b35f-cb88207a26d0-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "6b9360ad-3b69-4a8d-b35f-cb88207a26d0" (UID: "6b9360ad-3b69-4a8d-b35f-cb88207a26d0"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 09:55:44.372367 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:44.372352 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b9360ad-3b69-4a8d-b35f-cb88207a26d0-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "6b9360ad-3b69-4a8d-b35f-cb88207a26d0" (UID: "6b9360ad-3b69-4a8d-b35f-cb88207a26d0"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 09:55:44.372998 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:44.372983 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b9360ad-3b69-4a8d-b35f-cb88207a26d0-kube-api-access-r8t6q" (OuterVolumeSpecName: "kube-api-access-r8t6q") pod "6b9360ad-3b69-4a8d-b35f-cb88207a26d0" (UID: "6b9360ad-3b69-4a8d-b35f-cb88207a26d0"). InnerVolumeSpecName "kube-api-access-r8t6q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 09:55:44.377505 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:44.377469 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b9360ad-3b69-4a8d-b35f-cb88207a26d0-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "6b9360ad-3b69-4a8d-b35f-cb88207a26d0" (UID: "6b9360ad-3b69-4a8d-b35f-cb88207a26d0"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 27 09:55:44.470020 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:44.469962 2556 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6b9360ad-3b69-4a8d-b35f-cb88207a26d0-image-registry-private-configuration\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\"" Jul 27 09:55:44.470020 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:44.469985 2556 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6b9360ad-3b69-4a8d-b35f-cb88207a26d0-ca-trust-extracted\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\"" Jul 27 09:55:44.470020 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:44.469999 2556 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6b9360ad-3b69-4a8d-b35f-cb88207a26d0-installation-pull-secrets\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\"" Jul 27 09:55:44.470020 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:44.470011 2556 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ec43c5d4-5e58-4800-92e6-637c1fe1478b-oauth-serving-cert\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\"" Jul 27 09:55:44.470213 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:44.470023 2556 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ec43c5d4-5e58-4800-92e6-637c1fe1478b-console-oauth-config\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\"" Jul 27 09:55:44.470213 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:44.470035 2556 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6b9360ad-3b69-4a8d-b35f-cb88207a26d0-registry-certificates\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\"" Jul 27 09:55:44.470213 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:44.470046 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r8t6q\" (UniqueName: \"kubernetes.io/projected/6b9360ad-3b69-4a8d-b35f-cb88207a26d0-kube-api-access-r8t6q\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\"" Jul 27 09:55:44.470213 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:44.470058 2556 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6b9360ad-3b69-4a8d-b35f-cb88207a26d0-registry-tls\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\"" Jul 27 09:55:44.470213 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:44.470070 2556 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ec43c5d4-5e58-4800-92e6-637c1fe1478b-console-config\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\"" Jul 27 09:55:44.470213 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:44.470082 2556 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6b9360ad-3b69-4a8d-b35f-cb88207a26d0-trusted-ca\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\"" Jul 27 09:55:44.470213 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:44.470092 2556 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6b9360ad-3b69-4a8d-b35f-cb88207a26d0-bound-sa-token\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\"" Jul 27 09:55:44.470213 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:44.470104 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mpmwz\" (UniqueName: \"kubernetes.io/projected/ec43c5d4-5e58-4800-92e6-637c1fe1478b-kube-api-access-mpmwz\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\"" Jul 27 09:55:44.470213 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:44.470116 2556 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ec43c5d4-5e58-4800-92e6-637c1fe1478b-console-serving-cert\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\"" Jul 27 09:55:44.976495 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:44.976464 2556 generic.go:356] "Generic (PLEG): container finished" podID="ec43c5d4-5e58-4800-92e6-637c1fe1478b" containerID="eaf868e7c0adf17b5eee782b2dc8e2d41537788c7cfccc38ba4b0e8f49068f5c" exitCode=0 Jul 27 09:55:44.976878 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:44.976528 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-797f989d75-vx45l" Jul 27 09:55:44.976878 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:44.976548 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-797f989d75-vx45l" event={"ID":"ec43c5d4-5e58-4800-92e6-637c1fe1478b","Type":"ContainerDied","Data":"eaf868e7c0adf17b5eee782b2dc8e2d41537788c7cfccc38ba4b0e8f49068f5c"} Jul 27 09:55:44.976878 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:44.976605 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-797f989d75-vx45l" event={"ID":"ec43c5d4-5e58-4800-92e6-637c1fe1478b","Type":"ContainerDied","Data":"746b02b7c862b75a2e7551760f6724724bdee61dd0e3c0cb36871c2e0ad29cc0"} Jul 27 09:55:44.976878 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:44.976636 2556 scope.go:117] "RemoveContainer" containerID="eaf868e7c0adf17b5eee782b2dc8e2d41537788c7cfccc38ba4b0e8f49068f5c" Jul 27 09:55:44.977965 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:44.977941 2556 generic.go:356] "Generic (PLEG): container finished" podID="6b9360ad-3b69-4a8d-b35f-cb88207a26d0" containerID="b7827f0088da531d414988c1bbb0bf8f22b904bcc9493ba354e013b14218cd41" exitCode=0 Jul 27 09:55:44.978030 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:44.977977 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-65fb7b8f98-flrh7" event={"ID":"6b9360ad-3b69-4a8d-b35f-cb88207a26d0","Type":"ContainerDied","Data":"b7827f0088da531d414988c1bbb0bf8f22b904bcc9493ba354e013b14218cd41"} Jul 27 09:55:44.978030 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:44.978007 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65fb7b8f98-flrh7" Jul 27 09:55:44.978030 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:44.978015 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-65fb7b8f98-flrh7" event={"ID":"6b9360ad-3b69-4a8d-b35f-cb88207a26d0","Type":"ContainerDied","Data":"bf971aef529244d828e584db59f46fe1408d232c8faae37917f98b2a35305af1"} Jul 27 09:55:44.984530 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:44.984514 2556 scope.go:117] "RemoveContainer" containerID="eaf868e7c0adf17b5eee782b2dc8e2d41537788c7cfccc38ba4b0e8f49068f5c" Jul 27 09:55:44.984805 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:55:44.984784 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eaf868e7c0adf17b5eee782b2dc8e2d41537788c7cfccc38ba4b0e8f49068f5c\": container with ID starting with eaf868e7c0adf17b5eee782b2dc8e2d41537788c7cfccc38ba4b0e8f49068f5c not found: ID does not exist" containerID="eaf868e7c0adf17b5eee782b2dc8e2d41537788c7cfccc38ba4b0e8f49068f5c" Jul 27 09:55:44.984877 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:44.984817 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eaf868e7c0adf17b5eee782b2dc8e2d41537788c7cfccc38ba4b0e8f49068f5c"} err="failed to get container status \"eaf868e7c0adf17b5eee782b2dc8e2d41537788c7cfccc38ba4b0e8f49068f5c\": rpc error: code = NotFound desc = could not find container \"eaf868e7c0adf17b5eee782b2dc8e2d41537788c7cfccc38ba4b0e8f49068f5c\": container with ID starting with eaf868e7c0adf17b5eee782b2dc8e2d41537788c7cfccc38ba4b0e8f49068f5c not found: ID does not exist" Jul 27 09:55:44.984877 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:44.984838 2556 scope.go:117] "RemoveContainer" containerID="b7827f0088da531d414988c1bbb0bf8f22b904bcc9493ba354e013b14218cd41" Jul 27 09:55:44.992229 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:44.992214 2556 scope.go:117] "RemoveContainer" containerID="b7827f0088da531d414988c1bbb0bf8f22b904bcc9493ba354e013b14218cd41" Jul 27 09:55:44.992471 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:55:44.992451 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b7827f0088da531d414988c1bbb0bf8f22b904bcc9493ba354e013b14218cd41\": container with ID starting with b7827f0088da531d414988c1bbb0bf8f22b904bcc9493ba354e013b14218cd41 not found: ID does not exist" containerID="b7827f0088da531d414988c1bbb0bf8f22b904bcc9493ba354e013b14218cd41" Jul 27 09:55:44.992522 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:44.992478 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7827f0088da531d414988c1bbb0bf8f22b904bcc9493ba354e013b14218cd41"} err="failed to get container status \"b7827f0088da531d414988c1bbb0bf8f22b904bcc9493ba354e013b14218cd41\": rpc error: code = NotFound desc = could not find container \"b7827f0088da531d414988c1bbb0bf8f22b904bcc9493ba354e013b14218cd41\": container with ID starting with b7827f0088da531d414988c1bbb0bf8f22b904bcc9493ba354e013b14218cd41 not found: ID does not exist" Jul 27 09:55:45.004952 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:45.004932 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-797f989d75-vx45l"] Jul 27 09:55:45.010174 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:45.010156 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-797f989d75-vx45l"] Jul 27 09:55:45.024188 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:45.024167 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-65fb7b8f98-flrh7"] Jul 27 09:55:45.026772 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:45.026754 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-65fb7b8f98-flrh7"] Jul 27 09:55:45.909378 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:45.909345 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b9360ad-3b69-4a8d-b35f-cb88207a26d0" path="/var/lib/kubelet/pods/6b9360ad-3b69-4a8d-b35f-cb88207a26d0/volumes" Jul 27 09:55:45.909717 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:45.909704 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec43c5d4-5e58-4800-92e6-637c1fe1478b" path="/var/lib/kubelet/pods/ec43c5d4-5e58-4800-92e6-637c1fe1478b/volumes" Jul 27 09:55:46.990470 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:46.990443 2556 generic.go:356] "Generic (PLEG): container finished" podID="8fa28813-be68-4170-845e-069e6c14689d" containerID="c11091bbcddc079e11a28c9d446ece27c92ef4bf5b2034bd2a5ae32f446660b6" exitCode=0 Jul 27 09:55:46.990824 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:46.990523 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-msdf9" event={"ID":"8fa28813-be68-4170-845e-069e6c14689d","Type":"ContainerDied","Data":"c11091bbcddc079e11a28c9d446ece27c92ef4bf5b2034bd2a5ae32f446660b6"} Jul 27 09:55:46.990824 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:46.990820 2556 scope.go:117] "RemoveContainer" containerID="c11091bbcddc079e11a28c9d446ece27c92ef4bf5b2034bd2a5ae32f446660b6" Jul 27 09:55:47.996482 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:55:47.996454 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-msdf9" event={"ID":"8fa28813-be68-4170-845e-069e6c14689d","Type":"ContainerStarted","Data":"d50635f052c6db1a337a4e86a57dd6c8cbf65d2200118322ebef1da62a5c5718"} Jul 27 09:56:23.719933 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:23.719901 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 27 09:56:23.720415 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:23.720207 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d57c307c-8976-488d-804a-7dc01f98c08d" containerName="alertmanager" containerID="cri-o://5fb1ac53962a989415bc613ad6d4d84960c6b3cbd384092032f752ab96fdb204" gracePeriod=120 Jul 27 09:56:23.720415 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:23.720337 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d57c307c-8976-488d-804a-7dc01f98c08d" containerName="kube-rbac-proxy-metric" containerID="cri-o://1b159ead42d5df8b4903b75b95cb3ac74ba036f64ecfea15bd7f6d0b6a3cd25b" gracePeriod=120 Jul 27 09:56:23.720415 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:23.720387 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d57c307c-8976-488d-804a-7dc01f98c08d" containerName="config-reloader" containerID="cri-o://614ca7e2c22ae7e9296b7aab31a8c5a23a294d51445ac9f5a228dde1bcab442a" gracePeriod=120 Jul 27 09:56:23.720605 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:23.720337 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d57c307c-8976-488d-804a-7dc01f98c08d" containerName="prom-label-proxy" containerID="cri-o://1e7aaa3ce4650f997f4c8dc380411cc64731adcadadaf9dbea0596b8194018af" gracePeriod=120 Jul 27 09:56:23.720605 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:23.720424 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d57c307c-8976-488d-804a-7dc01f98c08d" containerName="kube-rbac-proxy" containerID="cri-o://a59d78ab47869e99f24281f54dfab2126277a560bb57a779f2342e9bea274ae2" gracePeriod=120 Jul 27 09:56:23.720605 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:23.720566 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d57c307c-8976-488d-804a-7dc01f98c08d" containerName="kube-rbac-proxy-web" containerID="cri-o://ffb524565bb2489cd4c9932f060252d294774383cb35e9f19eb16b5771934232" gracePeriod=120 Jul 27 09:56:24.127763 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:24.127729 2556 generic.go:356] "Generic (PLEG): container finished" podID="d57c307c-8976-488d-804a-7dc01f98c08d" containerID="1e7aaa3ce4650f997f4c8dc380411cc64731adcadadaf9dbea0596b8194018af" exitCode=0 Jul 27 09:56:24.127763 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:24.127754 2556 generic.go:356] "Generic (PLEG): container finished" podID="d57c307c-8976-488d-804a-7dc01f98c08d" containerID="a59d78ab47869e99f24281f54dfab2126277a560bb57a779f2342e9bea274ae2" exitCode=0 Jul 27 09:56:24.127763 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:24.127763 2556 generic.go:356] "Generic (PLEG): container finished" podID="d57c307c-8976-488d-804a-7dc01f98c08d" containerID="614ca7e2c22ae7e9296b7aab31a8c5a23a294d51445ac9f5a228dde1bcab442a" exitCode=0 Jul 27 09:56:24.127956 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:24.127770 2556 generic.go:356] "Generic (PLEG): container finished" podID="d57c307c-8976-488d-804a-7dc01f98c08d" containerID="5fb1ac53962a989415bc613ad6d4d84960c6b3cbd384092032f752ab96fdb204" exitCode=0 Jul 27 09:56:24.127956 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:24.127786 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d57c307c-8976-488d-804a-7dc01f98c08d","Type":"ContainerDied","Data":"1e7aaa3ce4650f997f4c8dc380411cc64731adcadadaf9dbea0596b8194018af"} Jul 27 09:56:24.127956 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:24.127850 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d57c307c-8976-488d-804a-7dc01f98c08d","Type":"ContainerDied","Data":"a59d78ab47869e99f24281f54dfab2126277a560bb57a779f2342e9bea274ae2"} Jul 27 09:56:24.127956 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:24.127875 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d57c307c-8976-488d-804a-7dc01f98c08d","Type":"ContainerDied","Data":"614ca7e2c22ae7e9296b7aab31a8c5a23a294d51445ac9f5a228dde1bcab442a"} Jul 27 09:56:24.127956 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:24.127899 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d57c307c-8976-488d-804a-7dc01f98c08d","Type":"ContainerDied","Data":"5fb1ac53962a989415bc613ad6d4d84960c6b3cbd384092032f752ab96fdb204"} Jul 27 09:56:24.965577 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:24.965556 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:56:25.058355 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.058328 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d57c307c-8976-488d-804a-7dc01f98c08d-secret-alertmanager-main-tls\") pod \"d57c307c-8976-488d-804a-7dc01f98c08d\" (UID: \"d57c307c-8976-488d-804a-7dc01f98c08d\") " Jul 27 09:56:25.058506 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.058363 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cp8kk\" (UniqueName: \"kubernetes.io/projected/d57c307c-8976-488d-804a-7dc01f98c08d-kube-api-access-cp8kk\") pod \"d57c307c-8976-488d-804a-7dc01f98c08d\" (UID: \"d57c307c-8976-488d-804a-7dc01f98c08d\") " Jul 27 09:56:25.058506 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.058405 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d57c307c-8976-488d-804a-7dc01f98c08d-tls-assets\") pod \"d57c307c-8976-488d-804a-7dc01f98c08d\" (UID: \"d57c307c-8976-488d-804a-7dc01f98c08d\") " Jul 27 09:56:25.058506 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.058428 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d57c307c-8976-488d-804a-7dc01f98c08d-config-out\") pod \"d57c307c-8976-488d-804a-7dc01f98c08d\" (UID: \"d57c307c-8976-488d-804a-7dc01f98c08d\") " Jul 27 09:56:25.058506 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.058450 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d57c307c-8976-488d-804a-7dc01f98c08d-secret-alertmanager-kube-rbac-proxy\") pod \"d57c307c-8976-488d-804a-7dc01f98c08d\" (UID: \"d57c307c-8976-488d-804a-7dc01f98c08d\") " Jul 27 09:56:25.058506 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.058477 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d57c307c-8976-488d-804a-7dc01f98c08d-alertmanager-trusted-ca-bundle\") pod \"d57c307c-8976-488d-804a-7dc01f98c08d\" (UID: \"d57c307c-8976-488d-804a-7dc01f98c08d\") " Jul 27 09:56:25.058748 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.058521 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d57c307c-8976-488d-804a-7dc01f98c08d-metrics-client-ca\") pod \"d57c307c-8976-488d-804a-7dc01f98c08d\" (UID: \"d57c307c-8976-488d-804a-7dc01f98c08d\") " Jul 27 09:56:25.058748 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.058685 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d57c307c-8976-488d-804a-7dc01f98c08d-secret-alertmanager-kube-rbac-proxy-web\") pod \"d57c307c-8976-488d-804a-7dc01f98c08d\" (UID: \"d57c307c-8976-488d-804a-7dc01f98c08d\") " Jul 27 09:56:25.058748 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.058732 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d57c307c-8976-488d-804a-7dc01f98c08d-alertmanager-main-db\") pod \"d57c307c-8976-488d-804a-7dc01f98c08d\" (UID: \"d57c307c-8976-488d-804a-7dc01f98c08d\") " Jul 27 09:56:25.058895 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.058762 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d57c307c-8976-488d-804a-7dc01f98c08d-web-config\") pod \"d57c307c-8976-488d-804a-7dc01f98c08d\" (UID: \"d57c307c-8976-488d-804a-7dc01f98c08d\") " Jul 27 09:56:25.058895 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.058784 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d57c307c-8976-488d-804a-7dc01f98c08d-config-volume\") pod \"d57c307c-8976-488d-804a-7dc01f98c08d\" (UID: \"d57c307c-8976-488d-804a-7dc01f98c08d\") " Jul 27 09:56:25.058895 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.058835 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d57c307c-8976-488d-804a-7dc01f98c08d-cluster-tls-config\") pod \"d57c307c-8976-488d-804a-7dc01f98c08d\" (UID: \"d57c307c-8976-488d-804a-7dc01f98c08d\") " Jul 27 09:56:25.058895 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.058867 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d57c307c-8976-488d-804a-7dc01f98c08d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"d57c307c-8976-488d-804a-7dc01f98c08d\" (UID: \"d57c307c-8976-488d-804a-7dc01f98c08d\") " Jul 27 09:56:25.059067 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.058938 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d57c307c-8976-488d-804a-7dc01f98c08d-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "d57c307c-8976-488d-804a-7dc01f98c08d" (UID: "d57c307c-8976-488d-804a-7dc01f98c08d"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 09:56:25.059531 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.059127 2556 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d57c307c-8976-488d-804a-7dc01f98c08d-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\"" Jul 27 09:56:25.059531 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.059464 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d57c307c-8976-488d-804a-7dc01f98c08d-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "d57c307c-8976-488d-804a-7dc01f98c08d" (UID: "d57c307c-8976-488d-804a-7dc01f98c08d"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 09:56:25.059827 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.059795 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d57c307c-8976-488d-804a-7dc01f98c08d-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "d57c307c-8976-488d-804a-7dc01f98c08d" (UID: "d57c307c-8976-488d-804a-7dc01f98c08d"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 27 09:56:25.061591 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.061500 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d57c307c-8976-488d-804a-7dc01f98c08d-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "d57c307c-8976-488d-804a-7dc01f98c08d" (UID: "d57c307c-8976-488d-804a-7dc01f98c08d"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 09:56:25.061728 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.061590 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d57c307c-8976-488d-804a-7dc01f98c08d-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "d57c307c-8976-488d-804a-7dc01f98c08d" (UID: "d57c307c-8976-488d-804a-7dc01f98c08d"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 09:56:25.062076 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.062026 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d57c307c-8976-488d-804a-7dc01f98c08d-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "d57c307c-8976-488d-804a-7dc01f98c08d" (UID: "d57c307c-8976-488d-804a-7dc01f98c08d"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 09:56:25.062220 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.062200 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d57c307c-8976-488d-804a-7dc01f98c08d-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "d57c307c-8976-488d-804a-7dc01f98c08d" (UID: "d57c307c-8976-488d-804a-7dc01f98c08d"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 09:56:25.062385 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.062365 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d57c307c-8976-488d-804a-7dc01f98c08d-kube-api-access-cp8kk" (OuterVolumeSpecName: "kube-api-access-cp8kk") pod "d57c307c-8976-488d-804a-7dc01f98c08d" (UID: "d57c307c-8976-488d-804a-7dc01f98c08d"). InnerVolumeSpecName "kube-api-access-cp8kk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 09:56:25.062453 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.062381 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d57c307c-8976-488d-804a-7dc01f98c08d-config-out" (OuterVolumeSpecName: "config-out") pod "d57c307c-8976-488d-804a-7dc01f98c08d" (UID: "d57c307c-8976-488d-804a-7dc01f98c08d"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 27 09:56:25.062453 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.062384 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d57c307c-8976-488d-804a-7dc01f98c08d-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "d57c307c-8976-488d-804a-7dc01f98c08d" (UID: "d57c307c-8976-488d-804a-7dc01f98c08d"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 09:56:25.062905 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.062887 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d57c307c-8976-488d-804a-7dc01f98c08d-config-volume" (OuterVolumeSpecName: "config-volume") pod "d57c307c-8976-488d-804a-7dc01f98c08d" (UID: "d57c307c-8976-488d-804a-7dc01f98c08d"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 09:56:25.067222 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.067200 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d57c307c-8976-488d-804a-7dc01f98c08d-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "d57c307c-8976-488d-804a-7dc01f98c08d" (UID: "d57c307c-8976-488d-804a-7dc01f98c08d"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 09:56:25.073341 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.073316 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d57c307c-8976-488d-804a-7dc01f98c08d-web-config" (OuterVolumeSpecName: "web-config") pod "d57c307c-8976-488d-804a-7dc01f98c08d" (UID: "d57c307c-8976-488d-804a-7dc01f98c08d"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 09:56:25.134016 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.133985 2556 generic.go:356] "Generic (PLEG): container finished" podID="d57c307c-8976-488d-804a-7dc01f98c08d" containerID="1b159ead42d5df8b4903b75b95cb3ac74ba036f64ecfea15bd7f6d0b6a3cd25b" exitCode=0 Jul 27 09:56:25.134016 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.134008 2556 generic.go:356] "Generic (PLEG): container finished" podID="d57c307c-8976-488d-804a-7dc01f98c08d" containerID="ffb524565bb2489cd4c9932f060252d294774383cb35e9f19eb16b5771934232" exitCode=0 Jul 27 09:56:25.134110 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.134052 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d57c307c-8976-488d-804a-7dc01f98c08d","Type":"ContainerDied","Data":"1b159ead42d5df8b4903b75b95cb3ac74ba036f64ecfea15bd7f6d0b6a3cd25b"} Jul 27 09:56:25.134151 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.134115 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d57c307c-8976-488d-804a-7dc01f98c08d","Type":"ContainerDied","Data":"ffb524565bb2489cd4c9932f060252d294774383cb35e9f19eb16b5771934232"} Jul 27 09:56:25.134151 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.134058 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:56:25.134151 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.134140 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d57c307c-8976-488d-804a-7dc01f98c08d","Type":"ContainerDied","Data":"8107330784e7e8cd6846a51fcc463a661c8cf3f1bdf04353ffa812e69b0c55e4"} Jul 27 09:56:25.134237 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.134170 2556 scope.go:117] "RemoveContainer" containerID="1e7aaa3ce4650f997f4c8dc380411cc64731adcadadaf9dbea0596b8194018af" Jul 27 09:56:25.141971 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.141956 2556 scope.go:117] "RemoveContainer" containerID="1b159ead42d5df8b4903b75b95cb3ac74ba036f64ecfea15bd7f6d0b6a3cd25b" Jul 27 09:56:25.148377 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.148361 2556 scope.go:117] "RemoveContainer" containerID="a59d78ab47869e99f24281f54dfab2126277a560bb57a779f2342e9bea274ae2" Jul 27 09:56:25.154738 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.154723 2556 scope.go:117] "RemoveContainer" containerID="ffb524565bb2489cd4c9932f060252d294774383cb35e9f19eb16b5771934232" Jul 27 09:56:25.159628 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.159612 2556 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d57c307c-8976-488d-804a-7dc01f98c08d-tls-assets\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\"" Jul 27 09:56:25.159628 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.159629 2556 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d57c307c-8976-488d-804a-7dc01f98c08d-config-out\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\"" Jul 27 09:56:25.159739 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.159637 2556 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d57c307c-8976-488d-804a-7dc01f98c08d-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\"" Jul 27 09:56:25.159739 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.159647 2556 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d57c307c-8976-488d-804a-7dc01f98c08d-metrics-client-ca\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\"" Jul 27 09:56:25.159739 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.159656 2556 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d57c307c-8976-488d-804a-7dc01f98c08d-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\"" Jul 27 09:56:25.159739 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.159665 2556 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d57c307c-8976-488d-804a-7dc01f98c08d-alertmanager-main-db\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\"" Jul 27 09:56:25.159739 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.159672 2556 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d57c307c-8976-488d-804a-7dc01f98c08d-web-config\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\"" Jul 27 09:56:25.159739 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.159680 2556 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d57c307c-8976-488d-804a-7dc01f98c08d-config-volume\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\"" Jul 27 09:56:25.159739 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.159686 2556 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d57c307c-8976-488d-804a-7dc01f98c08d-cluster-tls-config\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\"" Jul 27 09:56:25.159739 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.159694 2556 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d57c307c-8976-488d-804a-7dc01f98c08d-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\"" Jul 27 09:56:25.159739 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.159707 2556 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d57c307c-8976-488d-804a-7dc01f98c08d-secret-alertmanager-main-tls\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\"" Jul 27 09:56:25.159739 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.159708 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 27 09:56:25.159739 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.159717 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cp8kk\" (UniqueName: \"kubernetes.io/projected/d57c307c-8976-488d-804a-7dc01f98c08d-kube-api-access-cp8kk\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\"" Jul 27 09:56:25.161198 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.161182 2556 scope.go:117] "RemoveContainer" containerID="614ca7e2c22ae7e9296b7aab31a8c5a23a294d51445ac9f5a228dde1bcab442a" Jul 27 09:56:25.164209 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.164191 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 27 09:56:25.167919 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.167904 2556 scope.go:117] "RemoveContainer" containerID="5fb1ac53962a989415bc613ad6d4d84960c6b3cbd384092032f752ab96fdb204" Jul 27 09:56:25.174453 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.174434 2556 scope.go:117] "RemoveContainer" containerID="f92c4606f1e401005ddf9ed1ddd5b1a8aa195bf8fab54fc7ae311ca6f97284df" Jul 27 09:56:25.180724 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.180709 2556 scope.go:117] "RemoveContainer" containerID="1e7aaa3ce4650f997f4c8dc380411cc64731adcadadaf9dbea0596b8194018af" Jul 27 09:56:25.180958 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:56:25.180941 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e7aaa3ce4650f997f4c8dc380411cc64731adcadadaf9dbea0596b8194018af\": container with ID starting with 1e7aaa3ce4650f997f4c8dc380411cc64731adcadadaf9dbea0596b8194018af not found: ID does not exist" containerID="1e7aaa3ce4650f997f4c8dc380411cc64731adcadadaf9dbea0596b8194018af" Jul 27 09:56:25.181035 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.180975 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e7aaa3ce4650f997f4c8dc380411cc64731adcadadaf9dbea0596b8194018af"} err="failed to get container status \"1e7aaa3ce4650f997f4c8dc380411cc64731adcadadaf9dbea0596b8194018af\": rpc error: code = NotFound desc = could not find container \"1e7aaa3ce4650f997f4c8dc380411cc64731adcadadaf9dbea0596b8194018af\": container with ID starting with 1e7aaa3ce4650f997f4c8dc380411cc64731adcadadaf9dbea0596b8194018af not found: ID does not exist" Jul 27 09:56:25.181035 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.181000 2556 scope.go:117] "RemoveContainer" containerID="1b159ead42d5df8b4903b75b95cb3ac74ba036f64ecfea15bd7f6d0b6a3cd25b" Jul 27 09:56:25.181259 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:56:25.181243 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b159ead42d5df8b4903b75b95cb3ac74ba036f64ecfea15bd7f6d0b6a3cd25b\": container with ID starting with 1b159ead42d5df8b4903b75b95cb3ac74ba036f64ecfea15bd7f6d0b6a3cd25b not found: ID does not exist" containerID="1b159ead42d5df8b4903b75b95cb3ac74ba036f64ecfea15bd7f6d0b6a3cd25b" Jul 27 09:56:25.181296 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.181264 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b159ead42d5df8b4903b75b95cb3ac74ba036f64ecfea15bd7f6d0b6a3cd25b"} err="failed to get container status \"1b159ead42d5df8b4903b75b95cb3ac74ba036f64ecfea15bd7f6d0b6a3cd25b\": rpc error: code = NotFound desc = could not find container \"1b159ead42d5df8b4903b75b95cb3ac74ba036f64ecfea15bd7f6d0b6a3cd25b\": container with ID starting with 1b159ead42d5df8b4903b75b95cb3ac74ba036f64ecfea15bd7f6d0b6a3cd25b not found: ID does not exist" Jul 27 09:56:25.181296 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.181280 2556 scope.go:117] "RemoveContainer" containerID="a59d78ab47869e99f24281f54dfab2126277a560bb57a779f2342e9bea274ae2" Jul 27 09:56:25.181546 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:56:25.181529 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a59d78ab47869e99f24281f54dfab2126277a560bb57a779f2342e9bea274ae2\": container with ID starting with a59d78ab47869e99f24281f54dfab2126277a560bb57a779f2342e9bea274ae2 not found: ID does not exist" containerID="a59d78ab47869e99f24281f54dfab2126277a560bb57a779f2342e9bea274ae2" Jul 27 09:56:25.181593 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.181550 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a59d78ab47869e99f24281f54dfab2126277a560bb57a779f2342e9bea274ae2"} err="failed to get container status \"a59d78ab47869e99f24281f54dfab2126277a560bb57a779f2342e9bea274ae2\": rpc error: code = NotFound desc = could not find container \"a59d78ab47869e99f24281f54dfab2126277a560bb57a779f2342e9bea274ae2\": container with ID starting with a59d78ab47869e99f24281f54dfab2126277a560bb57a779f2342e9bea274ae2 not found: ID does not exist" Jul 27 09:56:25.181593 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.181565 2556 scope.go:117] "RemoveContainer" containerID="ffb524565bb2489cd4c9932f060252d294774383cb35e9f19eb16b5771934232" Jul 27 09:56:25.181791 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:56:25.181771 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ffb524565bb2489cd4c9932f060252d294774383cb35e9f19eb16b5771934232\": container with ID starting with ffb524565bb2489cd4c9932f060252d294774383cb35e9f19eb16b5771934232 not found: ID does not exist" containerID="ffb524565bb2489cd4c9932f060252d294774383cb35e9f19eb16b5771934232" Jul 27 09:56:25.181848 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.181798 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ffb524565bb2489cd4c9932f060252d294774383cb35e9f19eb16b5771934232"} err="failed to get container status \"ffb524565bb2489cd4c9932f060252d294774383cb35e9f19eb16b5771934232\": rpc error: code = NotFound desc = could not find container \"ffb524565bb2489cd4c9932f060252d294774383cb35e9f19eb16b5771934232\": container with ID starting with ffb524565bb2489cd4c9932f060252d294774383cb35e9f19eb16b5771934232 not found: ID does not exist" Jul 27 09:56:25.181848 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.181817 2556 scope.go:117] "RemoveContainer" containerID="614ca7e2c22ae7e9296b7aab31a8c5a23a294d51445ac9f5a228dde1bcab442a" Jul 27 09:56:25.182052 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:56:25.182037 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"614ca7e2c22ae7e9296b7aab31a8c5a23a294d51445ac9f5a228dde1bcab442a\": container with ID starting with 614ca7e2c22ae7e9296b7aab31a8c5a23a294d51445ac9f5a228dde1bcab442a not found: ID does not exist" containerID="614ca7e2c22ae7e9296b7aab31a8c5a23a294d51445ac9f5a228dde1bcab442a" Jul 27 09:56:25.182096 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.182055 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"614ca7e2c22ae7e9296b7aab31a8c5a23a294d51445ac9f5a228dde1bcab442a"} err="failed to get container status \"614ca7e2c22ae7e9296b7aab31a8c5a23a294d51445ac9f5a228dde1bcab442a\": rpc error: code = NotFound desc = could not find container \"614ca7e2c22ae7e9296b7aab31a8c5a23a294d51445ac9f5a228dde1bcab442a\": container with ID starting with 614ca7e2c22ae7e9296b7aab31a8c5a23a294d51445ac9f5a228dde1bcab442a not found: ID does not exist" Jul 27 09:56:25.182096 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.182068 2556 scope.go:117] "RemoveContainer" containerID="5fb1ac53962a989415bc613ad6d4d84960c6b3cbd384092032f752ab96fdb204" Jul 27 09:56:25.182292 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:56:25.182277 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5fb1ac53962a989415bc613ad6d4d84960c6b3cbd384092032f752ab96fdb204\": container with ID starting with 5fb1ac53962a989415bc613ad6d4d84960c6b3cbd384092032f752ab96fdb204 not found: ID does not exist" containerID="5fb1ac53962a989415bc613ad6d4d84960c6b3cbd384092032f752ab96fdb204" Jul 27 09:56:25.182362 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.182296 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5fb1ac53962a989415bc613ad6d4d84960c6b3cbd384092032f752ab96fdb204"} err="failed to get container status \"5fb1ac53962a989415bc613ad6d4d84960c6b3cbd384092032f752ab96fdb204\": rpc error: code = NotFound desc = could not find container \"5fb1ac53962a989415bc613ad6d4d84960c6b3cbd384092032f752ab96fdb204\": container with ID starting with 5fb1ac53962a989415bc613ad6d4d84960c6b3cbd384092032f752ab96fdb204 not found: ID does not exist" Jul 27 09:56:25.182362 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.182325 2556 scope.go:117] "RemoveContainer" containerID="f92c4606f1e401005ddf9ed1ddd5b1a8aa195bf8fab54fc7ae311ca6f97284df" Jul 27 09:56:25.182549 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:56:25.182533 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f92c4606f1e401005ddf9ed1ddd5b1a8aa195bf8fab54fc7ae311ca6f97284df\": container with ID starting with f92c4606f1e401005ddf9ed1ddd5b1a8aa195bf8fab54fc7ae311ca6f97284df not found: ID does not exist" containerID="f92c4606f1e401005ddf9ed1ddd5b1a8aa195bf8fab54fc7ae311ca6f97284df" Jul 27 09:56:25.182586 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.182562 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f92c4606f1e401005ddf9ed1ddd5b1a8aa195bf8fab54fc7ae311ca6f97284df"} err="failed to get container status \"f92c4606f1e401005ddf9ed1ddd5b1a8aa195bf8fab54fc7ae311ca6f97284df\": rpc error: code = NotFound desc = could not find container \"f92c4606f1e401005ddf9ed1ddd5b1a8aa195bf8fab54fc7ae311ca6f97284df\": container with ID starting with f92c4606f1e401005ddf9ed1ddd5b1a8aa195bf8fab54fc7ae311ca6f97284df not found: ID does not exist" Jul 27 09:56:25.182586 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.182575 2556 scope.go:117] "RemoveContainer" containerID="1e7aaa3ce4650f997f4c8dc380411cc64731adcadadaf9dbea0596b8194018af" Jul 27 09:56:25.182796 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.182781 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e7aaa3ce4650f997f4c8dc380411cc64731adcadadaf9dbea0596b8194018af"} err="failed to get container status \"1e7aaa3ce4650f997f4c8dc380411cc64731adcadadaf9dbea0596b8194018af\": rpc error: code = NotFound desc = could not find container \"1e7aaa3ce4650f997f4c8dc380411cc64731adcadadaf9dbea0596b8194018af\": container with ID starting with 1e7aaa3ce4650f997f4c8dc380411cc64731adcadadaf9dbea0596b8194018af not found: ID does not exist" Jul 27 09:56:25.182848 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.182798 2556 scope.go:117] "RemoveContainer" containerID="1b159ead42d5df8b4903b75b95cb3ac74ba036f64ecfea15bd7f6d0b6a3cd25b" Jul 27 09:56:25.183019 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.183003 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b159ead42d5df8b4903b75b95cb3ac74ba036f64ecfea15bd7f6d0b6a3cd25b"} err="failed to get container status \"1b159ead42d5df8b4903b75b95cb3ac74ba036f64ecfea15bd7f6d0b6a3cd25b\": rpc error: code = NotFound desc = could not find container \"1b159ead42d5df8b4903b75b95cb3ac74ba036f64ecfea15bd7f6d0b6a3cd25b\": container with ID starting with 1b159ead42d5df8b4903b75b95cb3ac74ba036f64ecfea15bd7f6d0b6a3cd25b not found: ID does not exist" Jul 27 09:56:25.183062 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.183020 2556 scope.go:117] "RemoveContainer" containerID="a59d78ab47869e99f24281f54dfab2126277a560bb57a779f2342e9bea274ae2" Jul 27 09:56:25.183231 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.183215 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a59d78ab47869e99f24281f54dfab2126277a560bb57a779f2342e9bea274ae2"} err="failed to get container status \"a59d78ab47869e99f24281f54dfab2126277a560bb57a779f2342e9bea274ae2\": rpc error: code = NotFound desc = could not find container \"a59d78ab47869e99f24281f54dfab2126277a560bb57a779f2342e9bea274ae2\": container with ID starting with a59d78ab47869e99f24281f54dfab2126277a560bb57a779f2342e9bea274ae2 not found: ID does not exist" Jul 27 09:56:25.183279 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.183232 2556 scope.go:117] "RemoveContainer" containerID="ffb524565bb2489cd4c9932f060252d294774383cb35e9f19eb16b5771934232" Jul 27 09:56:25.183488 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.183468 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ffb524565bb2489cd4c9932f060252d294774383cb35e9f19eb16b5771934232"} err="failed to get container status \"ffb524565bb2489cd4c9932f060252d294774383cb35e9f19eb16b5771934232\": rpc error: code = NotFound desc = could not find container \"ffb524565bb2489cd4c9932f060252d294774383cb35e9f19eb16b5771934232\": container with ID starting with ffb524565bb2489cd4c9932f060252d294774383cb35e9f19eb16b5771934232 not found: ID does not exist" Jul 27 09:56:25.183488 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.183488 2556 scope.go:117] "RemoveContainer" containerID="614ca7e2c22ae7e9296b7aab31a8c5a23a294d51445ac9f5a228dde1bcab442a" Jul 27 09:56:25.183716 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.183700 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"614ca7e2c22ae7e9296b7aab31a8c5a23a294d51445ac9f5a228dde1bcab442a"} err="failed to get container status \"614ca7e2c22ae7e9296b7aab31a8c5a23a294d51445ac9f5a228dde1bcab442a\": rpc error: code = NotFound desc = could not find container \"614ca7e2c22ae7e9296b7aab31a8c5a23a294d51445ac9f5a228dde1bcab442a\": container with ID starting with 614ca7e2c22ae7e9296b7aab31a8c5a23a294d51445ac9f5a228dde1bcab442a not found: ID does not exist" Jul 27 09:56:25.183756 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.183717 2556 scope.go:117] "RemoveContainer" containerID="5fb1ac53962a989415bc613ad6d4d84960c6b3cbd384092032f752ab96fdb204" Jul 27 09:56:25.183936 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.183916 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5fb1ac53962a989415bc613ad6d4d84960c6b3cbd384092032f752ab96fdb204"} err="failed to get container status \"5fb1ac53962a989415bc613ad6d4d84960c6b3cbd384092032f752ab96fdb204\": rpc error: code = NotFound desc = could not find container \"5fb1ac53962a989415bc613ad6d4d84960c6b3cbd384092032f752ab96fdb204\": container with ID starting with 5fb1ac53962a989415bc613ad6d4d84960c6b3cbd384092032f752ab96fdb204 not found: ID does not exist" Jul 27 09:56:25.183936 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.183935 2556 scope.go:117] "RemoveContainer" containerID="f92c4606f1e401005ddf9ed1ddd5b1a8aa195bf8fab54fc7ae311ca6f97284df" Jul 27 09:56:25.184159 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.184137 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f92c4606f1e401005ddf9ed1ddd5b1a8aa195bf8fab54fc7ae311ca6f97284df"} err="failed to get container status \"f92c4606f1e401005ddf9ed1ddd5b1a8aa195bf8fab54fc7ae311ca6f97284df\": rpc error: code = NotFound desc = could not find container \"f92c4606f1e401005ddf9ed1ddd5b1a8aa195bf8fab54fc7ae311ca6f97284df\": container with ID starting with f92c4606f1e401005ddf9ed1ddd5b1a8aa195bf8fab54fc7ae311ca6f97284df not found: ID does not exist" Jul 27 09:56:25.196251 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.196231 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 27 09:56:25.196515 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.196503 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b9360ad-3b69-4a8d-b35f-cb88207a26d0" containerName="registry" Jul 27 09:56:25.196560 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.196518 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b9360ad-3b69-4a8d-b35f-cb88207a26d0" containerName="registry" Jul 27 09:56:25.196560 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.196528 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d57c307c-8976-488d-804a-7dc01f98c08d" containerName="kube-rbac-proxy-web" Jul 27 09:56:25.196560 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.196536 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="d57c307c-8976-488d-804a-7dc01f98c08d" containerName="kube-rbac-proxy-web" Jul 27 09:56:25.196560 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.196549 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d57c307c-8976-488d-804a-7dc01f98c08d" containerName="alertmanager" Jul 27 09:56:25.196560 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.196555 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="d57c307c-8976-488d-804a-7dc01f98c08d" containerName="alertmanager" Jul 27 09:56:25.196699 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.196562 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d57c307c-8976-488d-804a-7dc01f98c08d" containerName="config-reloader" Jul 27 09:56:25.196699 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.196567 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="d57c307c-8976-488d-804a-7dc01f98c08d" containerName="config-reloader" Jul 27 09:56:25.196699 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.196574 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d57c307c-8976-488d-804a-7dc01f98c08d" containerName="kube-rbac-proxy" Jul 27 09:56:25.196699 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.196578 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="d57c307c-8976-488d-804a-7dc01f98c08d" containerName="kube-rbac-proxy" Jul 27 09:56:25.196699 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.196584 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d57c307c-8976-488d-804a-7dc01f98c08d" containerName="init-config-reloader" Jul 27 09:56:25.196699 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.196588 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="d57c307c-8976-488d-804a-7dc01f98c08d" containerName="init-config-reloader" Jul 27 09:56:25.196699 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.196594 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d57c307c-8976-488d-804a-7dc01f98c08d" containerName="kube-rbac-proxy-metric" Jul 27 09:56:25.196699 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.196601 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="d57c307c-8976-488d-804a-7dc01f98c08d" containerName="kube-rbac-proxy-metric" Jul 27 09:56:25.196699 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.196610 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec43c5d4-5e58-4800-92e6-637c1fe1478b" containerName="console" Jul 27 09:56:25.196699 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.196615 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec43c5d4-5e58-4800-92e6-637c1fe1478b" containerName="console" Jul 27 09:56:25.196699 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.196622 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e356a42-6808-4abf-ad23-188baa1eef2d" containerName="console" Jul 27 09:56:25.196699 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.196627 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e356a42-6808-4abf-ad23-188baa1eef2d" containerName="console" Jul 27 09:56:25.196699 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.196635 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d57c307c-8976-488d-804a-7dc01f98c08d" containerName="prom-label-proxy" Jul 27 09:56:25.196699 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.196639 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="d57c307c-8976-488d-804a-7dc01f98c08d" containerName="prom-label-proxy" Jul 27 09:56:25.196699 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.196684 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="d57c307c-8976-488d-804a-7dc01f98c08d" containerName="alertmanager" Jul 27 09:56:25.196699 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.196693 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec43c5d4-5e58-4800-92e6-637c1fe1478b" containerName="console" Jul 27 09:56:25.196699 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.196699 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="d57c307c-8976-488d-804a-7dc01f98c08d" containerName="config-reloader" Jul 27 09:56:25.196699 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.196704 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e356a42-6808-4abf-ad23-188baa1eef2d" containerName="console" Jul 27 09:56:25.197161 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.196709 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="d57c307c-8976-488d-804a-7dc01f98c08d" containerName="kube-rbac-proxy" Jul 27 09:56:25.197161 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.196713 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="d57c307c-8976-488d-804a-7dc01f98c08d" containerName="kube-rbac-proxy-metric" Jul 27 09:56:25.197161 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.196719 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="d57c307c-8976-488d-804a-7dc01f98c08d" containerName="prom-label-proxy" Jul 27 09:56:25.197161 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.196724 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="d57c307c-8976-488d-804a-7dc01f98c08d" containerName="kube-rbac-proxy-web" Jul 27 09:56:25.197161 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.196730 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b9360ad-3b69-4a8d-b35f-cb88207a26d0" containerName="registry" Jul 27 09:56:25.202762 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.202746 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:56:25.205805 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.205744 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 27 09:56:25.205805 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.205744 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 27 09:56:25.205805 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.205788 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 27 09:56:25.205805 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.205796 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 27 09:56:25.206068 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.205829 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 27 09:56:25.206068 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.205839 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 27 09:56:25.206444 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.206429 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-7fmqk\"" Jul 27 09:56:25.206523 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.206431 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 27 09:56:25.206523 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.206473 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 27 09:56:25.211836 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.211821 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 27 09:56:25.214576 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.214559 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 27 09:56:25.260024 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.259999 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c881aeda-799d-4e82-be0c-04228ab22318-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c881aeda-799d-4e82-be0c-04228ab22318\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:56:25.260170 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.260055 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c881aeda-799d-4e82-be0c-04228ab22318-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c881aeda-799d-4e82-be0c-04228ab22318\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:56:25.260170 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.260078 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c881aeda-799d-4e82-be0c-04228ab22318-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c881aeda-799d-4e82-be0c-04228ab22318\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:56:25.260170 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.260122 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c881aeda-799d-4e82-be0c-04228ab22318-config-volume\") pod \"alertmanager-main-0\" (UID: \"c881aeda-799d-4e82-be0c-04228ab22318\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:56:25.260170 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.260146 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c881aeda-799d-4e82-be0c-04228ab22318-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c881aeda-799d-4e82-be0c-04228ab22318\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:56:25.260392 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.260174 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c881aeda-799d-4e82-be0c-04228ab22318-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c881aeda-799d-4e82-be0c-04228ab22318\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:56:25.260392 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.260203 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c881aeda-799d-4e82-be0c-04228ab22318-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c881aeda-799d-4e82-be0c-04228ab22318\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:56:25.260392 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.260259 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c881aeda-799d-4e82-be0c-04228ab22318-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c881aeda-799d-4e82-be0c-04228ab22318\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:56:25.260392 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.260333 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l86fc\" (UniqueName: \"kubernetes.io/projected/c881aeda-799d-4e82-be0c-04228ab22318-kube-api-access-l86fc\") pod \"alertmanager-main-0\" (UID: \"c881aeda-799d-4e82-be0c-04228ab22318\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:56:25.260392 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.260368 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c881aeda-799d-4e82-be0c-04228ab22318-web-config\") pod \"alertmanager-main-0\" (UID: \"c881aeda-799d-4e82-be0c-04228ab22318\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:56:25.260598 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.260397 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c881aeda-799d-4e82-be0c-04228ab22318-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c881aeda-799d-4e82-be0c-04228ab22318\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:56:25.260598 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.260471 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c881aeda-799d-4e82-be0c-04228ab22318-config-out\") pod \"alertmanager-main-0\" (UID: \"c881aeda-799d-4e82-be0c-04228ab22318\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:56:25.260598 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.260500 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c881aeda-799d-4e82-be0c-04228ab22318-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c881aeda-799d-4e82-be0c-04228ab22318\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:56:25.361779 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.361717 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c881aeda-799d-4e82-be0c-04228ab22318-config-volume\") pod \"alertmanager-main-0\" (UID: \"c881aeda-799d-4e82-be0c-04228ab22318\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:56:25.361779 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.361744 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c881aeda-799d-4e82-be0c-04228ab22318-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c881aeda-799d-4e82-be0c-04228ab22318\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:56:25.361779 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.361766 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c881aeda-799d-4e82-be0c-04228ab22318-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c881aeda-799d-4e82-be0c-04228ab22318\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:56:25.361988 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.361787 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c881aeda-799d-4e82-be0c-04228ab22318-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c881aeda-799d-4e82-be0c-04228ab22318\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:56:25.361988 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.361803 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c881aeda-799d-4e82-be0c-04228ab22318-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c881aeda-799d-4e82-be0c-04228ab22318\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:56:25.361988 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.361820 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l86fc\" (UniqueName: \"kubernetes.io/projected/c881aeda-799d-4e82-be0c-04228ab22318-kube-api-access-l86fc\") pod \"alertmanager-main-0\" (UID: \"c881aeda-799d-4e82-be0c-04228ab22318\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:56:25.361988 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.361940 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c881aeda-799d-4e82-be0c-04228ab22318-web-config\") pod \"alertmanager-main-0\" (UID: \"c881aeda-799d-4e82-be0c-04228ab22318\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:56:25.361988 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.361972 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c881aeda-799d-4e82-be0c-04228ab22318-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c881aeda-799d-4e82-be0c-04228ab22318\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:56:25.362203 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.362011 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c881aeda-799d-4e82-be0c-04228ab22318-config-out\") pod \"alertmanager-main-0\" (UID: \"c881aeda-799d-4e82-be0c-04228ab22318\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:56:25.362203 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.362037 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c881aeda-799d-4e82-be0c-04228ab22318-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c881aeda-799d-4e82-be0c-04228ab22318\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:56:25.362203 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.362076 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c881aeda-799d-4e82-be0c-04228ab22318-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c881aeda-799d-4e82-be0c-04228ab22318\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:56:25.362203 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.362130 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c881aeda-799d-4e82-be0c-04228ab22318-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c881aeda-799d-4e82-be0c-04228ab22318\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:56:25.362203 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.362155 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c881aeda-799d-4e82-be0c-04228ab22318-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c881aeda-799d-4e82-be0c-04228ab22318\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:56:25.362602 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.362542 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c881aeda-799d-4e82-be0c-04228ab22318-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c881aeda-799d-4e82-be0c-04228ab22318\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:56:25.362887 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.362863 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c881aeda-799d-4e82-be0c-04228ab22318-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c881aeda-799d-4e82-be0c-04228ab22318\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:56:25.364933 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.364902 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c881aeda-799d-4e82-be0c-04228ab22318-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c881aeda-799d-4e82-be0c-04228ab22318\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:56:25.365029 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.365014 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c881aeda-799d-4e82-be0c-04228ab22318-config-volume\") pod \"alertmanager-main-0\" (UID: \"c881aeda-799d-4e82-be0c-04228ab22318\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:56:25.365105 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.365083 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c881aeda-799d-4e82-be0c-04228ab22318-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c881aeda-799d-4e82-be0c-04228ab22318\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:56:25.365179 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.365121 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c881aeda-799d-4e82-be0c-04228ab22318-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c881aeda-799d-4e82-be0c-04228ab22318\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:56:25.365237 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.365194 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c881aeda-799d-4e82-be0c-04228ab22318-config-out\") pod \"alertmanager-main-0\" (UID: \"c881aeda-799d-4e82-be0c-04228ab22318\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:56:25.365284 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.365239 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c881aeda-799d-4e82-be0c-04228ab22318-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c881aeda-799d-4e82-be0c-04228ab22318\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:56:25.365566 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.365543 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c881aeda-799d-4e82-be0c-04228ab22318-web-config\") pod \"alertmanager-main-0\" (UID: \"c881aeda-799d-4e82-be0c-04228ab22318\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:56:25.365651 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.365614 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c881aeda-799d-4e82-be0c-04228ab22318-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c881aeda-799d-4e82-be0c-04228ab22318\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:56:25.365651 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.365625 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c881aeda-799d-4e82-be0c-04228ab22318-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c881aeda-799d-4e82-be0c-04228ab22318\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:56:25.366847 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.366830 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c881aeda-799d-4e82-be0c-04228ab22318-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c881aeda-799d-4e82-be0c-04228ab22318\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:56:25.371717 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.371695 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l86fc\" (UniqueName: \"kubernetes.io/projected/c881aeda-799d-4e82-be0c-04228ab22318-kube-api-access-l86fc\") pod \"alertmanager-main-0\" (UID: \"c881aeda-799d-4e82-be0c-04228ab22318\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:56:25.512631 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.512611 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:56:25.643288 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.643258 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 27 09:56:25.646327 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:56:25.644481 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc881aeda_799d_4e82_be0c_04228ab22318.slice/crio-5ee24c14aebc92fc8cf5c9f613f75212db4bdd9eabc8e6162cb136f5bb488778 WatchSource:0}: Error finding container 5ee24c14aebc92fc8cf5c9f613f75212db4bdd9eabc8e6162cb136f5bb488778: Status 404 returned error can't find the container with id 5ee24c14aebc92fc8cf5c9f613f75212db4bdd9eabc8e6162cb136f5bb488778 Jul 27 09:56:25.909280 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:25.909224 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d57c307c-8976-488d-804a-7dc01f98c08d" path="/var/lib/kubelet/pods/d57c307c-8976-488d-804a-7dc01f98c08d/volumes" Jul 27 09:56:26.139551 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:26.139524 2556 generic.go:356] "Generic (PLEG): container finished" podID="c881aeda-799d-4e82-be0c-04228ab22318" containerID="2212fae2a74fbdaf52ef520738c65aa6b7486948c7a935e6151fa4f16b73112c" exitCode=0 Jul 27 09:56:26.139915 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:26.139606 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c881aeda-799d-4e82-be0c-04228ab22318","Type":"ContainerDied","Data":"2212fae2a74fbdaf52ef520738c65aa6b7486948c7a935e6151fa4f16b73112c"} Jul 27 09:56:26.139915 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:26.139665 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c881aeda-799d-4e82-be0c-04228ab22318","Type":"ContainerStarted","Data":"5ee24c14aebc92fc8cf5c9f613f75212db4bdd9eabc8e6162cb136f5bb488778"} Jul 27 09:56:26.875384 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:26.875351 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/27f2e8fc-173e-43ff-b7a6-0bd6e8b54d40-metrics-certs\") pod \"network-metrics-daemon-cl9xw\" (UID: \"27f2e8fc-173e-43ff-b7a6-0bd6e8b54d40\") " pod="openshift-multus/network-metrics-daemon-cl9xw" Jul 27 09:56:26.877645 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:26.877618 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/27f2e8fc-173e-43ff-b7a6-0bd6e8b54d40-metrics-certs\") pod \"network-metrics-daemon-cl9xw\" (UID: \"27f2e8fc-173e-43ff-b7a6-0bd6e8b54d40\") " pod="openshift-multus/network-metrics-daemon-cl9xw" Jul 27 09:56:27.008590 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:27.008566 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ngfpk\"" Jul 27 09:56:27.016093 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:27.016078 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cl9xw" Jul 27 09:56:27.141847 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:27.141762 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-cl9xw"] Jul 27 09:56:27.146458 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:56:27.146437 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27f2e8fc_173e_43ff_b7a6_0bd6e8b54d40.slice/crio-f3188f2fe36593538faea936d6af08ce7474be1ff93efc67c806363bcfa88dff WatchSource:0}: Error finding container f3188f2fe36593538faea936d6af08ce7474be1ff93efc67c806363bcfa88dff: Status 404 returned error can't find the container with id f3188f2fe36593538faea936d6af08ce7474be1ff93efc67c806363bcfa88dff Jul 27 09:56:27.148495 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:27.148479 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 27 09:56:27.149074 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:27.149054 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c881aeda-799d-4e82-be0c-04228ab22318","Type":"ContainerStarted","Data":"c7512280f7e8193c1ef50f9ba75636061462cecb88fdce3c95d8c4ef4d6d437e"} Jul 27 09:56:27.149157 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:27.149143 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c881aeda-799d-4e82-be0c-04228ab22318","Type":"ContainerStarted","Data":"7fd017dd4e62f7629931c539113695b6d0cc7fcd0d7fa584005f719bf96da6ca"} Jul 27 09:56:27.149223 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:27.149188 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c881aeda-799d-4e82-be0c-04228ab22318","Type":"ContainerStarted","Data":"9fa437f917d3262dd873dc19b99fdcfb5aed2086294d08725c27a8ed303fe683"} Jul 27 09:56:27.149275 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:27.149238 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c881aeda-799d-4e82-be0c-04228ab22318","Type":"ContainerStarted","Data":"5cd482eb8bd15463019e3a0739c7d6e8b47e28890e29927f2fefb4448c46d2a5"} Jul 27 09:56:27.149350 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:27.149279 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c881aeda-799d-4e82-be0c-04228ab22318","Type":"ContainerStarted","Data":"93a7dc20a2911516bf2bb69d45a75cd01cca72c2a0b01d9f9c63a82454c6c397"} Jul 27 09:56:27.149350 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:27.149340 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c881aeda-799d-4e82-be0c-04228ab22318","Type":"ContainerStarted","Data":"b86e7150f283c74a17de0f8725ebbabcdb887d20aa643ff52ffb1bef7383ba72"} Jul 27 09:56:27.184711 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:27.184592 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.1692793200000002 podStartE2EDuration="2.184579s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.29968ms" isStatefulPod=false podCreationTimestamp="2026-07-27 09:56:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 09:56:27.18148391 +0000 UTC m=+373.771981142" watchObservedRunningTime="2026-07-27 09:56:27.184579 +0000 UTC m=+373.775076256" Jul 27 09:56:27.809833 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:27.809802 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-576dcf8c79-pxw2q"] Jul 27 09:56:27.815334 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:27.814933 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-576dcf8c79-pxw2q" Jul 27 09:56:27.818387 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:27.818346 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 27 09:56:27.818577 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:27.818495 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 27 09:56:27.818577 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:27.818575 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-5ql4g\"" Jul 27 09:56:27.818748 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:27.818724 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 27 09:56:27.818936 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:27.818918 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 27 09:56:27.819055 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:27.818927 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 27 09:56:27.823555 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:27.823531 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 27 09:56:27.830021 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:27.829993 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-576dcf8c79-pxw2q"] Jul 27 09:56:27.884856 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:27.884828 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6e18a4eb-d978-400f-ae01-ba766e1d4cfc-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-576dcf8c79-pxw2q\" (UID: \"6e18a4eb-d978-400f-ae01-ba766e1d4cfc\") " pod="openshift-monitoring/telemeter-client-576dcf8c79-pxw2q" Jul 27 09:56:27.884856 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:27.884862 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6e18a4eb-d978-400f-ae01-ba766e1d4cfc-metrics-client-ca\") pod \"telemeter-client-576dcf8c79-pxw2q\" (UID: \"6e18a4eb-d978-400f-ae01-ba766e1d4cfc\") " pod="openshift-monitoring/telemeter-client-576dcf8c79-pxw2q" Jul 27 09:56:27.885083 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:27.884951 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/6e18a4eb-d978-400f-ae01-ba766e1d4cfc-telemeter-client-tls\") pod \"telemeter-client-576dcf8c79-pxw2q\" (UID: \"6e18a4eb-d978-400f-ae01-ba766e1d4cfc\") " pod="openshift-monitoring/telemeter-client-576dcf8c79-pxw2q" Jul 27 09:56:27.885083 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:27.884990 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mpzxr\" (UniqueName: \"kubernetes.io/projected/6e18a4eb-d978-400f-ae01-ba766e1d4cfc-kube-api-access-mpzxr\") pod \"telemeter-client-576dcf8c79-pxw2q\" (UID: \"6e18a4eb-d978-400f-ae01-ba766e1d4cfc\") " pod="openshift-monitoring/telemeter-client-576dcf8c79-pxw2q" Jul 27 09:56:27.885083 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:27.885018 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/6e18a4eb-d978-400f-ae01-ba766e1d4cfc-secret-telemeter-client\") pod \"telemeter-client-576dcf8c79-pxw2q\" (UID: \"6e18a4eb-d978-400f-ae01-ba766e1d4cfc\") " pod="openshift-monitoring/telemeter-client-576dcf8c79-pxw2q" Jul 27 09:56:27.885083 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:27.885036 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/6e18a4eb-d978-400f-ae01-ba766e1d4cfc-federate-client-tls\") pod \"telemeter-client-576dcf8c79-pxw2q\" (UID: \"6e18a4eb-d978-400f-ae01-ba766e1d4cfc\") " pod="openshift-monitoring/telemeter-client-576dcf8c79-pxw2q" Jul 27 09:56:27.885083 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:27.885057 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e18a4eb-d978-400f-ae01-ba766e1d4cfc-telemeter-trusted-ca-bundle\") pod \"telemeter-client-576dcf8c79-pxw2q\" (UID: \"6e18a4eb-d978-400f-ae01-ba766e1d4cfc\") " pod="openshift-monitoring/telemeter-client-576dcf8c79-pxw2q" Jul 27 09:56:27.885293 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:27.885163 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e18a4eb-d978-400f-ae01-ba766e1d4cfc-serving-certs-ca-bundle\") pod \"telemeter-client-576dcf8c79-pxw2q\" (UID: \"6e18a4eb-d978-400f-ae01-ba766e1d4cfc\") " pod="openshift-monitoring/telemeter-client-576dcf8c79-pxw2q" Jul 27 09:56:27.986591 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:27.986552 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/6e18a4eb-d978-400f-ae01-ba766e1d4cfc-telemeter-client-tls\") pod \"telemeter-client-576dcf8c79-pxw2q\" (UID: \"6e18a4eb-d978-400f-ae01-ba766e1d4cfc\") " pod="openshift-monitoring/telemeter-client-576dcf8c79-pxw2q" Jul 27 09:56:27.986776 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:27.986603 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mpzxr\" (UniqueName: \"kubernetes.io/projected/6e18a4eb-d978-400f-ae01-ba766e1d4cfc-kube-api-access-mpzxr\") pod \"telemeter-client-576dcf8c79-pxw2q\" (UID: \"6e18a4eb-d978-400f-ae01-ba766e1d4cfc\") " pod="openshift-monitoring/telemeter-client-576dcf8c79-pxw2q" Jul 27 09:56:27.986776 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:27.986631 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/6e18a4eb-d978-400f-ae01-ba766e1d4cfc-secret-telemeter-client\") pod \"telemeter-client-576dcf8c79-pxw2q\" (UID: \"6e18a4eb-d978-400f-ae01-ba766e1d4cfc\") " pod="openshift-monitoring/telemeter-client-576dcf8c79-pxw2q" Jul 27 09:56:27.986776 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:27.986652 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/6e18a4eb-d978-400f-ae01-ba766e1d4cfc-federate-client-tls\") pod \"telemeter-client-576dcf8c79-pxw2q\" (UID: \"6e18a4eb-d978-400f-ae01-ba766e1d4cfc\") " pod="openshift-monitoring/telemeter-client-576dcf8c79-pxw2q" Jul 27 09:56:27.986776 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:27.986682 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e18a4eb-d978-400f-ae01-ba766e1d4cfc-telemeter-trusted-ca-bundle\") pod \"telemeter-client-576dcf8c79-pxw2q\" (UID: \"6e18a4eb-d978-400f-ae01-ba766e1d4cfc\") " pod="openshift-monitoring/telemeter-client-576dcf8c79-pxw2q" Jul 27 09:56:27.986776 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:27.986758 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e18a4eb-d978-400f-ae01-ba766e1d4cfc-serving-certs-ca-bundle\") pod \"telemeter-client-576dcf8c79-pxw2q\" (UID: \"6e18a4eb-d978-400f-ae01-ba766e1d4cfc\") " pod="openshift-monitoring/telemeter-client-576dcf8c79-pxw2q" Jul 27 09:56:27.987076 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:27.986786 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6e18a4eb-d978-400f-ae01-ba766e1d4cfc-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-576dcf8c79-pxw2q\" (UID: \"6e18a4eb-d978-400f-ae01-ba766e1d4cfc\") " pod="openshift-monitoring/telemeter-client-576dcf8c79-pxw2q" Jul 27 09:56:27.987076 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:27.986814 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6e18a4eb-d978-400f-ae01-ba766e1d4cfc-metrics-client-ca\") pod \"telemeter-client-576dcf8c79-pxw2q\" (UID: \"6e18a4eb-d978-400f-ae01-ba766e1d4cfc\") " pod="openshift-monitoring/telemeter-client-576dcf8c79-pxw2q" Jul 27 09:56:27.990247 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:27.987604 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6e18a4eb-d978-400f-ae01-ba766e1d4cfc-metrics-client-ca\") pod \"telemeter-client-576dcf8c79-pxw2q\" (UID: \"6e18a4eb-d978-400f-ae01-ba766e1d4cfc\") " pod="openshift-monitoring/telemeter-client-576dcf8c79-pxw2q" Jul 27 09:56:27.990247 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:27.987922 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e18a4eb-d978-400f-ae01-ba766e1d4cfc-telemeter-trusted-ca-bundle\") pod \"telemeter-client-576dcf8c79-pxw2q\" (UID: \"6e18a4eb-d978-400f-ae01-ba766e1d4cfc\") " pod="openshift-monitoring/telemeter-client-576dcf8c79-pxw2q" Jul 27 09:56:27.990247 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:27.988157 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e18a4eb-d978-400f-ae01-ba766e1d4cfc-serving-certs-ca-bundle\") pod \"telemeter-client-576dcf8c79-pxw2q\" (UID: \"6e18a4eb-d978-400f-ae01-ba766e1d4cfc\") " pod="openshift-monitoring/telemeter-client-576dcf8c79-pxw2q" Jul 27 09:56:27.990733 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:27.990716 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/6e18a4eb-d978-400f-ae01-ba766e1d4cfc-federate-client-tls\") pod \"telemeter-client-576dcf8c79-pxw2q\" (UID: \"6e18a4eb-d978-400f-ae01-ba766e1d4cfc\") " pod="openshift-monitoring/telemeter-client-576dcf8c79-pxw2q" Jul 27 09:56:27.991092 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:27.991068 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/6e18a4eb-d978-400f-ae01-ba766e1d4cfc-secret-telemeter-client\") pod \"telemeter-client-576dcf8c79-pxw2q\" (UID: \"6e18a4eb-d978-400f-ae01-ba766e1d4cfc\") " pod="openshift-monitoring/telemeter-client-576dcf8c79-pxw2q" Jul 27 09:56:27.991601 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:27.991564 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/6e18a4eb-d978-400f-ae01-ba766e1d4cfc-telemeter-client-tls\") pod \"telemeter-client-576dcf8c79-pxw2q\" (UID: \"6e18a4eb-d978-400f-ae01-ba766e1d4cfc\") " pod="openshift-monitoring/telemeter-client-576dcf8c79-pxw2q" Jul 27 09:56:27.993070 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:27.993048 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6e18a4eb-d978-400f-ae01-ba766e1d4cfc-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-576dcf8c79-pxw2q\" (UID: \"6e18a4eb-d978-400f-ae01-ba766e1d4cfc\") " pod="openshift-monitoring/telemeter-client-576dcf8c79-pxw2q" Jul 27 09:56:27.998033 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:27.998004 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mpzxr\" (UniqueName: \"kubernetes.io/projected/6e18a4eb-d978-400f-ae01-ba766e1d4cfc-kube-api-access-mpzxr\") pod \"telemeter-client-576dcf8c79-pxw2q\" (UID: \"6e18a4eb-d978-400f-ae01-ba766e1d4cfc\") " pod="openshift-monitoring/telemeter-client-576dcf8c79-pxw2q" Jul 27 09:56:28.128564 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:28.128485 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-576dcf8c79-pxw2q" Jul 27 09:56:28.159635 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:28.159600 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cl9xw" event={"ID":"27f2e8fc-173e-43ff-b7a6-0bd6e8b54d40","Type":"ContainerStarted","Data":"f3188f2fe36593538faea936d6af08ce7474be1ff93efc67c806363bcfa88dff"} Jul 27 09:56:28.288641 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:28.288617 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-576dcf8c79-pxw2q"] Jul 27 09:56:28.291516 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:56:28.291491 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e18a4eb_d978_400f_ae01_ba766e1d4cfc.slice/crio-34f34393f08a51aabcca13e91eb8caba49b2391134a9098bd627c5a887e80364 WatchSource:0}: Error finding container 34f34393f08a51aabcca13e91eb8caba49b2391134a9098bd627c5a887e80364: Status 404 returned error can't find the container with id 34f34393f08a51aabcca13e91eb8caba49b2391134a9098bd627c5a887e80364 Jul 27 09:56:29.166182 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:29.166151 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cl9xw" event={"ID":"27f2e8fc-173e-43ff-b7a6-0bd6e8b54d40","Type":"ContainerStarted","Data":"6ecd957f88f1ab342cff06c550fec7d71fe1175248f3144de9ccd507d5b97bc6"} Jul 27 09:56:29.166687 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:29.166200 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cl9xw" event={"ID":"27f2e8fc-173e-43ff-b7a6-0bd6e8b54d40","Type":"ContainerStarted","Data":"3b168f62478cb5a9ffbb6720ddc65f137978a9c8b512e0fb7d0a27a7623dfa38"} Jul 27 09:56:29.167378 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:29.167356 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-576dcf8c79-pxw2q" event={"ID":"6e18a4eb-d978-400f-ae01-ba766e1d4cfc","Type":"ContainerStarted","Data":"34f34393f08a51aabcca13e91eb8caba49b2391134a9098bd627c5a887e80364"} Jul 27 09:56:29.189350 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:29.189283 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-cl9xw" podStartSLOduration=374.163616393 podStartE2EDuration="6m15.189264493s" totalImagesPullingTime="1.0256481s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 09:50:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 09:56:29.188769762 +0000 UTC m=+375.779266998" watchObservedRunningTime="2026-07-27 09:56:29.189264493 +0000 UTC m=+375.779761727" Jul 27 09:56:31.179905 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:31.179197 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-576dcf8c79-pxw2q" event={"ID":"6e18a4eb-d978-400f-ae01-ba766e1d4cfc","Type":"ContainerStarted","Data":"d174c2b7e7bfea1c3111956d3dc477c16f3d9ecf40223701e11f8f889a8a8eb3"} Jul 27 09:56:31.179905 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:31.179274 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-576dcf8c79-pxw2q" event={"ID":"6e18a4eb-d978-400f-ae01-ba766e1d4cfc","Type":"ContainerStarted","Data":"8f3127a9eacec77a87a5d59379e5b2ba5f177efb9c123530928cdbcb8005916f"} Jul 27 09:56:31.179905 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:31.179322 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-576dcf8c79-pxw2q" event={"ID":"6e18a4eb-d978-400f-ae01-ba766e1d4cfc","Type":"ContainerStarted","Data":"cd1812dd8683be7327e827a346577579291ee057f971aac9327761ac76750db2"} Jul 27 09:56:31.210567 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:31.210116 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-576dcf8c79-pxw2q" podStartSLOduration=2.268777324 podStartE2EDuration="4.210097754s" totalImagesPullingTime="1.94132043s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 09:56:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 09:56:31.209747825 +0000 UTC m=+377.800245072" watchObservedRunningTime="2026-07-27 09:56:31.210097754 +0000 UTC m=+377.800594990" Jul 27 09:56:32.223577 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:32.223538 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-66bc76c76c-db8gt"] Jul 27 09:56:32.227462 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:32.227436 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66bc76c76c-db8gt" Jul 27 09:56:32.231828 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:32.231626 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 27 09:56:32.231828 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:32.231655 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 27 09:56:32.231828 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:32.231696 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 27 09:56:32.231828 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:32.231702 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-kwfvc\"" Jul 27 09:56:32.231828 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:32.231721 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 27 09:56:32.231828 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:32.231770 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 27 09:56:32.231828 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:32.231721 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 27 09:56:32.232250 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:32.232006 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 27 09:56:32.237263 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:32.237241 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 27 09:56:32.240500 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:32.240478 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66bc76c76c-db8gt"] Jul 27 09:56:32.323369 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:32.323334 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8d50baa6-a302-4896-a2c8-ff4f2f4c20b5-console-config\") pod \"console-66bc76c76c-db8gt\" (UID: \"8d50baa6-a302-4896-a2c8-ff4f2f4c20b5\") " pod="openshift-console/console-66bc76c76c-db8gt" Jul 27 09:56:32.323528 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:32.323386 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8d50baa6-a302-4896-a2c8-ff4f2f4c20b5-console-serving-cert\") pod \"console-66bc76c76c-db8gt\" (UID: \"8d50baa6-a302-4896-a2c8-ff4f2f4c20b5\") " pod="openshift-console/console-66bc76c76c-db8gt" Jul 27 09:56:32.323528 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:32.323408 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8d50baa6-a302-4896-a2c8-ff4f2f4c20b5-oauth-serving-cert\") pod \"console-66bc76c76c-db8gt\" (UID: \"8d50baa6-a302-4896-a2c8-ff4f2f4c20b5\") " pod="openshift-console/console-66bc76c76c-db8gt" Jul 27 09:56:32.323528 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:32.323492 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8d50baa6-a302-4896-a2c8-ff4f2f4c20b5-service-ca\") pod \"console-66bc76c76c-db8gt\" (UID: \"8d50baa6-a302-4896-a2c8-ff4f2f4c20b5\") " pod="openshift-console/console-66bc76c76c-db8gt" Jul 27 09:56:32.323686 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:32.323530 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8d50baa6-a302-4896-a2c8-ff4f2f4c20b5-console-oauth-config\") pod \"console-66bc76c76c-db8gt\" (UID: \"8d50baa6-a302-4896-a2c8-ff4f2f4c20b5\") " pod="openshift-console/console-66bc76c76c-db8gt" Jul 27 09:56:32.323686 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:32.323645 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64m9b\" (UniqueName: \"kubernetes.io/projected/8d50baa6-a302-4896-a2c8-ff4f2f4c20b5-kube-api-access-64m9b\") pod \"console-66bc76c76c-db8gt\" (UID: \"8d50baa6-a302-4896-a2c8-ff4f2f4c20b5\") " pod="openshift-console/console-66bc76c76c-db8gt" Jul 27 09:56:32.323797 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:32.323780 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d50baa6-a302-4896-a2c8-ff4f2f4c20b5-trusted-ca-bundle\") pod \"console-66bc76c76c-db8gt\" (UID: \"8d50baa6-a302-4896-a2c8-ff4f2f4c20b5\") " pod="openshift-console/console-66bc76c76c-db8gt" Jul 27 09:56:32.424796 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:32.424767 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64m9b\" (UniqueName: \"kubernetes.io/projected/8d50baa6-a302-4896-a2c8-ff4f2f4c20b5-kube-api-access-64m9b\") pod \"console-66bc76c76c-db8gt\" (UID: \"8d50baa6-a302-4896-a2c8-ff4f2f4c20b5\") " pod="openshift-console/console-66bc76c76c-db8gt" Jul 27 09:56:32.424954 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:32.424804 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d50baa6-a302-4896-a2c8-ff4f2f4c20b5-trusted-ca-bundle\") pod \"console-66bc76c76c-db8gt\" (UID: \"8d50baa6-a302-4896-a2c8-ff4f2f4c20b5\") " pod="openshift-console/console-66bc76c76c-db8gt" Jul 27 09:56:32.424954 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:32.424825 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8d50baa6-a302-4896-a2c8-ff4f2f4c20b5-console-config\") pod \"console-66bc76c76c-db8gt\" (UID: \"8d50baa6-a302-4896-a2c8-ff4f2f4c20b5\") " pod="openshift-console/console-66bc76c76c-db8gt" Jul 27 09:56:32.424954 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:32.424857 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8d50baa6-a302-4896-a2c8-ff4f2f4c20b5-console-serving-cert\") pod \"console-66bc76c76c-db8gt\" (UID: \"8d50baa6-a302-4896-a2c8-ff4f2f4c20b5\") " pod="openshift-console/console-66bc76c76c-db8gt" Jul 27 09:56:32.424954 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:32.424874 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8d50baa6-a302-4896-a2c8-ff4f2f4c20b5-oauth-serving-cert\") pod \"console-66bc76c76c-db8gt\" (UID: \"8d50baa6-a302-4896-a2c8-ff4f2f4c20b5\") " pod="openshift-console/console-66bc76c76c-db8gt" Jul 27 09:56:32.425130 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:32.424971 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8d50baa6-a302-4896-a2c8-ff4f2f4c20b5-service-ca\") pod \"console-66bc76c76c-db8gt\" (UID: \"8d50baa6-a302-4896-a2c8-ff4f2f4c20b5\") " pod="openshift-console/console-66bc76c76c-db8gt" Jul 27 09:56:32.425130 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:32.425008 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8d50baa6-a302-4896-a2c8-ff4f2f4c20b5-console-oauth-config\") pod \"console-66bc76c76c-db8gt\" (UID: \"8d50baa6-a302-4896-a2c8-ff4f2f4c20b5\") " pod="openshift-console/console-66bc76c76c-db8gt" Jul 27 09:56:32.425667 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:32.425639 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8d50baa6-a302-4896-a2c8-ff4f2f4c20b5-oauth-serving-cert\") pod \"console-66bc76c76c-db8gt\" (UID: \"8d50baa6-a302-4896-a2c8-ff4f2f4c20b5\") " pod="openshift-console/console-66bc76c76c-db8gt" Jul 27 09:56:32.425667 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:32.425671 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d50baa6-a302-4896-a2c8-ff4f2f4c20b5-trusted-ca-bundle\") pod \"console-66bc76c76c-db8gt\" (UID: \"8d50baa6-a302-4896-a2c8-ff4f2f4c20b5\") " pod="openshift-console/console-66bc76c76c-db8gt" Jul 27 09:56:32.425806 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:32.425718 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8d50baa6-a302-4896-a2c8-ff4f2f4c20b5-service-ca\") pod \"console-66bc76c76c-db8gt\" (UID: \"8d50baa6-a302-4896-a2c8-ff4f2f4c20b5\") " pod="openshift-console/console-66bc76c76c-db8gt" Jul 27 09:56:32.425806 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:32.425724 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8d50baa6-a302-4896-a2c8-ff4f2f4c20b5-console-config\") pod \"console-66bc76c76c-db8gt\" (UID: \"8d50baa6-a302-4896-a2c8-ff4f2f4c20b5\") " pod="openshift-console/console-66bc76c76c-db8gt" Jul 27 09:56:32.427900 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:32.427881 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8d50baa6-a302-4896-a2c8-ff4f2f4c20b5-console-serving-cert\") pod \"console-66bc76c76c-db8gt\" (UID: \"8d50baa6-a302-4896-a2c8-ff4f2f4c20b5\") " pod="openshift-console/console-66bc76c76c-db8gt" Jul 27 09:56:32.428019 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:32.427908 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8d50baa6-a302-4896-a2c8-ff4f2f4c20b5-console-oauth-config\") pod \"console-66bc76c76c-db8gt\" (UID: \"8d50baa6-a302-4896-a2c8-ff4f2f4c20b5\") " pod="openshift-console/console-66bc76c76c-db8gt" Jul 27 09:56:32.435672 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:32.435648 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-64m9b\" (UniqueName: \"kubernetes.io/projected/8d50baa6-a302-4896-a2c8-ff4f2f4c20b5-kube-api-access-64m9b\") pod \"console-66bc76c76c-db8gt\" (UID: \"8d50baa6-a302-4896-a2c8-ff4f2f4c20b5\") " pod="openshift-console/console-66bc76c76c-db8gt" Jul 27 09:56:32.538428 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:32.538372 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66bc76c76c-db8gt" Jul 27 09:56:32.690533 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:32.690509 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66bc76c76c-db8gt"] Jul 27 09:56:32.692424 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:56:32.692403 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d50baa6_a302_4896_a2c8_ff4f2f4c20b5.slice/crio-36d8a99ff3aae72a6c44598734dd2a0c8dadb10612d25198441b3bc948df16d5 WatchSource:0}: Error finding container 36d8a99ff3aae72a6c44598734dd2a0c8dadb10612d25198441b3bc948df16d5: Status 404 returned error can't find the container with id 36d8a99ff3aae72a6c44598734dd2a0c8dadb10612d25198441b3bc948df16d5 Jul 27 09:56:33.189368 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:33.189331 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66bc76c76c-db8gt" event={"ID":"8d50baa6-a302-4896-a2c8-ff4f2f4c20b5","Type":"ContainerStarted","Data":"6a16ffb178798010526c5b2d0bd0e826cad6b4362326f8ea2790175c7cb06347"} Jul 27 09:56:33.189562 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:33.189391 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66bc76c76c-db8gt" event={"ID":"8d50baa6-a302-4896-a2c8-ff4f2f4c20b5","Type":"ContainerStarted","Data":"36d8a99ff3aae72a6c44598734dd2a0c8dadb10612d25198441b3bc948df16d5"} Jul 27 09:56:33.218613 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:33.218560 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-66bc76c76c-db8gt" podStartSLOduration=1.218548169 podStartE2EDuration="1.218548169s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 09:56:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 09:56:33.216194031 +0000 UTC m=+379.806691263" watchObservedRunningTime="2026-07-27 09:56:33.218548169 +0000 UTC m=+379.809045403" Jul 27 09:56:42.539322 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:42.539272 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-66bc76c76c-db8gt" Jul 27 09:56:42.539691 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:42.539358 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-66bc76c76c-db8gt" Jul 27 09:56:42.543836 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:42.543813 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-66bc76c76c-db8gt" Jul 27 09:56:43.230159 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:56:43.230132 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-66bc76c76c-db8gt" Jul 27 09:57:42.989599 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:57:42.989564 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7bd46f6475-68gwm"] Jul 27 09:57:42.993172 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:57:42.993145 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bd46f6475-68gwm" Jul 27 09:57:43.005232 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:57:43.005200 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bd46f6475-68gwm"] Jul 27 09:57:43.055759 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:57:43.055725 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/270f116b-e412-431c-a076-2bd1190a87be-console-config\") pod \"console-7bd46f6475-68gwm\" (UID: \"270f116b-e412-431c-a076-2bd1190a87be\") " pod="openshift-console/console-7bd46f6475-68gwm" Jul 27 09:57:43.055759 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:57:43.055762 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/270f116b-e412-431c-a076-2bd1190a87be-service-ca\") pod \"console-7bd46f6475-68gwm\" (UID: \"270f116b-e412-431c-a076-2bd1190a87be\") " pod="openshift-console/console-7bd46f6475-68gwm" Jul 27 09:57:43.056028 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:57:43.055792 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/270f116b-e412-431c-a076-2bd1190a87be-trusted-ca-bundle\") pod \"console-7bd46f6475-68gwm\" (UID: \"270f116b-e412-431c-a076-2bd1190a87be\") " pod="openshift-console/console-7bd46f6475-68gwm" Jul 27 09:57:43.056028 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:57:43.055817 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/270f116b-e412-431c-a076-2bd1190a87be-console-serving-cert\") pod \"console-7bd46f6475-68gwm\" (UID: \"270f116b-e412-431c-a076-2bd1190a87be\") " pod="openshift-console/console-7bd46f6475-68gwm" Jul 27 09:57:43.056028 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:57:43.055842 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8d6r\" (UniqueName: \"kubernetes.io/projected/270f116b-e412-431c-a076-2bd1190a87be-kube-api-access-q8d6r\") pod \"console-7bd46f6475-68gwm\" (UID: \"270f116b-e412-431c-a076-2bd1190a87be\") " pod="openshift-console/console-7bd46f6475-68gwm" Jul 27 09:57:43.056028 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:57:43.055876 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/270f116b-e412-431c-a076-2bd1190a87be-oauth-serving-cert\") pod \"console-7bd46f6475-68gwm\" (UID: \"270f116b-e412-431c-a076-2bd1190a87be\") " pod="openshift-console/console-7bd46f6475-68gwm" Jul 27 09:57:43.056179 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:57:43.056046 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/270f116b-e412-431c-a076-2bd1190a87be-console-oauth-config\") pod \"console-7bd46f6475-68gwm\" (UID: \"270f116b-e412-431c-a076-2bd1190a87be\") " pod="openshift-console/console-7bd46f6475-68gwm" Jul 27 09:57:43.157051 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:57:43.157012 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/270f116b-e412-431c-a076-2bd1190a87be-console-config\") pod \"console-7bd46f6475-68gwm\" (UID: \"270f116b-e412-431c-a076-2bd1190a87be\") " pod="openshift-console/console-7bd46f6475-68gwm" Jul 27 09:57:43.157051 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:57:43.157053 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/270f116b-e412-431c-a076-2bd1190a87be-service-ca\") pod \"console-7bd46f6475-68gwm\" (UID: \"270f116b-e412-431c-a076-2bd1190a87be\") " pod="openshift-console/console-7bd46f6475-68gwm" Jul 27 09:57:43.157267 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:57:43.157080 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/270f116b-e412-431c-a076-2bd1190a87be-trusted-ca-bundle\") pod \"console-7bd46f6475-68gwm\" (UID: \"270f116b-e412-431c-a076-2bd1190a87be\") " pod="openshift-console/console-7bd46f6475-68gwm" Jul 27 09:57:43.157267 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:57:43.157205 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/270f116b-e412-431c-a076-2bd1190a87be-console-serving-cert\") pod \"console-7bd46f6475-68gwm\" (UID: \"270f116b-e412-431c-a076-2bd1190a87be\") " pod="openshift-console/console-7bd46f6475-68gwm" Jul 27 09:57:43.157267 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:57:43.157253 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8d6r\" (UniqueName: \"kubernetes.io/projected/270f116b-e412-431c-a076-2bd1190a87be-kube-api-access-q8d6r\") pod \"console-7bd46f6475-68gwm\" (UID: \"270f116b-e412-431c-a076-2bd1190a87be\") " pod="openshift-console/console-7bd46f6475-68gwm" Jul 27 09:57:43.157433 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:57:43.157291 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/270f116b-e412-431c-a076-2bd1190a87be-oauth-serving-cert\") pod \"console-7bd46f6475-68gwm\" (UID: \"270f116b-e412-431c-a076-2bd1190a87be\") " pod="openshift-console/console-7bd46f6475-68gwm" Jul 27 09:57:43.157433 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:57:43.157397 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/270f116b-e412-431c-a076-2bd1190a87be-console-oauth-config\") pod \"console-7bd46f6475-68gwm\" (UID: \"270f116b-e412-431c-a076-2bd1190a87be\") " pod="openshift-console/console-7bd46f6475-68gwm" Jul 27 09:57:43.157927 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:57:43.157901 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/270f116b-e412-431c-a076-2bd1190a87be-service-ca\") pod \"console-7bd46f6475-68gwm\" (UID: \"270f116b-e412-431c-a076-2bd1190a87be\") " pod="openshift-console/console-7bd46f6475-68gwm" Jul 27 09:57:43.157927 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:57:43.157960 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/270f116b-e412-431c-a076-2bd1190a87be-console-config\") pod \"console-7bd46f6475-68gwm\" (UID: \"270f116b-e412-431c-a076-2bd1190a87be\") " pod="openshift-console/console-7bd46f6475-68gwm" Jul 27 09:57:43.158276 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:57:43.158035 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/270f116b-e412-431c-a076-2bd1190a87be-trusted-ca-bundle\") pod \"console-7bd46f6475-68gwm\" (UID: \"270f116b-e412-431c-a076-2bd1190a87be\") " pod="openshift-console/console-7bd46f6475-68gwm" Jul 27 09:57:43.158276 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:57:43.158128 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/270f116b-e412-431c-a076-2bd1190a87be-oauth-serving-cert\") pod \"console-7bd46f6475-68gwm\" (UID: \"270f116b-e412-431c-a076-2bd1190a87be\") " pod="openshift-console/console-7bd46f6475-68gwm" Jul 27 09:57:43.160069 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:57:43.160039 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/270f116b-e412-431c-a076-2bd1190a87be-console-serving-cert\") pod \"console-7bd46f6475-68gwm\" (UID: \"270f116b-e412-431c-a076-2bd1190a87be\") " pod="openshift-console/console-7bd46f6475-68gwm" Jul 27 09:57:43.160249 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:57:43.160233 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/270f116b-e412-431c-a076-2bd1190a87be-console-oauth-config\") pod \"console-7bd46f6475-68gwm\" (UID: \"270f116b-e412-431c-a076-2bd1190a87be\") " pod="openshift-console/console-7bd46f6475-68gwm" Jul 27 09:57:43.167076 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:57:43.167042 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8d6r\" (UniqueName: \"kubernetes.io/projected/270f116b-e412-431c-a076-2bd1190a87be-kube-api-access-q8d6r\") pod \"console-7bd46f6475-68gwm\" (UID: \"270f116b-e412-431c-a076-2bd1190a87be\") " pod="openshift-console/console-7bd46f6475-68gwm" Jul 27 09:57:43.304185 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:57:43.304152 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bd46f6475-68gwm" Jul 27 09:57:43.443369 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:57:43.443344 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bd46f6475-68gwm"] Jul 27 09:57:43.446168 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:57:43.446136 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod270f116b_e412_431c_a076_2bd1190a87be.slice/crio-efeba7a526be44141a9f0b4557f21164eeb9f7ef27d6f293e3a49ea4b01853e1 WatchSource:0}: Error finding container efeba7a526be44141a9f0b4557f21164eeb9f7ef27d6f293e3a49ea4b01853e1: Status 404 returned error can't find the container with id efeba7a526be44141a9f0b4557f21164eeb9f7ef27d6f293e3a49ea4b01853e1 Jul 27 09:57:43.458675 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:57:43.458648 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bd46f6475-68gwm" event={"ID":"270f116b-e412-431c-a076-2bd1190a87be","Type":"ContainerStarted","Data":"efeba7a526be44141a9f0b4557f21164eeb9f7ef27d6f293e3a49ea4b01853e1"} Jul 27 09:57:44.464843 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:57:44.464809 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bd46f6475-68gwm" event={"ID":"270f116b-e412-431c-a076-2bd1190a87be","Type":"ContainerStarted","Data":"eeca9070f9e363a93631b8c7322bab4c6bc8b917ee0e595cb7b1e4c822bf2c5c"} Jul 27 09:57:44.485743 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:57:44.485690 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7bd46f6475-68gwm" podStartSLOduration=2.48566876 podStartE2EDuration="2.48566876s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 09:57:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 09:57:44.48438037 +0000 UTC m=+451.074877604" watchObservedRunningTime="2026-07-27 09:57:44.48566876 +0000 UTC m=+451.076166000" Jul 27 09:57:53.305260 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:57:53.305229 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7bd46f6475-68gwm" Jul 27 09:57:53.305743 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:57:53.305287 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7bd46f6475-68gwm" Jul 27 09:57:53.309702 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:57:53.309683 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7bd46f6475-68gwm" Jul 27 09:57:53.502129 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:57:53.502101 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7bd46f6475-68gwm" Jul 27 09:57:53.560109 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:57:53.560025 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-66bc76c76c-db8gt"] Jul 27 09:58:18.580040 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:18.579980 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-66bc76c76c-db8gt" podUID="8d50baa6-a302-4896-a2c8-ff4f2f4c20b5" containerName="console" containerID="cri-o://6a16ffb178798010526c5b2d0bd0e826cad6b4362326f8ea2790175c7cb06347" gracePeriod=15 Jul 27 09:58:18.825994 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:18.825969 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66bc76c76c-db8gt" Jul 27 09:58:18.854079 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:18.854005 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8d50baa6-a302-4896-a2c8-ff4f2f4c20b5-oauth-serving-cert\") pod \"8d50baa6-a302-4896-a2c8-ff4f2f4c20b5\" (UID: \"8d50baa6-a302-4896-a2c8-ff4f2f4c20b5\") " Jul 27 09:58:18.854079 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:18.854045 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8d50baa6-a302-4896-a2c8-ff4f2f4c20b5-console-oauth-config\") pod \"8d50baa6-a302-4896-a2c8-ff4f2f4c20b5\" (UID: \"8d50baa6-a302-4896-a2c8-ff4f2f4c20b5\") " Jul 27 09:58:18.854079 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:18.854062 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d50baa6-a302-4896-a2c8-ff4f2f4c20b5-trusted-ca-bundle\") pod \"8d50baa6-a302-4896-a2c8-ff4f2f4c20b5\" (UID: \"8d50baa6-a302-4896-a2c8-ff4f2f4c20b5\") " Jul 27 09:58:18.854432 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:18.854092 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8d50baa6-a302-4896-a2c8-ff4f2f4c20b5-service-ca\") pod \"8d50baa6-a302-4896-a2c8-ff4f2f4c20b5\" (UID: \"8d50baa6-a302-4896-a2c8-ff4f2f4c20b5\") " Jul 27 09:58:18.854642 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:18.854284 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8d50baa6-a302-4896-a2c8-ff4f2f4c20b5-console-serving-cert\") pod \"8d50baa6-a302-4896-a2c8-ff4f2f4c20b5\" (UID: \"8d50baa6-a302-4896-a2c8-ff4f2f4c20b5\") " Jul 27 09:58:18.854731 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:18.854461 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d50baa6-a302-4896-a2c8-ff4f2f4c20b5-service-ca" (OuterVolumeSpecName: "service-ca") pod "8d50baa6-a302-4896-a2c8-ff4f2f4c20b5" (UID: "8d50baa6-a302-4896-a2c8-ff4f2f4c20b5"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 09:58:18.854731 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:18.854715 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-64m9b\" (UniqueName: \"kubernetes.io/projected/8d50baa6-a302-4896-a2c8-ff4f2f4c20b5-kube-api-access-64m9b\") pod \"8d50baa6-a302-4896-a2c8-ff4f2f4c20b5\" (UID: \"8d50baa6-a302-4896-a2c8-ff4f2f4c20b5\") " Jul 27 09:58:18.854835 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:18.854495 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d50baa6-a302-4896-a2c8-ff4f2f4c20b5-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8d50baa6-a302-4896-a2c8-ff4f2f4c20b5" (UID: "8d50baa6-a302-4896-a2c8-ff4f2f4c20b5"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 09:58:18.854835 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:18.854521 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d50baa6-a302-4896-a2c8-ff4f2f4c20b5-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "8d50baa6-a302-4896-a2c8-ff4f2f4c20b5" (UID: "8d50baa6-a302-4896-a2c8-ff4f2f4c20b5"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 09:58:18.854835 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:18.854753 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8d50baa6-a302-4896-a2c8-ff4f2f4c20b5-console-config\") pod \"8d50baa6-a302-4896-a2c8-ff4f2f4c20b5\" (UID: \"8d50baa6-a302-4896-a2c8-ff4f2f4c20b5\") " Jul 27 09:58:18.855150 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:18.855117 2556 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8d50baa6-a302-4896-a2c8-ff4f2f4c20b5-service-ca\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\"" Jul 27 09:58:18.855150 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:18.855138 2556 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8d50baa6-a302-4896-a2c8-ff4f2f4c20b5-oauth-serving-cert\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\"" Jul 27 09:58:18.855260 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:18.855152 2556 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d50baa6-a302-4896-a2c8-ff4f2f4c20b5-trusted-ca-bundle\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\"" Jul 27 09:58:18.855260 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:18.855184 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d50baa6-a302-4896-a2c8-ff4f2f4c20b5-console-config" (OuterVolumeSpecName: "console-config") pod "8d50baa6-a302-4896-a2c8-ff4f2f4c20b5" (UID: "8d50baa6-a302-4896-a2c8-ff4f2f4c20b5"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 09:58:18.856476 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:18.856448 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d50baa6-a302-4896-a2c8-ff4f2f4c20b5-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8d50baa6-a302-4896-a2c8-ff4f2f4c20b5" (UID: "8d50baa6-a302-4896-a2c8-ff4f2f4c20b5"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 09:58:18.856629 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:18.856606 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d50baa6-a302-4896-a2c8-ff4f2f4c20b5-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8d50baa6-a302-4896-a2c8-ff4f2f4c20b5" (UID: "8d50baa6-a302-4896-a2c8-ff4f2f4c20b5"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 09:58:18.856902 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:18.856879 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d50baa6-a302-4896-a2c8-ff4f2f4c20b5-kube-api-access-64m9b" (OuterVolumeSpecName: "kube-api-access-64m9b") pod "8d50baa6-a302-4896-a2c8-ff4f2f4c20b5" (UID: "8d50baa6-a302-4896-a2c8-ff4f2f4c20b5"). InnerVolumeSpecName "kube-api-access-64m9b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 09:58:18.956231 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:18.956196 2556 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8d50baa6-a302-4896-a2c8-ff4f2f4c20b5-console-oauth-config\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\"" Jul 27 09:58:18.956231 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:18.956227 2556 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8d50baa6-a302-4896-a2c8-ff4f2f4c20b5-console-serving-cert\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\"" Jul 27 09:58:18.956459 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:18.956241 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-64m9b\" (UniqueName: \"kubernetes.io/projected/8d50baa6-a302-4896-a2c8-ff4f2f4c20b5-kube-api-access-64m9b\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\"" Jul 27 09:58:18.956459 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:18.956254 2556 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8d50baa6-a302-4896-a2c8-ff4f2f4c20b5-console-config\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\"" Jul 27 09:58:19.601488 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:19.601455 2556 generic.go:356] "Generic (PLEG): container finished" podID="8d50baa6-a302-4896-a2c8-ff4f2f4c20b5" containerID="6a16ffb178798010526c5b2d0bd0e826cad6b4362326f8ea2790175c7cb06347" exitCode=0 Jul 27 09:58:19.601960 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:19.601504 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66bc76c76c-db8gt" event={"ID":"8d50baa6-a302-4896-a2c8-ff4f2f4c20b5","Type":"ContainerDied","Data":"6a16ffb178798010526c5b2d0bd0e826cad6b4362326f8ea2790175c7cb06347"} Jul 27 09:58:19.601960 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:19.601506 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66bc76c76c-db8gt" Jul 27 09:58:19.601960 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:19.601549 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66bc76c76c-db8gt" event={"ID":"8d50baa6-a302-4896-a2c8-ff4f2f4c20b5","Type":"ContainerDied","Data":"36d8a99ff3aae72a6c44598734dd2a0c8dadb10612d25198441b3bc948df16d5"} Jul 27 09:58:19.601960 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:19.601571 2556 scope.go:117] "RemoveContainer" containerID="6a16ffb178798010526c5b2d0bd0e826cad6b4362326f8ea2790175c7cb06347" Jul 27 09:58:19.610093 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:19.610074 2556 scope.go:117] "RemoveContainer" containerID="6a16ffb178798010526c5b2d0bd0e826cad6b4362326f8ea2790175c7cb06347" Jul 27 09:58:19.610365 ip-10-0-139-140 kubenswrapper[2556]: E0727 09:58:19.610342 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a16ffb178798010526c5b2d0bd0e826cad6b4362326f8ea2790175c7cb06347\": container with ID starting with 6a16ffb178798010526c5b2d0bd0e826cad6b4362326f8ea2790175c7cb06347 not found: ID does not exist" containerID="6a16ffb178798010526c5b2d0bd0e826cad6b4362326f8ea2790175c7cb06347" Jul 27 09:58:19.610448 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:19.610370 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a16ffb178798010526c5b2d0bd0e826cad6b4362326f8ea2790175c7cb06347"} err="failed to get container status \"6a16ffb178798010526c5b2d0bd0e826cad6b4362326f8ea2790175c7cb06347\": rpc error: code = NotFound desc = could not find container \"6a16ffb178798010526c5b2d0bd0e826cad6b4362326f8ea2790175c7cb06347\": container with ID starting with 6a16ffb178798010526c5b2d0bd0e826cad6b4362326f8ea2790175c7cb06347 not found: ID does not exist" Jul 27 09:58:19.624247 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:19.624226 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-66bc76c76c-db8gt"] Jul 27 09:58:19.626480 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:19.626461 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-66bc76c76c-db8gt"] Jul 27 09:58:19.909683 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:19.909608 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d50baa6-a302-4896-a2c8-ff4f2f4c20b5" path="/var/lib/kubelet/pods/8d50baa6-a302-4896-a2c8-ff4f2f4c20b5/volumes" Jul 27 09:58:19.950837 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:19.950793 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t7h79"] Jul 27 09:58:19.951128 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:19.951115 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d50baa6-a302-4896-a2c8-ff4f2f4c20b5" containerName="console" Jul 27 09:58:19.951173 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:19.951129 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d50baa6-a302-4896-a2c8-ff4f2f4c20b5" containerName="console" Jul 27 09:58:19.951217 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:19.951181 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d50baa6-a302-4896-a2c8-ff4f2f4c20b5" containerName="console" Jul 27 09:58:19.955627 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:19.955608 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t7h79" Jul 27 09:58:19.958580 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:19.958561 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 27 09:58:19.958580 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:19.958571 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-lf6qv\"" Jul 27 09:58:19.958668 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:19.958616 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 27 09:58:19.965081 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:19.965061 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t7h79"] Jul 27 09:58:20.064661 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:20.064629 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bbsm\" (UniqueName: \"kubernetes.io/projected/f46748bf-4357-4764-9310-ab967a379b43-kube-api-access-5bbsm\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t7h79\" (UID: \"f46748bf-4357-4764-9310-ab967a379b43\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t7h79" Jul 27 09:58:20.064823 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:20.064671 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f46748bf-4357-4764-9310-ab967a379b43-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t7h79\" (UID: \"f46748bf-4357-4764-9310-ab967a379b43\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t7h79" Jul 27 09:58:20.064823 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:20.064760 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f46748bf-4357-4764-9310-ab967a379b43-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t7h79\" (UID: \"f46748bf-4357-4764-9310-ab967a379b43\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t7h79" Jul 27 09:58:20.166080 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:20.166006 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f46748bf-4357-4764-9310-ab967a379b43-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t7h79\" (UID: \"f46748bf-4357-4764-9310-ab967a379b43\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t7h79" Jul 27 09:58:20.166080 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:20.166051 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bbsm\" (UniqueName: \"kubernetes.io/projected/f46748bf-4357-4764-9310-ab967a379b43-kube-api-access-5bbsm\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t7h79\" (UID: \"f46748bf-4357-4764-9310-ab967a379b43\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t7h79" Jul 27 09:58:20.166257 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:20.166243 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f46748bf-4357-4764-9310-ab967a379b43-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t7h79\" (UID: \"f46748bf-4357-4764-9310-ab967a379b43\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t7h79" Jul 27 09:58:20.166468 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:20.166450 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f46748bf-4357-4764-9310-ab967a379b43-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t7h79\" (UID: \"f46748bf-4357-4764-9310-ab967a379b43\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t7h79" Jul 27 09:58:20.166524 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:20.166509 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f46748bf-4357-4764-9310-ab967a379b43-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t7h79\" (UID: \"f46748bf-4357-4764-9310-ab967a379b43\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t7h79" Jul 27 09:58:20.177109 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:20.177093 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bbsm\" (UniqueName: \"kubernetes.io/projected/f46748bf-4357-4764-9310-ab967a379b43-kube-api-access-5bbsm\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t7h79\" (UID: \"f46748bf-4357-4764-9310-ab967a379b43\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t7h79" Jul 27 09:58:20.264760 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:20.264727 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t7h79" Jul 27 09:58:20.392162 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:20.392139 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t7h79"] Jul 27 09:58:20.394483 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:58:20.394453 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf46748bf_4357_4764_9310_ab967a379b43.slice/crio-6b6c5fe30f07bace98fb1856db9f93eb51becaaae3e92a6b1c329f15b2cb4ecf WatchSource:0}: Error finding container 6b6c5fe30f07bace98fb1856db9f93eb51becaaae3e92a6b1c329f15b2cb4ecf: Status 404 returned error can't find the container with id 6b6c5fe30f07bace98fb1856db9f93eb51becaaae3e92a6b1c329f15b2cb4ecf Jul 27 09:58:20.607048 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:20.607022 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t7h79" event={"ID":"f46748bf-4357-4764-9310-ab967a379b43","Type":"ContainerStarted","Data":"6b6c5fe30f07bace98fb1856db9f93eb51becaaae3e92a6b1c329f15b2cb4ecf"} Jul 27 09:58:25.629518 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:25.629486 2556 generic.go:356] "Generic (PLEG): container finished" podID="f46748bf-4357-4764-9310-ab967a379b43" containerID="fbd36c709a51fada0a353366b9dabc9bbd8d3e3457bdc2854c503a9b31354db3" exitCode=0 Jul 27 09:58:25.629880 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:25.629552 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t7h79" event={"ID":"f46748bf-4357-4764-9310-ab967a379b43","Type":"ContainerDied","Data":"fbd36c709a51fada0a353366b9dabc9bbd8d3e3457bdc2854c503a9b31354db3"} Jul 27 09:58:28.643436 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:28.643403 2556 generic.go:356] "Generic (PLEG): container finished" podID="f46748bf-4357-4764-9310-ab967a379b43" containerID="7a793adb512a03fc77638ab889093865838c4724c7a0e66436f2b80fdf140a6a" exitCode=0 Jul 27 09:58:28.643798 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:28.643458 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t7h79" event={"ID":"f46748bf-4357-4764-9310-ab967a379b43","Type":"ContainerDied","Data":"7a793adb512a03fc77638ab889093865838c4724c7a0e66436f2b80fdf140a6a"} Jul 27 09:58:35.677875 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:35.677790 2556 generic.go:356] "Generic (PLEG): container finished" podID="f46748bf-4357-4764-9310-ab967a379b43" containerID="9e81eccbfe5df68e00849e76a38a12eef9d10757bfb59cf8feae6710e8586024" exitCode=0 Jul 27 09:58:35.678187 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:35.677888 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t7h79" event={"ID":"f46748bf-4357-4764-9310-ab967a379b43","Type":"ContainerDied","Data":"9e81eccbfe5df68e00849e76a38a12eef9d10757bfb59cf8feae6710e8586024"} Jul 27 09:58:36.802282 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:36.802259 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t7h79" Jul 27 09:58:36.902539 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:36.902513 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5bbsm\" (UniqueName: \"kubernetes.io/projected/f46748bf-4357-4764-9310-ab967a379b43-kube-api-access-5bbsm\") pod \"f46748bf-4357-4764-9310-ab967a379b43\" (UID: \"f46748bf-4357-4764-9310-ab967a379b43\") " Jul 27 09:58:36.902659 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:36.902558 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f46748bf-4357-4764-9310-ab967a379b43-util\") pod \"f46748bf-4357-4764-9310-ab967a379b43\" (UID: \"f46748bf-4357-4764-9310-ab967a379b43\") " Jul 27 09:58:36.902659 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:36.902598 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f46748bf-4357-4764-9310-ab967a379b43-bundle\") pod \"f46748bf-4357-4764-9310-ab967a379b43\" (UID: \"f46748bf-4357-4764-9310-ab967a379b43\") " Jul 27 09:58:36.903311 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:36.903278 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f46748bf-4357-4764-9310-ab967a379b43-bundle" (OuterVolumeSpecName: "bundle") pod "f46748bf-4357-4764-9310-ab967a379b43" (UID: "f46748bf-4357-4764-9310-ab967a379b43"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 27 09:58:36.904757 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:36.904729 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f46748bf-4357-4764-9310-ab967a379b43-kube-api-access-5bbsm" (OuterVolumeSpecName: "kube-api-access-5bbsm") pod "f46748bf-4357-4764-9310-ab967a379b43" (UID: "f46748bf-4357-4764-9310-ab967a379b43"). InnerVolumeSpecName "kube-api-access-5bbsm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 09:58:36.907189 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:36.907161 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f46748bf-4357-4764-9310-ab967a379b43-util" (OuterVolumeSpecName: "util") pod "f46748bf-4357-4764-9310-ab967a379b43" (UID: "f46748bf-4357-4764-9310-ab967a379b43"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 27 09:58:37.003757 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:37.003696 2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f46748bf-4357-4764-9310-ab967a379b43-util\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\"" Jul 27 09:58:37.003757 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:37.003721 2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f46748bf-4357-4764-9310-ab967a379b43-bundle\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\"" Jul 27 09:58:37.003757 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:37.003732 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5bbsm\" (UniqueName: \"kubernetes.io/projected/f46748bf-4357-4764-9310-ab967a379b43-kube-api-access-5bbsm\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\"" Jul 27 09:58:37.687476 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:37.687451 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t7h79" Jul 27 09:58:37.687476 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:37.687457 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t7h79" event={"ID":"f46748bf-4357-4764-9310-ab967a379b43","Type":"ContainerDied","Data":"6b6c5fe30f07bace98fb1856db9f93eb51becaaae3e92a6b1c329f15b2cb4ecf"} Jul 27 09:58:37.687687 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:37.687500 2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6b6c5fe30f07bace98fb1856db9f93eb51becaaae3e92a6b1c329f15b2cb4ecf" Jul 27 09:58:42.732892 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:42.732861 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-jhmlf"] Jul 27 09:58:42.733335 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:42.733154 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f46748bf-4357-4764-9310-ab967a379b43" containerName="extract" Jul 27 09:58:42.733335 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:42.733164 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="f46748bf-4357-4764-9310-ab967a379b43" containerName="extract" Jul 27 09:58:42.733335 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:42.733179 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f46748bf-4357-4764-9310-ab967a379b43" containerName="util" Jul 27 09:58:42.733335 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:42.733185 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="f46748bf-4357-4764-9310-ab967a379b43" containerName="util" Jul 27 09:58:42.733335 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:42.733195 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f46748bf-4357-4764-9310-ab967a379b43" containerName="pull" Jul 27 09:58:42.733335 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:42.733199 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="f46748bf-4357-4764-9310-ab967a379b43" containerName="pull" Jul 27 09:58:42.733335 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:42.733246 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="f46748bf-4357-4764-9310-ab967a379b43" containerName="extract" Jul 27 09:58:42.766162 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:42.766133 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-jhmlf"] Jul 27 09:58:42.766331 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:42.766218 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-jhmlf" Jul 27 09:58:42.769178 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:42.769153 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 27 09:58:42.769286 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:42.769153 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-wmmcn\"" Jul 27 09:58:42.769286 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:42.769224 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 27 09:58:42.847253 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:42.847228 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kq8sp\" (UniqueName: \"kubernetes.io/projected/1a194ef8-3dbe-4393-a0fe-e715aae2e769-kube-api-access-kq8sp\") pod \"cert-manager-operator-controller-manager-56b4598547-jhmlf\" (UID: \"1a194ef8-3dbe-4393-a0fe-e715aae2e769\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-jhmlf" Jul 27 09:58:42.847378 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:42.847265 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1a194ef8-3dbe-4393-a0fe-e715aae2e769-tmp\") pod \"cert-manager-operator-controller-manager-56b4598547-jhmlf\" (UID: \"1a194ef8-3dbe-4393-a0fe-e715aae2e769\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-jhmlf" Jul 27 09:58:42.948176 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:42.948151 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kq8sp\" (UniqueName: \"kubernetes.io/projected/1a194ef8-3dbe-4393-a0fe-e715aae2e769-kube-api-access-kq8sp\") pod \"cert-manager-operator-controller-manager-56b4598547-jhmlf\" (UID: \"1a194ef8-3dbe-4393-a0fe-e715aae2e769\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-jhmlf" Jul 27 09:58:42.948284 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:42.948188 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1a194ef8-3dbe-4393-a0fe-e715aae2e769-tmp\") pod \"cert-manager-operator-controller-manager-56b4598547-jhmlf\" (UID: \"1a194ef8-3dbe-4393-a0fe-e715aae2e769\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-jhmlf" Jul 27 09:58:42.948655 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:42.948638 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1a194ef8-3dbe-4393-a0fe-e715aae2e769-tmp\") pod \"cert-manager-operator-controller-manager-56b4598547-jhmlf\" (UID: \"1a194ef8-3dbe-4393-a0fe-e715aae2e769\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-jhmlf" Jul 27 09:58:42.958248 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:42.958219 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kq8sp\" (UniqueName: \"kubernetes.io/projected/1a194ef8-3dbe-4393-a0fe-e715aae2e769-kube-api-access-kq8sp\") pod \"cert-manager-operator-controller-manager-56b4598547-jhmlf\" (UID: \"1a194ef8-3dbe-4393-a0fe-e715aae2e769\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-jhmlf" Jul 27 09:58:43.075864 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:43.075843 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-jhmlf" Jul 27 09:58:43.221432 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:43.221403 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-jhmlf"] Jul 27 09:58:43.224660 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:58:43.224627 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a194ef8_3dbe_4393_a0fe_e715aae2e769.slice/crio-e5c848b94dabe2f509123ee6d9f0ba9ecc66bb827c8010211fc962c37f7b794c WatchSource:0}: Error finding container e5c848b94dabe2f509123ee6d9f0ba9ecc66bb827c8010211fc962c37f7b794c: Status 404 returned error can't find the container with id e5c848b94dabe2f509123ee6d9f0ba9ecc66bb827c8010211fc962c37f7b794c Jul 27 09:58:43.711248 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:43.711207 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-jhmlf" event={"ID":"1a194ef8-3dbe-4393-a0fe-e715aae2e769","Type":"ContainerStarted","Data":"e5c848b94dabe2f509123ee6d9f0ba9ecc66bb827c8010211fc962c37f7b794c"} Jul 27 09:58:45.721596 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:45.721566 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-jhmlf" event={"ID":"1a194ef8-3dbe-4393-a0fe-e715aae2e769","Type":"ContainerStarted","Data":"bc55ab9b7a850820f44761a4105ef1bfb2ce98d44d7a98c7c1cba85fdb36a561"} Jul 27 09:58:45.748414 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:45.748372 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-jhmlf" podStartSLOduration=1.8187514949999999 podStartE2EDuration="3.748358028s" totalImagesPullingTime="1.929606533s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 09:58:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 09:58:45.746617449 +0000 UTC m=+512.337114687" watchObservedRunningTime="2026-07-27 09:58:45.748358028 +0000 UTC m=+512.338855261" Jul 27 09:58:48.618482 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:48.618454 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-rg762"] Jul 27 09:58:48.620994 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:48.620979 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-rg762" Jul 27 09:58:48.623792 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:48.623756 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 27 09:58:48.625076 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:48.625055 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 27 09:58:48.625215 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:48.625146 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-bp4tq\"" Jul 27 09:58:48.632470 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:48.632449 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-rg762"] Jul 27 09:58:48.700613 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:48.700589 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jkr9b\" (UniqueName: \"kubernetes.io/projected/279e6681-c4c4-4957-b834-1cd68c001e01-kube-api-access-jkr9b\") pod \"cert-manager-cainjector-559cdd8c87-rg762\" (UID: \"279e6681-c4c4-4957-b834-1cd68c001e01\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-rg762" Jul 27 09:58:48.700748 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:48.700643 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/279e6681-c4c4-4957-b834-1cd68c001e01-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-rg762\" (UID: \"279e6681-c4c4-4957-b834-1cd68c001e01\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-rg762" Jul 27 09:58:48.801006 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:48.800981 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/279e6681-c4c4-4957-b834-1cd68c001e01-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-rg762\" (UID: \"279e6681-c4c4-4957-b834-1cd68c001e01\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-rg762" Jul 27 09:58:48.801142 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:48.801037 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jkr9b\" (UniqueName: \"kubernetes.io/projected/279e6681-c4c4-4957-b834-1cd68c001e01-kube-api-access-jkr9b\") pod \"cert-manager-cainjector-559cdd8c87-rg762\" (UID: \"279e6681-c4c4-4957-b834-1cd68c001e01\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-rg762" Jul 27 09:58:48.810873 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:48.810845 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jkr9b\" (UniqueName: \"kubernetes.io/projected/279e6681-c4c4-4957-b834-1cd68c001e01-kube-api-access-jkr9b\") pod \"cert-manager-cainjector-559cdd8c87-rg762\" (UID: \"279e6681-c4c4-4957-b834-1cd68c001e01\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-rg762" Jul 27 09:58:48.810981 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:48.810940 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/279e6681-c4c4-4957-b834-1cd68c001e01-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-rg762\" (UID: \"279e6681-c4c4-4957-b834-1cd68c001e01\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-rg762" Jul 27 09:58:48.935890 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:48.935831 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-rg762" Jul 27 09:58:49.059904 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:49.059866 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-rg762"] Jul 27 09:58:49.062572 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:58:49.062542 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod279e6681_c4c4_4957_b834_1cd68c001e01.slice/crio-7884c70cc7210c5d9bf6177d90b8abbcf90cc035af4aecc2149ba65d65c10809 WatchSource:0}: Error finding container 7884c70cc7210c5d9bf6177d90b8abbcf90cc035af4aecc2149ba65d65c10809: Status 404 returned error can't find the container with id 7884c70cc7210c5d9bf6177d90b8abbcf90cc035af4aecc2149ba65d65c10809 Jul 27 09:58:49.739754 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:49.739724 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-rg762" event={"ID":"279e6681-c4c4-4957-b834-1cd68c001e01","Type":"ContainerStarted","Data":"7884c70cc7210c5d9bf6177d90b8abbcf90cc035af4aecc2149ba65d65c10809"} Jul 27 09:58:51.750549 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:51.750518 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-rg762" event={"ID":"279e6681-c4c4-4957-b834-1cd68c001e01","Type":"ContainerStarted","Data":"0847a97075e616e07cc0418a0c79c919ed329ece644aa0426a22f248305c836b"} Jul 27 09:58:51.771583 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:51.771529 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-rg762" podStartSLOduration=1.173204041 podStartE2EDuration="3.771513951s" totalImagesPullingTime="2.59830991s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 09:58:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 09:58:51.770931299 +0000 UTC m=+518.361428533" watchObservedRunningTime="2026-07-27 09:58:51.771513951 +0000 UTC m=+518.362011185" Jul 27 09:58:52.772390 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:52.772357 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-5p48p"] Jul 27 09:58:52.774888 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:52.774867 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-5p48p" Jul 27 09:58:52.777626 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:52.777606 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-nmgdx\"" Jul 27 09:58:52.786092 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:52.786071 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-5p48p"] Jul 27 09:58:52.940219 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:52.940185 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1b94e227-fe63-42a4-8a7d-ebc49db04313-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-5p48p\" (UID: \"1b94e227-fe63-42a4-8a7d-ebc49db04313\") " pod="cert-manager/cert-manager-webhook-6486ffd997-5p48p" Jul 27 09:58:52.940398 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:52.940283 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srslb\" (UniqueName: \"kubernetes.io/projected/1b94e227-fe63-42a4-8a7d-ebc49db04313-kube-api-access-srslb\") pod \"cert-manager-webhook-6486ffd997-5p48p\" (UID: \"1b94e227-fe63-42a4-8a7d-ebc49db04313\") " pod="cert-manager/cert-manager-webhook-6486ffd997-5p48p" Jul 27 09:58:53.041638 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:53.041542 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1b94e227-fe63-42a4-8a7d-ebc49db04313-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-5p48p\" (UID: \"1b94e227-fe63-42a4-8a7d-ebc49db04313\") " pod="cert-manager/cert-manager-webhook-6486ffd997-5p48p" Jul 27 09:58:53.041638 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:53.041630 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srslb\" (UniqueName: \"kubernetes.io/projected/1b94e227-fe63-42a4-8a7d-ebc49db04313-kube-api-access-srslb\") pod \"cert-manager-webhook-6486ffd997-5p48p\" (UID: \"1b94e227-fe63-42a4-8a7d-ebc49db04313\") " pod="cert-manager/cert-manager-webhook-6486ffd997-5p48p" Jul 27 09:58:53.051845 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:53.051813 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-srslb\" (UniqueName: \"kubernetes.io/projected/1b94e227-fe63-42a4-8a7d-ebc49db04313-kube-api-access-srslb\") pod \"cert-manager-webhook-6486ffd997-5p48p\" (UID: \"1b94e227-fe63-42a4-8a7d-ebc49db04313\") " pod="cert-manager/cert-manager-webhook-6486ffd997-5p48p" Jul 27 09:58:53.051962 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:53.051815 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1b94e227-fe63-42a4-8a7d-ebc49db04313-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-5p48p\" (UID: \"1b94e227-fe63-42a4-8a7d-ebc49db04313\") " pod="cert-manager/cert-manager-webhook-6486ffd997-5p48p" Jul 27 09:58:53.083816 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:53.083784 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-5p48p" Jul 27 09:58:53.211523 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:53.211499 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-5p48p"] Jul 27 09:58:53.213875 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:58:53.213839 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1b94e227_fe63_42a4_8a7d_ebc49db04313.slice/crio-5fc126e262f6138ef2bfa25d0cdfe5f9ce2416f7c6658ec09b2c3ea8a8a574c3 WatchSource:0}: Error finding container 5fc126e262f6138ef2bfa25d0cdfe5f9ce2416f7c6658ec09b2c3ea8a8a574c3: Status 404 returned error can't find the container with id 5fc126e262f6138ef2bfa25d0cdfe5f9ce2416f7c6658ec09b2c3ea8a8a574c3 Jul 27 09:58:53.760359 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:53.760321 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-5p48p" event={"ID":"1b94e227-fe63-42a4-8a7d-ebc49db04313","Type":"ContainerStarted","Data":"efa7c0a1ef746e33495b8759dfe99b9a4a79014b06f4c1eb69f32954e448d8df"} Jul 27 09:58:53.760359 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:53.760360 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-5p48p" event={"ID":"1b94e227-fe63-42a4-8a7d-ebc49db04313","Type":"ContainerStarted","Data":"5fc126e262f6138ef2bfa25d0cdfe5f9ce2416f7c6658ec09b2c3ea8a8a574c3"} Jul 27 09:58:53.760625 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:53.760395 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-5p48p" Jul 27 09:58:53.785095 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:53.785045 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-5p48p" podStartSLOduration=1.7850311570000001 podStartE2EDuration="1.785031157s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 09:58:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 09:58:53.78376789 +0000 UTC m=+520.374265126" watchObservedRunningTime="2026-07-27 09:58:53.785031157 +0000 UTC m=+520.375528391" Jul 27 09:58:59.766965 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:58:59.766930 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-5p48p" Jul 27 09:59:00.442569 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:59:00.442535 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ezlhj9"] Jul 27 09:59:00.445514 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:59:00.445494 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ezlhj9" Jul 27 09:59:00.448232 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:59:00.448215 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 27 09:59:00.448356 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:59:00.448217 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-lf6qv\"" Jul 27 09:59:00.449589 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:59:00.449572 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 27 09:59:00.455616 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:59:00.455594 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ezlhj9"] Jul 27 09:59:00.608041 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:59:00.608001 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d374f0c1-e6e9-4402-adda-7d71a898dcce-bundle\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ezlhj9\" (UID: \"d374f0c1-e6e9-4402-adda-7d71a898dcce\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ezlhj9" Jul 27 09:59:00.608041 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:59:00.608040 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lq4pc\" (UniqueName: \"kubernetes.io/projected/d374f0c1-e6e9-4402-adda-7d71a898dcce-kube-api-access-lq4pc\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ezlhj9\" (UID: \"d374f0c1-e6e9-4402-adda-7d71a898dcce\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ezlhj9" Jul 27 09:59:00.608250 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:59:00.608070 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d374f0c1-e6e9-4402-adda-7d71a898dcce-util\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ezlhj9\" (UID: \"d374f0c1-e6e9-4402-adda-7d71a898dcce\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ezlhj9" Jul 27 09:59:00.708846 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:59:00.708770 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d374f0c1-e6e9-4402-adda-7d71a898dcce-util\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ezlhj9\" (UID: \"d374f0c1-e6e9-4402-adda-7d71a898dcce\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ezlhj9" Jul 27 09:59:00.708966 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:59:00.708870 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d374f0c1-e6e9-4402-adda-7d71a898dcce-bundle\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ezlhj9\" (UID: \"d374f0c1-e6e9-4402-adda-7d71a898dcce\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ezlhj9" Jul 27 09:59:00.708966 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:59:00.708895 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lq4pc\" (UniqueName: \"kubernetes.io/projected/d374f0c1-e6e9-4402-adda-7d71a898dcce-kube-api-access-lq4pc\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ezlhj9\" (UID: \"d374f0c1-e6e9-4402-adda-7d71a898dcce\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ezlhj9" Jul 27 09:59:00.709171 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:59:00.709151 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d374f0c1-e6e9-4402-adda-7d71a898dcce-util\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ezlhj9\" (UID: \"d374f0c1-e6e9-4402-adda-7d71a898dcce\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ezlhj9" Jul 27 09:59:00.709255 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:59:00.709237 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d374f0c1-e6e9-4402-adda-7d71a898dcce-bundle\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ezlhj9\" (UID: \"d374f0c1-e6e9-4402-adda-7d71a898dcce\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ezlhj9" Jul 27 09:59:00.718218 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:59:00.718189 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lq4pc\" (UniqueName: \"kubernetes.io/projected/d374f0c1-e6e9-4402-adda-7d71a898dcce-kube-api-access-lq4pc\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ezlhj9\" (UID: \"d374f0c1-e6e9-4402-adda-7d71a898dcce\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ezlhj9" Jul 27 09:59:00.755239 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:59:00.755206 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ezlhj9" Jul 27 09:59:00.887726 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:59:00.887644 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ezlhj9"] Jul 27 09:59:00.889927 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:59:00.889900 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd374f0c1_e6e9_4402_adda_7d71a898dcce.slice/crio-d8e887abe4e636ba23b7545077ca2dac37b797f722876137bd9a6b245c4c1d6d WatchSource:0}: Error finding container d8e887abe4e636ba23b7545077ca2dac37b797f722876137bd9a6b245c4c1d6d: Status 404 returned error can't find the container with id d8e887abe4e636ba23b7545077ca2dac37b797f722876137bd9a6b245c4c1d6d Jul 27 09:59:01.797825 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:59:01.797798 2556 generic.go:356] "Generic (PLEG): container finished" podID="d374f0c1-e6e9-4402-adda-7d71a898dcce" containerID="55315ba72b1b08e351dc20eab66ce0f989871f7654aa1504a94881776f511ba7" exitCode=0 Jul 27 09:59:01.797971 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:59:01.797846 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ezlhj9" event={"ID":"d374f0c1-e6e9-4402-adda-7d71a898dcce","Type":"ContainerDied","Data":"55315ba72b1b08e351dc20eab66ce0f989871f7654aa1504a94881776f511ba7"} Jul 27 09:59:01.797971 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:59:01.797879 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ezlhj9" event={"ID":"d374f0c1-e6e9-4402-adda-7d71a898dcce","Type":"ContainerStarted","Data":"d8e887abe4e636ba23b7545077ca2dac37b797f722876137bd9a6b245c4c1d6d"} Jul 27 09:59:03.809584 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:59:03.809549 2556 generic.go:356] "Generic (PLEG): container finished" podID="d374f0c1-e6e9-4402-adda-7d71a898dcce" containerID="79c6ae42ae3b0344fd392a7a9fa3b6b21b13bbe61bdf3e159ce25f692ea33bcc" exitCode=0 Jul 27 09:59:03.809895 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:59:03.809636 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ezlhj9" event={"ID":"d374f0c1-e6e9-4402-adda-7d71a898dcce","Type":"ContainerDied","Data":"79c6ae42ae3b0344fd392a7a9fa3b6b21b13bbe61bdf3e159ce25f692ea33bcc"} Jul 27 09:59:04.816212 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:59:04.816175 2556 generic.go:356] "Generic (PLEG): container finished" podID="d374f0c1-e6e9-4402-adda-7d71a898dcce" containerID="2b77c2d7524fc9b1dbfe0eea83d89604fbc856aa328db4e62f05a6cd1a4aa8ec" exitCode=0 Jul 27 09:59:04.816617 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:59:04.816253 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ezlhj9" event={"ID":"d374f0c1-e6e9-4402-adda-7d71a898dcce","Type":"ContainerDied","Data":"2b77c2d7524fc9b1dbfe0eea83d89604fbc856aa328db4e62f05a6cd1a4aa8ec"} Jul 27 09:59:05.945944 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:59:05.945922 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ezlhj9" Jul 27 09:59:05.953333 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:59:05.953314 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lq4pc\" (UniqueName: \"kubernetes.io/projected/d374f0c1-e6e9-4402-adda-7d71a898dcce-kube-api-access-lq4pc\") pod \"d374f0c1-e6e9-4402-adda-7d71a898dcce\" (UID: \"d374f0c1-e6e9-4402-adda-7d71a898dcce\") " Jul 27 09:59:05.953442 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:59:05.953385 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d374f0c1-e6e9-4402-adda-7d71a898dcce-util\") pod \"d374f0c1-e6e9-4402-adda-7d71a898dcce\" (UID: \"d374f0c1-e6e9-4402-adda-7d71a898dcce\") " Jul 27 09:59:05.953442 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:59:05.953433 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d374f0c1-e6e9-4402-adda-7d71a898dcce-bundle\") pod \"d374f0c1-e6e9-4402-adda-7d71a898dcce\" (UID: \"d374f0c1-e6e9-4402-adda-7d71a898dcce\") " Jul 27 09:59:05.954148 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:59:05.953892 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d374f0c1-e6e9-4402-adda-7d71a898dcce-bundle" (OuterVolumeSpecName: "bundle") pod "d374f0c1-e6e9-4402-adda-7d71a898dcce" (UID: "d374f0c1-e6e9-4402-adda-7d71a898dcce"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 27 09:59:05.954148 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:59:05.953985 2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d374f0c1-e6e9-4402-adda-7d71a898dcce-bundle\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\"" Jul 27 09:59:05.955393 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:59:05.955374 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d374f0c1-e6e9-4402-adda-7d71a898dcce-kube-api-access-lq4pc" (OuterVolumeSpecName: "kube-api-access-lq4pc") pod "d374f0c1-e6e9-4402-adda-7d71a898dcce" (UID: "d374f0c1-e6e9-4402-adda-7d71a898dcce"). InnerVolumeSpecName "kube-api-access-lq4pc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 09:59:05.959469 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:59:05.959386 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d374f0c1-e6e9-4402-adda-7d71a898dcce-util" (OuterVolumeSpecName: "util") pod "d374f0c1-e6e9-4402-adda-7d71a898dcce" (UID: "d374f0c1-e6e9-4402-adda-7d71a898dcce"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 27 09:59:06.055316 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:59:06.055272 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lq4pc\" (UniqueName: \"kubernetes.io/projected/d374f0c1-e6e9-4402-adda-7d71a898dcce-kube-api-access-lq4pc\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\"" Jul 27 09:59:06.055316 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:59:06.055294 2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d374f0c1-e6e9-4402-adda-7d71a898dcce-util\") on node \"ip-10-0-139-140.ec2.internal\" DevicePath \"\"" Jul 27 09:59:06.826875 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:59:06.826847 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ezlhj9" Jul 27 09:59:06.826875 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:59:06.826857 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ezlhj9" event={"ID":"d374f0c1-e6e9-4402-adda-7d71a898dcce","Type":"ContainerDied","Data":"d8e887abe4e636ba23b7545077ca2dac37b797f722876137bd9a6b245c4c1d6d"} Jul 27 09:59:06.827072 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:59:06.826895 2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d8e887abe4e636ba23b7545077ca2dac37b797f722876137bd9a6b245c4c1d6d" Jul 27 09:59:11.997412 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:59:11.997381 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-jobset-operator/jobset-operator-5bc45f897-fpfm8"] Jul 27 09:59:11.997780 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:59:11.997718 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d374f0c1-e6e9-4402-adda-7d71a898dcce" containerName="extract" Jul 27 09:59:11.997780 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:59:11.997730 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="d374f0c1-e6e9-4402-adda-7d71a898dcce" containerName="extract" Jul 27 09:59:11.997780 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:59:11.997739 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d374f0c1-e6e9-4402-adda-7d71a898dcce" containerName="util" Jul 27 09:59:11.997780 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:59:11.997745 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="d374f0c1-e6e9-4402-adda-7d71a898dcce" containerName="util" Jul 27 09:59:11.997780 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:59:11.997754 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d374f0c1-e6e9-4402-adda-7d71a898dcce" containerName="pull" Jul 27 09:59:11.997780 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:59:11.997760 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="d374f0c1-e6e9-4402-adda-7d71a898dcce" containerName="pull" Jul 27 09:59:11.997968 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:59:11.997818 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="d374f0c1-e6e9-4402-adda-7d71a898dcce" containerName="extract" Jul 27 09:59:11.999711 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:59:11.999692 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-5bc45f897-fpfm8" Jul 27 09:59:12.002546 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:59:12.002521 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"openshift-service-ca.crt\"" Jul 27 09:59:12.002546 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:59:12.002531 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"kube-root-ca.crt\"" Jul 27 09:59:12.002690 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:59:12.002556 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"jobset-operator-dockercfg-rv7m8\"" Jul 27 09:59:12.010238 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:59:12.010219 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-5bc45f897-fpfm8"] Jul 27 09:59:12.099429 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:59:12.099399 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w94lh\" (UniqueName: \"kubernetes.io/projected/8f965b23-624e-40a7-80df-20bb21536cda-kube-api-access-w94lh\") pod \"jobset-operator-5bc45f897-fpfm8\" (UID: \"8f965b23-624e-40a7-80df-20bb21536cda\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-fpfm8" Jul 27 09:59:12.099560 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:59:12.099434 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8f965b23-624e-40a7-80df-20bb21536cda-tmp\") pod \"jobset-operator-5bc45f897-fpfm8\" (UID: \"8f965b23-624e-40a7-80df-20bb21536cda\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-fpfm8" Jul 27 09:59:12.200459 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:59:12.200428 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w94lh\" (UniqueName: \"kubernetes.io/projected/8f965b23-624e-40a7-80df-20bb21536cda-kube-api-access-w94lh\") pod \"jobset-operator-5bc45f897-fpfm8\" (UID: \"8f965b23-624e-40a7-80df-20bb21536cda\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-fpfm8" Jul 27 09:59:12.200585 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:59:12.200472 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8f965b23-624e-40a7-80df-20bb21536cda-tmp\") pod \"jobset-operator-5bc45f897-fpfm8\" (UID: \"8f965b23-624e-40a7-80df-20bb21536cda\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-fpfm8" Jul 27 09:59:12.200801 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:59:12.200786 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8f965b23-624e-40a7-80df-20bb21536cda-tmp\") pod \"jobset-operator-5bc45f897-fpfm8\" (UID: \"8f965b23-624e-40a7-80df-20bb21536cda\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-fpfm8" Jul 27 09:59:12.210418 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:59:12.210391 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w94lh\" (UniqueName: \"kubernetes.io/projected/8f965b23-624e-40a7-80df-20bb21536cda-kube-api-access-w94lh\") pod \"jobset-operator-5bc45f897-fpfm8\" (UID: \"8f965b23-624e-40a7-80df-20bb21536cda\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-fpfm8" Jul 27 09:59:12.308764 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:59:12.308739 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-5bc45f897-fpfm8" Jul 27 09:59:12.439622 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:59:12.439596 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-5bc45f897-fpfm8"] Jul 27 09:59:12.441713 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:59:12.441688 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8f965b23_624e_40a7_80df_20bb21536cda.slice/crio-3dd193fdee4abebf8b1d2d9152c9bc258b68222aed2af57d04295e046adea37e WatchSource:0}: Error finding container 3dd193fdee4abebf8b1d2d9152c9bc258b68222aed2af57d04295e046adea37e: Status 404 returned error can't find the container with id 3dd193fdee4abebf8b1d2d9152c9bc258b68222aed2af57d04295e046adea37e Jul 27 09:59:12.853572 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:59:12.853542 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-5bc45f897-fpfm8" event={"ID":"8f965b23-624e-40a7-80df-20bb21536cda","Type":"ContainerStarted","Data":"3dd193fdee4abebf8b1d2d9152c9bc258b68222aed2af57d04295e046adea37e"} Jul 27 09:59:14.864745 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:59:14.864715 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-5bc45f897-fpfm8" event={"ID":"8f965b23-624e-40a7-80df-20bb21536cda","Type":"ContainerStarted","Data":"08140fdee00bd12a2c4122f9f4bc014e2a1444891979dbf16f32b18a110d8eca"} Jul 27 09:59:14.885273 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:59:14.885211 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-jobset-operator/jobset-operator-5bc45f897-fpfm8" podStartSLOduration=2.212549269 podStartE2EDuration="3.885196792s" totalImagesPullingTime="1.672647523s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 09:59:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 09:59:14.884339291 +0000 UTC m=+541.474836525" watchObservedRunningTime="2026-07-27 09:59:14.885196792 +0000 UTC m=+541.475694022" Jul 27 09:59:28.475822 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:59:28.475785 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-jobset-operator/jobset-controller-manager-7474777596-9nkjx"] Jul 27 09:59:28.478813 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:59:28.478794 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-controller-manager-7474777596-9nkjx" Jul 27 09:59:28.482785 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:59:28.482762 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"jobset-controller-manager-dockercfg-dqgcw\"" Jul 27 09:59:28.482912 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:59:28.482803 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"metrics-server-cert\"" Jul 27 09:59:28.482912 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:59:28.482813 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"webhook-server-cert\"" Jul 27 09:59:28.482912 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:59:28.482814 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"jobset-manager-config\"" Jul 27 09:59:28.490698 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:59:28.490677 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-controller-manager-7474777596-9nkjx"] Jul 27 09:59:28.536362 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:59:28.536320 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6s4c2\" (UniqueName: \"kubernetes.io/projected/f344e9e0-e2ab-46eb-a513-c3f3fdb90db8-kube-api-access-6s4c2\") pod \"jobset-controller-manager-7474777596-9nkjx\" (UID: \"f344e9e0-e2ab-46eb-a513-c3f3fdb90db8\") " pod="openshift-jobset-operator/jobset-controller-manager-7474777596-9nkjx" Jul 27 09:59:28.536539 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:59:28.536378 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f344e9e0-e2ab-46eb-a513-c3f3fdb90db8-manager-config\") pod \"jobset-controller-manager-7474777596-9nkjx\" (UID: \"f344e9e0-e2ab-46eb-a513-c3f3fdb90db8\") " pod="openshift-jobset-operator/jobset-controller-manager-7474777596-9nkjx" Jul 27 09:59:28.536539 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:59:28.536459 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f344e9e0-e2ab-46eb-a513-c3f3fdb90db8-cert\") pod \"jobset-controller-manager-7474777596-9nkjx\" (UID: \"f344e9e0-e2ab-46eb-a513-c3f3fdb90db8\") " pod="openshift-jobset-operator/jobset-controller-manager-7474777596-9nkjx" Jul 27 09:59:28.536539 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:59:28.536488 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f344e9e0-e2ab-46eb-a513-c3f3fdb90db8-metrics-certs\") pod \"jobset-controller-manager-7474777596-9nkjx\" (UID: \"f344e9e0-e2ab-46eb-a513-c3f3fdb90db8\") " pod="openshift-jobset-operator/jobset-controller-manager-7474777596-9nkjx" Jul 27 09:59:28.637286 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:59:28.637255 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6s4c2\" (UniqueName: \"kubernetes.io/projected/f344e9e0-e2ab-46eb-a513-c3f3fdb90db8-kube-api-access-6s4c2\") pod \"jobset-controller-manager-7474777596-9nkjx\" (UID: \"f344e9e0-e2ab-46eb-a513-c3f3fdb90db8\") " pod="openshift-jobset-operator/jobset-controller-manager-7474777596-9nkjx" Jul 27 09:59:28.637286 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:59:28.637287 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f344e9e0-e2ab-46eb-a513-c3f3fdb90db8-manager-config\") pod \"jobset-controller-manager-7474777596-9nkjx\" (UID: \"f344e9e0-e2ab-46eb-a513-c3f3fdb90db8\") " pod="openshift-jobset-operator/jobset-controller-manager-7474777596-9nkjx" Jul 27 09:59:28.637493 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:59:28.637346 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f344e9e0-e2ab-46eb-a513-c3f3fdb90db8-cert\") pod \"jobset-controller-manager-7474777596-9nkjx\" (UID: \"f344e9e0-e2ab-46eb-a513-c3f3fdb90db8\") " pod="openshift-jobset-operator/jobset-controller-manager-7474777596-9nkjx" Jul 27 09:59:28.637493 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:59:28.637365 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f344e9e0-e2ab-46eb-a513-c3f3fdb90db8-metrics-certs\") pod \"jobset-controller-manager-7474777596-9nkjx\" (UID: \"f344e9e0-e2ab-46eb-a513-c3f3fdb90db8\") " pod="openshift-jobset-operator/jobset-controller-manager-7474777596-9nkjx" Jul 27 09:59:28.638025 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:59:28.637996 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f344e9e0-e2ab-46eb-a513-c3f3fdb90db8-manager-config\") pod \"jobset-controller-manager-7474777596-9nkjx\" (UID: \"f344e9e0-e2ab-46eb-a513-c3f3fdb90db8\") " pod="openshift-jobset-operator/jobset-controller-manager-7474777596-9nkjx" Jul 27 09:59:28.639929 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:59:28.639904 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f344e9e0-e2ab-46eb-a513-c3f3fdb90db8-cert\") pod \"jobset-controller-manager-7474777596-9nkjx\" (UID: \"f344e9e0-e2ab-46eb-a513-c3f3fdb90db8\") " pod="openshift-jobset-operator/jobset-controller-manager-7474777596-9nkjx" Jul 27 09:59:28.640004 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:59:28.639942 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f344e9e0-e2ab-46eb-a513-c3f3fdb90db8-metrics-certs\") pod \"jobset-controller-manager-7474777596-9nkjx\" (UID: \"f344e9e0-e2ab-46eb-a513-c3f3fdb90db8\") " pod="openshift-jobset-operator/jobset-controller-manager-7474777596-9nkjx" Jul 27 09:59:28.648689 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:59:28.648663 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6s4c2\" (UniqueName: \"kubernetes.io/projected/f344e9e0-e2ab-46eb-a513-c3f3fdb90db8-kube-api-access-6s4c2\") pod \"jobset-controller-manager-7474777596-9nkjx\" (UID: \"f344e9e0-e2ab-46eb-a513-c3f3fdb90db8\") " pod="openshift-jobset-operator/jobset-controller-manager-7474777596-9nkjx" Jul 27 09:59:28.788531 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:59:28.788470 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-controller-manager-7474777596-9nkjx" Jul 27 09:59:28.916705 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:59:28.916646 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-controller-manager-7474777596-9nkjx"] Jul 27 09:59:28.918918 ip-10-0-139-140 kubenswrapper[2556]: W0727 09:59:28.918887 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf344e9e0_e2ab_46eb_a513_c3f3fdb90db8.slice/crio-2069e72fe5e68ff652bfb2ce4c6be32e6ddba11e218b0a15e248b0366c5de2d4 WatchSource:0}: Error finding container 2069e72fe5e68ff652bfb2ce4c6be32e6ddba11e218b0a15e248b0366c5de2d4: Status 404 returned error can't find the container with id 2069e72fe5e68ff652bfb2ce4c6be32e6ddba11e218b0a15e248b0366c5de2d4 Jul 27 09:59:29.929218 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:59:29.929178 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-controller-manager-7474777596-9nkjx" event={"ID":"f344e9e0-e2ab-46eb-a513-c3f3fdb90db8","Type":"ContainerStarted","Data":"2069e72fe5e68ff652bfb2ce4c6be32e6ddba11e218b0a15e248b0366c5de2d4"} Jul 27 09:59:31.940918 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:59:31.940884 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-controller-manager-7474777596-9nkjx" event={"ID":"f344e9e0-e2ab-46eb-a513-c3f3fdb90db8","Type":"ContainerStarted","Data":"804ef363134128583c72fce33707a21d131872336d5d035361f7235a741a7df9"} Jul 27 09:59:31.941285 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:59:31.940968 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-jobset-operator/jobset-controller-manager-7474777596-9nkjx" Jul 27 09:59:31.962386 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:59:31.962343 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-jobset-operator/jobset-controller-manager-7474777596-9nkjx" podStartSLOduration=1.835678949 podStartE2EDuration="3.96233088s" totalImagesPullingTime="2.126651931s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 09:59:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 09:59:31.960897576 +0000 UTC m=+558.551394813" watchObservedRunningTime="2026-07-27 09:59:31.96233088 +0000 UTC m=+558.552828115" Jul 27 09:59:42.950694 ip-10-0-139-140 kubenswrapper[2556]: I0727 09:59:42.950662 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-jobset-operator/jobset-controller-manager-7474777596-9nkjx" Jul 27 10:00:13.864075 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:00:13.863975 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-gqgcx_a7a42a0d-f7e2-49ba-a366-88d424f60c20/console-operator/1.log" Jul 27 10:00:13.867992 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:00:13.864611 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-gqgcx_a7a42a0d-f7e2-49ba-a366-88d424f60c20/console-operator/1.log" Jul 27 10:01:37.121653 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:37.121611 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-qlrkd_081653f9-8f80-4844-b67f-7d8965198bb6/global-pull-secret-syncer/0.log" Jul 27 10:01:37.291794 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:37.291760 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-sxq7r_be638d62-c9e5-4e50-ac56-253fa74e20c1/konnectivity-agent/0.log" Jul 27 10:01:37.368030 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:37.367943 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-140.ec2.internal_d53d4fb2319b8a6bcca414fa1eb18354/haproxy/0.log" Jul 27 10:01:41.069771 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:41.069735 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c881aeda-799d-4e82-be0c-04228ab22318/alertmanager/0.log" Jul 27 10:01:41.103853 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:41.103825 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c881aeda-799d-4e82-be0c-04228ab22318/config-reloader/0.log" Jul 27 10:01:41.131422 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:41.131395 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c881aeda-799d-4e82-be0c-04228ab22318/kube-rbac-proxy-web/0.log" Jul 27 10:01:41.159841 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:41.159817 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c881aeda-799d-4e82-be0c-04228ab22318/kube-rbac-proxy/0.log" Jul 27 10:01:41.187249 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:41.187230 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c881aeda-799d-4e82-be0c-04228ab22318/kube-rbac-proxy-metric/0.log" Jul 27 10:01:41.216049 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:41.216027 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c881aeda-799d-4e82-be0c-04228ab22318/prom-label-proxy/0.log" Jul 27 10:01:41.248220 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:41.248198 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c881aeda-799d-4e82-be0c-04228ab22318/init-config-reloader/0.log" Jul 27 10:01:41.299197 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:41.299173 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-9st6k_c7ee9b6a-d070-4453-b366-4366d0949b35/cluster-monitoring-operator/0.log" Jul 27 10:01:41.329698 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:41.329635 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-56vkh_db463516-9278-439a-bbbc-a7637a20ee85/kube-state-metrics/0.log" Jul 27 10:01:41.364871 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:41.364843 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-56vkh_db463516-9278-439a-bbbc-a7637a20ee85/kube-rbac-proxy-main/0.log" Jul 27 10:01:41.392908 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:41.392887 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-56vkh_db463516-9278-439a-bbbc-a7637a20ee85/kube-rbac-proxy-self/0.log" Jul 27 10:01:41.613168 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:41.613083 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kf8w8_426dd32e-ebd6-4471-bfa7-232df29b03bf/node-exporter/0.log" Jul 27 10:01:41.639741 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:41.639713 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kf8w8_426dd32e-ebd6-4471-bfa7-232df29b03bf/kube-rbac-proxy/0.log" Jul 27 10:01:41.672124 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:41.672102 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kf8w8_426dd32e-ebd6-4471-bfa7-232df29b03bf/init-textfile/0.log" Jul 27 10:01:42.196549 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:42.196509 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-kx4n6_24614231-7a34-435d-99ef-fa43d72bfc1f/prometheus-operator/0.log" Jul 27 10:01:42.219353 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:42.219329 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-kx4n6_24614231-7a34-435d-99ef-fa43d72bfc1f/kube-rbac-proxy/0.log" Jul 27 10:01:42.288798 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:42.288770 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-576dcf8c79-pxw2q_6e18a4eb-d978-400f-ae01-ba766e1d4cfc/telemeter-client/0.log" Jul 27 10:01:42.320523 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:42.320502 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-576dcf8c79-pxw2q_6e18a4eb-d978-400f-ae01-ba766e1d4cfc/reload/0.log" Jul 27 10:01:42.349051 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:42.349030 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-576dcf8c79-pxw2q_6e18a4eb-d978-400f-ae01-ba766e1d4cfc/kube-rbac-proxy/0.log" Jul 27 10:01:43.613487 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:43.613414 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-74c9f884b7-dsz8p_2daea300-7a7e-412b-a226-b0214ffe75a3/networking-console-plugin/0.log" Jul 27 10:01:44.081053 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:44.081027 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-gqgcx_a7a42a0d-f7e2-49ba-a366-88d424f60c20/console-operator/1.log" Jul 27 10:01:44.089191 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:44.089167 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-gqgcx_a7a42a0d-f7e2-49ba-a366-88d424f60c20/console-operator/2.log" Jul 27 10:01:44.438116 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:44.438032 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9dzxm/perf-node-gather-daemonset-7h4r6"] Jul 27 10:01:44.441709 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:44.441687 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9dzxm/perf-node-gather-daemonset-7h4r6" Jul 27 10:01:44.444952 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:44.444935 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9dzxm\"/\"openshift-service-ca.crt\"" Jul 27 10:01:44.445062 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:44.444996 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-9dzxm\"/\"default-dockercfg-fmzmv\"" Jul 27 10:01:44.446261 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:44.446243 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9dzxm\"/\"kube-root-ca.crt\"" Jul 27 10:01:44.451373 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:44.451349 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9dzxm/perf-node-gather-daemonset-7h4r6"] Jul 27 10:01:44.458446 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:44.458424 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qv7bn\" (UniqueName: \"kubernetes.io/projected/0d9595b8-1cc3-4867-a3ba-cc8f7879de09-kube-api-access-qv7bn\") pod \"perf-node-gather-daemonset-7h4r6\" (UID: \"0d9595b8-1cc3-4867-a3ba-cc8f7879de09\") " pod="openshift-must-gather-9dzxm/perf-node-gather-daemonset-7h4r6" Jul 27 10:01:44.458540 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:44.458459 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0d9595b8-1cc3-4867-a3ba-cc8f7879de09-sys\") pod \"perf-node-gather-daemonset-7h4r6\" (UID: \"0d9595b8-1cc3-4867-a3ba-cc8f7879de09\") " pod="openshift-must-gather-9dzxm/perf-node-gather-daemonset-7h4r6" Jul 27 10:01:44.458540 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:44.458474 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0d9595b8-1cc3-4867-a3ba-cc8f7879de09-proc\") pod \"perf-node-gather-daemonset-7h4r6\" (UID: \"0d9595b8-1cc3-4867-a3ba-cc8f7879de09\") " pod="openshift-must-gather-9dzxm/perf-node-gather-daemonset-7h4r6" Jul 27 10:01:44.458618 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:44.458579 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0d9595b8-1cc3-4867-a3ba-cc8f7879de09-lib-modules\") pod \"perf-node-gather-daemonset-7h4r6\" (UID: \"0d9595b8-1cc3-4867-a3ba-cc8f7879de09\") " pod="openshift-must-gather-9dzxm/perf-node-gather-daemonset-7h4r6" Jul 27 10:01:44.458662 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:44.458624 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0d9595b8-1cc3-4867-a3ba-cc8f7879de09-podres\") pod \"perf-node-gather-daemonset-7h4r6\" (UID: \"0d9595b8-1cc3-4867-a3ba-cc8f7879de09\") " pod="openshift-must-gather-9dzxm/perf-node-gather-daemonset-7h4r6" Jul 27 10:01:44.551369 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:44.551345 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7bd46f6475-68gwm_270f116b-e412-431c-a076-2bd1190a87be/console/0.log" Jul 27 10:01:44.559903 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:44.559877 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0d9595b8-1cc3-4867-a3ba-cc8f7879de09-podres\") pod \"perf-node-gather-daemonset-7h4r6\" (UID: \"0d9595b8-1cc3-4867-a3ba-cc8f7879de09\") " pod="openshift-must-gather-9dzxm/perf-node-gather-daemonset-7h4r6" Jul 27 10:01:44.560090 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:44.559919 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qv7bn\" (UniqueName: \"kubernetes.io/projected/0d9595b8-1cc3-4867-a3ba-cc8f7879de09-kube-api-access-qv7bn\") pod \"perf-node-gather-daemonset-7h4r6\" (UID: \"0d9595b8-1cc3-4867-a3ba-cc8f7879de09\") " pod="openshift-must-gather-9dzxm/perf-node-gather-daemonset-7h4r6" Jul 27 10:01:44.560090 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:44.559946 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0d9595b8-1cc3-4867-a3ba-cc8f7879de09-sys\") pod \"perf-node-gather-daemonset-7h4r6\" (UID: \"0d9595b8-1cc3-4867-a3ba-cc8f7879de09\") " pod="openshift-must-gather-9dzxm/perf-node-gather-daemonset-7h4r6" Jul 27 10:01:44.560090 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:44.559965 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0d9595b8-1cc3-4867-a3ba-cc8f7879de09-proc\") pod \"perf-node-gather-daemonset-7h4r6\" (UID: \"0d9595b8-1cc3-4867-a3ba-cc8f7879de09\") " pod="openshift-must-gather-9dzxm/perf-node-gather-daemonset-7h4r6" Jul 27 10:01:44.560090 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:44.560007 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0d9595b8-1cc3-4867-a3ba-cc8f7879de09-lib-modules\") pod \"perf-node-gather-daemonset-7h4r6\" (UID: \"0d9595b8-1cc3-4867-a3ba-cc8f7879de09\") " pod="openshift-must-gather-9dzxm/perf-node-gather-daemonset-7h4r6" Jul 27 10:01:44.560090 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:44.560024 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0d9595b8-1cc3-4867-a3ba-cc8f7879de09-sys\") pod \"perf-node-gather-daemonset-7h4r6\" (UID: \"0d9595b8-1cc3-4867-a3ba-cc8f7879de09\") " pod="openshift-must-gather-9dzxm/perf-node-gather-daemonset-7h4r6" Jul 27 10:01:44.560090 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:44.560070 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0d9595b8-1cc3-4867-a3ba-cc8f7879de09-proc\") pod \"perf-node-gather-daemonset-7h4r6\" (UID: \"0d9595b8-1cc3-4867-a3ba-cc8f7879de09\") " pod="openshift-must-gather-9dzxm/perf-node-gather-daemonset-7h4r6" Jul 27 10:01:44.560090 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:44.560032 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0d9595b8-1cc3-4867-a3ba-cc8f7879de09-podres\") pod \"perf-node-gather-daemonset-7h4r6\" (UID: \"0d9595b8-1cc3-4867-a3ba-cc8f7879de09\") " pod="openshift-must-gather-9dzxm/perf-node-gather-daemonset-7h4r6" Jul 27 10:01:44.560395 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:44.560121 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0d9595b8-1cc3-4867-a3ba-cc8f7879de09-lib-modules\") pod \"perf-node-gather-daemonset-7h4r6\" (UID: \"0d9595b8-1cc3-4867-a3ba-cc8f7879de09\") " pod="openshift-must-gather-9dzxm/perf-node-gather-daemonset-7h4r6" Jul 27 10:01:44.569827 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:44.569798 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qv7bn\" (UniqueName: \"kubernetes.io/projected/0d9595b8-1cc3-4867-a3ba-cc8f7879de09-kube-api-access-qv7bn\") pod \"perf-node-gather-daemonset-7h4r6\" (UID: \"0d9595b8-1cc3-4867-a3ba-cc8f7879de09\") " pod="openshift-must-gather-9dzxm/perf-node-gather-daemonset-7h4r6" Jul 27 10:01:44.753083 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:44.752992 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9dzxm/perf-node-gather-daemonset-7h4r6" Jul 27 10:01:44.881970 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:44.881945 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9dzxm/perf-node-gather-daemonset-7h4r6"] Jul 27 10:01:44.884289 ip-10-0-139-140 kubenswrapper[2556]: W0727 10:01:44.884259 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod0d9595b8_1cc3_4867_a3ba_cc8f7879de09.slice/crio-60a11ed9246b6801b4c467619d7ea41b665abd9b79739edfafb213c44a03b496 WatchSource:0}: Error finding container 60a11ed9246b6801b4c467619d7ea41b665abd9b79739edfafb213c44a03b496: Status 404 returned error can't find the container with id 60a11ed9246b6801b4c467619d7ea41b665abd9b79739edfafb213c44a03b496 Jul 27 10:01:45.088697 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:45.088672 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-549c6d54cf-t4c46_c8455d96-d25b-4d6a-af5d-2c2091b8e78a/volume-data-source-validator/0.log" Jul 27 10:01:45.534936 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:45.534833 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9dzxm/perf-node-gather-daemonset-7h4r6" event={"ID":"0d9595b8-1cc3-4867-a3ba-cc8f7879de09","Type":"ContainerStarted","Data":"ad876a9a20d025db9e65f53ff5f3cef46fdeb12706c701370a52a099ae160ac6"} Jul 27 10:01:45.534936 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:45.534920 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9dzxm/perf-node-gather-daemonset-7h4r6" event={"ID":"0d9595b8-1cc3-4867-a3ba-cc8f7879de09","Type":"ContainerStarted","Data":"60a11ed9246b6801b4c467619d7ea41b665abd9b79739edfafb213c44a03b496"} Jul 27 10:01:45.535164 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:45.534979 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-9dzxm/perf-node-gather-daemonset-7h4r6" Jul 27 10:01:45.554348 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:45.554283 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-9dzxm/perf-node-gather-daemonset-7h4r6" podStartSLOduration=1.554269178 podStartE2EDuration="1.554269178s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 10:01:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 10:01:45.552565771 +0000 UTC m=+692.143063019" watchObservedRunningTime="2026-07-27 10:01:45.554269178 +0000 UTC m=+692.144766411" Jul 27 10:01:45.965327 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:45.965279 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-p5w7g_3de4b7d7-40ed-495d-b81a-fecb048d11c0/dns/0.log" Jul 27 10:01:45.991715 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:45.991691 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-p5w7g_3de4b7d7-40ed-495d-b81a-fecb048d11c0/kube-rbac-proxy/0.log" Jul 27 10:01:46.070253 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:46.070221 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4mdxm_c01da73c-3338-41bb-884a-f7c145421d57/dns-node-resolver/0.log" Jul 27 10:01:46.606363 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:46.606336 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wgfkj_3400c9d3-50c8-4143-83fb-e22dbe5b627a/node-ca/0.log" Jul 27 10:01:47.921904 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:47.921876 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hbcw9_96a91a1b-f1c8-4710-9473-3c032767f309/serve-healthcheck-canary/0.log" Jul 27 10:01:48.363743 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:48.363717 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-msdf9_8fa28813-be68-4170-845e-069e6c14689d/insights-operator/1.log" Jul 27 10:01:48.364745 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:48.364711 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-msdf9_8fa28813-be68-4170-845e-069e6c14689d/insights-operator/0.log" Jul 27 10:01:48.497611 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:48.497581 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rmdcz_a7160ea4-3ff4-4f76-b373-bc30be56f1f9/kube-rbac-proxy/0.log" Jul 27 10:01:48.524789 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:48.524765 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rmdcz_a7160ea4-3ff4-4f76-b373-bc30be56f1f9/exporter/0.log" Jul 27 10:01:48.553100 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:48.553075 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rmdcz_a7160ea4-3ff4-4f76-b373-bc30be56f1f9/extractor/0.log" Jul 27 10:01:50.252825 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:50.252791 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-jobset-operator_jobset-controller-manager-7474777596-9nkjx_f344e9e0-e2ab-46eb-a513-c3f3fdb90db8/manager/0.log" Jul 27 10:01:50.291983 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:50.291951 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-jobset-operator_jobset-operator-5bc45f897-fpfm8_8f965b23-624e-40a7-80df-20bb21536cda/jobset-operator/0.log" Jul 27 10:01:51.553420 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:51.553393 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-9dzxm/perf-node-gather-daemonset-7h4r6" Jul 27 10:01:54.001048 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:54.001022 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-vzhdc_2e6cbabb-aed7-441b-8c0b-1e95cafd32a4/migrator/0.log" Jul 27 10:01:54.045479 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:54.045404 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-vzhdc_2e6cbabb-aed7-441b-8c0b-1e95cafd32a4/graceful-termination/0.log" Jul 27 10:01:54.510901 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:54.510870 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-85f9c64bd-5hvb4"] Jul 27 10:01:54.514240 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:54.514220 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85f9c64bd-5hvb4" Jul 27 10:01:54.524456 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:54.524435 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-85f9c64bd-5hvb4"] Jul 27 10:01:54.545542 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:54.545506 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqdbj\" (UniqueName: \"kubernetes.io/projected/ae624118-0621-4d8c-855c-e77e58b30a45-kube-api-access-zqdbj\") pod \"console-85f9c64bd-5hvb4\" (UID: \"ae624118-0621-4d8c-855c-e77e58b30a45\") " pod="openshift-console/console-85f9c64bd-5hvb4" Jul 27 10:01:54.545730 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:54.545621 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ae624118-0621-4d8c-855c-e77e58b30a45-console-config\") pod \"console-85f9c64bd-5hvb4\" (UID: \"ae624118-0621-4d8c-855c-e77e58b30a45\") " pod="openshift-console/console-85f9c64bd-5hvb4" Jul 27 10:01:54.545730 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:54.545649 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ae624118-0621-4d8c-855c-e77e58b30a45-oauth-serving-cert\") pod \"console-85f9c64bd-5hvb4\" (UID: \"ae624118-0621-4d8c-855c-e77e58b30a45\") " pod="openshift-console/console-85f9c64bd-5hvb4" Jul 27 10:01:54.545730 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:54.545693 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ae624118-0621-4d8c-855c-e77e58b30a45-console-oauth-config\") pod \"console-85f9c64bd-5hvb4\" (UID: \"ae624118-0621-4d8c-855c-e77e58b30a45\") " pod="openshift-console/console-85f9c64bd-5hvb4" Jul 27 10:01:54.545730 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:54.545717 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae624118-0621-4d8c-855c-e77e58b30a45-trusted-ca-bundle\") pod \"console-85f9c64bd-5hvb4\" (UID: \"ae624118-0621-4d8c-855c-e77e58b30a45\") " pod="openshift-console/console-85f9c64bd-5hvb4" Jul 27 10:01:54.545909 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:54.545741 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ae624118-0621-4d8c-855c-e77e58b30a45-service-ca\") pod \"console-85f9c64bd-5hvb4\" (UID: \"ae624118-0621-4d8c-855c-e77e58b30a45\") " pod="openshift-console/console-85f9c64bd-5hvb4" Jul 27 10:01:54.545909 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:54.545771 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ae624118-0621-4d8c-855c-e77e58b30a45-console-serving-cert\") pod \"console-85f9c64bd-5hvb4\" (UID: \"ae624118-0621-4d8c-855c-e77e58b30a45\") " pod="openshift-console/console-85f9c64bd-5hvb4" Jul 27 10:01:54.646692 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:54.646663 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ae624118-0621-4d8c-855c-e77e58b30a45-console-config\") pod \"console-85f9c64bd-5hvb4\" (UID: \"ae624118-0621-4d8c-855c-e77e58b30a45\") " pod="openshift-console/console-85f9c64bd-5hvb4" Jul 27 10:01:54.646692 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:54.646694 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ae624118-0621-4d8c-855c-e77e58b30a45-oauth-serving-cert\") pod \"console-85f9c64bd-5hvb4\" (UID: \"ae624118-0621-4d8c-855c-e77e58b30a45\") " pod="openshift-console/console-85f9c64bd-5hvb4" Jul 27 10:01:54.646936 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:54.646728 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ae624118-0621-4d8c-855c-e77e58b30a45-console-oauth-config\") pod \"console-85f9c64bd-5hvb4\" (UID: \"ae624118-0621-4d8c-855c-e77e58b30a45\") " pod="openshift-console/console-85f9c64bd-5hvb4" Jul 27 10:01:54.646936 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:54.646849 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae624118-0621-4d8c-855c-e77e58b30a45-trusted-ca-bundle\") pod \"console-85f9c64bd-5hvb4\" (UID: \"ae624118-0621-4d8c-855c-e77e58b30a45\") " pod="openshift-console/console-85f9c64bd-5hvb4" Jul 27 10:01:54.646936 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:54.646886 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ae624118-0621-4d8c-855c-e77e58b30a45-service-ca\") pod \"console-85f9c64bd-5hvb4\" (UID: \"ae624118-0621-4d8c-855c-e77e58b30a45\") " pod="openshift-console/console-85f9c64bd-5hvb4" Jul 27 10:01:54.646936 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:54.646922 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ae624118-0621-4d8c-855c-e77e58b30a45-console-serving-cert\") pod \"console-85f9c64bd-5hvb4\" (UID: \"ae624118-0621-4d8c-855c-e77e58b30a45\") " pod="openshift-console/console-85f9c64bd-5hvb4" Jul 27 10:01:54.647133 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:54.647001 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqdbj\" (UniqueName: \"kubernetes.io/projected/ae624118-0621-4d8c-855c-e77e58b30a45-kube-api-access-zqdbj\") pod \"console-85f9c64bd-5hvb4\" (UID: \"ae624118-0621-4d8c-855c-e77e58b30a45\") " pod="openshift-console/console-85f9c64bd-5hvb4" Jul 27 10:01:54.647476 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:54.647449 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ae624118-0621-4d8c-855c-e77e58b30a45-console-config\") pod \"console-85f9c64bd-5hvb4\" (UID: \"ae624118-0621-4d8c-855c-e77e58b30a45\") " pod="openshift-console/console-85f9c64bd-5hvb4" Jul 27 10:01:54.647733 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:54.647678 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ae624118-0621-4d8c-855c-e77e58b30a45-service-ca\") pod \"console-85f9c64bd-5hvb4\" (UID: \"ae624118-0621-4d8c-855c-e77e58b30a45\") " pod="openshift-console/console-85f9c64bd-5hvb4" Jul 27 10:01:54.647833 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:54.647735 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae624118-0621-4d8c-855c-e77e58b30a45-trusted-ca-bundle\") pod \"console-85f9c64bd-5hvb4\" (UID: \"ae624118-0621-4d8c-855c-e77e58b30a45\") " pod="openshift-console/console-85f9c64bd-5hvb4" Jul 27 10:01:54.647833 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:54.647746 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ae624118-0621-4d8c-855c-e77e58b30a45-oauth-serving-cert\") pod \"console-85f9c64bd-5hvb4\" (UID: \"ae624118-0621-4d8c-855c-e77e58b30a45\") " pod="openshift-console/console-85f9c64bd-5hvb4" Jul 27 10:01:54.649289 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:54.649273 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ae624118-0621-4d8c-855c-e77e58b30a45-console-oauth-config\") pod \"console-85f9c64bd-5hvb4\" (UID: \"ae624118-0621-4d8c-855c-e77e58b30a45\") " pod="openshift-console/console-85f9c64bd-5hvb4" Jul 27 10:01:54.649488 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:54.649472 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ae624118-0621-4d8c-855c-e77e58b30a45-console-serving-cert\") pod \"console-85f9c64bd-5hvb4\" (UID: \"ae624118-0621-4d8c-855c-e77e58b30a45\") " pod="openshift-console/console-85f9c64bd-5hvb4" Jul 27 10:01:54.664773 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:54.664751 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqdbj\" (UniqueName: \"kubernetes.io/projected/ae624118-0621-4d8c-855c-e77e58b30a45-kube-api-access-zqdbj\") pod \"console-85f9c64bd-5hvb4\" (UID: \"ae624118-0621-4d8c-855c-e77e58b30a45\") " pod="openshift-console/console-85f9c64bd-5hvb4" Jul 27 10:01:54.823763 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:54.823734 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85f9c64bd-5hvb4" Jul 27 10:01:54.958950 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:54.958928 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-85f9c64bd-5hvb4"] Jul 27 10:01:54.961097 ip-10-0-139-140 kubenswrapper[2556]: W0727 10:01:54.961073 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae624118_0621_4d8c_855c_e77e58b30a45.slice/crio-3ea890ff0eee0426bc4a333284e3314dfd4315cab1389e9b0ce88494970062dc WatchSource:0}: Error finding container 3ea890ff0eee0426bc4a333284e3314dfd4315cab1389e9b0ce88494970062dc: Status 404 returned error can't find the container with id 3ea890ff0eee0426bc4a333284e3314dfd4315cab1389e9b0ce88494970062dc Jul 27 10:01:55.594917 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:55.594887 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85f9c64bd-5hvb4" event={"ID":"ae624118-0621-4d8c-855c-e77e58b30a45","Type":"ContainerStarted","Data":"86725149df0b0be8e4c6ae1b1177ee26e18178d3324bbe3abdaa15ed4f3093d7"} Jul 27 10:01:55.595259 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:55.594959 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85f9c64bd-5hvb4" event={"ID":"ae624118-0621-4d8c-855c-e77e58b30a45","Type":"ContainerStarted","Data":"3ea890ff0eee0426bc4a333284e3314dfd4315cab1389e9b0ce88494970062dc"} Jul 27 10:01:55.614523 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:55.614461 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-85f9c64bd-5hvb4" podStartSLOduration=1.614415727 podStartE2EDuration="1.614415727s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 10:01:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 10:01:55.613686964 +0000 UTC m=+702.204184197" watchObservedRunningTime="2026-07-27 10:01:55.614415727 +0000 UTC m=+702.204912960" Jul 27 10:01:56.035981 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:56.035910 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-w2txx_b4deab12-8c9e-4151-81f3-6c87e474578e/kube-multus-additional-cni-plugins/0.log" Jul 27 10:01:56.059973 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:56.059943 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-w2txx_b4deab12-8c9e-4151-81f3-6c87e474578e/egress-router-binary-copy/0.log" Jul 27 10:01:56.084864 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:56.084843 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-w2txx_b4deab12-8c9e-4151-81f3-6c87e474578e/cni-plugins/0.log" Jul 27 10:01:56.113469 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:56.113450 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-w2txx_b4deab12-8c9e-4151-81f3-6c87e474578e/bond-cni-plugin/0.log" Jul 27 10:01:56.143784 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:56.143765 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-w2txx_b4deab12-8c9e-4151-81f3-6c87e474578e/routeoverride-cni/0.log" Jul 27 10:01:56.183253 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:56.183231 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-w2txx_b4deab12-8c9e-4151-81f3-6c87e474578e/whereabouts-cni-bincopy/0.log" Jul 27 10:01:56.212463 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:56.212442 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-w2txx_b4deab12-8c9e-4151-81f3-6c87e474578e/whereabouts-cni/0.log" Jul 27 10:01:56.324750 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:56.324726 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-sxn5x_876d6010-7686-42f7-86e0-773c644257af/kube-multus/0.log" Jul 27 10:01:56.411936 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:56.411905 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-cl9xw_27f2e8fc-173e-43ff-b7a6-0bd6e8b54d40/network-metrics-daemon/0.log" Jul 27 10:01:56.442750 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:56.442731 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-cl9xw_27f2e8fc-173e-43ff-b7a6-0bd6e8b54d40/kube-rbac-proxy/0.log" Jul 27 10:01:58.006712 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:58.006682 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ph68r_e722c870-2401-4465-a42b-c9e3305f15c2/ovn-controller/0.log" Jul 27 10:01:58.034771 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:58.034712 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ph68r_e722c870-2401-4465-a42b-c9e3305f15c2/ovn-acl-logging/0.log" Jul 27 10:01:58.072578 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:58.072549 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ph68r_e722c870-2401-4465-a42b-c9e3305f15c2/kube-rbac-proxy-node/0.log" Jul 27 10:01:58.105591 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:58.105563 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ph68r_e722c870-2401-4465-a42b-c9e3305f15c2/kube-rbac-proxy-ovn-metrics/0.log" Jul 27 10:01:58.126259 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:58.126240 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ph68r_e722c870-2401-4465-a42b-c9e3305f15c2/northd/0.log" Jul 27 10:01:58.155228 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:58.155205 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ph68r_e722c870-2401-4465-a42b-c9e3305f15c2/nbdb/0.log" Jul 27 10:01:58.185787 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:58.185769 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ph68r_e722c870-2401-4465-a42b-c9e3305f15c2/sbdb/0.log" Jul 27 10:01:58.246715 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:58.246694 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ph68r_e722c870-2401-4465-a42b-c9e3305f15c2/ovnkube-controller/0.log" Jul 27 10:01:59.455392 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:01:59.455362 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-hlhxc_4c375e68-a7a1-414b-9d33-3040925415f4/network-check-target-container/0.log" Jul 27 10:02:00.612125 ip-10-0-139-140 kubenswrapper[2556]: I0727 10:02:00.612095 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-7sb2h_c5018771-30e7-4be6-9603-43580e63bde0/iptables-alerter/0.log"