Jul 24 11:23:28.870873 ip-10-0-137-219 systemd[1]: Starting Kubernetes Kubelet... Jul 24 11:23:29.298373 ip-10-0-137-219 kubenswrapper[2586]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 24 11:23:29.298373 ip-10-0-137-219 kubenswrapper[2586]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 24 11:23:29.298373 ip-10-0-137-219 kubenswrapper[2586]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 24 11:23:29.298373 ip-10-0-137-219 kubenswrapper[2586]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 24 11:23:29.298373 ip-10-0-137-219 kubenswrapper[2586]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 24 11:23:29.298373 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.271328 2586 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 24 11:23:29.298373 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.275823 2586 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 11:23:29.298373 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.275838 2586 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 11:23:29.298373 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.275843 2586 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 11:23:29.298373 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.275848 2586 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 11:23:29.298373 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.275853 2586 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 11:23:29.298373 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.275857 2586 feature_gate.go:328] unrecognized feature gate: Example Jul 24 11:23:29.298373 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.275862 2586 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 11:23:29.298373 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.275866 2586 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 11:23:29.305871 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.275870 2586 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 11:23:29.305871 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.275876 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 11:23:29.305871 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.275880 2586 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 11:23:29.305871 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.275885 2586 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 11:23:29.305871 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.275888 2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 11:23:29.305871 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.275892 2586 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 11:23:29.305871 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.275896 2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 11:23:29.305871 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.275900 2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 11:23:29.305871 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.275904 2586 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 11:23:29.305871 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.275909 2586 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 11:23:29.305871 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.275913 2586 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 11:23:29.305871 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.275917 2586 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 11:23:29.305871 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.275920 2586 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 11:23:29.305871 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.275924 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 11:23:29.305871 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.275930 2586 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 11:23:29.305871 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.275935 2586 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 11:23:29.305871 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.275939 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 11:23:29.305871 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.275944 2586 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 11:23:29.305871 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.275948 2586 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 11:23:29.306759 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.275953 2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 11:23:29.306759 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.275957 2586 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 11:23:29.306759 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.275961 2586 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 11:23:29.306759 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.275965 2586 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 11:23:29.306759 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.275969 2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 11:23:29.306759 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.275973 2586 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 11:23:29.306759 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.275977 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 11:23:29.306759 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.275981 2586 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 11:23:29.306759 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.275985 2586 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 11:23:29.306759 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.275989 2586 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 11:23:29.306759 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.275994 2586 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 11:23:29.306759 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.275997 2586 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 11:23:29.306759 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.276001 2586 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 11:23:29.306759 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.276004 2586 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 11:23:29.306759 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.276008 2586 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 11:23:29.306759 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.276011 2586 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 11:23:29.306759 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.276015 2586 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 11:23:29.306759 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.276019 2586 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 11:23:29.306759 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.276023 2586 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 11:23:29.307835 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.276027 2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 11:23:29.307835 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.276031 2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 11:23:29.307835 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.276034 2586 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 11:23:29.307835 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.276038 2586 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 11:23:29.307835 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.276042 2586 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 11:23:29.307835 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.276046 2586 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 11:23:29.307835 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.276050 2586 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 11:23:29.307835 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.276054 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 11:23:29.307835 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.276057 2586 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 11:23:29.307835 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.276061 2586 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 11:23:29.307835 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.276065 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 11:23:29.307835 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.276068 2586 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 11:23:29.307835 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.276073 2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 11:23:29.307835 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.276076 2586 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 11:23:29.307835 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.276080 2586 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 11:23:29.307835 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.276084 2586 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 11:23:29.307835 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.276088 2586 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 11:23:29.307835 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.276091 2586 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 11:23:29.307835 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.276095 2586 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 11:23:29.307835 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.276099 2586 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 11:23:29.308720 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.276103 2586 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 11:23:29.308720 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.276107 2586 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 11:23:29.308720 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.276111 2586 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 11:23:29.308720 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.276114 2586 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 11:23:29.308720 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.276118 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 11:23:29.308720 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.276122 2586 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 11:23:29.308720 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.276126 2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 11:23:29.308720 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.276130 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 11:23:29.308720 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.276133 2586 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 11:23:29.308720 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.276136 2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 11:23:29.308720 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.276140 2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 11:23:29.308720 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.276144 2586 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 11:23:29.308720 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.276147 2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 11:23:29.308720 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.276153 2586 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 11:23:29.308720 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.276158 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 11:23:29.308720 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.276162 2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 11:23:29.308720 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.276166 2586 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 11:23:29.308720 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.276170 2586 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 11:23:29.308720 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.276174 2586 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 11:23:29.309591 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.276178 2586 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 11:23:29.309591 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.276182 2586 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 11:23:29.309591 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.276185 2586 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 11:23:29.309591 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.276189 2586 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 11:23:29.309591 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.276195 2586 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 11:23:29.309591 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.276198 2586 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 11:23:29.309591 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.276202 2586 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 11:23:29.309591 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.276207 2586 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 11:23:29.309591 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.276211 2586 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 11:23:29.309591 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.276215 2586 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 11:23:29.309591 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.276219 2586 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 11:23:29.309591 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.276222 2586 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 11:23:29.309591 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.276227 2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 11:23:29.309591 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.276233 2586 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 11:23:29.309591 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.290523 2586 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 11:23:29.309591 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.290552 2586 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 11:23:29.309591 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.290559 2586 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 11:23:29.309591 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.290567 2586 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 11:23:29.309591 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.290595 2586 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 11:23:29.310445 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.290601 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 11:23:29.310445 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.290606 2586 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 11:23:29.310445 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.290612 2586 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 11:23:29.310445 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.290617 2586 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 11:23:29.310445 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.290624 2586 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 11:23:29.310445 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.290628 2586 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 11:23:29.310445 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.290632 2586 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 11:23:29.310445 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.290639 2586 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 11:23:29.310445 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.290643 2586 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 11:23:29.310445 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.290651 2586 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 11:23:29.310445 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.290665 2586 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 11:23:29.310445 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.290678 2586 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 11:23:29.310445 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.290682 2586 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 11:23:29.310445 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.290689 2586 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 11:23:29.310445 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.290695 2586 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 11:23:29.310445 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.290700 2586 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 11:23:29.310445 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.290704 2586 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 11:23:29.310445 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.290709 2586 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 11:23:29.310445 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.290713 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 11:23:29.311302 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.290722 2586 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 11:23:29.311302 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.290726 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 11:23:29.311302 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.290733 2586 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 11:23:29.311302 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.290738 2586 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 11:23:29.311302 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.290745 2586 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 11:23:29.311302 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.290756 2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 11:23:29.311302 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.290760 2586 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 11:23:29.311302 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.290767 2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 11:23:29.311302 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.290773 2586 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 11:23:29.311302 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.290787 2586 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 11:23:29.311302 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.290795 2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 11:23:29.311302 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.290799 2586 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 11:23:29.311302 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.290806 2586 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 11:23:29.311302 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.290811 2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 11:23:29.311302 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.290817 2586 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 11:23:29.311302 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.290821 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 11:23:29.311302 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.290831 2586 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 11:23:29.311302 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.290836 2586 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 11:23:29.311302 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.290843 2586 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 11:23:29.311302 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.290846 2586 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 11:23:29.312380 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.290852 2586 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 11:23:29.312380 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.290857 2586 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 11:23:29.312380 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.290866 2586 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 11:23:29.312380 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.290871 2586 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 11:23:29.312380 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.290878 2586 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 11:23:29.312380 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.290883 2586 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 11:23:29.312380 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.290890 2586 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 11:23:29.312380 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.290895 2586 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 11:23:29.312380 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.290901 2586 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 11:23:29.312380 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.290912 2586 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 11:23:29.312380 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.290917 2586 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 11:23:29.312380 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.290921 2586 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 11:23:29.312380 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.290925 2586 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 11:23:29.312380 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.290928 2586 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 11:23:29.312380 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.290934 2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 11:23:29.312380 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.290937 2586 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 11:23:29.312380 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.290941 2586 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 11:23:29.312380 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.290946 2586 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 11:23:29.312380 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.290948 2586 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 11:23:29.312380 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.290951 2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 11:23:29.313247 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.290956 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 11:23:29.313247 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.290959 2586 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 11:23:29.313247 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.290972 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 11:23:29.313247 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.290975 2586 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 11:23:29.313247 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.290980 2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 11:23:29.313247 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.290984 2586 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 11:23:29.313247 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.290991 2586 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 11:23:29.313247 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.290995 2586 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 11:23:29.313247 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.290998 2586 feature_gate.go:328] unrecognized feature gate: Example Jul 24 11:23:29.313247 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.291002 2586 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 11:23:29.313247 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.291006 2586 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 11:23:29.313247 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.291010 2586 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 11:23:29.313247 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.291015 2586 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 11:23:29.313247 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.291021 2586 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 11:23:29.313247 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.291024 2586 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 11:23:29.313247 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.291029 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 11:23:29.313247 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.291035 2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 11:23:29.313247 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.291040 2586 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 11:23:29.313247 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.291043 2586 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 11:23:29.313247 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.291046 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 11:23:29.314116 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.291051 2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 11:23:29.314116 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.291055 2586 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 11:23:29.314116 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.291057 2586 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 11:23:29.314116 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.291062 2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 11:23:29.314116 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.291065 2586 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 11:23:29.314116 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.291071 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 11:23:29.314116 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.291076 2586 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 11:23:29.314116 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.291079 2586 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 11:23:29.314116 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.291082 2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 11:23:29.314116 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.291087 2586 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 11:23:29.314116 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.291090 2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 11:23:29.314116 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.291092 2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 11:23:29.314116 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.291095 2586 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 11:23:29.314116 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.291100 2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 11:23:29.314116 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.291102 2586 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 11:23:29.314116 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.292061 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 11:23:29.314116 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.292070 2586 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 11:23:29.314116 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.292073 2586 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 11:23:29.314116 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.292076 2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 11:23:29.314116 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.292083 2586 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 11:23:29.314988 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.292086 2586 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 11:23:29.314988 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.292089 2586 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 11:23:29.314988 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.292094 2586 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 11:23:29.314988 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.292097 2586 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 11:23:29.314988 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.292100 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 11:23:29.314988 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.292104 2586 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 11:23:29.314988 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.292107 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 11:23:29.314988 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.292110 2586 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 11:23:29.314988 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.292118 2586 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 11:23:29.314988 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.292121 2586 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 11:23:29.314988 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.292124 2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 11:23:29.314988 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.292128 2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 11:23:29.314988 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.292134 2586 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 11:23:29.314988 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.292137 2586 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 11:23:29.314988 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.292142 2586 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 11:23:29.314988 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.292146 2586 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 11:23:29.314988 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.292152 2586 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 11:23:29.314988 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.292156 2586 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 11:23:29.314988 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.292160 2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 11:23:29.315858 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.292164 2586 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 11:23:29.315858 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.292167 2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 11:23:29.315858 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.292174 2586 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 11:23:29.315858 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.292176 2586 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 11:23:29.315858 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.292179 2586 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 11:23:29.315858 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.292186 2586 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 11:23:29.315858 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.292189 2586 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 11:23:29.315858 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.292192 2586 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 11:23:29.315858 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.292203 2586 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 11:23:29.315858 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.292208 2586 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 11:23:29.315858 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.292211 2586 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 11:23:29.315858 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.292213 2586 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 11:23:29.315858 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.292216 2586 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 11:23:29.315858 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.292220 2586 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 11:23:29.315858 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.292223 2586 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 11:23:29.315858 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.292225 2586 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 11:23:29.315858 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.292228 2586 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 11:23:29.315858 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.292233 2586 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 11:23:29.315858 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.292238 2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 11:23:29.316722 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.292240 2586 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 11:23:29.316722 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.292245 2586 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 11:23:29.316722 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.292250 2586 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 11:23:29.316722 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.292252 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 11:23:29.316722 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.292257 2586 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 11:23:29.316722 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.292260 2586 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 11:23:29.316722 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.292265 2586 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 11:23:29.316722 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.292270 2586 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 11:23:29.316722 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.292273 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 11:23:29.316722 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.292275 2586 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 11:23:29.316722 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.292280 2586 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 11:23:29.316722 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.292286 2586 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 11:23:29.316722 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.292289 2586 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 11:23:29.316722 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.292293 2586 feature_gate.go:328] unrecognized feature gate: Example Jul 24 11:23:29.316722 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.292296 2586 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 11:23:29.316722 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.292299 2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 11:23:29.316722 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.292303 2586 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 11:23:29.316722 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.292306 2586 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 11:23:29.316722 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.292309 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 11:23:29.316722 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.292312 2586 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 11:23:29.317609 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.292318 2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 11:23:29.317609 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.292321 2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 11:23:29.317609 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.292339 2586 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 11:23:29.317609 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.292345 2586 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 11:23:29.317609 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.292350 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 11:23:29.317609 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.292353 2586 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 11:23:29.317609 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.292355 2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 11:23:29.317609 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.292358 2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 11:23:29.317609 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.292363 2586 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 11:23:29.317609 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.292366 2586 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 11:23:29.317609 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.292369 2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 11:23:29.317609 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.292374 2586 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 11:23:29.317609 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.292377 2586 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 11:23:29.317609 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.292379 2586 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 11:23:29.317609 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.292384 2586 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 11:23:29.317609 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.292390 2586 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 11:23:29.317609 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.292395 2586 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 11:23:29.317609 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.292398 2586 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 11:23:29.317609 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.292400 2586 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 11:23:29.317609 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.292403 2586 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 11:23:29.318462 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.292409 2586 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 11:23:29.318462 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.292412 2586 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 11:23:29.318462 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.292417 2586 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 11:23:29.318462 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.292421 2586 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 11:23:29.318462 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.292425 2586 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 11:23:29.318462 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.292431 2586 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 11:23:29.318462 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.292434 2586 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 11:23:29.318462 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.292441 2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 11:23:29.318462 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.292444 2586 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 11:23:29.318462 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.292447 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 11:23:29.318462 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.292449 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 11:23:29.318462 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.292454 2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 11:23:29.318462 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.292457 2586 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 11:23:29.318462 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.292460 2586 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 11:23:29.318462 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.292462 2586 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 11:23:29.318462 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.292474 2586 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 11:23:29.318462 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.292609 2586 flags.go:64] FLAG: --address="0.0.0.0" Jul 24 11:23:29.318462 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.292619 2586 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 24 11:23:29.318462 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.292631 2586 flags.go:64] FLAG: --anonymous-auth="true" Jul 24 11:23:29.318462 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.292635 2586 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 24 11:23:29.318462 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.292644 2586 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 24 11:23:29.319535 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.292648 2586 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 24 11:23:29.319535 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.292654 2586 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 24 11:23:29.319535 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.292659 2586 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 24 11:23:29.319535 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.292665 2586 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 24 11:23:29.319535 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.292668 2586 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 24 11:23:29.319535 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.292675 2586 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 24 11:23:29.319535 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.292679 2586 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 24 11:23:29.319535 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.292686 2586 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 24 11:23:29.319535 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.292690 2586 flags.go:64] FLAG: --cgroup-root="" Jul 24 11:23:29.319535 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.292693 2586 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 24 11:23:29.319535 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.292698 2586 flags.go:64] FLAG: --client-ca-file="" Jul 24 11:23:29.319535 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.292704 2586 flags.go:64] FLAG: --cloud-provider="external" Jul 24 11:23:29.319535 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.292707 2586 flags.go:64] FLAG: --cluster-dns="[]" Jul 24 11:23:29.319535 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.292716 2586 flags.go:64] FLAG: --cluster-domain="" Jul 24 11:23:29.319535 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.292719 2586 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 24 11:23:29.319535 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.292724 2586 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 24 11:23:29.319535 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.292730 2586 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 24 11:23:29.319535 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.292736 2586 flags.go:64] FLAG: --container-log-max-files="5" Jul 24 11:23:29.319535 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.292741 2586 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 24 11:23:29.319535 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.292746 2586 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 24 11:23:29.319535 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.292749 2586 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 24 11:23:29.319535 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.292753 2586 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 24 11:23:29.319535 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.292758 2586 flags.go:64] FLAG: --contention-profiling="false" Jul 24 11:23:29.319535 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.292762 2586 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 24 11:23:29.320616 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.292775 2586 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 24 11:23:29.320616 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.292778 2586 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 24 11:23:29.320616 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.292783 2586 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 24 11:23:29.320616 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.292795 2586 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 24 11:23:29.320616 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.292799 2586 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 24 11:23:29.320616 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.292809 2586 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 24 11:23:29.320616 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.292814 2586 flags.go:64] FLAG: --enable-load-reader="false" Jul 24 11:23:29.320616 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.292818 2586 flags.go:64] FLAG: --enable-server="true" Jul 24 11:23:29.320616 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.292824 2586 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 24 11:23:29.320616 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.292834 2586 flags.go:64] FLAG: --event-burst="100" Jul 24 11:23:29.320616 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.292839 2586 flags.go:64] FLAG: --event-qps="50" Jul 24 11:23:29.320616 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.292842 2586 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 24 11:23:29.320616 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.292846 2586 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 24 11:23:29.320616 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.292852 2586 flags.go:64] FLAG: --eviction-hard="" Jul 24 11:23:29.320616 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.292856 2586 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 24 11:23:29.320616 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.292859 2586 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 24 11:23:29.320616 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.292867 2586 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 24 11:23:29.320616 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.292871 2586 flags.go:64] FLAG: --eviction-soft="" Jul 24 11:23:29.320616 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.292876 2586 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 24 11:23:29.320616 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.292881 2586 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 24 11:23:29.320616 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.292886 2586 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 24 11:23:29.320616 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.292889 2586 flags.go:64] FLAG: --experimental-mounter-path="" Jul 24 11:23:29.320616 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.292892 2586 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 24 11:23:29.320616 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.292905 2586 flags.go:64] FLAG: --fail-swap-on="true" Jul 24 11:23:29.320616 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.292913 2586 flags.go:64] FLAG: --feature-gates="" Jul 24 11:23:29.321701 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.292918 2586 flags.go:64] FLAG: --file-check-frequency="20s" Jul 24 11:23:29.321701 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.292921 2586 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 24 11:23:29.321701 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.292927 2586 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 24 11:23:29.321701 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.292930 2586 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 24 11:23:29.321701 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.292935 2586 flags.go:64] FLAG: --healthz-port="10248" Jul 24 11:23:29.321701 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.292939 2586 flags.go:64] FLAG: --help="false" Jul 24 11:23:29.321701 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.292942 2586 flags.go:64] FLAG: --hostname-override="ip-10-0-137-219.ec2.internal" Jul 24 11:23:29.321701 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.292947 2586 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 24 11:23:29.321701 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.292953 2586 flags.go:64] FLAG: --http-check-frequency="20s" Jul 24 11:23:29.321701 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.292958 2586 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 24 11:23:29.321701 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.292961 2586 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 24 11:23:29.321701 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.292978 2586 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 24 11:23:29.321701 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.292984 2586 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 24 11:23:29.321701 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.292987 2586 flags.go:64] FLAG: --image-service-endpoint="" Jul 24 11:23:29.321701 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.292990 2586 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 24 11:23:29.321701 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.292995 2586 flags.go:64] FLAG: --kube-api-burst="100" Jul 24 11:23:29.321701 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.293000 2586 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 24 11:23:29.321701 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.293005 2586 flags.go:64] FLAG: --kube-api-qps="50" Jul 24 11:23:29.321701 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.293008 2586 flags.go:64] FLAG: --kube-reserved="" Jul 24 11:23:29.321701 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.293012 2586 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 24 11:23:29.321701 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.293016 2586 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 24 11:23:29.321701 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.293019 2586 flags.go:64] FLAG: --kubelet-cgroups="" Jul 24 11:23:29.321701 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.293022 2586 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 24 11:23:29.321701 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.293027 2586 flags.go:64] FLAG: --lock-file="" Jul 24 11:23:29.322824 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.293030 2586 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 24 11:23:29.322824 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.293038 2586 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 24 11:23:29.322824 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.293049 2586 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 24 11:23:29.322824 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.293054 2586 flags.go:64] FLAG: --log-json-split-stream="false" Jul 24 11:23:29.322824 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.293059 2586 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 24 11:23:29.322824 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.293063 2586 flags.go:64] FLAG: --log-text-split-stream="false" Jul 24 11:23:29.322824 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.293066 2586 flags.go:64] FLAG: --logging-format="text" Jul 24 11:23:29.322824 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.293071 2586 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 24 11:23:29.322824 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.293075 2586 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 24 11:23:29.322824 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.293082 2586 flags.go:64] FLAG: --manifest-url="" Jul 24 11:23:29.322824 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.293086 2586 flags.go:64] FLAG: --manifest-url-header="" Jul 24 11:23:29.322824 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.293090 2586 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 24 11:23:29.322824 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.293095 2586 flags.go:64] FLAG: --max-open-files="1000000" Jul 24 11:23:29.322824 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.293100 2586 flags.go:64] FLAG: --max-pods="110" Jul 24 11:23:29.322824 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.293103 2586 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 24 11:23:29.322824 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.293108 2586 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 24 11:23:29.322824 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.293112 2586 flags.go:64] FLAG: --memory-manager-policy="None" Jul 24 11:23:29.322824 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.293115 2586 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 24 11:23:29.322824 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.293123 2586 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 24 11:23:29.322824 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.293126 2586 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 24 11:23:29.322824 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.293137 2586 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 24 11:23:29.322824 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.293147 2586 flags.go:64] FLAG: --node-status-max-images="50" Jul 24 11:23:29.322824 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.293150 2586 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 24 11:23:29.322824 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.293156 2586 flags.go:64] FLAG: --oom-score-adj="-999" Jul 24 11:23:29.322824 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.293159 2586 flags.go:64] FLAG: --pod-cidr="" Jul 24 11:23:29.323907 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.293167 2586 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb" Jul 24 11:23:29.323907 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.293173 2586 flags.go:64] FLAG: --pod-manifest-path="" Jul 24 11:23:29.323907 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.293178 2586 flags.go:64] FLAG: --pod-max-pids="-1" Jul 24 11:23:29.323907 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.293181 2586 flags.go:64] FLAG: --pods-per-core="0" Jul 24 11:23:29.323907 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.293188 2586 flags.go:64] FLAG: --port="10250" Jul 24 11:23:29.323907 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.293191 2586 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 24 11:23:29.323907 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.293195 2586 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0806ecd5256fead96" Jul 24 11:23:29.323907 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.293200 2586 flags.go:64] FLAG: --qos-reserved="" Jul 24 11:23:29.323907 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.293206 2586 flags.go:64] FLAG: --read-only-port="10255" Jul 24 11:23:29.323907 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.293212 2586 flags.go:64] FLAG: --register-node="true" Jul 24 11:23:29.323907 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.293215 2586 flags.go:64] FLAG: --register-with-taints="" Jul 24 11:23:29.323907 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.293219 2586 flags.go:64] FLAG: --registry-burst="10" Jul 24 11:23:29.323907 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.293222 2586 flags.go:64] FLAG: --registry-qps="5" Jul 24 11:23:29.323907 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.293225 2586 flags.go:64] FLAG: --reserved-cpus="" Jul 24 11:23:29.323907 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.293228 2586 flags.go:64] FLAG: --reserved-memory="" Jul 24 11:23:29.323907 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.293234 2586 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 24 11:23:29.323907 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.293239 2586 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 24 11:23:29.323907 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.293244 2586 flags.go:64] FLAG: --rotate-certificates="false" Jul 24 11:23:29.323907 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.293248 2586 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 24 11:23:29.323907 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.293251 2586 flags.go:64] FLAG: --runonce="false" Jul 24 11:23:29.323907 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.293256 2586 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 24 11:23:29.323907 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.293264 2586 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 24 11:23:29.323907 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.293269 2586 flags.go:64] FLAG: --seccomp-default="false" Jul 24 11:23:29.323907 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.293272 2586 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 24 11:23:29.323907 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.293275 2586 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 24 11:23:29.395389 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.293283 2586 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 24 11:23:29.395389 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.293286 2586 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 24 11:23:29.395389 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.293291 2586 flags.go:64] FLAG: --storage-driver-password="root" Jul 24 11:23:29.395389 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.293302 2586 flags.go:64] FLAG: --storage-driver-secure="false" Jul 24 11:23:29.395389 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.293306 2586 flags.go:64] FLAG: --storage-driver-table="stats" Jul 24 11:23:29.395389 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.293309 2586 flags.go:64] FLAG: --storage-driver-user="root" Jul 24 11:23:29.395389 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.293314 2586 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 24 11:23:29.395389 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.293317 2586 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 24 11:23:29.395389 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.293320 2586 flags.go:64] FLAG: --system-cgroups="" Jul 24 11:23:29.395389 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.293327 2586 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 24 11:23:29.395389 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.293333 2586 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 24 11:23:29.395389 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.293339 2586 flags.go:64] FLAG: --tls-cert-file="" Jul 24 11:23:29.395389 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.293342 2586 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 24 11:23:29.395389 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.293351 2586 flags.go:64] FLAG: --tls-min-version="" Jul 24 11:23:29.395389 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.293354 2586 flags.go:64] FLAG: --tls-private-key-file="" Jul 24 11:23:29.395389 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.293362 2586 flags.go:64] FLAG: --topology-manager-policy="none" Jul 24 11:23:29.395389 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.293366 2586 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 24 11:23:29.395389 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.293369 2586 flags.go:64] FLAG: --topology-manager-scope="container" Jul 24 11:23:29.395389 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.293375 2586 flags.go:64] FLAG: --v="2" Jul 24 11:23:29.395389 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.293379 2586 flags.go:64] FLAG: --version="false" Jul 24 11:23:29.395389 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.293385 2586 flags.go:64] FLAG: --vmodule="" Jul 24 11:23:29.395389 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.293389 2586 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 24 11:23:29.395389 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.293393 2586 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 24 11:23:29.395389 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.294200 2586 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 11:23:29.396487 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.294210 2586 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 11:23:29.396487 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.294219 2586 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 11:23:29.396487 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.294224 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 11:23:29.396487 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.294230 2586 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 11:23:29.396487 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.294233 2586 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 11:23:29.396487 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.294237 2586 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 11:23:29.396487 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.294242 2586 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 11:23:29.396487 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.294245 2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 11:23:29.396487 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.294250 2586 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 11:23:29.396487 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.294253 2586 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 11:23:29.396487 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.294256 2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 11:23:29.396487 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.294259 2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 11:23:29.396487 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.294268 2586 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 11:23:29.396487 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.294275 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 11:23:29.396487 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.294278 2586 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 11:23:29.396487 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.294281 2586 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 11:23:29.396487 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.294285 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 11:23:29.396487 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.294288 2586 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 11:23:29.396487 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.294292 2586 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 11:23:29.397993 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.294299 2586 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 11:23:29.397993 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.294303 2586 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 11:23:29.397993 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.294308 2586 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 11:23:29.397993 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.294311 2586 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 11:23:29.397993 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.294314 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 11:23:29.397993 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.294320 2586 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 11:23:29.397993 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.294326 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 11:23:29.397993 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.294331 2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 11:23:29.397993 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.294334 2586 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 11:23:29.397993 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.294337 2586 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 11:23:29.397993 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.294339 2586 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 11:23:29.397993 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.294344 2586 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 11:23:29.397993 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.294347 2586 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 11:23:29.397993 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.294349 2586 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 11:23:29.397993 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.294352 2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 11:23:29.397993 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.294357 2586 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 11:23:29.397993 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.294360 2586 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 11:23:29.397993 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.294362 2586 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 11:23:29.397993 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.294367 2586 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 11:23:29.398903 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.294380 2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 11:23:29.398903 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.294383 2586 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 11:23:29.398903 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.294385 2586 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 11:23:29.398903 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.294388 2586 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 11:23:29.398903 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.294393 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 11:23:29.398903 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.294396 2586 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 11:23:29.398903 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.294398 2586 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 11:23:29.398903 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.294409 2586 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 11:23:29.398903 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.294412 2586 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 11:23:29.398903 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.294417 2586 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 11:23:29.398903 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.294419 2586 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 11:23:29.398903 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.294422 2586 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 11:23:29.398903 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.294429 2586 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 11:23:29.398903 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.294433 2586 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 11:23:29.398903 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.294438 2586 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 11:23:29.398903 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.294441 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 11:23:29.398903 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.294444 2586 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 11:23:29.398903 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.294447 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 11:23:29.398903 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.294454 2586 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 11:23:29.398903 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.294456 2586 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 11:23:29.400170 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.294461 2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 11:23:29.400170 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.294464 2586 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 11:23:29.400170 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.294467 2586 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 11:23:29.400170 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.294469 2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 11:23:29.400170 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.294472 2586 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 11:23:29.400170 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.294477 2586 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 11:23:29.400170 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.294480 2586 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 11:23:29.400170 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.294484 2586 feature_gate.go:328] unrecognized feature gate: Example Jul 24 11:23:29.400170 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.294487 2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 11:23:29.400170 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.294489 2586 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 11:23:29.400170 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.294492 2586 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 11:23:29.400170 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.294497 2586 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 11:23:29.400170 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.294500 2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 11:23:29.400170 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.294503 2586 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 11:23:29.400170 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.294508 2586 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 11:23:29.400170 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.294510 2586 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 11:23:29.400170 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.294513 2586 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 11:23:29.400170 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.294516 2586 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 11:23:29.400170 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.294523 2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 11:23:29.400170 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.294526 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 11:23:29.400170 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.294543 2586 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 11:23:29.401075 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.294546 2586 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 11:23:29.401075 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.294549 2586 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 11:23:29.401075 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.294551 2586 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 11:23:29.401075 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.294556 2586 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 11:23:29.401075 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.294560 2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 11:23:29.401075 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.294563 2586 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 11:23:29.401075 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.294568 2586 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 11:23:29.401075 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.294571 2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 11:23:29.401075 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.294593 2586 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 11:23:29.401075 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.294602 2586 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 11:23:29.401075 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.294608 2586 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 11:23:29.401075 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.294613 2586 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 11:23:29.401075 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.294616 2586 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 11:23:29.401075 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.294619 2586 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 11:23:29.401075 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.294622 2586 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 11:23:29.401075 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.294628 2586 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 11:23:29.401075 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.294630 2586 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 11:23:29.401075 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.294633 2586 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 11:23:29.401075 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.294638 2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 11:23:29.405396 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.295258 2586 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 24 11:23:29.405396 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.331193 2586 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 24 11:23:29.405396 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.331217 2586 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 24 11:23:29.405396 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.331236 2586 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 24 11:23:29.405396 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.331242 2586 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 24 11:23:29.405396 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331311 2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 11:23:29.405396 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331316 2586 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 11:23:29.405396 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331320 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 11:23:29.405396 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331323 2586 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 11:23:29.405396 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331326 2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 11:23:29.405396 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331328 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 11:23:29.405396 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331331 2586 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 11:23:29.405396 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331335 2586 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 11:23:29.405396 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331337 2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 11:23:29.405396 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331340 2586 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 11:23:29.406066 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331342 2586 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 11:23:29.406066 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331345 2586 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 11:23:29.406066 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331350 2586 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 11:23:29.406066 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331354 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 11:23:29.406066 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331357 2586 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 11:23:29.406066 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331360 2586 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 11:23:29.406066 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331362 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 11:23:29.406066 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331365 2586 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 11:23:29.406066 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331367 2586 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 11:23:29.406066 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331370 2586 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 11:23:29.406066 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331373 2586 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 11:23:29.406066 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331375 2586 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 11:23:29.406066 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331378 2586 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 11:23:29.406066 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331380 2586 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 11:23:29.406066 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331383 2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 11:23:29.406066 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331387 2586 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 11:23:29.406066 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331390 2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 11:23:29.406066 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331392 2586 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 11:23:29.406066 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331395 2586 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 11:23:29.407552 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331398 2586 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 11:23:29.407552 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331401 2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 11:23:29.407552 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331403 2586 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 11:23:29.407552 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331406 2586 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 11:23:29.407552 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331408 2586 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 11:23:29.407552 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331413 2586 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 11:23:29.407552 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331416 2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 11:23:29.407552 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331419 2586 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 11:23:29.407552 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331422 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 11:23:29.407552 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331425 2586 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 11:23:29.407552 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331428 2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 11:23:29.407552 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331430 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 11:23:29.407552 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331433 2586 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 11:23:29.407552 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331435 2586 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 11:23:29.407552 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331438 2586 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 11:23:29.407552 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331440 2586 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 11:23:29.407552 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331443 2586 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 11:23:29.407552 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331445 2586 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 11:23:29.407552 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331448 2586 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 11:23:29.407552 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331450 2586 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 11:23:29.408434 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331453 2586 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 11:23:29.408434 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331455 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 11:23:29.408434 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331458 2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 11:23:29.408434 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331460 2586 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 11:23:29.408434 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331463 2586 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 11:23:29.408434 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331465 2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 11:23:29.408434 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331468 2586 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 11:23:29.408434 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331470 2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 11:23:29.408434 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331474 2586 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 11:23:29.408434 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331477 2586 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 11:23:29.408434 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331481 2586 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 11:23:29.408434 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331484 2586 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 11:23:29.408434 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331487 2586 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 11:23:29.408434 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331490 2586 feature_gate.go:328] unrecognized feature gate: Example Jul 24 11:23:29.408434 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331493 2586 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 11:23:29.408434 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331495 2586 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 11:23:29.408434 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331498 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 11:23:29.408434 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331501 2586 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 11:23:29.408434 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331503 2586 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 11:23:29.408434 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331506 2586 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 11:23:29.409534 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331509 2586 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 11:23:29.409534 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331512 2586 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 11:23:29.409534 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331515 2586 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 11:23:29.409534 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331517 2586 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 11:23:29.409534 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331520 2586 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 11:23:29.409534 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331523 2586 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 11:23:29.409534 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331526 2586 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 11:23:29.409534 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331529 2586 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 11:23:29.409534 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331532 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 11:23:29.409534 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331535 2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 11:23:29.409534 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331537 2586 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 11:23:29.409534 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331540 2586 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 11:23:29.409534 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331542 2586 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 11:23:29.409534 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331544 2586 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 11:23:29.409534 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331547 2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 11:23:29.409534 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331550 2586 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 11:23:29.409534 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331552 2586 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 11:23:29.409534 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331555 2586 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 11:23:29.409534 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331557 2586 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 11:23:29.409534 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331560 2586 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 11:23:29.500398 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331564 2586 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 11:23:29.500398 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331568 2586 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 11:23:29.500398 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331589 2586 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 11:23:29.500398 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331595 2586 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 11:23:29.500398 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331598 2586 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 11:23:29.500398 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331601 2586 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 11:23:29.500398 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331604 2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 11:23:29.500398 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331607 2586 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 11:23:29.500398 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331610 2586 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 11:23:29.500398 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331613 2586 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 11:23:29.500398 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.331619 2586 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 24 11:23:29.500398 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331769 2586 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 11:23:29.500398 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331773 2586 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 11:23:29.500398 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331777 2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 11:23:29.500398 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331781 2586 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 11:23:29.438363 ip-10-0-137-219 systemd[1]: Started Kubernetes Kubelet. Jul 24 11:23:29.501688 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331784 2586 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 11:23:29.501688 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331787 2586 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 11:23:29.501688 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331790 2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 11:23:29.501688 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331792 2586 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 11:23:29.501688 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331795 2586 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 11:23:29.501688 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331798 2586 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 11:23:29.501688 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331801 2586 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 11:23:29.501688 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331804 2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 11:23:29.501688 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331806 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 11:23:29.501688 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331809 2586 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 11:23:29.501688 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331813 2586 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 11:23:29.501688 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331816 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 11:23:29.501688 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331819 2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 11:23:29.501688 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331822 2586 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 11:23:29.501688 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331825 2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 11:23:29.501688 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331829 2586 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 11:23:29.501688 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331832 2586 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 11:23:29.501688 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331835 2586 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 11:23:29.501688 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331838 2586 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 11:23:29.503330 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331841 2586 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 11:23:29.503330 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331844 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 11:23:29.503330 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331846 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 11:23:29.503330 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331849 2586 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 11:23:29.503330 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331851 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 11:23:29.503330 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331854 2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 11:23:29.503330 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331857 2586 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 11:23:29.503330 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331860 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 11:23:29.503330 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331863 2586 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 11:23:29.503330 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331865 2586 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 11:23:29.503330 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331868 2586 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 11:23:29.503330 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331870 2586 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 11:23:29.503330 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331873 2586 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 11:23:29.503330 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331875 2586 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 11:23:29.503330 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331878 2586 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 11:23:29.503330 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331880 2586 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 11:23:29.503330 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331883 2586 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 11:23:29.503330 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331885 2586 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 11:23:29.503330 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331889 2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 11:23:29.503330 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331892 2586 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 11:23:29.505437 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331894 2586 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 11:23:29.505437 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331897 2586 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 11:23:29.505437 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331900 2586 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 11:23:29.505437 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331903 2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 11:23:29.505437 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331905 2586 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 11:23:29.505437 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331908 2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 11:23:29.505437 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331911 2586 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 11:23:29.505437 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331913 2586 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 11:23:29.505437 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331916 2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 11:23:29.505437 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331919 2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 11:23:29.505437 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331922 2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 11:23:29.505437 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331924 2586 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 11:23:29.505437 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331927 2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 11:23:29.505437 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331930 2586 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 11:23:29.505437 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331932 2586 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 11:23:29.505437 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331935 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 11:23:29.505437 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331937 2586 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 11:23:29.505437 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331940 2586 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 11:23:29.505437 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331943 2586 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 11:23:29.505437 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331945 2586 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 11:23:29.506553 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331948 2586 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 11:23:29.506553 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331950 2586 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 11:23:29.506553 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331953 2586 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 11:23:29.506553 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331956 2586 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 11:23:29.506553 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331958 2586 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 11:23:29.506553 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331961 2586 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 11:23:29.506553 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331964 2586 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 11:23:29.506553 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331967 2586 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 11:23:29.506553 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331970 2586 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 11:23:29.506553 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331972 2586 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 11:23:29.506553 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331975 2586 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 11:23:29.506553 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331977 2586 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 11:23:29.506553 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331981 2586 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 11:23:29.506553 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331984 2586 feature_gate.go:328] unrecognized feature gate: Example Jul 24 11:23:29.506553 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331987 2586 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 11:23:29.506553 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331990 2586 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 11:23:29.506553 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331993 2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 11:23:29.506553 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331996 2586 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 11:23:29.506553 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.331998 2586 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 11:23:29.506553 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.332001 2586 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 11:23:29.507719 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.332003 2586 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 11:23:29.507719 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.332006 2586 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 11:23:29.507719 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.332009 2586 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 11:23:29.507719 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.332011 2586 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 11:23:29.507719 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.332014 2586 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 11:23:29.507719 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.332016 2586 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 11:23:29.507719 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.332020 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 11:23:29.507719 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.332022 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 11:23:29.507719 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.332025 2586 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 11:23:29.507719 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.332027 2586 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 11:23:29.507719 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.332030 2586 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 11:23:29.507719 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.332033 2586 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 11:23:29.507719 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.332036 2586 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 11:23:29.507719 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.332038 2586 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 11:23:29.507719 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.332041 2586 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 11:23:29.507719 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:29.332044 2586 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 11:23:29.510218 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.332048 2586 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 24 11:23:29.510218 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.332190 2586 server.go:962] "Client rotation is on, will bootstrap in background" Jul 24 11:23:29.510218 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.334336 2586 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 24 11:23:29.510218 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.335559 2586 server.go:1019] "Starting client certificate rotation" Jul 24 11:23:29.510218 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.335675 2586 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 24 11:23:29.510218 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.335708 2586 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 24 11:23:29.510218 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.337991 2586 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 24 11:23:29.510218 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.340466 2586 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 24 11:23:29.510218 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.350960 2586 log.go:25] "Validated CRI v1 runtime API" Jul 24 11:23:29.510218 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.354047 2586 log.go:25] "Validated CRI v1 image API" Jul 24 11:23:29.510218 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.368874 2586 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 24 11:23:29.510218 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.376518 2586 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 24 11:23:29.511157 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.389445 2586 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 7ee7727b-d608-4858-8189-bb68ad81d1eb:/dev/nvme0n1p3 f635fb7d-3ef6-4407-9823-d23baa48f121:/dev/nvme0n1p4] Jul 24 11:23:29.511157 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.389463 2586 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 24 11:23:29.511157 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.390750 2586 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-tmd4n" Jul 24 11:23:29.512979 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.396180 2586 manager.go:216] Machine: {Timestamp:2026-07-24 11:23:29.394853398 +0000 UTC m=+0.412907936 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:2499998 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec201be1dc72501c00120918c66f338a SystemUUID:ec201be1-dc72-501c-0012-0918c66f338a BootID:cba05a8d-cfe4-4fa2-b578-a3f8d89469c1 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:b8:54:63:5e:e3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:b8:54:63:5e:e3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:4e:4a:5e:46:31:94 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 24 11:23:29.512979 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.396287 2586 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 24 11:23:29.512979 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.396374 2586 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 24 11:23:29.512979 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.420770 2586 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-tmd4n" Jul 24 11:23:29.512979 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.421243 2586 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 24 11:23:29.512979 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.421769 2586 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-219.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 24 11:23:29.512979 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.422960 2586 topology_manager.go:138] "Creating topology manager with none policy" Jul 24 11:23:29.512979 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.422975 2586 container_manager_linux.go:309] "Creating device plugin manager" Jul 24 11:23:29.512979 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.422984 2586 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 24 11:23:29.512979 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.423719 2586 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 24 11:23:29.512979 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.424833 2586 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 24 11:23:29.512979 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.427337 2586 state_mem.go:36] "Initialized new in-memory state store" Jul 24 11:23:29.512979 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.427483 2586 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 24 11:23:29.512979 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.427517 2586 kubelet.go:486] "Attempting to sync node with API server" Jul 24 11:23:29.512979 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.427531 2586 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 24 11:23:29.512979 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.427547 2586 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 24 11:23:29.512979 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.427558 2586 kubelet.go:398] "Adding apiserver pod source" Jul 24 11:23:29.514568 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.427570 2586 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 24 11:23:29.514568 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.428102 2586 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 24 11:23:29.514568 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.428121 2586 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 24 11:23:29.514568 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.430357 2586 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 24 11:23:29.514568 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.432380 2586 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 24 11:23:29.514568 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.432409 2586 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 24 11:23:29.514568 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.433746 2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 24 11:23:29.514568 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.433761 2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 24 11:23:29.514568 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.433767 2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 24 11:23:29.514568 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.433773 2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 24 11:23:29.514568 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.433782 2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 24 11:23:29.514568 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.433787 2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 24 11:23:29.514568 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.433795 2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 24 11:23:29.514568 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.433800 2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 24 11:23:29.514568 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.433807 2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 24 11:23:29.514568 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.433813 2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 24 11:23:29.514568 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.433821 2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 24 11:23:29.514568 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.433827 2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 24 11:23:29.514568 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.434542 2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 24 11:23:29.514568 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.434550 2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 24 11:23:29.514568 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.437639 2586 server.go:1268] "Started kubelet" Jul 24 11:23:29.514568 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.438603 2586 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 24 11:23:29.514568 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.438781 2586 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 24 11:23:29.514568 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.438854 2586 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 24 11:23:29.514568 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.440568 2586 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 24 11:23:29.514568 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.441288 2586 server.go:310] "Adding debug handlers to kubelet server" Jul 24 11:23:29.514568 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.441509 2586 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 11:23:29.514568 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:23:29.443272 2586 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 24 11:23:29.514568 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.443983 2586 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 11:23:29.514568 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.445506 2586 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-137-219.ec2.internal" not found Jul 24 11:23:29.514568 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.448241 2586 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 24 11:23:29.514568 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.448446 2586 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 24 11:23:29.514568 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:23:29.448507 2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-219.ec2.internal\" not found" Jul 24 11:23:29.514568 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.448982 2586 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 24 11:23:29.514568 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.449072 2586 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 24 11:23:29.514568 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.449085 2586 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 24 11:23:29.514568 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.449282 2586 factory.go:55] Registering systemd factory Jul 24 11:23:29.514568 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.449300 2586 factory.go:223] Registration of the systemd container factory successfully Jul 24 11:23:29.514568 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.449520 2586 factory.go:153] Registering CRI-O factory Jul 24 11:23:29.514568 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.449533 2586 factory.go:223] Registration of the crio container factory successfully Jul 24 11:23:29.514568 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.449605 2586 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 24 11:23:29.514568 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.449629 2586 factory.go:103] Registering Raw factory Jul 24 11:23:29.514568 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.449644 2586 manager.go:1196] Started watching for new ooms in manager Jul 24 11:23:29.514568 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.450079 2586 reconstruct.go:97] "Volume reconstruction finished" Jul 24 11:23:29.514568 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.450094 2586 reconciler.go:29] "Reconciler: start to sync state" Jul 24 11:23:29.514568 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.450169 2586 manager.go:349] Starting recovery of all containers Jul 24 11:23:29.514568 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.451775 2586 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 11:23:29.514568 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:23:29.453639 2586 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-137-219.ec2.internal\" not found" node="ip-10-0-137-219.ec2.internal" Jul 24 11:23:29.514568 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.461008 2586 manager.go:354] Recovery completed Jul 24 11:23:29.514568 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.462185 2586 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-137-219.ec2.internal" not found Jul 24 11:23:29.514568 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:23:29.462545 2586 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jul 24 11:23:29.517545 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.466405 2586 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 11:23:29.517545 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.468434 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-219.ec2.internal" event="NodeHasSufficientMemory" Jul 24 11:23:29.517545 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.468463 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-219.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 11:23:29.517545 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.468477 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-219.ec2.internal" event="NodeHasSufficientPID" Jul 24 11:23:29.517545 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.471891 2586 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 24 11:23:29.517545 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.471902 2586 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 24 11:23:29.517545 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.471907 2586 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 11:23:29.517545 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.471921 2586 state_mem.go:36] "Initialized new in-memory state store" Jul 24 11:23:29.517545 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.472728 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-219.ec2.internal" event="NodeHasSufficientMemory" Jul 24 11:23:29.517545 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.472758 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-219.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 11:23:29.517545 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.472774 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-219.ec2.internal" event="NodeHasSufficientPID" Jul 24 11:23:29.517545 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.474641 2586 policy_none.go:49] "None policy: Start" Jul 24 11:23:29.517545 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.474654 2586 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 24 11:23:29.517545 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.474664 2586 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 24 11:23:29.517545 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.476505 2586 policy_none.go:47] "Start" Jul 24 11:23:29.699948 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.525302 2586 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-137-219.ec2.internal" not found Jul 24 11:23:29.699948 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.528327 2586 manager.go:337] "Starting Device Plugin manager" Jul 24 11:23:29.699948 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:23:29.528361 2586 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 24 11:23:29.699948 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.528375 2586 server.go:87] "Starting device plugin registration server" Jul 24 11:23:29.699948 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.528673 2586 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 24 11:23:29.699948 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.528689 2586 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 24 11:23:29.699948 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.528788 2586 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 24 11:23:29.699948 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.528896 2586 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 24 11:23:29.699948 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.528906 2586 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 24 11:23:29.699948 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:23:29.529425 2586 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 24 11:23:29.699948 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:23:29.529485 2586 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-219.ec2.internal\" not found" Jul 24 11:23:29.699948 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.629961 2586 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 11:23:29.699948 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.631185 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-219.ec2.internal" event="NodeHasSufficientMemory" Jul 24 11:23:29.699948 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.631215 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-219.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 11:23:29.699948 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.631227 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-219.ec2.internal" event="NodeHasSufficientPID" Jul 24 11:23:29.699948 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.631280 2586 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-219.ec2.internal" Jul 24 11:23:29.699948 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.640277 2586 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-219.ec2.internal" Jul 24 11:23:29.699948 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:23:29.640299 2586 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-219.ec2.internal\": node \"ip-10-0-137-219.ec2.internal\" not found" Jul 24 11:23:29.699948 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.676633 2586 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 24 11:23:29.699948 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.678247 2586 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 24 11:23:29.699948 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.678295 2586 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 24 11:23:29.699948 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.678320 2586 kubelet.go:2448] "Starting kubelet main sync loop" Jul 24 11:23:29.699948 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:23:29.678356 2586 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 24 11:23:29.699948 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.681399 2586 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 11:23:29.811341 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.778728 2586 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-219.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-219.ec2.internal"] Jul 24 11:23:29.811341 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.782524 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-219.ec2.internal" Jul 24 11:23:29.811341 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.784867 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-219.ec2.internal" Jul 24 11:23:29.942826 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.818373 2586 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-219.ec2.internal" Jul 24 11:23:29.942826 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.823113 2586 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-219.ec2.internal" Jul 24 11:23:29.942826 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.832597 2586 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 24 11:23:29.942826 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.853409 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0a58966c9c9415e0cb0e62662bc78ddb-config\") pod \"kube-apiserver-proxy-ip-10-0-137-219.ec2.internal\" (UID: \"0a58966c9c9415e0cb0e62662bc78ddb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-219.ec2.internal" Jul 24 11:23:29.942826 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.853439 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ada3248d115cbf6613f9adbfb21b7408-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-219.ec2.internal\" (UID: \"ada3248d115cbf6613f9adbfb21b7408\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-219.ec2.internal" Jul 24 11:23:29.942826 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.853467 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ada3248d115cbf6613f9adbfb21b7408-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-219.ec2.internal\" (UID: \"ada3248d115cbf6613f9adbfb21b7408\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-219.ec2.internal" Jul 24 11:23:29.942826 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.870884 2586 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 24 11:23:30.101979 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.954398 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ada3248d115cbf6613f9adbfb21b7408-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-219.ec2.internal\" (UID: \"ada3248d115cbf6613f9adbfb21b7408\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-219.ec2.internal" Jul 24 11:23:30.101979 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.954428 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0a58966c9c9415e0cb0e62662bc78ddb-config\") pod \"kube-apiserver-proxy-ip-10-0-137-219.ec2.internal\" (UID: \"0a58966c9c9415e0cb0e62662bc78ddb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-219.ec2.internal" Jul 24 11:23:30.101979 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.954447 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ada3248d115cbf6613f9adbfb21b7408-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-219.ec2.internal\" (UID: \"ada3248d115cbf6613f9adbfb21b7408\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-219.ec2.internal" Jul 24 11:23:30.101979 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.954490 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ada3248d115cbf6613f9adbfb21b7408-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-219.ec2.internal\" (UID: \"ada3248d115cbf6613f9adbfb21b7408\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-219.ec2.internal" Jul 24 11:23:30.101979 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.954502 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ada3248d115cbf6613f9adbfb21b7408-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-219.ec2.internal\" (UID: \"ada3248d115cbf6613f9adbfb21b7408\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-219.ec2.internal" Jul 24 11:23:30.101979 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:29.954502 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0a58966c9c9415e0cb0e62662bc78ddb-config\") pod \"kube-apiserver-proxy-ip-10-0-137-219.ec2.internal\" (UID: \"0a58966c9c9415e0cb0e62662bc78ddb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-219.ec2.internal" Jul 24 11:23:30.206376 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.135411 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-219.ec2.internal" Jul 24 11:23:30.206376 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.174837 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-219.ec2.internal" Jul 24 11:23:30.446259 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.337123 2586 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 24 11:23:30.446259 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.337303 2586 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 24 11:23:30.446259 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.337335 2586 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 24 11:23:30.446259 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.337359 2586 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 24 11:23:30.446259 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.427195 2586 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-23 11:18:30 +0000 UTC" deadline="2028-03-20 03:44:45.157825241 +0000 UTC" Jul 24 11:23:30.446259 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.427265 2586 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14512h21m14.730564576s" Jul 24 11:23:30.446259 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.428355 2586 apiserver.go:52] "Watching apiserver" Jul 24 11:23:30.446259 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.436265 2586 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 24 11:23:30.446259 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.439503 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qssdq","openshift-cluster-node-tuning-operator/tuned-smc7z","openshift-multus/multus-s7l4r","openshift-network-diagnostics/network-check-target-7hx7h","openshift-network-operator/iptables-alerter-v9xmz","kube-system/konnectivity-agent-wqkd5","kube-system/kube-apiserver-proxy-ip-10-0-137-219.ec2.internal","openshift-dns/node-resolver-82kpg","openshift-image-registry/node-ca-vdcjb","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-219.ec2.internal","openshift-multus/multus-additional-cni-plugins-cj25f","openshift-multus/network-metrics-daemon-hmcs7","openshift-ovn-kubernetes/ovnkube-node-n7wb9","kube-system/global-pull-secret-syncer-6djk7"] Jul 24 11:23:30.446259 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.442281 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qssdq" Jul 24 11:23:30.446259 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.445026 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-smc7z" Jul 24 11:23:30.446259 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.445744 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 24 11:23:30.446259 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.445927 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-q8dg5\"" Jul 24 11:23:30.446259 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.446096 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 24 11:23:30.446259 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.446232 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 24 11:23:30.551281 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.449576 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 24 11:23:30.551281 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.449804 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 24 11:23:30.551281 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.449941 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-lztbq\"" Jul 24 11:23:30.551281 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.450221 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-s7l4r" Jul 24 11:23:30.551281 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.450249 2586 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 24 11:23:30.551281 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.450284 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7hx7h" Jul 24 11:23:30.551281 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:23:30.450349 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7hx7h" podUID="a5939932-1706-4bde-9ca9-9e03ae19d047" Jul 24 11:23:30.551281 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.451431 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-v9xmz" Jul 24 11:23:30.551281 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.452258 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-562jw\"" Jul 24 11:23:30.551281 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.452263 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 24 11:23:30.551281 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.452455 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 24 11:23:30.551281 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.452486 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 24 11:23:30.551281 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.452767 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 24 11:23:30.551281 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.453293 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 24 11:23:30.551281 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.453535 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-698vm\"" Jul 24 11:23:30.551281 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.453734 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-wqkd5" Jul 24 11:23:30.551281 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.453798 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 24 11:23:30.551281 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.453840 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 24 11:23:30.551281 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.456086 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-82kpg" Jul 24 11:23:30.551281 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.456187 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 24 11:23:30.551281 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.456286 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 24 11:23:30.551281 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.456568 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-fwnj9\"" Jul 24 11:23:30.551281 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.458377 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 24 11:23:30.551281 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.458531 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-8kt9q\"" Jul 24 11:23:30.551281 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.458597 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 24 11:23:30.551281 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.458826 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vdcjb" Jul 24 11:23:30.551281 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.460580 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d66aa4b3-d28b-4a11-a0b0-5e45ec334583-etc-sysctl-d\") pod \"tuned-smc7z\" (UID: \"d66aa4b3-d28b-4a11-a0b0-5e45ec334583\") " pod="openshift-cluster-node-tuning-operator/tuned-smc7z" Jul 24 11:23:30.551281 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.460607 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fec1ec6a-7f13-4dfb-8fdf-dec73487246d-system-cni-dir\") pod \"multus-s7l4r\" (UID: \"fec1ec6a-7f13-4dfb-8fdf-dec73487246d\") " pod="openshift-multus/multus-s7l4r" Jul 24 11:23:30.551281 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.460628 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wls9c\" (UniqueName: \"kubernetes.io/projected/fec1ec6a-7f13-4dfb-8fdf-dec73487246d-kube-api-access-wls9c\") pod \"multus-s7l4r\" (UID: \"fec1ec6a-7f13-4dfb-8fdf-dec73487246d\") " pod="openshift-multus/multus-s7l4r" Jul 24 11:23:30.551281 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.460670 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d66aa4b3-d28b-4a11-a0b0-5e45ec334583-etc-sysconfig\") pod \"tuned-smc7z\" (UID: \"d66aa4b3-d28b-4a11-a0b0-5e45ec334583\") " pod="openshift-cluster-node-tuning-operator/tuned-smc7z" Jul 24 11:23:30.551281 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.460696 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d66aa4b3-d28b-4a11-a0b0-5e45ec334583-etc-kubernetes\") pod \"tuned-smc7z\" (UID: \"d66aa4b3-d28b-4a11-a0b0-5e45ec334583\") " pod="openshift-cluster-node-tuning-operator/tuned-smc7z" Jul 24 11:23:30.552449 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.460712 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d66aa4b3-d28b-4a11-a0b0-5e45ec334583-lib-modules\") pod \"tuned-smc7z\" (UID: \"d66aa4b3-d28b-4a11-a0b0-5e45ec334583\") " pod="openshift-cluster-node-tuning-operator/tuned-smc7z" Jul 24 11:23:30.552449 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.460728 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d66aa4b3-d28b-4a11-a0b0-5e45ec334583-var-lib-kubelet\") pod \"tuned-smc7z\" (UID: \"d66aa4b3-d28b-4a11-a0b0-5e45ec334583\") " pod="openshift-cluster-node-tuning-operator/tuned-smc7z" Jul 24 11:23:30.552449 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.460742 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fec1ec6a-7f13-4dfb-8fdf-dec73487246d-cni-binary-copy\") pod \"multus-s7l4r\" (UID: \"fec1ec6a-7f13-4dfb-8fdf-dec73487246d\") " pod="openshift-multus/multus-s7l4r" Jul 24 11:23:30.552449 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.460765 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fec1ec6a-7f13-4dfb-8fdf-dec73487246d-host-run-netns\") pod \"multus-s7l4r\" (UID: \"fec1ec6a-7f13-4dfb-8fdf-dec73487246d\") " pod="openshift-multus/multus-s7l4r" Jul 24 11:23:30.552449 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.460800 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/04e77e9d-0516-48e9-bca4-cd32c4c9e82c-device-dir\") pod \"aws-ebs-csi-driver-node-qssdq\" (UID: \"04e77e9d-0516-48e9-bca4-cd32c4c9e82c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qssdq" Jul 24 11:23:30.552449 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.460824 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fec1ec6a-7f13-4dfb-8fdf-dec73487246d-host-run-k8s-cni-cncf-io\") pod \"multus-s7l4r\" (UID: \"fec1ec6a-7f13-4dfb-8fdf-dec73487246d\") " pod="openshift-multus/multus-s7l4r" Jul 24 11:23:30.552449 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.460839 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fec1ec6a-7f13-4dfb-8fdf-dec73487246d-hostroot\") pod \"multus-s7l4r\" (UID: \"fec1ec6a-7f13-4dfb-8fdf-dec73487246d\") " pod="openshift-multus/multus-s7l4r" Jul 24 11:23:30.552449 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.460871 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fec1ec6a-7f13-4dfb-8fdf-dec73487246d-multus-conf-dir\") pod \"multus-s7l4r\" (UID: \"fec1ec6a-7f13-4dfb-8fdf-dec73487246d\") " pod="openshift-multus/multus-s7l4r" Jul 24 11:23:30.552449 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.460903 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9c2ffd69-ca76-424a-9a0f-4e606ff4a872-host-slash\") pod \"iptables-alerter-v9xmz\" (UID: \"9c2ffd69-ca76-424a-9a0f-4e606ff4a872\") " pod="openshift-network-operator/iptables-alerter-v9xmz" Jul 24 11:23:30.552449 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.460926 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/04e77e9d-0516-48e9-bca4-cd32c4c9e82c-sys-fs\") pod \"aws-ebs-csi-driver-node-qssdq\" (UID: \"04e77e9d-0516-48e9-bca4-cd32c4c9e82c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qssdq" Jul 24 11:23:30.552449 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.460942 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9c2ffd69-ca76-424a-9a0f-4e606ff4a872-iptables-alerter-script\") pod \"iptables-alerter-v9xmz\" (UID: \"9c2ffd69-ca76-424a-9a0f-4e606ff4a872\") " pod="openshift-network-operator/iptables-alerter-v9xmz" Jul 24 11:23:30.552449 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.460965 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/04e77e9d-0516-48e9-bca4-cd32c4c9e82c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qssdq\" (UID: \"04e77e9d-0516-48e9-bca4-cd32c4c9e82c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qssdq" Jul 24 11:23:30.552449 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.460990 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d66aa4b3-d28b-4a11-a0b0-5e45ec334583-etc-systemd\") pod \"tuned-smc7z\" (UID: \"d66aa4b3-d28b-4a11-a0b0-5e45ec334583\") " pod="openshift-cluster-node-tuning-operator/tuned-smc7z" Jul 24 11:23:30.552449 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.461011 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d66aa4b3-d28b-4a11-a0b0-5e45ec334583-host\") pod \"tuned-smc7z\" (UID: \"d66aa4b3-d28b-4a11-a0b0-5e45ec334583\") " pod="openshift-cluster-node-tuning-operator/tuned-smc7z" Jul 24 11:23:30.552449 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.461027 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fec1ec6a-7f13-4dfb-8fdf-dec73487246d-host-var-lib-cni-multus\") pod \"multus-s7l4r\" (UID: \"fec1ec6a-7f13-4dfb-8fdf-dec73487246d\") " pod="openshift-multus/multus-s7l4r" Jul 24 11:23:30.552449 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.461043 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fec1ec6a-7f13-4dfb-8fdf-dec73487246d-multus-daemon-config\") pod \"multus-s7l4r\" (UID: \"fec1ec6a-7f13-4dfb-8fdf-dec73487246d\") " pod="openshift-multus/multus-s7l4r" Jul 24 11:23:30.552449 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.461012 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 24 11:23:30.553548 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.461115 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfgzv\" (UniqueName: \"kubernetes.io/projected/9c2ffd69-ca76-424a-9a0f-4e606ff4a872-kube-api-access-tfgzv\") pod \"iptables-alerter-v9xmz\" (UID: \"9c2ffd69-ca76-424a-9a0f-4e606ff4a872\") " pod="openshift-network-operator/iptables-alerter-v9xmz" Jul 24 11:23:30.553548 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.461143 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/04e77e9d-0516-48e9-bca4-cd32c4c9e82c-registration-dir\") pod \"aws-ebs-csi-driver-node-qssdq\" (UID: \"04e77e9d-0516-48e9-bca4-cd32c4c9e82c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qssdq" Jul 24 11:23:30.553548 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.461168 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d66aa4b3-d28b-4a11-a0b0-5e45ec334583-etc-sysctl-conf\") pod \"tuned-smc7z\" (UID: \"d66aa4b3-d28b-4a11-a0b0-5e45ec334583\") " pod="openshift-cluster-node-tuning-operator/tuned-smc7z" Jul 24 11:23:30.553548 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.461191 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d66aa4b3-d28b-4a11-a0b0-5e45ec334583-etc-tuned\") pod \"tuned-smc7z\" (UID: \"d66aa4b3-d28b-4a11-a0b0-5e45ec334583\") " pod="openshift-cluster-node-tuning-operator/tuned-smc7z" Jul 24 11:23:30.553548 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.461213 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fec1ec6a-7f13-4dfb-8fdf-dec73487246d-host-var-lib-cni-bin\") pod \"multus-s7l4r\" (UID: \"fec1ec6a-7f13-4dfb-8fdf-dec73487246d\") " pod="openshift-multus/multus-s7l4r" Jul 24 11:23:30.553548 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.461240 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fec1ec6a-7f13-4dfb-8fdf-dec73487246d-host-var-lib-kubelet\") pod \"multus-s7l4r\" (UID: \"fec1ec6a-7f13-4dfb-8fdf-dec73487246d\") " pod="openshift-multus/multus-s7l4r" Jul 24 11:23:30.553548 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.461263 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fec1ec6a-7f13-4dfb-8fdf-dec73487246d-host-run-multus-certs\") pod \"multus-s7l4r\" (UID: \"fec1ec6a-7f13-4dfb-8fdf-dec73487246d\") " pod="openshift-multus/multus-s7l4r" Jul 24 11:23:30.553548 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.461285 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5t286\" (UniqueName: \"kubernetes.io/projected/d66aa4b3-d28b-4a11-a0b0-5e45ec334583-kube-api-access-5t286\") pod \"tuned-smc7z\" (UID: \"d66aa4b3-d28b-4a11-a0b0-5e45ec334583\") " pod="openshift-cluster-node-tuning-operator/tuned-smc7z" Jul 24 11:23:30.553548 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.461300 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fec1ec6a-7f13-4dfb-8fdf-dec73487246d-multus-cni-dir\") pod \"multus-s7l4r\" (UID: \"fec1ec6a-7f13-4dfb-8fdf-dec73487246d\") " pod="openshift-multus/multus-s7l4r" Jul 24 11:23:30.553548 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.461319 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fec1ec6a-7f13-4dfb-8fdf-dec73487246d-multus-socket-dir-parent\") pod \"multus-s7l4r\" (UID: \"fec1ec6a-7f13-4dfb-8fdf-dec73487246d\") " pod="openshift-multus/multus-s7l4r" Jul 24 11:23:30.553548 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.461360 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fec1ec6a-7f13-4dfb-8fdf-dec73487246d-etc-kubernetes\") pod \"multus-s7l4r\" (UID: \"fec1ec6a-7f13-4dfb-8fdf-dec73487246d\") " pod="openshift-multus/multus-s7l4r" Jul 24 11:23:30.553548 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.461390 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/04e77e9d-0516-48e9-bca4-cd32c4c9e82c-socket-dir\") pod \"aws-ebs-csi-driver-node-qssdq\" (UID: \"04e77e9d-0516-48e9-bca4-cd32c4c9e82c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qssdq" Jul 24 11:23:30.553548 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.461434 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d66aa4b3-d28b-4a11-a0b0-5e45ec334583-etc-modprobe-d\") pod \"tuned-smc7z\" (UID: \"d66aa4b3-d28b-4a11-a0b0-5e45ec334583\") " pod="openshift-cluster-node-tuning-operator/tuned-smc7z" Jul 24 11:23:30.553548 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.461454 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d66aa4b3-d28b-4a11-a0b0-5e45ec334583-run\") pod \"tuned-smc7z\" (UID: \"d66aa4b3-d28b-4a11-a0b0-5e45ec334583\") " pod="openshift-cluster-node-tuning-operator/tuned-smc7z" Jul 24 11:23:30.553548 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.461470 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d66aa4b3-d28b-4a11-a0b0-5e45ec334583-sys\") pod \"tuned-smc7z\" (UID: \"d66aa4b3-d28b-4a11-a0b0-5e45ec334583\") " pod="openshift-cluster-node-tuning-operator/tuned-smc7z" Jul 24 11:23:30.553548 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.461499 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d66aa4b3-d28b-4a11-a0b0-5e45ec334583-tmp\") pod \"tuned-smc7z\" (UID: \"d66aa4b3-d28b-4a11-a0b0-5e45ec334583\") " pod="openshift-cluster-node-tuning-operator/tuned-smc7z" Jul 24 11:23:30.553548 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.461522 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fec1ec6a-7f13-4dfb-8fdf-dec73487246d-cnibin\") pod \"multus-s7l4r\" (UID: \"fec1ec6a-7f13-4dfb-8fdf-dec73487246d\") " pod="openshift-multus/multus-s7l4r" Jul 24 11:23:30.554248 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.461549 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlzbx\" (UniqueName: \"kubernetes.io/projected/a5939932-1706-4bde-9ca9-9e03ae19d047-kube-api-access-mlzbx\") pod \"network-check-target-7hx7h\" (UID: \"a5939932-1706-4bde-9ca9-9e03ae19d047\") " pod="openshift-network-diagnostics/network-check-target-7hx7h" Jul 24 11:23:30.554248 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.461555 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cj25f" Jul 24 11:23:30.554248 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.461604 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fec1ec6a-7f13-4dfb-8fdf-dec73487246d-os-release\") pod \"multus-s7l4r\" (UID: \"fec1ec6a-7f13-4dfb-8fdf-dec73487246d\") " pod="openshift-multus/multus-s7l4r" Jul 24 11:23:30.554248 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.461683 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/04e77e9d-0516-48e9-bca4-cd32c4c9e82c-etc-selinux\") pod \"aws-ebs-csi-driver-node-qssdq\" (UID: \"04e77e9d-0516-48e9-bca4-cd32c4c9e82c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qssdq" Jul 24 11:23:30.554248 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.461746 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wl7ht\" (UniqueName: \"kubernetes.io/projected/04e77e9d-0516-48e9-bca4-cd32c4c9e82c-kube-api-access-wl7ht\") pod \"aws-ebs-csi-driver-node-qssdq\" (UID: \"04e77e9d-0516-48e9-bca4-cd32c4c9e82c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qssdq" Jul 24 11:23:30.554248 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.461786 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-rr5dz\"" Jul 24 11:23:30.554248 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.461949 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 24 11:23:30.554248 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.462046 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 24 11:23:30.554248 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.462073 2586 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 24 11:23:30.554248 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.464809 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 24 11:23:30.554248 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.465039 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-6qbz4\"" Jul 24 11:23:30.554248 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.467302 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 24 11:23:30.554248 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.467380 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmcs7" Jul 24 11:23:30.554248 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.467513 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-n7wb9" Jul 24 11:23:30.554248 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:23:30.467523 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hmcs7" podUID="1e159073-9250-4ffc-aa96-224b8ae48029" Jul 24 11:23:30.554248 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.470344 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 24 11:23:30.554248 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.470395 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 24 11:23:30.554248 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.470506 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6djk7" Jul 24 11:23:30.554248 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:23:30.470576 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6djk7" podUID="cc095a00-6820-40bf-a3a4-24c63bf7869b" Jul 24 11:23:30.554248 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.470608 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 24 11:23:30.554248 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.470666 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-cjh9k\"" Jul 24 11:23:30.554248 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.471012 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 24 11:23:30.554248 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.471037 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 24 11:23:30.554248 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.471099 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 24 11:23:30.554248 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.489471 2586 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-vhrnw" Jul 24 11:23:30.554248 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.498466 2586 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-vhrnw" Jul 24 11:23:30.554248 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.550517 2586 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 24 11:23:30.562462 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.562442 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cc095a00-6820-40bf-a3a4-24c63bf7869b-original-pull-secret\") pod \"global-pull-secret-syncer-6djk7\" (UID: \"cc095a00-6820-40bf-a3a4-24c63bf7869b\") " pod="kube-system/global-pull-secret-syncer-6djk7" Jul 24 11:23:30.562548 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.562484 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wls9c\" (UniqueName: \"kubernetes.io/projected/fec1ec6a-7f13-4dfb-8fdf-dec73487246d-kube-api-access-wls9c\") pod \"multus-s7l4r\" (UID: \"fec1ec6a-7f13-4dfb-8fdf-dec73487246d\") " pod="openshift-multus/multus-s7l4r" Jul 24 11:23:30.562548 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.562514 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/55c78980-902f-4c71-9557-a0c6631fdc8b-host-run-netns\") pod \"ovnkube-node-n7wb9\" (UID: \"55c78980-902f-4c71-9557-a0c6631fdc8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7wb9" Jul 24 11:23:30.562548 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.562540 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d66aa4b3-d28b-4a11-a0b0-5e45ec334583-etc-sysconfig\") pod \"tuned-smc7z\" (UID: \"d66aa4b3-d28b-4a11-a0b0-5e45ec334583\") " pod="openshift-cluster-node-tuning-operator/tuned-smc7z" Jul 24 11:23:30.562691 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.562592 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d66aa4b3-d28b-4a11-a0b0-5e45ec334583-etc-kubernetes\") pod \"tuned-smc7z\" (UID: \"d66aa4b3-d28b-4a11-a0b0-5e45ec334583\") " pod="openshift-cluster-node-tuning-operator/tuned-smc7z" Jul 24 11:23:30.562691 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.562650 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d66aa4b3-d28b-4a11-a0b0-5e45ec334583-etc-kubernetes\") pod \"tuned-smc7z\" (UID: \"d66aa4b3-d28b-4a11-a0b0-5e45ec334583\") " pod="openshift-cluster-node-tuning-operator/tuned-smc7z" Jul 24 11:23:30.562691 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.562681 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fec1ec6a-7f13-4dfb-8fdf-dec73487246d-host-run-netns\") pod \"multus-s7l4r\" (UID: \"fec1ec6a-7f13-4dfb-8fdf-dec73487246d\") " pod="openshift-multus/multus-s7l4r" Jul 24 11:23:30.562816 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.562702 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/55c78980-902f-4c71-9557-a0c6631fdc8b-log-socket\") pod \"ovnkube-node-n7wb9\" (UID: \"55c78980-902f-4c71-9557-a0c6631fdc8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7wb9" Jul 24 11:23:30.562816 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.562714 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d66aa4b3-d28b-4a11-a0b0-5e45ec334583-etc-sysconfig\") pod \"tuned-smc7z\" (UID: \"d66aa4b3-d28b-4a11-a0b0-5e45ec334583\") " pod="openshift-cluster-node-tuning-operator/tuned-smc7z" Jul 24 11:23:30.562816 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.562723 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27kh9\" (UniqueName: \"kubernetes.io/projected/1e159073-9250-4ffc-aa96-224b8ae48029-kube-api-access-27kh9\") pod \"network-metrics-daemon-hmcs7\" (UID: \"1e159073-9250-4ffc-aa96-224b8ae48029\") " pod="openshift-multus/network-metrics-daemon-hmcs7" Jul 24 11:23:30.562816 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.562762 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/04e77e9d-0516-48e9-bca4-cd32c4c9e82c-device-dir\") pod \"aws-ebs-csi-driver-node-qssdq\" (UID: \"04e77e9d-0516-48e9-bca4-cd32c4c9e82c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qssdq" Jul 24 11:23:30.562816 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.562804 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fec1ec6a-7f13-4dfb-8fdf-dec73487246d-host-run-netns\") pod \"multus-s7l4r\" (UID: \"fec1ec6a-7f13-4dfb-8fdf-dec73487246d\") " pod="openshift-multus/multus-s7l4r" Jul 24 11:23:30.563029 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.562848 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fec1ec6a-7f13-4dfb-8fdf-dec73487246d-host-run-k8s-cni-cncf-io\") pod \"multus-s7l4r\" (UID: \"fec1ec6a-7f13-4dfb-8fdf-dec73487246d\") " pod="openshift-multus/multus-s7l4r" Jul 24 11:23:30.563029 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.562870 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fec1ec6a-7f13-4dfb-8fdf-dec73487246d-host-run-k8s-cni-cncf-io\") pod \"multus-s7l4r\" (UID: \"fec1ec6a-7f13-4dfb-8fdf-dec73487246d\") " pod="openshift-multus/multus-s7l4r" Jul 24 11:23:30.563029 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.562903 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fec1ec6a-7f13-4dfb-8fdf-dec73487246d-hostroot\") pod \"multus-s7l4r\" (UID: \"fec1ec6a-7f13-4dfb-8fdf-dec73487246d\") " pod="openshift-multus/multus-s7l4r" Jul 24 11:23:30.563029 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.562933 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/55c78980-902f-4c71-9557-a0c6631fdc8b-ovn-node-metrics-cert\") pod \"ovnkube-node-n7wb9\" (UID: \"55c78980-902f-4c71-9557-a0c6631fdc8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7wb9" Jul 24 11:23:30.563029 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.562966 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fec1ec6a-7f13-4dfb-8fdf-dec73487246d-hostroot\") pod \"multus-s7l4r\" (UID: \"fec1ec6a-7f13-4dfb-8fdf-dec73487246d\") " pod="openshift-multus/multus-s7l4r" Jul 24 11:23:30.563029 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.562976 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/284caaf1-7e86-411d-b5c2-1ffd87dd1017-konnectivity-ca\") pod \"konnectivity-agent-wqkd5\" (UID: \"284caaf1-7e86-411d-b5c2-1ffd87dd1017\") " pod="kube-system/konnectivity-agent-wqkd5" Jul 24 11:23:30.563029 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.563027 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/04e77e9d-0516-48e9-bca4-cd32c4c9e82c-sys-fs\") pod \"aws-ebs-csi-driver-node-qssdq\" (UID: \"04e77e9d-0516-48e9-bca4-cd32c4c9e82c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qssdq" Jul 24 11:23:30.563316 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.563039 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/04e77e9d-0516-48e9-bca4-cd32c4c9e82c-device-dir\") pod \"aws-ebs-csi-driver-node-qssdq\" (UID: \"04e77e9d-0516-48e9-bca4-cd32c4c9e82c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qssdq" Jul 24 11:23:30.563316 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.563083 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/55c78980-902f-4c71-9557-a0c6631fdc8b-host-run-ovn-kubernetes\") pod \"ovnkube-node-n7wb9\" (UID: \"55c78980-902f-4c71-9557-a0c6631fdc8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7wb9" Jul 24 11:23:30.563316 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.563104 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/55c78980-902f-4c71-9557-a0c6631fdc8b-ovnkube-config\") pod \"ovnkube-node-n7wb9\" (UID: \"55c78980-902f-4c71-9557-a0c6631fdc8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7wb9" Jul 24 11:23:30.563316 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.563134 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c92f5312-fb6f-4bd2-9e9a-89363c65621c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cj25f\" (UID: \"c92f5312-fb6f-4bd2-9e9a-89363c65621c\") " pod="openshift-multus/multus-additional-cni-plugins-cj25f" Jul 24 11:23:30.563316 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.563161 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/04e77e9d-0516-48e9-bca4-cd32c4c9e82c-sys-fs\") pod \"aws-ebs-csi-driver-node-qssdq\" (UID: \"04e77e9d-0516-48e9-bca4-cd32c4c9e82c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qssdq" Jul 24 11:23:30.563316 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.563202 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fec1ec6a-7f13-4dfb-8fdf-dec73487246d-multus-daemon-config\") pod \"multus-s7l4r\" (UID: \"fec1ec6a-7f13-4dfb-8fdf-dec73487246d\") " pod="openshift-multus/multus-s7l4r" Jul 24 11:23:30.563316 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.563238 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfgzv\" (UniqueName: \"kubernetes.io/projected/9c2ffd69-ca76-424a-9a0f-4e606ff4a872-kube-api-access-tfgzv\") pod \"iptables-alerter-v9xmz\" (UID: \"9c2ffd69-ca76-424a-9a0f-4e606ff4a872\") " pod="openshift-network-operator/iptables-alerter-v9xmz" Jul 24 11:23:30.563316 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.563288 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxrrg\" (UniqueName: \"kubernetes.io/projected/55c78980-902f-4c71-9557-a0c6631fdc8b-kube-api-access-rxrrg\") pod \"ovnkube-node-n7wb9\" (UID: \"55c78980-902f-4c71-9557-a0c6631fdc8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7wb9" Jul 24 11:23:30.563642 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.563307 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cc095a00-6820-40bf-a3a4-24c63bf7869b-kubelet-config\") pod \"global-pull-secret-syncer-6djk7\" (UID: \"cc095a00-6820-40bf-a3a4-24c63bf7869b\") " pod="kube-system/global-pull-secret-syncer-6djk7" Jul 24 11:23:30.563642 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.563353 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c92f5312-fb6f-4bd2-9e9a-89363c65621c-os-release\") pod \"multus-additional-cni-plugins-cj25f\" (UID: \"c92f5312-fb6f-4bd2-9e9a-89363c65621c\") " pod="openshift-multus/multus-additional-cni-plugins-cj25f" Jul 24 11:23:30.563642 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.563381 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c92f5312-fb6f-4bd2-9e9a-89363c65621c-cni-binary-copy\") pod \"multus-additional-cni-plugins-cj25f\" (UID: \"c92f5312-fb6f-4bd2-9e9a-89363c65621c\") " pod="openshift-multus/multus-additional-cni-plugins-cj25f" Jul 24 11:23:30.563642 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.563416 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c92f5312-fb6f-4bd2-9e9a-89363c65621c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cj25f\" (UID: \"c92f5312-fb6f-4bd2-9e9a-89363c65621c\") " pod="openshift-multus/multus-additional-cni-plugins-cj25f" Jul 24 11:23:30.563642 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.563440 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/04e77e9d-0516-48e9-bca4-cd32c4c9e82c-registration-dir\") pod \"aws-ebs-csi-driver-node-qssdq\" (UID: \"04e77e9d-0516-48e9-bca4-cd32c4c9e82c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qssdq" Jul 24 11:23:30.563642 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.563464 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fec1ec6a-7f13-4dfb-8fdf-dec73487246d-host-var-lib-cni-bin\") pod \"multus-s7l4r\" (UID: \"fec1ec6a-7f13-4dfb-8fdf-dec73487246d\") " pod="openshift-multus/multus-s7l4r" Jul 24 11:23:30.563642 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.563482 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fec1ec6a-7f13-4dfb-8fdf-dec73487246d-host-var-lib-kubelet\") pod \"multus-s7l4r\" (UID: \"fec1ec6a-7f13-4dfb-8fdf-dec73487246d\") " pod="openshift-multus/multus-s7l4r" Jul 24 11:23:30.563642 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.563519 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/04e77e9d-0516-48e9-bca4-cd32c4c9e82c-registration-dir\") pod \"aws-ebs-csi-driver-node-qssdq\" (UID: \"04e77e9d-0516-48e9-bca4-cd32c4c9e82c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qssdq" Jul 24 11:23:30.563642 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.563533 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fec1ec6a-7f13-4dfb-8fdf-dec73487246d-host-run-multus-certs\") pod \"multus-s7l4r\" (UID: \"fec1ec6a-7f13-4dfb-8fdf-dec73487246d\") " pod="openshift-multus/multus-s7l4r" Jul 24 11:23:30.563642 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.563539 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fec1ec6a-7f13-4dfb-8fdf-dec73487246d-host-var-lib-cni-bin\") pod \"multus-s7l4r\" (UID: \"fec1ec6a-7f13-4dfb-8fdf-dec73487246d\") " pod="openshift-multus/multus-s7l4r" Jul 24 11:23:30.563642 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.563548 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fec1ec6a-7f13-4dfb-8fdf-dec73487246d-host-var-lib-kubelet\") pod \"multus-s7l4r\" (UID: \"fec1ec6a-7f13-4dfb-8fdf-dec73487246d\") " pod="openshift-multus/multus-s7l4r" Jul 24 11:23:30.563642 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.563550 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/55c78980-902f-4c71-9557-a0c6631fdc8b-systemd-units\") pod \"ovnkube-node-n7wb9\" (UID: \"55c78980-902f-4c71-9557-a0c6631fdc8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7wb9" Jul 24 11:23:30.563642 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.563576 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fec1ec6a-7f13-4dfb-8fdf-dec73487246d-host-run-multus-certs\") pod \"multus-s7l4r\" (UID: \"fec1ec6a-7f13-4dfb-8fdf-dec73487246d\") " pod="openshift-multus/multus-s7l4r" Jul 24 11:23:30.563642 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.563609 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/55c78980-902f-4c71-9557-a0c6631fdc8b-var-lib-openvswitch\") pod \"ovnkube-node-n7wb9\" (UID: \"55c78980-902f-4c71-9557-a0c6631fdc8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7wb9" Jul 24 11:23:30.563642 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.563630 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cc095a00-6820-40bf-a3a4-24c63bf7869b-dbus\") pod \"global-pull-secret-syncer-6djk7\" (UID: \"cc095a00-6820-40bf-a3a4-24c63bf7869b\") " pod="kube-system/global-pull-secret-syncer-6djk7" Jul 24 11:23:30.563642 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.563655 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fec1ec6a-7f13-4dfb-8fdf-dec73487246d-multus-cni-dir\") pod \"multus-s7l4r\" (UID: \"fec1ec6a-7f13-4dfb-8fdf-dec73487246d\") " pod="openshift-multus/multus-s7l4r" Jul 24 11:23:30.564345 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.563675 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fec1ec6a-7f13-4dfb-8fdf-dec73487246d-multus-socket-dir-parent\") pod \"multus-s7l4r\" (UID: \"fec1ec6a-7f13-4dfb-8fdf-dec73487246d\") " pod="openshift-multus/multus-s7l4r" Jul 24 11:23:30.564345 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.563690 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fec1ec6a-7f13-4dfb-8fdf-dec73487246d-etc-kubernetes\") pod \"multus-s7l4r\" (UID: \"fec1ec6a-7f13-4dfb-8fdf-dec73487246d\") " pod="openshift-multus/multus-s7l4r" Jul 24 11:23:30.564345 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.563708 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fzkx\" (UniqueName: \"kubernetes.io/projected/321eae1c-057a-42e8-85e3-ddb84821b4d6-kube-api-access-6fzkx\") pod \"node-resolver-82kpg\" (UID: \"321eae1c-057a-42e8-85e3-ddb84821b4d6\") " pod="openshift-dns/node-resolver-82kpg" Jul 24 11:23:30.564345 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.563739 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/55c78980-902f-4c71-9557-a0c6631fdc8b-host-slash\") pod \"ovnkube-node-n7wb9\" (UID: \"55c78980-902f-4c71-9557-a0c6631fdc8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7wb9" Jul 24 11:23:30.564345 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.563759 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/55c78980-902f-4c71-9557-a0c6631fdc8b-node-log\") pod \"ovnkube-node-n7wb9\" (UID: \"55c78980-902f-4c71-9557-a0c6631fdc8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7wb9" Jul 24 11:23:30.564345 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.563783 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/55c78980-902f-4c71-9557-a0c6631fdc8b-env-overrides\") pod \"ovnkube-node-n7wb9\" (UID: \"55c78980-902f-4c71-9557-a0c6631fdc8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7wb9" Jul 24 11:23:30.564345 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.563802 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/284caaf1-7e86-411d-b5c2-1ffd87dd1017-agent-certs\") pod \"konnectivity-agent-wqkd5\" (UID: \"284caaf1-7e86-411d-b5c2-1ffd87dd1017\") " pod="kube-system/konnectivity-agent-wqkd5" Jul 24 11:23:30.564345 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.563820 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fec1ec6a-7f13-4dfb-8fdf-dec73487246d-multus-cni-dir\") pod \"multus-s7l4r\" (UID: \"fec1ec6a-7f13-4dfb-8fdf-dec73487246d\") " pod="openshift-multus/multus-s7l4r" Jul 24 11:23:30.564345 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.563828 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d66aa4b3-d28b-4a11-a0b0-5e45ec334583-etc-modprobe-d\") pod \"tuned-smc7z\" (UID: \"d66aa4b3-d28b-4a11-a0b0-5e45ec334583\") " pod="openshift-cluster-node-tuning-operator/tuned-smc7z" Jul 24 11:23:30.564345 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.563742 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fec1ec6a-7f13-4dfb-8fdf-dec73487246d-etc-kubernetes\") pod \"multus-s7l4r\" (UID: \"fec1ec6a-7f13-4dfb-8fdf-dec73487246d\") " pod="openshift-multus/multus-s7l4r" Jul 24 11:23:30.564345 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.563858 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d66aa4b3-d28b-4a11-a0b0-5e45ec334583-run\") pod \"tuned-smc7z\" (UID: \"d66aa4b3-d28b-4a11-a0b0-5e45ec334583\") " pod="openshift-cluster-node-tuning-operator/tuned-smc7z" Jul 24 11:23:30.564345 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.563859 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fec1ec6a-7f13-4dfb-8fdf-dec73487246d-multus-socket-dir-parent\") pod \"multus-s7l4r\" (UID: \"fec1ec6a-7f13-4dfb-8fdf-dec73487246d\") " pod="openshift-multus/multus-s7l4r" Jul 24 11:23:30.564345 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.563879 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d66aa4b3-d28b-4a11-a0b0-5e45ec334583-sys\") pod \"tuned-smc7z\" (UID: \"d66aa4b3-d28b-4a11-a0b0-5e45ec334583\") " pod="openshift-cluster-node-tuning-operator/tuned-smc7z" Jul 24 11:23:30.564345 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.563891 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d66aa4b3-d28b-4a11-a0b0-5e45ec334583-run\") pod \"tuned-smc7z\" (UID: \"d66aa4b3-d28b-4a11-a0b0-5e45ec334583\") " pod="openshift-cluster-node-tuning-operator/tuned-smc7z" Jul 24 11:23:30.564345 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.563900 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d66aa4b3-d28b-4a11-a0b0-5e45ec334583-tmp\") pod \"tuned-smc7z\" (UID: \"d66aa4b3-d28b-4a11-a0b0-5e45ec334583\") " pod="openshift-cluster-node-tuning-operator/tuned-smc7z" Jul 24 11:23:30.564345 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.563918 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d66aa4b3-d28b-4a11-a0b0-5e45ec334583-sys\") pod \"tuned-smc7z\" (UID: \"d66aa4b3-d28b-4a11-a0b0-5e45ec334583\") " pod="openshift-cluster-node-tuning-operator/tuned-smc7z" Jul 24 11:23:30.564345 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.563934 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d66aa4b3-d28b-4a11-a0b0-5e45ec334583-etc-modprobe-d\") pod \"tuned-smc7z\" (UID: \"d66aa4b3-d28b-4a11-a0b0-5e45ec334583\") " pod="openshift-cluster-node-tuning-operator/tuned-smc7z" Jul 24 11:23:30.564345 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.563969 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fec1ec6a-7f13-4dfb-8fdf-dec73487246d-cnibin\") pod \"multus-s7l4r\" (UID: \"fec1ec6a-7f13-4dfb-8fdf-dec73487246d\") " pod="openshift-multus/multus-s7l4r" Jul 24 11:23:30.565222 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.563988 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6d6115b5-67cb-4f64-b157-29872df323bb-host\") pod \"node-ca-vdcjb\" (UID: \"6d6115b5-67cb-4f64-b157-29872df323bb\") " pod="openshift-image-registry/node-ca-vdcjb" Jul 24 11:23:30.565222 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.564015 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c92f5312-fb6f-4bd2-9e9a-89363c65621c-system-cni-dir\") pod \"multus-additional-cni-plugins-cj25f\" (UID: \"c92f5312-fb6f-4bd2-9e9a-89363c65621c\") " pod="openshift-multus/multus-additional-cni-plugins-cj25f" Jul 24 11:23:30.565222 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.564031 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c92f5312-fb6f-4bd2-9e9a-89363c65621c-cnibin\") pod \"multus-additional-cni-plugins-cj25f\" (UID: \"c92f5312-fb6f-4bd2-9e9a-89363c65621c\") " pod="openshift-multus/multus-additional-cni-plugins-cj25f" Jul 24 11:23:30.565222 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.564032 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fec1ec6a-7f13-4dfb-8fdf-dec73487246d-cnibin\") pod \"multus-s7l4r\" (UID: \"fec1ec6a-7f13-4dfb-8fdf-dec73487246d\") " pod="openshift-multus/multus-s7l4r" Jul 24 11:23:30.565222 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.564047 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fec1ec6a-7f13-4dfb-8fdf-dec73487246d-os-release\") pod \"multus-s7l4r\" (UID: \"fec1ec6a-7f13-4dfb-8fdf-dec73487246d\") " pod="openshift-multus/multus-s7l4r" Jul 24 11:23:30.565222 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.564064 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/04e77e9d-0516-48e9-bca4-cd32c4c9e82c-etc-selinux\") pod \"aws-ebs-csi-driver-node-qssdq\" (UID: \"04e77e9d-0516-48e9-bca4-cd32c4c9e82c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qssdq" Jul 24 11:23:30.565222 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.564103 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wl7ht\" (UniqueName: \"kubernetes.io/projected/04e77e9d-0516-48e9-bca4-cd32c4c9e82c-kube-api-access-wl7ht\") pod \"aws-ebs-csi-driver-node-qssdq\" (UID: \"04e77e9d-0516-48e9-bca4-cd32c4c9e82c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qssdq" Jul 24 11:23:30.565222 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.564117 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fec1ec6a-7f13-4dfb-8fdf-dec73487246d-os-release\") pod \"multus-s7l4r\" (UID: \"fec1ec6a-7f13-4dfb-8fdf-dec73487246d\") " pod="openshift-multus/multus-s7l4r" Jul 24 11:23:30.565222 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.564139 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d66aa4b3-d28b-4a11-a0b0-5e45ec334583-etc-sysctl-d\") pod \"tuned-smc7z\" (UID: \"d66aa4b3-d28b-4a11-a0b0-5e45ec334583\") " pod="openshift-cluster-node-tuning-operator/tuned-smc7z" Jul 24 11:23:30.565222 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.564161 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fec1ec6a-7f13-4dfb-8fdf-dec73487246d-system-cni-dir\") pod \"multus-s7l4r\" (UID: \"fec1ec6a-7f13-4dfb-8fdf-dec73487246d\") " pod="openshift-multus/multus-s7l4r" Jul 24 11:23:30.565222 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.564180 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5tjc\" (UniqueName: \"kubernetes.io/projected/c92f5312-fb6f-4bd2-9e9a-89363c65621c-kube-api-access-b5tjc\") pod \"multus-additional-cni-plugins-cj25f\" (UID: \"c92f5312-fb6f-4bd2-9e9a-89363c65621c\") " pod="openshift-multus/multus-additional-cni-plugins-cj25f" Jul 24 11:23:30.565222 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.564159 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/04e77e9d-0516-48e9-bca4-cd32c4c9e82c-etc-selinux\") pod \"aws-ebs-csi-driver-node-qssdq\" (UID: \"04e77e9d-0516-48e9-bca4-cd32c4c9e82c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qssdq" Jul 24 11:23:30.565222 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.564200 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d66aa4b3-d28b-4a11-a0b0-5e45ec334583-lib-modules\") pod \"tuned-smc7z\" (UID: \"d66aa4b3-d28b-4a11-a0b0-5e45ec334583\") " pod="openshift-cluster-node-tuning-operator/tuned-smc7z" Jul 24 11:23:30.565222 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.564228 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d66aa4b3-d28b-4a11-a0b0-5e45ec334583-var-lib-kubelet\") pod \"tuned-smc7z\" (UID: \"d66aa4b3-d28b-4a11-a0b0-5e45ec334583\") " pod="openshift-cluster-node-tuning-operator/tuned-smc7z" Jul 24 11:23:30.565222 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.564246 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fec1ec6a-7f13-4dfb-8fdf-dec73487246d-cni-binary-copy\") pod \"multus-s7l4r\" (UID: \"fec1ec6a-7f13-4dfb-8fdf-dec73487246d\") " pod="openshift-multus/multus-s7l4r" Jul 24 11:23:30.565222 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.564259 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fec1ec6a-7f13-4dfb-8fdf-dec73487246d-system-cni-dir\") pod \"multus-s7l4r\" (UID: \"fec1ec6a-7f13-4dfb-8fdf-dec73487246d\") " pod="openshift-multus/multus-s7l4r" Jul 24 11:23:30.565222 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.564263 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/321eae1c-057a-42e8-85e3-ddb84821b4d6-hosts-file\") pod \"node-resolver-82kpg\" (UID: \"321eae1c-057a-42e8-85e3-ddb84821b4d6\") " pod="openshift-dns/node-resolver-82kpg" Jul 24 11:23:30.565825 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.564273 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d66aa4b3-d28b-4a11-a0b0-5e45ec334583-etc-sysctl-d\") pod \"tuned-smc7z\" (UID: \"d66aa4b3-d28b-4a11-a0b0-5e45ec334583\") " pod="openshift-cluster-node-tuning-operator/tuned-smc7z" Jul 24 11:23:30.565825 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.564281 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/321eae1c-057a-42e8-85e3-ddb84821b4d6-tmp-dir\") pod \"node-resolver-82kpg\" (UID: \"321eae1c-057a-42e8-85e3-ddb84821b4d6\") " pod="openshift-dns/node-resolver-82kpg" Jul 24 11:23:30.565825 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.564291 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d66aa4b3-d28b-4a11-a0b0-5e45ec334583-lib-modules\") pod \"tuned-smc7z\" (UID: \"d66aa4b3-d28b-4a11-a0b0-5e45ec334583\") " pod="openshift-cluster-node-tuning-operator/tuned-smc7z" Jul 24 11:23:30.565825 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.564296 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/55c78980-902f-4c71-9557-a0c6631fdc8b-etc-openvswitch\") pod \"ovnkube-node-n7wb9\" (UID: \"55c78980-902f-4c71-9557-a0c6631fdc8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7wb9" Jul 24 11:23:30.565825 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.564317 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d66aa4b3-d28b-4a11-a0b0-5e45ec334583-var-lib-kubelet\") pod \"tuned-smc7z\" (UID: \"d66aa4b3-d28b-4a11-a0b0-5e45ec334583\") " pod="openshift-cluster-node-tuning-operator/tuned-smc7z" Jul 24 11:23:30.565825 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.564357 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e159073-9250-4ffc-aa96-224b8ae48029-metrics-certs\") pod \"network-metrics-daemon-hmcs7\" (UID: \"1e159073-9250-4ffc-aa96-224b8ae48029\") " pod="openshift-multus/network-metrics-daemon-hmcs7" Jul 24 11:23:30.565825 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.564383 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fec1ec6a-7f13-4dfb-8fdf-dec73487246d-multus-conf-dir\") pod \"multus-s7l4r\" (UID: \"fec1ec6a-7f13-4dfb-8fdf-dec73487246d\") " pod="openshift-multus/multus-s7l4r" Jul 24 11:23:30.565825 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.564418 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fec1ec6a-7f13-4dfb-8fdf-dec73487246d-multus-conf-dir\") pod \"multus-s7l4r\" (UID: \"fec1ec6a-7f13-4dfb-8fdf-dec73487246d\") " pod="openshift-multus/multus-s7l4r" Jul 24 11:23:30.565825 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.564419 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9c2ffd69-ca76-424a-9a0f-4e606ff4a872-host-slash\") pod \"iptables-alerter-v9xmz\" (UID: \"9c2ffd69-ca76-424a-9a0f-4e606ff4a872\") " pod="openshift-network-operator/iptables-alerter-v9xmz" Jul 24 11:23:30.565825 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.564472 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9c2ffd69-ca76-424a-9a0f-4e606ff4a872-host-slash\") pod \"iptables-alerter-v9xmz\" (UID: \"9c2ffd69-ca76-424a-9a0f-4e606ff4a872\") " pod="openshift-network-operator/iptables-alerter-v9xmz" Jul 24 11:23:30.565825 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.564500 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/55c78980-902f-4c71-9557-a0c6631fdc8b-run-systemd\") pod \"ovnkube-node-n7wb9\" (UID: \"55c78980-902f-4c71-9557-a0c6631fdc8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7wb9" Jul 24 11:23:30.565825 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.564556 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/55c78980-902f-4c71-9557-a0c6631fdc8b-host-cni-netd\") pod \"ovnkube-node-n7wb9\" (UID: \"55c78980-902f-4c71-9557-a0c6631fdc8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7wb9" Jul 24 11:23:30.565825 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.564602 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/55c78980-902f-4c71-9557-a0c6631fdc8b-ovnkube-script-lib\") pod \"ovnkube-node-n7wb9\" (UID: \"55c78980-902f-4c71-9557-a0c6631fdc8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7wb9" Jul 24 11:23:30.565825 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.564646 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c92f5312-fb6f-4bd2-9e9a-89363c65621c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cj25f\" (UID: \"c92f5312-fb6f-4bd2-9e9a-89363c65621c\") " pod="openshift-multus/multus-additional-cni-plugins-cj25f" Jul 24 11:23:30.565825 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.564675 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9c2ffd69-ca76-424a-9a0f-4e606ff4a872-iptables-alerter-script\") pod \"iptables-alerter-v9xmz\" (UID: \"9c2ffd69-ca76-424a-9a0f-4e606ff4a872\") " pod="openshift-network-operator/iptables-alerter-v9xmz" Jul 24 11:23:30.565825 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.564700 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/04e77e9d-0516-48e9-bca4-cd32c4c9e82c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qssdq\" (UID: \"04e77e9d-0516-48e9-bca4-cd32c4c9e82c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qssdq" Jul 24 11:23:30.565825 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.564737 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d66aa4b3-d28b-4a11-a0b0-5e45ec334583-etc-systemd\") pod \"tuned-smc7z\" (UID: \"d66aa4b3-d28b-4a11-a0b0-5e45ec334583\") " pod="openshift-cluster-node-tuning-operator/tuned-smc7z" Jul 24 11:23:30.566314 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.564763 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d66aa4b3-d28b-4a11-a0b0-5e45ec334583-host\") pod \"tuned-smc7z\" (UID: \"d66aa4b3-d28b-4a11-a0b0-5e45ec334583\") " pod="openshift-cluster-node-tuning-operator/tuned-smc7z" Jul 24 11:23:30.566314 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.564775 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/04e77e9d-0516-48e9-bca4-cd32c4c9e82c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qssdq\" (UID: \"04e77e9d-0516-48e9-bca4-cd32c4c9e82c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qssdq" Jul 24 11:23:30.566314 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.564791 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fec1ec6a-7f13-4dfb-8fdf-dec73487246d-host-var-lib-cni-multus\") pod \"multus-s7l4r\" (UID: \"fec1ec6a-7f13-4dfb-8fdf-dec73487246d\") " pod="openshift-multus/multus-s7l4r" Jul 24 11:23:30.566314 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.564802 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d66aa4b3-d28b-4a11-a0b0-5e45ec334583-etc-systemd\") pod \"tuned-smc7z\" (UID: \"d66aa4b3-d28b-4a11-a0b0-5e45ec334583\") " pod="openshift-cluster-node-tuning-operator/tuned-smc7z" Jul 24 11:23:30.566314 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.564818 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/55c78980-902f-4c71-9557-a0c6631fdc8b-host-kubelet\") pod \"ovnkube-node-n7wb9\" (UID: \"55c78980-902f-4c71-9557-a0c6631fdc8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7wb9" Jul 24 11:23:30.566314 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.564812 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d66aa4b3-d28b-4a11-a0b0-5e45ec334583-host\") pod \"tuned-smc7z\" (UID: \"d66aa4b3-d28b-4a11-a0b0-5e45ec334583\") " pod="openshift-cluster-node-tuning-operator/tuned-smc7z" Jul 24 11:23:30.566314 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.564816 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fec1ec6a-7f13-4dfb-8fdf-dec73487246d-multus-daemon-config\") pod \"multus-s7l4r\" (UID: \"fec1ec6a-7f13-4dfb-8fdf-dec73487246d\") " pod="openshift-multus/multus-s7l4r" Jul 24 11:23:30.566314 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.564837 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fec1ec6a-7f13-4dfb-8fdf-dec73487246d-host-var-lib-cni-multus\") pod \"multus-s7l4r\" (UID: \"fec1ec6a-7f13-4dfb-8fdf-dec73487246d\") " pod="openshift-multus/multus-s7l4r" Jul 24 11:23:30.566314 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.564816 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fec1ec6a-7f13-4dfb-8fdf-dec73487246d-cni-binary-copy\") pod \"multus-s7l4r\" (UID: \"fec1ec6a-7f13-4dfb-8fdf-dec73487246d\") " pod="openshift-multus/multus-s7l4r" Jul 24 11:23:30.566314 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.564845 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/55c78980-902f-4c71-9557-a0c6631fdc8b-run-openvswitch\") pod \"ovnkube-node-n7wb9\" (UID: \"55c78980-902f-4c71-9557-a0c6631fdc8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7wb9" Jul 24 11:23:30.566314 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.564901 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/55c78980-902f-4c71-9557-a0c6631fdc8b-host-cni-bin\") pod \"ovnkube-node-n7wb9\" (UID: \"55c78980-902f-4c71-9557-a0c6631fdc8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7wb9" Jul 24 11:23:30.566314 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.564927 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d66aa4b3-d28b-4a11-a0b0-5e45ec334583-etc-sysctl-conf\") pod \"tuned-smc7z\" (UID: \"d66aa4b3-d28b-4a11-a0b0-5e45ec334583\") " pod="openshift-cluster-node-tuning-operator/tuned-smc7z" Jul 24 11:23:30.566314 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.564954 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d66aa4b3-d28b-4a11-a0b0-5e45ec334583-etc-tuned\") pod \"tuned-smc7z\" (UID: \"d66aa4b3-d28b-4a11-a0b0-5e45ec334583\") " pod="openshift-cluster-node-tuning-operator/tuned-smc7z" Jul 24 11:23:30.566314 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.564986 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6d6115b5-67cb-4f64-b157-29872df323bb-serviceca\") pod \"node-ca-vdcjb\" (UID: \"6d6115b5-67cb-4f64-b157-29872df323bb\") " pod="openshift-image-registry/node-ca-vdcjb" Jul 24 11:23:30.566314 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.565023 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5t286\" (UniqueName: \"kubernetes.io/projected/d66aa4b3-d28b-4a11-a0b0-5e45ec334583-kube-api-access-5t286\") pod \"tuned-smc7z\" (UID: \"d66aa4b3-d28b-4a11-a0b0-5e45ec334583\") " pod="openshift-cluster-node-tuning-operator/tuned-smc7z" Jul 24 11:23:30.566314 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.565047 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/55c78980-902f-4c71-9557-a0c6631fdc8b-run-ovn\") pod \"ovnkube-node-n7wb9\" (UID: \"55c78980-902f-4c71-9557-a0c6631fdc8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7wb9" Jul 24 11:23:30.566314 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.565081 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/55c78980-902f-4c71-9557-a0c6631fdc8b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-n7wb9\" (UID: \"55c78980-902f-4c71-9557-a0c6631fdc8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7wb9" Jul 24 11:23:30.566314 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.565085 2586 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 24 11:23:30.566849 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.565111 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wzkf\" (UniqueName: \"kubernetes.io/projected/6d6115b5-67cb-4f64-b157-29872df323bb-kube-api-access-2wzkf\") pod \"node-ca-vdcjb\" (UID: \"6d6115b5-67cb-4f64-b157-29872df323bb\") " pod="openshift-image-registry/node-ca-vdcjb" Jul 24 11:23:30.566849 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.565148 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d66aa4b3-d28b-4a11-a0b0-5e45ec334583-etc-sysctl-conf\") pod \"tuned-smc7z\" (UID: \"d66aa4b3-d28b-4a11-a0b0-5e45ec334583\") " pod="openshift-cluster-node-tuning-operator/tuned-smc7z" Jul 24 11:23:30.566849 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.565151 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/04e77e9d-0516-48e9-bca4-cd32c4c9e82c-socket-dir\") pod \"aws-ebs-csi-driver-node-qssdq\" (UID: \"04e77e9d-0516-48e9-bca4-cd32c4c9e82c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qssdq" Jul 24 11:23:30.566849 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.565200 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlzbx\" (UniqueName: \"kubernetes.io/projected/a5939932-1706-4bde-9ca9-9e03ae19d047-kube-api-access-mlzbx\") pod \"network-check-target-7hx7h\" (UID: \"a5939932-1706-4bde-9ca9-9e03ae19d047\") " pod="openshift-network-diagnostics/network-check-target-7hx7h" Jul 24 11:23:30.566849 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.565238 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9c2ffd69-ca76-424a-9a0f-4e606ff4a872-iptables-alerter-script\") pod \"iptables-alerter-v9xmz\" (UID: \"9c2ffd69-ca76-424a-9a0f-4e606ff4a872\") " pod="openshift-network-operator/iptables-alerter-v9xmz" Jul 24 11:23:30.566849 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.565246 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/04e77e9d-0516-48e9-bca4-cd32c4c9e82c-socket-dir\") pod \"aws-ebs-csi-driver-node-qssdq\" (UID: \"04e77e9d-0516-48e9-bca4-cd32c4c9e82c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qssdq" Jul 24 11:23:30.568254 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.568237 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d66aa4b3-d28b-4a11-a0b0-5e45ec334583-tmp\") pod \"tuned-smc7z\" (UID: \"d66aa4b3-d28b-4a11-a0b0-5e45ec334583\") " pod="openshift-cluster-node-tuning-operator/tuned-smc7z" Jul 24 11:23:30.568345 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.568314 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d66aa4b3-d28b-4a11-a0b0-5e45ec334583-etc-tuned\") pod \"tuned-smc7z\" (UID: \"d66aa4b3-d28b-4a11-a0b0-5e45ec334583\") " pod="openshift-cluster-node-tuning-operator/tuned-smc7z" Jul 24 11:23:30.571263 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.571240 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wls9c\" (UniqueName: \"kubernetes.io/projected/fec1ec6a-7f13-4dfb-8fdf-dec73487246d-kube-api-access-wls9c\") pod \"multus-s7l4r\" (UID: \"fec1ec6a-7f13-4dfb-8fdf-dec73487246d\") " pod="openshift-multus/multus-s7l4r" Jul 24 11:23:30.571975 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:23:30.571956 2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 11:23:30.572080 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:23:30.571978 2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 11:23:30.572080 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:23:30.571988 2586 projected.go:196] Error preparing data for projected volume kube-api-access-mlzbx for pod openshift-network-diagnostics/network-check-target-7hx7h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 11:23:30.572080 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:23:30.572053 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a5939932-1706-4bde-9ca9-9e03ae19d047-kube-api-access-mlzbx podName:a5939932-1706-4bde-9ca9-9e03ae19d047 nodeName:}" failed. No retries permitted until 2026-07-24 11:23:31.072035286 +0000 UTC m=+2.090089817 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-mlzbx" (UniqueName: "kubernetes.io/projected/a5939932-1706-4bde-9ca9-9e03ae19d047-kube-api-access-mlzbx") pod "network-check-target-7hx7h" (UID: "a5939932-1706-4bde-9ca9-9e03ae19d047") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 11:23:30.573540 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.573517 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfgzv\" (UniqueName: \"kubernetes.io/projected/9c2ffd69-ca76-424a-9a0f-4e606ff4a872-kube-api-access-tfgzv\") pod \"iptables-alerter-v9xmz\" (UID: \"9c2ffd69-ca76-424a-9a0f-4e606ff4a872\") " pod="openshift-network-operator/iptables-alerter-v9xmz" Jul 24 11:23:30.583127 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.577526 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5t286\" (UniqueName: \"kubernetes.io/projected/d66aa4b3-d28b-4a11-a0b0-5e45ec334583-kube-api-access-5t286\") pod \"tuned-smc7z\" (UID: \"d66aa4b3-d28b-4a11-a0b0-5e45ec334583\") " pod="openshift-cluster-node-tuning-operator/tuned-smc7z" Jul 24 11:23:30.583237 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.583215 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wl7ht\" (UniqueName: \"kubernetes.io/projected/04e77e9d-0516-48e9-bca4-cd32c4c9e82c-kube-api-access-wl7ht\") pod \"aws-ebs-csi-driver-node-qssdq\" (UID: \"04e77e9d-0516-48e9-bca4-cd32c4c9e82c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qssdq" Jul 24 11:23:30.665520 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.665484 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6d6115b5-67cb-4f64-b157-29872df323bb-host\") pod \"node-ca-vdcjb\" (UID: \"6d6115b5-67cb-4f64-b157-29872df323bb\") " pod="openshift-image-registry/node-ca-vdcjb" Jul 24 11:23:30.665520 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.665524 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c92f5312-fb6f-4bd2-9e9a-89363c65621c-system-cni-dir\") pod \"multus-additional-cni-plugins-cj25f\" (UID: \"c92f5312-fb6f-4bd2-9e9a-89363c65621c\") " pod="openshift-multus/multus-additional-cni-plugins-cj25f" Jul 24 11:23:30.665785 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.665546 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c92f5312-fb6f-4bd2-9e9a-89363c65621c-cnibin\") pod \"multus-additional-cni-plugins-cj25f\" (UID: \"c92f5312-fb6f-4bd2-9e9a-89363c65621c\") " pod="openshift-multus/multus-additional-cni-plugins-cj25f" Jul 24 11:23:30.665785 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.665569 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5tjc\" (UniqueName: \"kubernetes.io/projected/c92f5312-fb6f-4bd2-9e9a-89363c65621c-kube-api-access-b5tjc\") pod \"multus-additional-cni-plugins-cj25f\" (UID: \"c92f5312-fb6f-4bd2-9e9a-89363c65621c\") " pod="openshift-multus/multus-additional-cni-plugins-cj25f" Jul 24 11:23:30.665785 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.665612 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/321eae1c-057a-42e8-85e3-ddb84821b4d6-hosts-file\") pod \"node-resolver-82kpg\" (UID: \"321eae1c-057a-42e8-85e3-ddb84821b4d6\") " pod="openshift-dns/node-resolver-82kpg" Jul 24 11:23:30.665785 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.665615 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6d6115b5-67cb-4f64-b157-29872df323bb-host\") pod \"node-ca-vdcjb\" (UID: \"6d6115b5-67cb-4f64-b157-29872df323bb\") " pod="openshift-image-registry/node-ca-vdcjb" Jul 24 11:23:30.665785 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.665635 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/321eae1c-057a-42e8-85e3-ddb84821b4d6-tmp-dir\") pod \"node-resolver-82kpg\" (UID: \"321eae1c-057a-42e8-85e3-ddb84821b4d6\") " pod="openshift-dns/node-resolver-82kpg" Jul 24 11:23:30.665785 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.665615 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c92f5312-fb6f-4bd2-9e9a-89363c65621c-system-cni-dir\") pod \"multus-additional-cni-plugins-cj25f\" (UID: \"c92f5312-fb6f-4bd2-9e9a-89363c65621c\") " pod="openshift-multus/multus-additional-cni-plugins-cj25f" Jul 24 11:23:30.665785 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.665659 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/55c78980-902f-4c71-9557-a0c6631fdc8b-etc-openvswitch\") pod \"ovnkube-node-n7wb9\" (UID: \"55c78980-902f-4c71-9557-a0c6631fdc8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7wb9" Jul 24 11:23:30.665785 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.665686 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e159073-9250-4ffc-aa96-224b8ae48029-metrics-certs\") pod \"network-metrics-daemon-hmcs7\" (UID: \"1e159073-9250-4ffc-aa96-224b8ae48029\") " pod="openshift-multus/network-metrics-daemon-hmcs7" Jul 24 11:23:30.665785 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.665685 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/321eae1c-057a-42e8-85e3-ddb84821b4d6-hosts-file\") pod \"node-resolver-82kpg\" (UID: \"321eae1c-057a-42e8-85e3-ddb84821b4d6\") " pod="openshift-dns/node-resolver-82kpg" Jul 24 11:23:30.665785 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.665699 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/55c78980-902f-4c71-9557-a0c6631fdc8b-etc-openvswitch\") pod \"ovnkube-node-n7wb9\" (UID: \"55c78980-902f-4c71-9557-a0c6631fdc8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7wb9" Jul 24 11:23:30.665785 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.665713 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/55c78980-902f-4c71-9557-a0c6631fdc8b-run-systemd\") pod \"ovnkube-node-n7wb9\" (UID: \"55c78980-902f-4c71-9557-a0c6631fdc8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7wb9" Jul 24 11:23:30.665785 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.665738 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/55c78980-902f-4c71-9557-a0c6631fdc8b-host-cni-netd\") pod \"ovnkube-node-n7wb9\" (UID: \"55c78980-902f-4c71-9557-a0c6631fdc8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7wb9" Jul 24 11:23:30.665785 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.665761 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/55c78980-902f-4c71-9557-a0c6631fdc8b-ovnkube-script-lib\") pod \"ovnkube-node-n7wb9\" (UID: \"55c78980-902f-4c71-9557-a0c6631fdc8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7wb9" Jul 24 11:23:30.665785 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.665785 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c92f5312-fb6f-4bd2-9e9a-89363c65621c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cj25f\" (UID: \"c92f5312-fb6f-4bd2-9e9a-89363c65621c\") " pod="openshift-multus/multus-additional-cni-plugins-cj25f" Jul 24 11:23:30.666545 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.665781 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/55c78980-902f-4c71-9557-a0c6631fdc8b-run-systemd\") pod \"ovnkube-node-n7wb9\" (UID: \"55c78980-902f-4c71-9557-a0c6631fdc8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7wb9" Jul 24 11:23:30.666545 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.665815 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/55c78980-902f-4c71-9557-a0c6631fdc8b-host-kubelet\") pod \"ovnkube-node-n7wb9\" (UID: \"55c78980-902f-4c71-9557-a0c6631fdc8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7wb9" Jul 24 11:23:30.666545 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:23:30.665780 2586 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 11:23:30.666545 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.665833 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/55c78980-902f-4c71-9557-a0c6631fdc8b-host-cni-netd\") pod \"ovnkube-node-n7wb9\" (UID: \"55c78980-902f-4c71-9557-a0c6631fdc8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7wb9" Jul 24 11:23:30.666545 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.665839 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/55c78980-902f-4c71-9557-a0c6631fdc8b-run-openvswitch\") pod \"ovnkube-node-n7wb9\" (UID: \"55c78980-902f-4c71-9557-a0c6631fdc8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7wb9" Jul 24 11:23:30.666545 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.665655 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c92f5312-fb6f-4bd2-9e9a-89363c65621c-cnibin\") pod \"multus-additional-cni-plugins-cj25f\" (UID: \"c92f5312-fb6f-4bd2-9e9a-89363c65621c\") " pod="openshift-multus/multus-additional-cni-plugins-cj25f" Jul 24 11:23:30.666545 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.665881 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/55c78980-902f-4c71-9557-a0c6631fdc8b-run-openvswitch\") pod \"ovnkube-node-n7wb9\" (UID: \"55c78980-902f-4c71-9557-a0c6631fdc8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7wb9" Jul 24 11:23:30.666545 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:23:30.665914 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e159073-9250-4ffc-aa96-224b8ae48029-metrics-certs podName:1e159073-9250-4ffc-aa96-224b8ae48029 nodeName:}" failed. No retries permitted until 2026-07-24 11:23:31.165872971 +0000 UTC m=+2.183927509 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1e159073-9250-4ffc-aa96-224b8ae48029-metrics-certs") pod "network-metrics-daemon-hmcs7" (UID: "1e159073-9250-4ffc-aa96-224b8ae48029") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 11:23:30.666545 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.665920 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/55c78980-902f-4c71-9557-a0c6631fdc8b-host-kubelet\") pod \"ovnkube-node-n7wb9\" (UID: \"55c78980-902f-4c71-9557-a0c6631fdc8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7wb9" Jul 24 11:23:30.666545 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.665933 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/321eae1c-057a-42e8-85e3-ddb84821b4d6-tmp-dir\") pod \"node-resolver-82kpg\" (UID: \"321eae1c-057a-42e8-85e3-ddb84821b4d6\") " pod="openshift-dns/node-resolver-82kpg" Jul 24 11:23:30.666545 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.665938 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/55c78980-902f-4c71-9557-a0c6631fdc8b-host-cni-bin\") pod \"ovnkube-node-n7wb9\" (UID: \"55c78980-902f-4c71-9557-a0c6631fdc8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7wb9" Jul 24 11:23:30.666545 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.665986 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6d6115b5-67cb-4f64-b157-29872df323bb-serviceca\") pod \"node-ca-vdcjb\" (UID: \"6d6115b5-67cb-4f64-b157-29872df323bb\") " pod="openshift-image-registry/node-ca-vdcjb" Jul 24 11:23:30.666545 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.666014 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/55c78980-902f-4c71-9557-a0c6631fdc8b-run-ovn\") pod \"ovnkube-node-n7wb9\" (UID: \"55c78980-902f-4c71-9557-a0c6631fdc8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7wb9" Jul 24 11:23:30.666545 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.666027 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c92f5312-fb6f-4bd2-9e9a-89363c65621c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cj25f\" (UID: \"c92f5312-fb6f-4bd2-9e9a-89363c65621c\") " pod="openshift-multus/multus-additional-cni-plugins-cj25f" Jul 24 11:23:30.666545 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.666014 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/55c78980-902f-4c71-9557-a0c6631fdc8b-host-cni-bin\") pod \"ovnkube-node-n7wb9\" (UID: \"55c78980-902f-4c71-9557-a0c6631fdc8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7wb9" Jul 24 11:23:30.666545 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.666043 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/55c78980-902f-4c71-9557-a0c6631fdc8b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-n7wb9\" (UID: \"55c78980-902f-4c71-9557-a0c6631fdc8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7wb9" Jul 24 11:23:30.666545 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.666095 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/55c78980-902f-4c71-9557-a0c6631fdc8b-run-ovn\") pod \"ovnkube-node-n7wb9\" (UID: \"55c78980-902f-4c71-9557-a0c6631fdc8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7wb9" Jul 24 11:23:30.667542 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.666096 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/55c78980-902f-4c71-9557-a0c6631fdc8b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-n7wb9\" (UID: \"55c78980-902f-4c71-9557-a0c6631fdc8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7wb9" Jul 24 11:23:30.667542 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.666120 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wzkf\" (UniqueName: \"kubernetes.io/projected/6d6115b5-67cb-4f64-b157-29872df323bb-kube-api-access-2wzkf\") pod \"node-ca-vdcjb\" (UID: \"6d6115b5-67cb-4f64-b157-29872df323bb\") " pod="openshift-image-registry/node-ca-vdcjb" Jul 24 11:23:30.667542 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.666168 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cc095a00-6820-40bf-a3a4-24c63bf7869b-original-pull-secret\") pod \"global-pull-secret-syncer-6djk7\" (UID: \"cc095a00-6820-40bf-a3a4-24c63bf7869b\") " pod="kube-system/global-pull-secret-syncer-6djk7" Jul 24 11:23:30.667542 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.666195 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/55c78980-902f-4c71-9557-a0c6631fdc8b-host-run-netns\") pod \"ovnkube-node-n7wb9\" (UID: \"55c78980-902f-4c71-9557-a0c6631fdc8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7wb9" Jul 24 11:23:30.667542 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.666227 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/55c78980-902f-4c71-9557-a0c6631fdc8b-log-socket\") pod \"ovnkube-node-n7wb9\" (UID: \"55c78980-902f-4c71-9557-a0c6631fdc8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7wb9" Jul 24 11:23:30.667542 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.666252 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27kh9\" (UniqueName: \"kubernetes.io/projected/1e159073-9250-4ffc-aa96-224b8ae48029-kube-api-access-27kh9\") pod \"network-metrics-daemon-hmcs7\" (UID: \"1e159073-9250-4ffc-aa96-224b8ae48029\") " pod="openshift-multus/network-metrics-daemon-hmcs7" Jul 24 11:23:30.667542 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.666283 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/55c78980-902f-4c71-9557-a0c6631fdc8b-ovn-node-metrics-cert\") pod \"ovnkube-node-n7wb9\" (UID: \"55c78980-902f-4c71-9557-a0c6631fdc8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7wb9" Jul 24 11:23:30.667542 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.666310 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/284caaf1-7e86-411d-b5c2-1ffd87dd1017-konnectivity-ca\") pod \"konnectivity-agent-wqkd5\" (UID: \"284caaf1-7e86-411d-b5c2-1ffd87dd1017\") " pod="kube-system/konnectivity-agent-wqkd5" Jul 24 11:23:30.667542 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.666337 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/55c78980-902f-4c71-9557-a0c6631fdc8b-host-run-ovn-kubernetes\") pod \"ovnkube-node-n7wb9\" (UID: \"55c78980-902f-4c71-9557-a0c6631fdc8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7wb9" Jul 24 11:23:30.667542 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:23:30.666346 2586 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 11:23:30.667542 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.666361 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/55c78980-902f-4c71-9557-a0c6631fdc8b-ovnkube-config\") pod \"ovnkube-node-n7wb9\" (UID: \"55c78980-902f-4c71-9557-a0c6631fdc8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7wb9" Jul 24 11:23:30.667542 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:23:30.666398 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc095a00-6820-40bf-a3a4-24c63bf7869b-original-pull-secret podName:cc095a00-6820-40bf-a3a4-24c63bf7869b nodeName:}" failed. No retries permitted until 2026-07-24 11:23:31.166384109 +0000 UTC m=+2.184438633 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cc095a00-6820-40bf-a3a4-24c63bf7869b-original-pull-secret") pod "global-pull-secret-syncer-6djk7" (UID: "cc095a00-6820-40bf-a3a4-24c63bf7869b") : object "kube-system"/"original-pull-secret" not registered Jul 24 11:23:30.667542 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.666433 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c92f5312-fb6f-4bd2-9e9a-89363c65621c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cj25f\" (UID: \"c92f5312-fb6f-4bd2-9e9a-89363c65621c\") " pod="openshift-multus/multus-additional-cni-plugins-cj25f" Jul 24 11:23:30.667542 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.666463 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxrrg\" (UniqueName: \"kubernetes.io/projected/55c78980-902f-4c71-9557-a0c6631fdc8b-kube-api-access-rxrrg\") pod \"ovnkube-node-n7wb9\" (UID: \"55c78980-902f-4c71-9557-a0c6631fdc8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7wb9" Jul 24 11:23:30.667542 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.666480 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cc095a00-6820-40bf-a3a4-24c63bf7869b-kubelet-config\") pod \"global-pull-secret-syncer-6djk7\" (UID: \"cc095a00-6820-40bf-a3a4-24c63bf7869b\") " pod="kube-system/global-pull-secret-syncer-6djk7" Jul 24 11:23:30.667542 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.666499 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c92f5312-fb6f-4bd2-9e9a-89363c65621c-os-release\") pod \"multus-additional-cni-plugins-cj25f\" (UID: \"c92f5312-fb6f-4bd2-9e9a-89363c65621c\") " pod="openshift-multus/multus-additional-cni-plugins-cj25f" Jul 24 11:23:30.668286 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.666285 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/55c78980-902f-4c71-9557-a0c6631fdc8b-host-run-netns\") pod \"ovnkube-node-n7wb9\" (UID: \"55c78980-902f-4c71-9557-a0c6631fdc8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7wb9" Jul 24 11:23:30.668286 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.666522 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c92f5312-fb6f-4bd2-9e9a-89363c65621c-cni-binary-copy\") pod \"multus-additional-cni-plugins-cj25f\" (UID: \"c92f5312-fb6f-4bd2-9e9a-89363c65621c\") " pod="openshift-multus/multus-additional-cni-plugins-cj25f" Jul 24 11:23:30.668286 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.666540 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c92f5312-fb6f-4bd2-9e9a-89363c65621c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cj25f\" (UID: \"c92f5312-fb6f-4bd2-9e9a-89363c65621c\") " pod="openshift-multus/multus-additional-cni-plugins-cj25f" Jul 24 11:23:30.668286 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.666547 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/55c78980-902f-4c71-9557-a0c6631fdc8b-log-socket\") pod \"ovnkube-node-n7wb9\" (UID: \"55c78980-902f-4c71-9557-a0c6631fdc8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7wb9" Jul 24 11:23:30.668286 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.666562 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/55c78980-902f-4c71-9557-a0c6631fdc8b-systemd-units\") pod \"ovnkube-node-n7wb9\" (UID: \"55c78980-902f-4c71-9557-a0c6631fdc8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7wb9" Jul 24 11:23:30.668286 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.666580 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/55c78980-902f-4c71-9557-a0c6631fdc8b-var-lib-openvswitch\") pod \"ovnkube-node-n7wb9\" (UID: \"55c78980-902f-4c71-9557-a0c6631fdc8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7wb9" Jul 24 11:23:30.668286 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.666616 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/55c78980-902f-4c71-9557-a0c6631fdc8b-ovnkube-script-lib\") pod \"ovnkube-node-n7wb9\" (UID: \"55c78980-902f-4c71-9557-a0c6631fdc8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7wb9" Jul 24 11:23:30.668286 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.666630 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/55c78980-902f-4c71-9557-a0c6631fdc8b-var-lib-openvswitch\") pod \"ovnkube-node-n7wb9\" (UID: \"55c78980-902f-4c71-9557-a0c6631fdc8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7wb9" Jul 24 11:23:30.668286 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.666496 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6d6115b5-67cb-4f64-b157-29872df323bb-serviceca\") pod \"node-ca-vdcjb\" (UID: \"6d6115b5-67cb-4f64-b157-29872df323bb\") " pod="openshift-image-registry/node-ca-vdcjb" Jul 24 11:23:30.668286 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.666893 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cc095a00-6820-40bf-a3a4-24c63bf7869b-kubelet-config\") pod \"global-pull-secret-syncer-6djk7\" (UID: \"cc095a00-6820-40bf-a3a4-24c63bf7869b\") " pod="kube-system/global-pull-secret-syncer-6djk7" Jul 24 11:23:30.668286 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.666947 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/55c78980-902f-4c71-9557-a0c6631fdc8b-ovnkube-config\") pod \"ovnkube-node-n7wb9\" (UID: \"55c78980-902f-4c71-9557-a0c6631fdc8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7wb9" Jul 24 11:23:30.668286 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.666967 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c92f5312-fb6f-4bd2-9e9a-89363c65621c-os-release\") pod \"multus-additional-cni-plugins-cj25f\" (UID: \"c92f5312-fb6f-4bd2-9e9a-89363c65621c\") " pod="openshift-multus/multus-additional-cni-plugins-cj25f" Jul 24 11:23:30.668286 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.667018 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/55c78980-902f-4c71-9557-a0c6631fdc8b-host-run-ovn-kubernetes\") pod \"ovnkube-node-n7wb9\" (UID: \"55c78980-902f-4c71-9557-a0c6631fdc8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7wb9" Jul 24 11:23:30.668286 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.667067 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/55c78980-902f-4c71-9557-a0c6631fdc8b-systemd-units\") pod \"ovnkube-node-n7wb9\" (UID: \"55c78980-902f-4c71-9557-a0c6631fdc8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7wb9" Jul 24 11:23:30.668286 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.667173 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c92f5312-fb6f-4bd2-9e9a-89363c65621c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cj25f\" (UID: \"c92f5312-fb6f-4bd2-9e9a-89363c65621c\") " pod="openshift-multus/multus-additional-cni-plugins-cj25f" Jul 24 11:23:30.668286 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.667199 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cc095a00-6820-40bf-a3a4-24c63bf7869b-dbus\") pod \"global-pull-secret-syncer-6djk7\" (UID: \"cc095a00-6820-40bf-a3a4-24c63bf7869b\") " pod="kube-system/global-pull-secret-syncer-6djk7" Jul 24 11:23:30.668286 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.667230 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/284caaf1-7e86-411d-b5c2-1ffd87dd1017-konnectivity-ca\") pod \"konnectivity-agent-wqkd5\" (UID: \"284caaf1-7e86-411d-b5c2-1ffd87dd1017\") " pod="kube-system/konnectivity-agent-wqkd5" Jul 24 11:23:30.668876 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.667244 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fzkx\" (UniqueName: \"kubernetes.io/projected/321eae1c-057a-42e8-85e3-ddb84821b4d6-kube-api-access-6fzkx\") pod \"node-resolver-82kpg\" (UID: \"321eae1c-057a-42e8-85e3-ddb84821b4d6\") " pod="openshift-dns/node-resolver-82kpg" Jul 24 11:23:30.668876 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.667305 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/55c78980-902f-4c71-9557-a0c6631fdc8b-host-slash\") pod \"ovnkube-node-n7wb9\" (UID: \"55c78980-902f-4c71-9557-a0c6631fdc8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7wb9" Jul 24 11:23:30.668876 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.667327 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/55c78980-902f-4c71-9557-a0c6631fdc8b-node-log\") pod \"ovnkube-node-n7wb9\" (UID: \"55c78980-902f-4c71-9557-a0c6631fdc8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7wb9" Jul 24 11:23:30.668876 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.667348 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/55c78980-902f-4c71-9557-a0c6631fdc8b-env-overrides\") pod \"ovnkube-node-n7wb9\" (UID: \"55c78980-902f-4c71-9557-a0c6631fdc8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7wb9" Jul 24 11:23:30.668876 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.667373 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/284caaf1-7e86-411d-b5c2-1ffd87dd1017-agent-certs\") pod \"konnectivity-agent-wqkd5\" (UID: \"284caaf1-7e86-411d-b5c2-1ffd87dd1017\") " pod="kube-system/konnectivity-agent-wqkd5" Jul 24 11:23:30.668876 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.667399 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/55c78980-902f-4c71-9557-a0c6631fdc8b-node-log\") pod \"ovnkube-node-n7wb9\" (UID: \"55c78980-902f-4c71-9557-a0c6631fdc8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7wb9" Jul 24 11:23:30.668876 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.667388 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cc095a00-6820-40bf-a3a4-24c63bf7869b-dbus\") pod \"global-pull-secret-syncer-6djk7\" (UID: \"cc095a00-6820-40bf-a3a4-24c63bf7869b\") " pod="kube-system/global-pull-secret-syncer-6djk7" Jul 24 11:23:30.668876 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.667481 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/55c78980-902f-4c71-9557-a0c6631fdc8b-host-slash\") pod \"ovnkube-node-n7wb9\" (UID: \"55c78980-902f-4c71-9557-a0c6631fdc8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7wb9" Jul 24 11:23:30.668876 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.667613 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c92f5312-fb6f-4bd2-9e9a-89363c65621c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cj25f\" (UID: \"c92f5312-fb6f-4bd2-9e9a-89363c65621c\") " pod="openshift-multus/multus-additional-cni-plugins-cj25f" Jul 24 11:23:30.668876 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.667622 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c92f5312-fb6f-4bd2-9e9a-89363c65621c-cni-binary-copy\") pod \"multus-additional-cni-plugins-cj25f\" (UID: \"c92f5312-fb6f-4bd2-9e9a-89363c65621c\") " pod="openshift-multus/multus-additional-cni-plugins-cj25f" Jul 24 11:23:30.668876 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.667906 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/55c78980-902f-4c71-9557-a0c6631fdc8b-env-overrides\") pod \"ovnkube-node-n7wb9\" (UID: \"55c78980-902f-4c71-9557-a0c6631fdc8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7wb9" Jul 24 11:23:30.669402 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.669378 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/55c78980-902f-4c71-9557-a0c6631fdc8b-ovn-node-metrics-cert\") pod \"ovnkube-node-n7wb9\" (UID: \"55c78980-902f-4c71-9557-a0c6631fdc8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7wb9" Jul 24 11:23:30.669868 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.669845 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/284caaf1-7e86-411d-b5c2-1ffd87dd1017-agent-certs\") pod \"konnectivity-agent-wqkd5\" (UID: \"284caaf1-7e86-411d-b5c2-1ffd87dd1017\") " pod="kube-system/konnectivity-agent-wqkd5" Jul 24 11:23:30.675262 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.675241 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-27kh9\" (UniqueName: \"kubernetes.io/projected/1e159073-9250-4ffc-aa96-224b8ae48029-kube-api-access-27kh9\") pod \"network-metrics-daemon-hmcs7\" (UID: \"1e159073-9250-4ffc-aa96-224b8ae48029\") " pod="openshift-multus/network-metrics-daemon-hmcs7" Jul 24 11:23:30.675401 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.675378 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5tjc\" (UniqueName: \"kubernetes.io/projected/c92f5312-fb6f-4bd2-9e9a-89363c65621c-kube-api-access-b5tjc\") pod \"multus-additional-cni-plugins-cj25f\" (UID: \"c92f5312-fb6f-4bd2-9e9a-89363c65621c\") " pod="openshift-multus/multus-additional-cni-plugins-cj25f" Jul 24 11:23:30.675621 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.675602 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wzkf\" (UniqueName: \"kubernetes.io/projected/6d6115b5-67cb-4f64-b157-29872df323bb-kube-api-access-2wzkf\") pod \"node-ca-vdcjb\" (UID: \"6d6115b5-67cb-4f64-b157-29872df323bb\") " pod="openshift-image-registry/node-ca-vdcjb" Jul 24 11:23:30.676098 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.676078 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxrrg\" (UniqueName: \"kubernetes.io/projected/55c78980-902f-4c71-9557-a0c6631fdc8b-kube-api-access-rxrrg\") pod \"ovnkube-node-n7wb9\" (UID: \"55c78980-902f-4c71-9557-a0c6631fdc8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7wb9" Jul 24 11:23:30.677399 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.677380 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fzkx\" (UniqueName: \"kubernetes.io/projected/321eae1c-057a-42e8-85e3-ddb84821b4d6-kube-api-access-6fzkx\") pod \"node-resolver-82kpg\" (UID: \"321eae1c-057a-42e8-85e3-ddb84821b4d6\") " pod="openshift-dns/node-resolver-82kpg" Jul 24 11:23:30.775362 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.775273 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qssdq" Jul 24 11:23:30.789916 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.789887 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-smc7z" Jul 24 11:23:30.822423 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:30.822379 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04e77e9d_0516_48e9_bca4_cd32c4c9e82c.slice/crio-db2e2d3c6fb06d96cd65a9067fc8eb7bca38969de225834530dbe30ee923a8cd WatchSource:0}: Error finding container db2e2d3c6fb06d96cd65a9067fc8eb7bca38969de225834530dbe30ee923a8cd: Status 404 returned error can't find the container with id db2e2d3c6fb06d96cd65a9067fc8eb7bca38969de225834530dbe30ee923a8cd Jul 24 11:23:30.822798 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:30.822780 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd66aa4b3_d28b_4a11_a0b0_5e45ec334583.slice/crio-1f4112653f2f3ca8fc7ab8e7be3968677aee2904f81addb4ca18c0d7b489b6b1 WatchSource:0}: Error finding container 1f4112653f2f3ca8fc7ab8e7be3968677aee2904f81addb4ca18c0d7b489b6b1: Status 404 returned error can't find the container with id 1f4112653f2f3ca8fc7ab8e7be3968677aee2904f81addb4ca18c0d7b489b6b1 Jul 24 11:23:30.824038 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:30.824006 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podada3248d115cbf6613f9adbfb21b7408.slice/crio-01a71532f4bbf003c15d93c5729da4361ca355ba23ce955ca43df78509a8eeb8 WatchSource:0}: Error finding container 01a71532f4bbf003c15d93c5729da4361ca355ba23ce955ca43df78509a8eeb8: Status 404 returned error can't find the container with id 01a71532f4bbf003c15d93c5729da4361ca355ba23ce955ca43df78509a8eeb8 Jul 24 11:23:30.826475 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:30.826413 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a58966c9c9415e0cb0e62662bc78ddb.slice/crio-60818a3d54f13e5b6dd22006742f28bc8646de30b090c87d906c3c95f9a273d8 WatchSource:0}: Error finding container 60818a3d54f13e5b6dd22006742f28bc8646de30b090c87d906c3c95f9a273d8: Status 404 returned error can't find the container with id 60818a3d54f13e5b6dd22006742f28bc8646de30b090c87d906c3c95f9a273d8 Jul 24 11:23:30.828141 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.828117 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-s7l4r" Jul 24 11:23:30.828918 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.828838 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-v9xmz" Jul 24 11:23:30.828980 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.828925 2586 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 24 11:23:30.834682 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.834641 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-wqkd5" Jul 24 11:23:30.838110 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:30.838079 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfec1ec6a_7f13_4dfb_8fdf_dec73487246d.slice/crio-1a0ca0aad6f35cbe8302f0a107b0e67928e99f1b28984e1dff6fa6075555d058 WatchSource:0}: Error finding container 1a0ca0aad6f35cbe8302f0a107b0e67928e99f1b28984e1dff6fa6075555d058: Status 404 returned error can't find the container with id 1a0ca0aad6f35cbe8302f0a107b0e67928e99f1b28984e1dff6fa6075555d058 Jul 24 11:23:30.843871 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:30.843845 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c2ffd69_ca76_424a_9a0f_4e606ff4a872.slice/crio-7be206a2546239465c1e82c3358bd8e33dafefd74fc272f6f00667ff39f72f35 WatchSource:0}: Error finding container 7be206a2546239465c1e82c3358bd8e33dafefd74fc272f6f00667ff39f72f35: Status 404 returned error can't find the container with id 7be206a2546239465c1e82c3358bd8e33dafefd74fc272f6f00667ff39f72f35 Jul 24 11:23:30.847416 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:30.847388 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod284caaf1_7e86_411d_b5c2_1ffd87dd1017.slice/crio-5ddb1a9617039acc5a8f2e7f029ece6212233c0ca908fb53c32a476368918612 WatchSource:0}: Error finding container 5ddb1a9617039acc5a8f2e7f029ece6212233c0ca908fb53c32a476368918612: Status 404 returned error can't find the container with id 5ddb1a9617039acc5a8f2e7f029ece6212233c0ca908fb53c32a476368918612 Jul 24 11:23:30.886626 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.886566 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-82kpg" Jul 24 11:23:30.896832 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:30.896805 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod321eae1c_057a_42e8_85e3_ddb84821b4d6.slice/crio-4d2dec0830e19ba47bfc404dfbab0d45be46a8cb9e3f7a29467a63a6e0b916b2 WatchSource:0}: Error finding container 4d2dec0830e19ba47bfc404dfbab0d45be46a8cb9e3f7a29467a63a6e0b916b2: Status 404 returned error can't find the container with id 4d2dec0830e19ba47bfc404dfbab0d45be46a8cb9e3f7a29467a63a6e0b916b2 Jul 24 11:23:30.901098 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.901075 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vdcjb" Jul 24 11:23:30.911127 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:30.911096 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d6115b5_67cb_4f64_b157_29872df323bb.slice/crio-924fda97ff7637e8d4f8735c69df3ec97264459456fdba239aff05eecf93e955 WatchSource:0}: Error finding container 924fda97ff7637e8d4f8735c69df3ec97264459456fdba239aff05eecf93e955: Status 404 returned error can't find the container with id 924fda97ff7637e8d4f8735c69df3ec97264459456fdba239aff05eecf93e955 Jul 24 11:23:30.937945 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.937908 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cj25f" Jul 24 11:23:30.939134 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:30.939114 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-n7wb9" Jul 24 11:23:30.948358 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:30.948329 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc92f5312_fb6f_4bd2_9e9a_89363c65621c.slice/crio-0e16bfa109ae3f1dca1ab124b353df6201ce45e825449db7349c280a6203d1b9 WatchSource:0}: Error finding container 0e16bfa109ae3f1dca1ab124b353df6201ce45e825449db7349c280a6203d1b9: Status 404 returned error can't find the container with id 0e16bfa109ae3f1dca1ab124b353df6201ce45e825449db7349c280a6203d1b9 Jul 24 11:23:30.950215 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:23:30.950196 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55c78980_902f_4c71_9557_a0c6631fdc8b.slice/crio-4b427bc84404a8ff4896c6b794ada0ad111c61bd51580809f598f394a6cb0b74 WatchSource:0}: Error finding container 4b427bc84404a8ff4896c6b794ada0ad111c61bd51580809f598f394a6cb0b74: Status 404 returned error can't find the container with id 4b427bc84404a8ff4896c6b794ada0ad111c61bd51580809f598f394a6cb0b74 Jul 24 11:23:30.952383 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:23:30.952362 2586 kuberuntime_manager.go:1459] "Unhandled Error" err="container ovn-controller start failed in pod ovnkube-node-n7wb9_openshift-ovn-kubernetes(55c78980-902f-4c71-9557-a0c6631fdc8b): ErrImagePull: pull QPS exceeded" logger="UnhandledError" Jul 24 11:23:30.953811 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:23:30.953788 2586 kuberuntime_manager.go:1459] "Unhandled Error" err="container kube-rbac-proxy-node start failed in pod ovnkube-node-n7wb9_openshift-ovn-kubernetes(55c78980-902f-4c71-9557-a0c6631fdc8b): ErrImagePull: pull QPS exceeded" logger="UnhandledError" Jul 24 11:23:30.956981 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:23:30.956940 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"ovn-controller\" with ErrImagePull: \"pull QPS exceeded\", failed to \"StartContainer\" for \"ovn-acl-logging\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"kube-rbac-proxy-node\" with ErrImagePull: \"pull QPS exceeded\", failed to \"StartContainer\" for \"kube-rbac-proxy-ovn-metrics\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"northd\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"nbdb\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"sbdb\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"ovnkube-controller\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\": ErrImagePull: pull QPS exceeded\"]" pod="openshift-ovn-kubernetes/ovnkube-node-n7wb9" podUID="55c78980-902f-4c71-9557-a0c6631fdc8b" Jul 24 11:23:31.170955 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:31.170854 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e159073-9250-4ffc-aa96-224b8ae48029-metrics-certs\") pod \"network-metrics-daemon-hmcs7\" (UID: \"1e159073-9250-4ffc-aa96-224b8ae48029\") " pod="openshift-multus/network-metrics-daemon-hmcs7" Jul 24 11:23:31.170955 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:31.170914 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlzbx\" (UniqueName: \"kubernetes.io/projected/a5939932-1706-4bde-9ca9-9e03ae19d047-kube-api-access-mlzbx\") pod \"network-check-target-7hx7h\" (UID: \"a5939932-1706-4bde-9ca9-9e03ae19d047\") " pod="openshift-network-diagnostics/network-check-target-7hx7h" Jul 24 11:23:31.170955 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:31.170943 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cc095a00-6820-40bf-a3a4-24c63bf7869b-original-pull-secret\") pod \"global-pull-secret-syncer-6djk7\" (UID: \"cc095a00-6820-40bf-a3a4-24c63bf7869b\") " pod="kube-system/global-pull-secret-syncer-6djk7" Jul 24 11:23:31.171224 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:23:31.171050 2586 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 11:23:31.171224 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:23:31.171113 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc095a00-6820-40bf-a3a4-24c63bf7869b-original-pull-secret podName:cc095a00-6820-40bf-a3a4-24c63bf7869b nodeName:}" failed. No retries permitted until 2026-07-24 11:23:32.171098821 +0000 UTC m=+3.189153349 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cc095a00-6820-40bf-a3a4-24c63bf7869b-original-pull-secret") pod "global-pull-secret-syncer-6djk7" (UID: "cc095a00-6820-40bf-a3a4-24c63bf7869b") : object "kube-system"/"original-pull-secret" not registered Jul 24 11:23:31.171224 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:23:31.171114 2586 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 11:23:31.171224 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:23:31.171053 2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 11:23:31.171224 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:23:31.171169 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e159073-9250-4ffc-aa96-224b8ae48029-metrics-certs podName:1e159073-9250-4ffc-aa96-224b8ae48029 nodeName:}" failed. No retries permitted until 2026-07-24 11:23:32.171152416 +0000 UTC m=+3.189206944 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1e159073-9250-4ffc-aa96-224b8ae48029-metrics-certs") pod "network-metrics-daemon-hmcs7" (UID: "1e159073-9250-4ffc-aa96-224b8ae48029") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 11:23:31.171224 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:23:31.171193 2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 11:23:31.171224 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:23:31.171208 2586 projected.go:196] Error preparing data for projected volume kube-api-access-mlzbx for pod openshift-network-diagnostics/network-check-target-7hx7h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 11:23:31.171459 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:23:31.171261 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a5939932-1706-4bde-9ca9-9e03ae19d047-kube-api-access-mlzbx podName:a5939932-1706-4bde-9ca9-9e03ae19d047 nodeName:}" failed. No retries permitted until 2026-07-24 11:23:32.171249974 +0000 UTC m=+3.189304502 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-mlzbx" (UniqueName: "kubernetes.io/projected/a5939932-1706-4bde-9ca9-9e03ae19d047-kube-api-access-mlzbx") pod "network-check-target-7hx7h" (UID: "a5939932-1706-4bde-9ca9-9e03ae19d047") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 11:23:31.342658 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:31.342401 2586 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 11:23:31.441003 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:31.440915 2586 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 11:23:31.501503 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:31.501432 2586 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-23 11:18:31 +0000 UTC" deadline="2028-02-05 00:01:13.414673891 +0000 UTC" Jul 24 11:23:31.501503 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:31.501502 2586 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13452h37m41.913177828s" Jul 24 11:23:31.681457 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:31.681422 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmcs7" Jul 24 11:23:31.681647 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:23:31.681580 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hmcs7" podUID="1e159073-9250-4ffc-aa96-224b8ae48029" Jul 24 11:23:31.682092 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:31.682070 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7hx7h" Jul 24 11:23:31.682207 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:23:31.682185 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7hx7h" podUID="a5939932-1706-4bde-9ca9-9e03ae19d047" Jul 24 11:23:31.695773 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:31.695676 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n7wb9" event={"ID":"55c78980-902f-4c71-9557-a0c6631fdc8b","Type":"ContainerStarted","Data":"4b427bc84404a8ff4896c6b794ada0ad111c61bd51580809f598f394a6cb0b74"} Jul 24 11:23:31.715686 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:31.715630 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cj25f" event={"ID":"c92f5312-fb6f-4bd2-9e9a-89363c65621c","Type":"ContainerStarted","Data":"0e16bfa109ae3f1dca1ab124b353df6201ce45e825449db7349c280a6203d1b9"} Jul 24 11:23:31.725821 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:31.725788 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-82kpg" event={"ID":"321eae1c-057a-42e8-85e3-ddb84821b4d6","Type":"ContainerStarted","Data":"4d2dec0830e19ba47bfc404dfbab0d45be46a8cb9e3f7a29467a63a6e0b916b2"} Jul 24 11:23:31.741017 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:23:31.740924 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"ovn-controller\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"ovn-acl-logging\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"kube-rbac-proxy-node\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"kube-rbac-proxy-ovn-metrics\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"northd\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"nbdb\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"sbdb\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"ovnkube-controller\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\": ErrImagePull: pull QPS exceeded\"]" pod="openshift-ovn-kubernetes/ovnkube-node-n7wb9" podUID="55c78980-902f-4c71-9557-a0c6631fdc8b" Jul 24 11:23:31.744169 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:31.744138 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-v9xmz" event={"ID":"9c2ffd69-ca76-424a-9a0f-4e606ff4a872","Type":"ContainerStarted","Data":"7be206a2546239465c1e82c3358bd8e33dafefd74fc272f6f00667ff39f72f35"} Jul 24 11:23:31.766733 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:31.766693 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-219.ec2.internal" event={"ID":"0a58966c9c9415e0cb0e62662bc78ddb","Type":"ContainerStarted","Data":"60818a3d54f13e5b6dd22006742f28bc8646de30b090c87d906c3c95f9a273d8"} Jul 24 11:23:31.770411 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:31.770377 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qssdq" event={"ID":"04e77e9d-0516-48e9-bca4-cd32c4c9e82c","Type":"ContainerStarted","Data":"db2e2d3c6fb06d96cd65a9067fc8eb7bca38969de225834530dbe30ee923a8cd"} Jul 24 11:23:31.780989 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:31.780955 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-smc7z" event={"ID":"d66aa4b3-d28b-4a11-a0b0-5e45ec334583","Type":"ContainerStarted","Data":"1f4112653f2f3ca8fc7ab8e7be3968677aee2904f81addb4ca18c0d7b489b6b1"} Jul 24 11:23:31.787068 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:31.787038 2586 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 11:23:31.806055 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:31.806013 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vdcjb" event={"ID":"6d6115b5-67cb-4f64-b157-29872df323bb","Type":"ContainerStarted","Data":"924fda97ff7637e8d4f8735c69df3ec97264459456fdba239aff05eecf93e955"} Jul 24 11:23:31.824388 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:31.824349 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-wqkd5" event={"ID":"284caaf1-7e86-411d-b5c2-1ffd87dd1017","Type":"ContainerStarted","Data":"5ddb1a9617039acc5a8f2e7f029ece6212233c0ca908fb53c32a476368918612"} Jul 24 11:23:31.830387 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:31.830341 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-s7l4r" event={"ID":"fec1ec6a-7f13-4dfb-8fdf-dec73487246d","Type":"ContainerStarted","Data":"1a0ca0aad6f35cbe8302f0a107b0e67928e99f1b28984e1dff6fa6075555d058"} Jul 24 11:23:31.840678 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:31.840638 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-219.ec2.internal" event={"ID":"ada3248d115cbf6613f9adbfb21b7408","Type":"ContainerStarted","Data":"01a71532f4bbf003c15d93c5729da4361ca355ba23ce955ca43df78509a8eeb8"} Jul 24 11:23:32.180509 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:32.180403 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlzbx\" (UniqueName: \"kubernetes.io/projected/a5939932-1706-4bde-9ca9-9e03ae19d047-kube-api-access-mlzbx\") pod \"network-check-target-7hx7h\" (UID: \"a5939932-1706-4bde-9ca9-9e03ae19d047\") " pod="openshift-network-diagnostics/network-check-target-7hx7h" Jul 24 11:23:32.180509 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:32.180468 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cc095a00-6820-40bf-a3a4-24c63bf7869b-original-pull-secret\") pod \"global-pull-secret-syncer-6djk7\" (UID: \"cc095a00-6820-40bf-a3a4-24c63bf7869b\") " pod="kube-system/global-pull-secret-syncer-6djk7" Jul 24 11:23:32.180767 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:32.180528 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e159073-9250-4ffc-aa96-224b8ae48029-metrics-certs\") pod \"network-metrics-daemon-hmcs7\" (UID: \"1e159073-9250-4ffc-aa96-224b8ae48029\") " pod="openshift-multus/network-metrics-daemon-hmcs7" Jul 24 11:23:32.180767 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:23:32.180689 2586 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 11:23:32.180767 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:23:32.180753 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e159073-9250-4ffc-aa96-224b8ae48029-metrics-certs podName:1e159073-9250-4ffc-aa96-224b8ae48029 nodeName:}" failed. No retries permitted until 2026-07-24 11:23:34.180733758 +0000 UTC m=+5.198788288 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1e159073-9250-4ffc-aa96-224b8ae48029-metrics-certs") pod "network-metrics-daemon-hmcs7" (UID: "1e159073-9250-4ffc-aa96-224b8ae48029") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 11:23:32.181195 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:23:32.181176 2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 11:23:32.181284 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:23:32.181200 2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 11:23:32.181284 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:23:32.181215 2586 projected.go:196] Error preparing data for projected volume kube-api-access-mlzbx for pod openshift-network-diagnostics/network-check-target-7hx7h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 11:23:32.181284 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:23:32.181265 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a5939932-1706-4bde-9ca9-9e03ae19d047-kube-api-access-mlzbx podName:a5939932-1706-4bde-9ca9-9e03ae19d047 nodeName:}" failed. No retries permitted until 2026-07-24 11:23:34.181247453 +0000 UTC m=+5.199301993 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-mlzbx" (UniqueName: "kubernetes.io/projected/a5939932-1706-4bde-9ca9-9e03ae19d047-kube-api-access-mlzbx") pod "network-check-target-7hx7h" (UID: "a5939932-1706-4bde-9ca9-9e03ae19d047") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 11:23:32.181456 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:23:32.181330 2586 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 11:23:32.181456 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:23:32.181365 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc095a00-6820-40bf-a3a4-24c63bf7869b-original-pull-secret podName:cc095a00-6820-40bf-a3a4-24c63bf7869b nodeName:}" failed. No retries permitted until 2026-07-24 11:23:34.181353065 +0000 UTC m=+5.199407594 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cc095a00-6820-40bf-a3a4-24c63bf7869b-original-pull-secret") pod "global-pull-secret-syncer-6djk7" (UID: "cc095a00-6820-40bf-a3a4-24c63bf7869b") : object "kube-system"/"original-pull-secret" not registered Jul 24 11:23:32.501874 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:32.501780 2586 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-23 11:18:31 +0000 UTC" deadline="2028-03-04 12:37:55.919271753 +0000 UTC" Jul 24 11:23:32.501874 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:32.501819 2586 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14137h14m23.417457879s" Jul 24 11:23:32.678914 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:32.678866 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6djk7" Jul 24 11:23:32.679100 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:23:32.679013 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6djk7" podUID="cc095a00-6820-40bf-a3a4-24c63bf7869b" Jul 24 11:23:33.682280 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:33.681493 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7hx7h" Jul 24 11:23:33.682280 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:23:33.681657 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7hx7h" podUID="a5939932-1706-4bde-9ca9-9e03ae19d047" Jul 24 11:23:33.682280 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:33.682047 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmcs7" Jul 24 11:23:33.682280 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:23:33.682152 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hmcs7" podUID="1e159073-9250-4ffc-aa96-224b8ae48029" Jul 24 11:23:34.201319 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:34.201271 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlzbx\" (UniqueName: \"kubernetes.io/projected/a5939932-1706-4bde-9ca9-9e03ae19d047-kube-api-access-mlzbx\") pod \"network-check-target-7hx7h\" (UID: \"a5939932-1706-4bde-9ca9-9e03ae19d047\") " pod="openshift-network-diagnostics/network-check-target-7hx7h" Jul 24 11:23:34.201506 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:34.201337 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cc095a00-6820-40bf-a3a4-24c63bf7869b-original-pull-secret\") pod \"global-pull-secret-syncer-6djk7\" (UID: \"cc095a00-6820-40bf-a3a4-24c63bf7869b\") " pod="kube-system/global-pull-secret-syncer-6djk7" Jul 24 11:23:34.201506 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:34.201415 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e159073-9250-4ffc-aa96-224b8ae48029-metrics-certs\") pod \"network-metrics-daemon-hmcs7\" (UID: \"1e159073-9250-4ffc-aa96-224b8ae48029\") " pod="openshift-multus/network-metrics-daemon-hmcs7" Jul 24 11:23:34.201506 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:23:34.201485 2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 11:23:34.201696 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:23:34.201516 2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 11:23:34.201696 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:23:34.201528 2586 projected.go:196] Error preparing data for projected volume kube-api-access-mlzbx for pod openshift-network-diagnostics/network-check-target-7hx7h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 11:23:34.201696 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:23:34.201553 2586 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 11:23:34.201696 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:23:34.201576 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a5939932-1706-4bde-9ca9-9e03ae19d047-kube-api-access-mlzbx podName:a5939932-1706-4bde-9ca9-9e03ae19d047 nodeName:}" failed. No retries permitted until 2026-07-24 11:23:38.201560064 +0000 UTC m=+9.219614588 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-mlzbx" (UniqueName: "kubernetes.io/projected/a5939932-1706-4bde-9ca9-9e03ae19d047-kube-api-access-mlzbx") pod "network-check-target-7hx7h" (UID: "a5939932-1706-4bde-9ca9-9e03ae19d047") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 11:23:34.201696 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:23:34.201609 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e159073-9250-4ffc-aa96-224b8ae48029-metrics-certs podName:1e159073-9250-4ffc-aa96-224b8ae48029 nodeName:}" failed. No retries permitted until 2026-07-24 11:23:38.201593003 +0000 UTC m=+9.219647528 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1e159073-9250-4ffc-aa96-224b8ae48029-metrics-certs") pod "network-metrics-daemon-hmcs7" (UID: "1e159073-9250-4ffc-aa96-224b8ae48029") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 11:23:34.201982 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:23:34.201706 2586 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 11:23:34.201982 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:23:34.201747 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc095a00-6820-40bf-a3a4-24c63bf7869b-original-pull-secret podName:cc095a00-6820-40bf-a3a4-24c63bf7869b nodeName:}" failed. No retries permitted until 2026-07-24 11:23:38.201733911 +0000 UTC m=+9.219788455 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cc095a00-6820-40bf-a3a4-24c63bf7869b-original-pull-secret") pod "global-pull-secret-syncer-6djk7" (UID: "cc095a00-6820-40bf-a3a4-24c63bf7869b") : object "kube-system"/"original-pull-secret" not registered Jul 24 11:23:34.679165 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:34.679079 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6djk7" Jul 24 11:23:34.679333 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:23:34.679229 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6djk7" podUID="cc095a00-6820-40bf-a3a4-24c63bf7869b" Jul 24 11:23:35.679261 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:35.679220 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7hx7h" Jul 24 11:23:35.679752 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:23:35.679357 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7hx7h" podUID="a5939932-1706-4bde-9ca9-9e03ae19d047" Jul 24 11:23:35.680012 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:35.679866 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmcs7" Jul 24 11:23:35.680012 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:23:35.679969 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hmcs7" podUID="1e159073-9250-4ffc-aa96-224b8ae48029" Jul 24 11:23:36.678972 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:36.678927 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6djk7" Jul 24 11:23:36.679197 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:23:36.679090 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6djk7" podUID="cc095a00-6820-40bf-a3a4-24c63bf7869b" Jul 24 11:23:37.679393 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:37.679309 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmcs7" Jul 24 11:23:37.679872 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:23:37.679463 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hmcs7" podUID="1e159073-9250-4ffc-aa96-224b8ae48029" Jul 24 11:23:37.679872 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:37.679527 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7hx7h" Jul 24 11:23:37.679872 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:23:37.679675 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7hx7h" podUID="a5939932-1706-4bde-9ca9-9e03ae19d047" Jul 24 11:23:38.234989 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:38.234946 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e159073-9250-4ffc-aa96-224b8ae48029-metrics-certs\") pod \"network-metrics-daemon-hmcs7\" (UID: \"1e159073-9250-4ffc-aa96-224b8ae48029\") " pod="openshift-multus/network-metrics-daemon-hmcs7" Jul 24 11:23:38.235202 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:38.235014 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlzbx\" (UniqueName: \"kubernetes.io/projected/a5939932-1706-4bde-9ca9-9e03ae19d047-kube-api-access-mlzbx\") pod \"network-check-target-7hx7h\" (UID: \"a5939932-1706-4bde-9ca9-9e03ae19d047\") " pod="openshift-network-diagnostics/network-check-target-7hx7h" Jul 24 11:23:38.235202 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:38.235042 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cc095a00-6820-40bf-a3a4-24c63bf7869b-original-pull-secret\") pod \"global-pull-secret-syncer-6djk7\" (UID: \"cc095a00-6820-40bf-a3a4-24c63bf7869b\") " pod="kube-system/global-pull-secret-syncer-6djk7" Jul 24 11:23:38.235202 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:23:38.235139 2586 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 11:23:38.235372 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:23:38.235226 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e159073-9250-4ffc-aa96-224b8ae48029-metrics-certs podName:1e159073-9250-4ffc-aa96-224b8ae48029 nodeName:}" failed. No retries permitted until 2026-07-24 11:23:46.235204714 +0000 UTC m=+17.253259264 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1e159073-9250-4ffc-aa96-224b8ae48029-metrics-certs") pod "network-metrics-daemon-hmcs7" (UID: "1e159073-9250-4ffc-aa96-224b8ae48029") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 11:23:38.235372 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:23:38.235144 2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 11:23:38.235372 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:23:38.235265 2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 11:23:38.235372 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:23:38.235276 2586 projected.go:196] Error preparing data for projected volume kube-api-access-mlzbx for pod openshift-network-diagnostics/network-check-target-7hx7h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 11:23:38.235372 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:23:38.235149 2586 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 11:23:38.235372 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:23:38.235323 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a5939932-1706-4bde-9ca9-9e03ae19d047-kube-api-access-mlzbx podName:a5939932-1706-4bde-9ca9-9e03ae19d047 nodeName:}" failed. No retries permitted until 2026-07-24 11:23:46.235308424 +0000 UTC m=+17.253362952 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-mlzbx" (UniqueName: "kubernetes.io/projected/a5939932-1706-4bde-9ca9-9e03ae19d047-kube-api-access-mlzbx") pod "network-check-target-7hx7h" (UID: "a5939932-1706-4bde-9ca9-9e03ae19d047") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 11:23:38.235372 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:23:38.235373 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc095a00-6820-40bf-a3a4-24c63bf7869b-original-pull-secret podName:cc095a00-6820-40bf-a3a4-24c63bf7869b nodeName:}" failed. No retries permitted until 2026-07-24 11:23:46.235350601 +0000 UTC m=+17.253405131 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cc095a00-6820-40bf-a3a4-24c63bf7869b-original-pull-secret") pod "global-pull-secret-syncer-6djk7" (UID: "cc095a00-6820-40bf-a3a4-24c63bf7869b") : object "kube-system"/"original-pull-secret" not registered Jul 24 11:23:38.679257 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:38.679166 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6djk7" Jul 24 11:23:38.679444 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:23:38.679316 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6djk7" podUID="cc095a00-6820-40bf-a3a4-24c63bf7869b" Jul 24 11:23:39.679296 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:39.679261 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmcs7" Jul 24 11:23:39.679296 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:39.679285 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7hx7h" Jul 24 11:23:39.679878 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:23:39.679397 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hmcs7" podUID="1e159073-9250-4ffc-aa96-224b8ae48029" Jul 24 11:23:39.679878 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:23:39.679468 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7hx7h" podUID="a5939932-1706-4bde-9ca9-9e03ae19d047" Jul 24 11:23:40.678982 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:40.678948 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6djk7" Jul 24 11:23:40.679160 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:23:40.679070 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6djk7" podUID="cc095a00-6820-40bf-a3a4-24c63bf7869b" Jul 24 11:23:41.679087 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:41.679051 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7hx7h" Jul 24 11:23:41.679550 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:41.679053 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmcs7" Jul 24 11:23:41.679550 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:23:41.679192 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7hx7h" podUID="a5939932-1706-4bde-9ca9-9e03ae19d047" Jul 24 11:23:41.679550 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:23:41.679295 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hmcs7" podUID="1e159073-9250-4ffc-aa96-224b8ae48029" Jul 24 11:23:42.679170 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:42.679134 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6djk7" Jul 24 11:23:42.679643 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:23:42.679263 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6djk7" podUID="cc095a00-6820-40bf-a3a4-24c63bf7869b" Jul 24 11:23:43.678868 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:43.678815 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7hx7h" Jul 24 11:23:43.679056 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:43.678831 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmcs7" Jul 24 11:23:43.679056 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:23:43.678991 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7hx7h" podUID="a5939932-1706-4bde-9ca9-9e03ae19d047" Jul 24 11:23:43.679056 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:23:43.679031 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hmcs7" podUID="1e159073-9250-4ffc-aa96-224b8ae48029" Jul 24 11:23:44.678951 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:44.678921 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6djk7" Jul 24 11:23:44.679474 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:23:44.679155 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6djk7" podUID="cc095a00-6820-40bf-a3a4-24c63bf7869b" Jul 24 11:23:44.876146 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:44.876102 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-smc7z" event={"ID":"d66aa4b3-d28b-4a11-a0b0-5e45ec334583","Type":"ContainerStarted","Data":"94717b36df956f0e285db091881eb2a28613b52ca056e2815fe3499cc26d475f"} Jul 24 11:23:44.877765 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:44.877738 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-s7l4r" event={"ID":"fec1ec6a-7f13-4dfb-8fdf-dec73487246d","Type":"ContainerStarted","Data":"938f06016c026ed80fbb7c7dd3be32fcb80f6ba9f6692bfa3517f73e64f4d07f"} Jul 24 11:23:44.884249 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:44.884216 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-219.ec2.internal" event={"ID":"0a58966c9c9415e0cb0e62662bc78ddb","Type":"ContainerStarted","Data":"4079f8d0abc05667af1d5b64ca632958d3301b48fe5942b35e71d50841987a75"} Jul 24 11:23:44.894603 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:44.894017 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-smc7z" podStartSLOduration=1.498284429 podStartE2EDuration="14.893997729s" totalImagesPullingTime="13.3957133s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 11:23:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 11:23:44.893974197 +0000 UTC m=+15.912028742" watchObservedRunningTime="2026-07-24 11:23:44.893997729 +0000 UTC m=+15.912052271" Jul 24 11:23:44.907994 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:44.907949 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-219.ec2.internal" podStartSLOduration=14.907933952 podStartE2EDuration="14.907933952s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 11:23:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 11:23:44.907467766 +0000 UTC m=+15.925522310" watchObservedRunningTime="2026-07-24 11:23:44.907933952 +0000 UTC m=+15.925988495" Jul 24 11:23:44.926366 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:44.926317 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-s7l4r" podStartSLOduration=1.269448609 podStartE2EDuration="14.926304196s" totalImagesPullingTime="13.656855587s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 11:23:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 11:23:44.925858301 +0000 UTC m=+15.943912845" watchObservedRunningTime="2026-07-24 11:23:44.926304196 +0000 UTC m=+15.944358739" Jul 24 11:23:45.679867 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:45.679393 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmcs7" Jul 24 11:23:45.679867 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:23:45.679763 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hmcs7" podUID="1e159073-9250-4ffc-aa96-224b8ae48029" Jul 24 11:23:45.680365 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:45.679440 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7hx7h" Jul 24 11:23:45.680365 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:23:45.680192 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7hx7h" podUID="a5939932-1706-4bde-9ca9-9e03ae19d047" Jul 24 11:23:45.888452 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:45.888341 2586 generic.go:356] "Generic (PLEG): container finished" podID="c92f5312-fb6f-4bd2-9e9a-89363c65621c" containerID="ba7898f7328975136bf4404f3e91f014a0a41d1c45bdebd8a2cc993776c3c530" exitCode=0 Jul 24 11:23:45.888631 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:45.888453 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cj25f" event={"ID":"c92f5312-fb6f-4bd2-9e9a-89363c65621c","Type":"ContainerDied","Data":"ba7898f7328975136bf4404f3e91f014a0a41d1c45bdebd8a2cc993776c3c530"} Jul 24 11:23:45.890360 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:45.890331 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-82kpg" event={"ID":"321eae1c-057a-42e8-85e3-ddb84821b4d6","Type":"ContainerStarted","Data":"cdd63626b6bd2a52f07917887b90674bd0aeb00c7e5f3607a98a32ad1495564d"} Jul 24 11:23:45.892342 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:45.892315 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-v9xmz" event={"ID":"9c2ffd69-ca76-424a-9a0f-4e606ff4a872","Type":"ContainerStarted","Data":"86ed94e360228c50a91aea32c0a1c818161301e48da5581f560272295c6b923b"} Jul 24 11:23:45.896713 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:45.896678 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qssdq" event={"ID":"04e77e9d-0516-48e9-bca4-cd32c4c9e82c","Type":"ContainerStarted","Data":"efaff382ff87abc5b9e1ae285039d1658568584ee9822187bfe5351a844d9071"} Jul 24 11:23:45.899130 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:45.899104 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vdcjb" event={"ID":"6d6115b5-67cb-4f64-b157-29872df323bb","Type":"ContainerStarted","Data":"2743281c22c863cb1b4785f27cff67962304d873851a8aaa999bb60974f8ac38"} Jul 24 11:23:45.901209 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:45.901183 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-wqkd5" event={"ID":"284caaf1-7e86-411d-b5c2-1ffd87dd1017","Type":"ContainerStarted","Data":"e3811a457d34bf5e022484a4109494c034b761bdd7bd3618ee4320d1e1d40eb0"} Jul 24 11:23:45.903560 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:45.903422 2586 generic.go:356] "Generic (PLEG): container finished" podID="ada3248d115cbf6613f9adbfb21b7408" containerID="c667e28bfaa95670fc5b1294f038bc777f2032c8c6256aa8026941f509bc9a88" exitCode=0 Jul 24 11:23:45.903560 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:45.903519 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-219.ec2.internal" event={"ID":"ada3248d115cbf6613f9adbfb21b7408","Type":"ContainerDied","Data":"c667e28bfaa95670fc5b1294f038bc777f2032c8c6256aa8026941f509bc9a88"} Jul 24 11:23:45.941012 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:45.940945 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-v9xmz" podStartSLOduration=2.565154005 podStartE2EDuration="15.940924793s" totalImagesPullingTime="13.375770788s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 11:23:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 11:23:45.926979171 +0000 UTC m=+16.945033728" watchObservedRunningTime="2026-07-24 11:23:45.940924793 +0000 UTC m=+16.958979339" Jul 24 11:23:45.955344 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:45.955286 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-wqkd5" podStartSLOduration=6.283192349 podStartE2EDuration="15.955265242s" totalImagesPullingTime="9.672072893s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 11:23:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 11:23:45.941056461 +0000 UTC m=+16.959111005" watchObservedRunningTime="2026-07-24 11:23:45.955265242 +0000 UTC m=+16.973319787" Jul 24 11:23:45.955513 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:45.955448 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-82kpg" podStartSLOduration=2.624310978 podStartE2EDuration="15.955434505s" totalImagesPullingTime="13.331123527s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 11:23:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 11:23:45.955072142 +0000 UTC m=+16.973126713" watchObservedRunningTime="2026-07-24 11:23:45.955434505 +0000 UTC m=+16.973489050" Jul 24 11:23:45.972167 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:45.972108 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-vdcjb" podStartSLOduration=2.662976837 podStartE2EDuration="15.972089546s" totalImagesPullingTime="13.309112709s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 11:23:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 11:23:45.971660627 +0000 UTC m=+16.989715185" watchObservedRunningTime="2026-07-24 11:23:45.972089546 +0000 UTC m=+16.990144089" Jul 24 11:23:46.295293 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:46.295203 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e159073-9250-4ffc-aa96-224b8ae48029-metrics-certs\") pod \"network-metrics-daemon-hmcs7\" (UID: \"1e159073-9250-4ffc-aa96-224b8ae48029\") " pod="openshift-multus/network-metrics-daemon-hmcs7" Jul 24 11:23:46.295293 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:46.295257 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlzbx\" (UniqueName: \"kubernetes.io/projected/a5939932-1706-4bde-9ca9-9e03ae19d047-kube-api-access-mlzbx\") pod \"network-check-target-7hx7h\" (UID: \"a5939932-1706-4bde-9ca9-9e03ae19d047\") " pod="openshift-network-diagnostics/network-check-target-7hx7h" Jul 24 11:23:46.295293 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:46.295280 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cc095a00-6820-40bf-a3a4-24c63bf7869b-original-pull-secret\") pod \"global-pull-secret-syncer-6djk7\" (UID: \"cc095a00-6820-40bf-a3a4-24c63bf7869b\") " pod="kube-system/global-pull-secret-syncer-6djk7" Jul 24 11:23:46.295613 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:23:46.295337 2586 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 11:23:46.295613 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:23:46.295405 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e159073-9250-4ffc-aa96-224b8ae48029-metrics-certs podName:1e159073-9250-4ffc-aa96-224b8ae48029 nodeName:}" failed. No retries permitted until 2026-07-24 11:24:02.295386767 +0000 UTC m=+33.313441292 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1e159073-9250-4ffc-aa96-224b8ae48029-metrics-certs") pod "network-metrics-daemon-hmcs7" (UID: "1e159073-9250-4ffc-aa96-224b8ae48029") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 11:23:46.295613 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:23:46.295431 2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 11:23:46.295613 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:23:46.295453 2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 11:23:46.295613 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:23:46.295456 2586 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 11:23:46.295613 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:23:46.295467 2586 projected.go:196] Error preparing data for projected volume kube-api-access-mlzbx for pod openshift-network-diagnostics/network-check-target-7hx7h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 11:23:46.295613 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:23:46.295504 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc095a00-6820-40bf-a3a4-24c63bf7869b-original-pull-secret podName:cc095a00-6820-40bf-a3a4-24c63bf7869b nodeName:}" failed. No retries permitted until 2026-07-24 11:24:02.295491369 +0000 UTC m=+33.313545891 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cc095a00-6820-40bf-a3a4-24c63bf7869b-original-pull-secret") pod "global-pull-secret-syncer-6djk7" (UID: "cc095a00-6820-40bf-a3a4-24c63bf7869b") : object "kube-system"/"original-pull-secret" not registered Jul 24 11:23:46.295613 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:23:46.295517 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a5939932-1706-4bde-9ca9-9e03ae19d047-kube-api-access-mlzbx podName:a5939932-1706-4bde-9ca9-9e03ae19d047 nodeName:}" failed. No retries permitted until 2026-07-24 11:24:02.295511239 +0000 UTC m=+33.313565761 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-mlzbx" (UniqueName: "kubernetes.io/projected/a5939932-1706-4bde-9ca9-9e03ae19d047-kube-api-access-mlzbx") pod "network-check-target-7hx7h" (UID: "a5939932-1706-4bde-9ca9-9e03ae19d047") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 11:23:46.679611 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:46.679523 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6djk7" Jul 24 11:23:46.679742 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:23:46.679675 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6djk7" podUID="cc095a00-6820-40bf-a3a4-24c63bf7869b" Jul 24 11:23:47.032529 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:47.032503 2586 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 24 11:23:47.536761 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:47.536636 2586 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-24T11:23:47.032527112Z","UUID":"78a2fe42-3ab5-45a9-9b4f-8244ef2c36bf","Handler":null,"Name":"","Endpoint":""} Jul 24 11:23:47.539492 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:47.539467 2586 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 24 11:23:47.539621 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:47.539513 2586 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 24 11:23:47.682427 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:47.682287 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmcs7" Jul 24 11:23:47.682427 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:47.682287 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7hx7h" Jul 24 11:23:47.682676 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:23:47.682433 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hmcs7" podUID="1e159073-9250-4ffc-aa96-224b8ae48029" Jul 24 11:23:47.682676 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:23:47.682481 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7hx7h" podUID="a5939932-1706-4bde-9ca9-9e03ae19d047" Jul 24 11:23:47.910491 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:47.910454 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qssdq" event={"ID":"04e77e9d-0516-48e9-bca4-cd32c4c9e82c","Type":"ContainerStarted","Data":"4904c0bafb0387be282960c2e27939ac7ff3fdddcfb19592fdef71492b6aba91"} Jul 24 11:23:47.912599 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:47.912558 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-219.ec2.internal" event={"ID":"ada3248d115cbf6613f9adbfb21b7408","Type":"ContainerStarted","Data":"267d738211676fb5b58a5e7bfef177d9df7b2f1ef5dcc382cf7534e58dc561cb"} Jul 24 11:23:47.927834 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:47.927792 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-219.ec2.internal" podStartSLOduration=17.92777916 podStartE2EDuration="17.92777916s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 11:23:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 11:23:47.927654147 +0000 UTC m=+18.945708692" watchObservedRunningTime="2026-07-24 11:23:47.92777916 +0000 UTC m=+18.945833703" Jul 24 11:23:48.554444 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:48.554404 2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-wqkd5" Jul 24 11:23:48.556350 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:48.556163 2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-wqkd5" Jul 24 11:23:48.678775 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:48.678741 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6djk7" Jul 24 11:23:48.678922 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:23:48.678878 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6djk7" podUID="cc095a00-6820-40bf-a3a4-24c63bf7869b" Jul 24 11:23:48.917807 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:48.917728 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qssdq" event={"ID":"04e77e9d-0516-48e9-bca4-cd32c4c9e82c","Type":"ContainerStarted","Data":"4279cd573c9cce7b4cd2d53fa172140b9ee78e1650124db1410f6b4b5471be26"} Jul 24 11:23:48.918454 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:48.918431 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-wqkd5" Jul 24 11:23:48.919005 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:48.918989 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-wqkd5" Jul 24 11:23:48.937165 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:48.937112 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qssdq" podStartSLOduration=2.879743856 podStartE2EDuration="18.937093839s" totalImagesPullingTime="16.057349983s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 11:23:30 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 11:23:48.936610188 +0000 UTC m=+19.954664711" watchObservedRunningTime="2026-07-24 11:23:48.937093839 +0000 UTC m=+19.955148383" Jul 24 11:23:49.680266 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:49.680087 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7hx7h" Jul 24 11:23:49.680266 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:23:49.680205 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7hx7h" podUID="a5939932-1706-4bde-9ca9-9e03ae19d047" Jul 24 11:23:49.680741 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:49.680286 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmcs7" Jul 24 11:23:49.680741 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:23:49.680391 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hmcs7" podUID="1e159073-9250-4ffc-aa96-224b8ae48029" Jul 24 11:23:50.678503 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:50.678473 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6djk7" Jul 24 11:23:50.678689 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:23:50.678622 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6djk7" podUID="cc095a00-6820-40bf-a3a4-24c63bf7869b" Jul 24 11:23:51.678849 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:51.678778 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7hx7h" Jul 24 11:23:51.679202 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:23:51.678896 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7hx7h" podUID="a5939932-1706-4bde-9ca9-9e03ae19d047" Jul 24 11:23:51.679202 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:51.678945 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmcs7" Jul 24 11:23:51.679202 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:23:51.679038 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hmcs7" podUID="1e159073-9250-4ffc-aa96-224b8ae48029" Jul 24 11:23:51.926901 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:51.926863 2586 generic.go:356] "Generic (PLEG): container finished" podID="c92f5312-fb6f-4bd2-9e9a-89363c65621c" containerID="335ec0513f4533863dc9dc23c09f353eeea81e2eb99207e273cb56553d180cf4" exitCode=0 Jul 24 11:23:51.927075 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:51.926917 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cj25f" event={"ID":"c92f5312-fb6f-4bd2-9e9a-89363c65621c","Type":"ContainerDied","Data":"335ec0513f4533863dc9dc23c09f353eeea81e2eb99207e273cb56553d180cf4"} Jul 24 11:23:52.679375 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:52.679340 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6djk7" Jul 24 11:23:52.679963 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:23:52.679461 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6djk7" podUID="cc095a00-6820-40bf-a3a4-24c63bf7869b" Jul 24 11:23:53.679542 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:53.679505 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmcs7" Jul 24 11:23:53.680012 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:23:53.679669 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hmcs7" podUID="1e159073-9250-4ffc-aa96-224b8ae48029" Jul 24 11:23:53.680012 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:53.679690 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7hx7h" Jul 24 11:23:53.680012 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:23:53.679793 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7hx7h" podUID="a5939932-1706-4bde-9ca9-9e03ae19d047" Jul 24 11:23:54.679298 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:54.679262 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6djk7" Jul 24 11:23:54.679473 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:23:54.679372 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6djk7" podUID="cc095a00-6820-40bf-a3a4-24c63bf7869b" Jul 24 11:23:55.682354 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:55.682312 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmcs7" Jul 24 11:23:55.682814 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:23:55.682508 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hmcs7" podUID="1e159073-9250-4ffc-aa96-224b8ae48029" Jul 24 11:23:55.682814 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:55.682611 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7hx7h" Jul 24 11:23:55.682814 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:23:55.682707 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7hx7h" podUID="a5939932-1706-4bde-9ca9-9e03ae19d047" Jul 24 11:23:56.679591 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:56.679417 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6djk7" Jul 24 11:23:56.679698 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:23:56.679666 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6djk7" podUID="cc095a00-6820-40bf-a3a4-24c63bf7869b" Jul 24 11:23:56.939289 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:56.939266 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n7wb9_55c78980-902f-4c71-9557-a0c6631fdc8b/ovn-acl-logging/0.log" Jul 24 11:23:56.939627 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:56.939607 2586 generic.go:356] "Generic (PLEG): container finished" podID="55c78980-902f-4c71-9557-a0c6631fdc8b" containerID="979902ec5a69d6c82fbe5147ef8eb851ad7009ea021d5afea25645d9d3e41e9e" exitCode=1 Jul 24 11:23:56.939680 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:56.939659 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n7wb9" event={"ID":"55c78980-902f-4c71-9557-a0c6631fdc8b","Type":"ContainerStarted","Data":"cba8386464ccd5d525008e8037a4c42141006be545d07387f410e85a531845c4"} Jul 24 11:23:56.939724 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:56.939712 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n7wb9" event={"ID":"55c78980-902f-4c71-9557-a0c6631fdc8b","Type":"ContainerStarted","Data":"2f0716a48f67fd79b8eb8a98015a02748b466c810deef7054ffe86136f1a9bea"} Jul 24 11:23:56.939762 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:56.939750 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n7wb9" event={"ID":"55c78980-902f-4c71-9557-a0c6631fdc8b","Type":"ContainerDied","Data":"979902ec5a69d6c82fbe5147ef8eb851ad7009ea021d5afea25645d9d3e41e9e"} Jul 24 11:23:56.939798 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:56.939785 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n7wb9" event={"ID":"55c78980-902f-4c71-9557-a0c6631fdc8b","Type":"ContainerStarted","Data":"5ffe133330bc289a32f97ac288afe651dee8378dc602cc7de74af6366f95de23"} Jul 24 11:23:57.681839 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:57.681754 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmcs7" Jul 24 11:23:57.681977 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:23:57.681864 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hmcs7" podUID="1e159073-9250-4ffc-aa96-224b8ae48029" Jul 24 11:23:57.681977 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:57.681936 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7hx7h" Jul 24 11:23:57.682049 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:23:57.682024 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7hx7h" podUID="a5939932-1706-4bde-9ca9-9e03ae19d047" Jul 24 11:23:57.944104 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:57.944020 2586 generic.go:356] "Generic (PLEG): container finished" podID="c92f5312-fb6f-4bd2-9e9a-89363c65621c" containerID="7349144b5b4ccc3fe1f5edc79bf56334ee6fd54b67c53278e1b2bcd0b83549cb" exitCode=0 Jul 24 11:23:57.944649 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:57.944101 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cj25f" event={"ID":"c92f5312-fb6f-4bd2-9e9a-89363c65621c","Type":"ContainerDied","Data":"7349144b5b4ccc3fe1f5edc79bf56334ee6fd54b67c53278e1b2bcd0b83549cb"} Jul 24 11:23:57.949407 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:57.949389 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n7wb9_55c78980-902f-4c71-9557-a0c6631fdc8b/ovn-acl-logging/0.log" Jul 24 11:23:57.949743 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:57.949723 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n7wb9" event={"ID":"55c78980-902f-4c71-9557-a0c6631fdc8b","Type":"ContainerStarted","Data":"e61f5ffa81df74594c05d34734088f801c397633050f7bb9960c8ace03787b41"} Jul 24 11:23:57.949830 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:57.949799 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n7wb9" event={"ID":"55c78980-902f-4c71-9557-a0c6631fdc8b","Type":"ContainerStarted","Data":"ad34fd1d8ef85096884dec0ba07bdbc585ad3020cb5a9f89740aea5062e62bcc"} Jul 24 11:23:58.678563 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:58.678531 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6djk7" Jul 24 11:23:58.678733 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:23:58.678656 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6djk7" podUID="cc095a00-6820-40bf-a3a4-24c63bf7869b" Jul 24 11:23:59.679737 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:59.679653 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7hx7h" Jul 24 11:23:59.680082 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:23:59.679769 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7hx7h" podUID="a5939932-1706-4bde-9ca9-9e03ae19d047" Jul 24 11:23:59.680082 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:59.679814 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmcs7" Jul 24 11:23:59.680082 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:23:59.679907 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hmcs7" podUID="1e159073-9250-4ffc-aa96-224b8ae48029" Jul 24 11:23:59.956967 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:59.956890 2586 generic.go:356] "Generic (PLEG): container finished" podID="c92f5312-fb6f-4bd2-9e9a-89363c65621c" containerID="8821ecfe2a1e1a2d0397b8c5845947c8011b040e26b436a80808946a2e345fb8" exitCode=0 Jul 24 11:23:59.957102 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:59.956976 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cj25f" event={"ID":"c92f5312-fb6f-4bd2-9e9a-89363c65621c","Type":"ContainerDied","Data":"8821ecfe2a1e1a2d0397b8c5845947c8011b040e26b436a80808946a2e345fb8"} Jul 24 11:23:59.959990 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:59.959972 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n7wb9_55c78980-902f-4c71-9557-a0c6631fdc8b/ovn-acl-logging/0.log" Jul 24 11:23:59.960290 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:23:59.960271 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n7wb9" event={"ID":"55c78980-902f-4c71-9557-a0c6631fdc8b","Type":"ContainerStarted","Data":"0b64c5258083a4b8b388bc4014e625301e16a78a258d7f12d19d0ca521672485"} Jul 24 11:24:00.679116 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:00.679085 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6djk7" Jul 24 11:24:00.679276 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:24:00.679189 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6djk7" podUID="cc095a00-6820-40bf-a3a4-24c63bf7869b" Jul 24 11:24:01.679786 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:01.679518 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7hx7h" Jul 24 11:24:01.679786 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:01.679566 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmcs7" Jul 24 11:24:01.680233 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:24:01.679806 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7hx7h" podUID="a5939932-1706-4bde-9ca9-9e03ae19d047" Jul 24 11:24:01.680233 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:24:01.679860 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hmcs7" podUID="1e159073-9250-4ffc-aa96-224b8ae48029" Jul 24 11:24:01.967297 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:01.967220 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n7wb9_55c78980-902f-4c71-9557-a0c6631fdc8b/ovn-acl-logging/0.log" Jul 24 11:24:01.967559 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:01.967538 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n7wb9" event={"ID":"55c78980-902f-4c71-9557-a0c6631fdc8b","Type":"ContainerStarted","Data":"63981d2da05df1ff0f812a9e01618cfa56abf4643198174e0b9f7d36a0ede3b3"} Jul 24 11:24:01.967846 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:01.967823 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-n7wb9" Jul 24 11:24:01.968032 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:01.968015 2586 scope.go:117] "RemoveContainer" containerID="979902ec5a69d6c82fbe5147ef8eb851ad7009ea021d5afea25645d9d3e41e9e" Jul 24 11:24:01.984839 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:01.984795 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-n7wb9" Jul 24 11:24:02.313664 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:02.313561 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e159073-9250-4ffc-aa96-224b8ae48029-metrics-certs\") pod \"network-metrics-daemon-hmcs7\" (UID: \"1e159073-9250-4ffc-aa96-224b8ae48029\") " pod="openshift-multus/network-metrics-daemon-hmcs7" Jul 24 11:24:02.313664 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:02.313627 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlzbx\" (UniqueName: \"kubernetes.io/projected/a5939932-1706-4bde-9ca9-9e03ae19d047-kube-api-access-mlzbx\") pod \"network-check-target-7hx7h\" (UID: \"a5939932-1706-4bde-9ca9-9e03ae19d047\") " pod="openshift-network-diagnostics/network-check-target-7hx7h" Jul 24 11:24:02.313664 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:02.313648 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cc095a00-6820-40bf-a3a4-24c63bf7869b-original-pull-secret\") pod \"global-pull-secret-syncer-6djk7\" (UID: \"cc095a00-6820-40bf-a3a4-24c63bf7869b\") " pod="kube-system/global-pull-secret-syncer-6djk7" Jul 24 11:24:02.313991 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:24:02.313720 2586 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 11:24:02.313991 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:24:02.313745 2586 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 11:24:02.313991 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:24:02.313773 2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 11:24:02.313991 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:24:02.313787 2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 11:24:02.313991 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:24:02.313797 2586 projected.go:196] Error preparing data for projected volume kube-api-access-mlzbx for pod openshift-network-diagnostics/network-check-target-7hx7h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 11:24:02.313991 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:24:02.313797 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e159073-9250-4ffc-aa96-224b8ae48029-metrics-certs podName:1e159073-9250-4ffc-aa96-224b8ae48029 nodeName:}" failed. No retries permitted until 2026-07-24 11:24:34.313778622 +0000 UTC m=+65.331833147 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1e159073-9250-4ffc-aa96-224b8ae48029-metrics-certs") pod "network-metrics-daemon-hmcs7" (UID: "1e159073-9250-4ffc-aa96-224b8ae48029") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 11:24:02.313991 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:24:02.313839 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc095a00-6820-40bf-a3a4-24c63bf7869b-original-pull-secret podName:cc095a00-6820-40bf-a3a4-24c63bf7869b nodeName:}" failed. No retries permitted until 2026-07-24 11:24:34.313826963 +0000 UTC m=+65.331881485 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cc095a00-6820-40bf-a3a4-24c63bf7869b-original-pull-secret") pod "global-pull-secret-syncer-6djk7" (UID: "cc095a00-6820-40bf-a3a4-24c63bf7869b") : object "kube-system"/"original-pull-secret" not registered Jul 24 11:24:02.313991 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:24:02.313861 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a5939932-1706-4bde-9ca9-9e03ae19d047-kube-api-access-mlzbx podName:a5939932-1706-4bde-9ca9-9e03ae19d047 nodeName:}" failed. No retries permitted until 2026-07-24 11:24:34.313843465 +0000 UTC m=+65.331897987 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-mlzbx" (UniqueName: "kubernetes.io/projected/a5939932-1706-4bde-9ca9-9e03ae19d047-kube-api-access-mlzbx") pod "network-check-target-7hx7h" (UID: "a5939932-1706-4bde-9ca9-9e03ae19d047") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 11:24:02.679663 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:02.679141 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6djk7" Jul 24 11:24:02.679663 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:24:02.679272 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6djk7" podUID="cc095a00-6820-40bf-a3a4-24c63bf7869b" Jul 24 11:24:02.975143 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:02.975074 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n7wb9_55c78980-902f-4c71-9557-a0c6631fdc8b/ovn-acl-logging/0.log" Jul 24 11:24:02.976211 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:02.976174 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n7wb9" event={"ID":"55c78980-902f-4c71-9557-a0c6631fdc8b","Type":"ContainerStarted","Data":"302ddc9ad9ea5d5d32ccaff070081f8f3e709a358283e662637f0c414057a584"} Jul 24 11:24:02.976631 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:02.976559 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-n7wb9" Jul 24 11:24:02.976741 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:02.976691 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-n7wb9" Jul 24 11:24:02.993517 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:02.993487 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-n7wb9" Jul 24 11:24:03.007190 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:03.007141 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-n7wb9" podStartSLOduration=7.736359467 podStartE2EDuration="33.007123235s" totalImagesPullingTime="25.270763768s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 11:23:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=2 observedRunningTime="2026-07-24 11:24:03.00646314 +0000 UTC m=+34.024517684" watchObservedRunningTime="2026-07-24 11:24:03.007123235 +0000 UTC m=+34.025177780" Jul 24 11:24:03.656877 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:03.656844 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7hx7h"] Jul 24 11:24:03.657071 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:03.656977 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7hx7h" Jul 24 11:24:03.657137 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:24:03.657070 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7hx7h" podUID="a5939932-1706-4bde-9ca9-9e03ae19d047" Jul 24 11:24:03.664058 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:03.664026 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6djk7"] Jul 24 11:24:03.664870 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:03.664805 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6djk7" Jul 24 11:24:03.664870 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:03.664842 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-hmcs7"] Jul 24 11:24:03.665033 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:24:03.664942 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6djk7" podUID="cc095a00-6820-40bf-a3a4-24c63bf7869b" Jul 24 11:24:03.665033 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:03.665019 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmcs7" Jul 24 11:24:03.665145 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:24:03.665107 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hmcs7" podUID="1e159073-9250-4ffc-aa96-224b8ae48029" Jul 24 11:24:04.985889 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:04.985651 2586 generic.go:356] "Generic (PLEG): container finished" podID="c92f5312-fb6f-4bd2-9e9a-89363c65621c" containerID="3b40bda9fe073dac1690806863bafe36b9cf09bc274bba183ca3b8b5c5736091" exitCode=0 Jul 24 11:24:04.985889 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:04.985713 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cj25f" event={"ID":"c92f5312-fb6f-4bd2-9e9a-89363c65621c","Type":"ContainerDied","Data":"3b40bda9fe073dac1690806863bafe36b9cf09bc274bba183ca3b8b5c5736091"} Jul 24 11:24:05.678910 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:05.678875 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmcs7" Jul 24 11:24:05.679072 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:05.678879 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7hx7h" Jul 24 11:24:05.679072 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:24:05.679004 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hmcs7" podUID="1e159073-9250-4ffc-aa96-224b8ae48029" Jul 24 11:24:05.679072 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:05.678879 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6djk7" Jul 24 11:24:05.679072 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:24:05.679054 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7hx7h" podUID="a5939932-1706-4bde-9ca9-9e03ae19d047" Jul 24 11:24:05.679195 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:24:05.679121 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6djk7" podUID="cc095a00-6820-40bf-a3a4-24c63bf7869b" Jul 24 11:24:05.991427 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:05.991395 2586 generic.go:356] "Generic (PLEG): container finished" podID="c92f5312-fb6f-4bd2-9e9a-89363c65621c" containerID="c228579a95ef381cc39bd803584e6f3d31be65a5e9a4e8f184bc259d1d5613a7" exitCode=0 Jul 24 11:24:05.992123 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:05.991443 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cj25f" event={"ID":"c92f5312-fb6f-4bd2-9e9a-89363c65621c","Type":"ContainerDied","Data":"c228579a95ef381cc39bd803584e6f3d31be65a5e9a4e8f184bc259d1d5613a7"} Jul 24 11:24:06.997693 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:06.997660 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cj25f" event={"ID":"c92f5312-fb6f-4bd2-9e9a-89363c65621c","Type":"ContainerStarted","Data":"fbd6636741ff824c71e3f7c809028782c19650a6846ecc639ffa90b2dbb3a44c"} Jul 24 11:24:07.022024 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:07.021972 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-cj25f" podStartSLOduration=7.512452937 podStartE2EDuration="37.021955466s" totalImagesPullingTime="29.509502529s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 11:23:30 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 11:24:07.021557097 +0000 UTC m=+38.039611640" watchObservedRunningTime="2026-07-24 11:24:07.021955466 +0000 UTC m=+38.040010009" Jul 24 11:24:07.678673 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:07.678631 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7hx7h" Jul 24 11:24:07.678866 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:07.678631 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6djk7" Jul 24 11:24:07.678866 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:07.678771 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmcs7" Jul 24 11:24:07.678866 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:24:07.678761 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7hx7h" podUID="a5939932-1706-4bde-9ca9-9e03ae19d047" Jul 24 11:24:07.679032 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:24:07.678873 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6djk7" podUID="cc095a00-6820-40bf-a3a4-24c63bf7869b" Jul 24 11:24:07.679032 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:24:07.678942 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hmcs7" podUID="1e159073-9250-4ffc-aa96-224b8ae48029" Jul 24 11:24:07.732895 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:07.732865 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-82kpg_321eae1c-057a-42e8-85e3-ddb84821b4d6/dns-node-resolver/0.log" Jul 24 11:24:09.099424 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:09.099393 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vdcjb_6d6115b5-67cb-4f64-b157-29872df323bb/node-ca/0.log" Jul 24 11:24:09.679697 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:09.679658 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6djk7" Jul 24 11:24:09.679895 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:24:09.679764 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6djk7" podUID="cc095a00-6820-40bf-a3a4-24c63bf7869b" Jul 24 11:24:09.679895 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:09.679843 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmcs7" Jul 24 11:24:09.680019 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:09.679935 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7hx7h" Jul 24 11:24:09.680019 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:24:09.679949 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hmcs7" podUID="1e159073-9250-4ffc-aa96-224b8ae48029" Jul 24 11:24:09.680119 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:24:09.680015 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7hx7h" podUID="a5939932-1706-4bde-9ca9-9e03ae19d047" Jul 24 11:24:11.679522 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:11.679485 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7hx7h" Jul 24 11:24:11.679937 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:11.679485 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmcs7" Jul 24 11:24:11.679937 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:24:11.679606 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7hx7h" podUID="a5939932-1706-4bde-9ca9-9e03ae19d047" Jul 24 11:24:11.679937 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:24:11.679713 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hmcs7" podUID="1e159073-9250-4ffc-aa96-224b8ae48029" Jul 24 11:24:11.679937 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:11.679486 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6djk7" Jul 24 11:24:11.679937 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:24:11.679823 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6djk7" podUID="cc095a00-6820-40bf-a3a4-24c63bf7869b" Jul 24 11:24:13.679199 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:13.679161 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7hx7h" Jul 24 11:24:13.679569 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:13.679161 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6djk7" Jul 24 11:24:13.679569 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:24:13.679333 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7hx7h" podUID="a5939932-1706-4bde-9ca9-9e03ae19d047" Jul 24 11:24:13.679569 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:13.679161 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmcs7" Jul 24 11:24:13.679569 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:24:13.679467 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hmcs7" podUID="1e159073-9250-4ffc-aa96-224b8ae48029" Jul 24 11:24:13.679569 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:24:13.679328 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6djk7" podUID="cc095a00-6820-40bf-a3a4-24c63bf7869b" Jul 24 11:24:15.679710 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:15.679531 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6djk7" Jul 24 11:24:15.680120 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:15.679531 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7hx7h" Jul 24 11:24:15.680120 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:24:15.679796 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6djk7" podUID="cc095a00-6820-40bf-a3a4-24c63bf7869b" Jul 24 11:24:15.680120 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:15.679613 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmcs7" Jul 24 11:24:15.680120 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:24:15.679841 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7hx7h" podUID="a5939932-1706-4bde-9ca9-9e03ae19d047" Jul 24 11:24:15.680120 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:24:15.679972 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hmcs7" podUID="1e159073-9250-4ffc-aa96-224b8ae48029" Jul 24 11:24:17.679494 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:17.679455 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7hx7h" Jul 24 11:24:17.679494 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:17.679485 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6djk7" Jul 24 11:24:17.679942 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:17.679568 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmcs7" Jul 24 11:24:17.679942 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:24:17.679606 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7hx7h" podUID="a5939932-1706-4bde-9ca9-9e03ae19d047" Jul 24 11:24:17.679942 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:24:17.679655 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hmcs7" podUID="1e159073-9250-4ffc-aa96-224b8ae48029" Jul 24 11:24:17.679942 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:24:17.679713 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6djk7" podUID="cc095a00-6820-40bf-a3a4-24c63bf7869b" Jul 24 11:24:19.680156 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:19.680121 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmcs7" Jul 24 11:24:19.680564 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:24:19.680221 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hmcs7" podUID="1e159073-9250-4ffc-aa96-224b8ae48029" Jul 24 11:24:19.680564 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:19.680240 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7hx7h" Jul 24 11:24:19.680564 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:24:19.680314 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7hx7h" podUID="a5939932-1706-4bde-9ca9-9e03ae19d047" Jul 24 11:24:19.680564 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:19.680333 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6djk7" Jul 24 11:24:19.680564 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:24:19.680430 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6djk7" podUID="cc095a00-6820-40bf-a3a4-24c63bf7869b" Jul 24 11:24:21.678960 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:21.678921 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6djk7" Jul 24 11:24:21.678960 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:21.678943 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmcs7" Jul 24 11:24:21.679383 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:21.678921 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7hx7h" Jul 24 11:24:21.679383 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:24:21.679048 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6djk7" podUID="cc095a00-6820-40bf-a3a4-24c63bf7869b" Jul 24 11:24:21.679383 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:24:21.679093 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7hx7h" podUID="a5939932-1706-4bde-9ca9-9e03ae19d047" Jul 24 11:24:21.679383 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:24:21.679178 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hmcs7" podUID="1e159073-9250-4ffc-aa96-224b8ae48029" Jul 24 11:24:23.682180 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:23.682148 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmcs7" Jul 24 11:24:23.682753 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:23.682148 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6djk7" Jul 24 11:24:23.682753 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:24:23.682248 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hmcs7" podUID="1e159073-9250-4ffc-aa96-224b8ae48029" Jul 24 11:24:23.682753 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:24:23.682349 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6djk7" podUID="cc095a00-6820-40bf-a3a4-24c63bf7869b" Jul 24 11:24:23.682753 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:23.682148 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7hx7h" Jul 24 11:24:23.682753 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:24:23.682446 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7hx7h" podUID="a5939932-1706-4bde-9ca9-9e03ae19d047" Jul 24 11:24:25.679439 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:25.679406 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7hx7h" Jul 24 11:24:25.679439 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:25.679420 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmcs7" Jul 24 11:24:25.679961 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:25.679420 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6djk7" Jul 24 11:24:25.679961 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:24:25.679510 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7hx7h" podUID="a5939932-1706-4bde-9ca9-9e03ae19d047" Jul 24 11:24:25.679961 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:24:25.679639 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hmcs7" podUID="1e159073-9250-4ffc-aa96-224b8ae48029" Jul 24 11:24:25.679961 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:24:25.679689 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6djk7" podUID="cc095a00-6820-40bf-a3a4-24c63bf7869b" Jul 24 11:24:27.678830 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:27.678800 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6djk7" Jul 24 11:24:27.678830 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:27.678823 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7hx7h" Jul 24 11:24:27.679355 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:27.678800 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmcs7" Jul 24 11:24:27.679355 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:24:27.678907 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6djk7" podUID="cc095a00-6820-40bf-a3a4-24c63bf7869b" Jul 24 11:24:27.679355 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:24:27.678980 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hmcs7" podUID="1e159073-9250-4ffc-aa96-224b8ae48029" Jul 24 11:24:27.679355 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:24:27.679039 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7hx7h" podUID="a5939932-1706-4bde-9ca9-9e03ae19d047" Jul 24 11:24:29.343793 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:29.343763 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-219.ec2.internal" event="NodeReady" Jul 24 11:24:29.344252 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:29.343922 2586 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 24 11:24:29.402491 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:29.402460 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-4kdkj"] Jul 24 11:24:29.435987 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:29.435960 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-rv8d4"] Jul 24 11:24:29.436139 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:29.436077 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4kdkj" Jul 24 11:24:29.438588 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:29.438558 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 24 11:24:29.438717 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:29.438599 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8q265\"" Jul 24 11:24:29.438717 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:29.438665 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 24 11:24:29.449764 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:29.449741 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4kdkj"] Jul 24 11:24:29.449880 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:29.449774 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rv8d4"] Jul 24 11:24:29.449880 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:29.449841 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rv8d4" Jul 24 11:24:29.453115 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:29.453094 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 24 11:24:29.453256 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:29.453240 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-rbdgq\"" Jul 24 11:24:29.453391 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:29.453378 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 24 11:24:29.453705 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:29.453690 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 24 11:24:29.505366 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:29.505336 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-jtwpm"] Jul 24 11:24:29.510774 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:29.510750 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fa539900-5006-4699-878f-650cf6842b6e-tmp-dir\") pod \"dns-default-4kdkj\" (UID: \"fa539900-5006-4699-878f-650cf6842b6e\") " pod="openshift-dns/dns-default-4kdkj" Jul 24 11:24:29.510897 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:29.510791 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fa539900-5006-4699-878f-650cf6842b6e-config-volume\") pod \"dns-default-4kdkj\" (UID: \"fa539900-5006-4699-878f-650cf6842b6e\") " pod="openshift-dns/dns-default-4kdkj" Jul 24 11:24:29.510897 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:29.510828 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5ntn\" (UniqueName: \"kubernetes.io/projected/fa539900-5006-4699-878f-650cf6842b6e-kube-api-access-q5ntn\") pod \"dns-default-4kdkj\" (UID: \"fa539900-5006-4699-878f-650cf6842b6e\") " pod="openshift-dns/dns-default-4kdkj" Jul 24 11:24:29.510897 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:29.510847 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bqbj\" (UniqueName: \"kubernetes.io/projected/9699ca38-0cdc-471f-8a03-4d65c1517a9f-kube-api-access-8bqbj\") pod \"ingress-canary-rv8d4\" (UID: \"9699ca38-0cdc-471f-8a03-4d65c1517a9f\") " pod="openshift-ingress-canary/ingress-canary-rv8d4" Jul 24 11:24:29.510897 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:29.510878 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9699ca38-0cdc-471f-8a03-4d65c1517a9f-cert\") pod \"ingress-canary-rv8d4\" (UID: \"9699ca38-0cdc-471f-8a03-4d65c1517a9f\") " pod="openshift-ingress-canary/ingress-canary-rv8d4" Jul 24 11:24:29.510897 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:29.510891 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fa539900-5006-4699-878f-650cf6842b6e-metrics-tls\") pod \"dns-default-4kdkj\" (UID: \"fa539900-5006-4699-878f-650cf6842b6e\") " pod="openshift-dns/dns-default-4kdkj" Jul 24 11:24:29.526076 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:29.526052 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jtwpm"] Jul 24 11:24:29.526207 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:29.526147 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jtwpm" Jul 24 11:24:29.528627 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:29.528609 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 24 11:24:29.528879 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:29.528865 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 24 11:24:29.528937 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:29.528895 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-n754j\"" Jul 24 11:24:29.529068 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:29.529048 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 24 11:24:29.529453 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:29.529432 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 24 11:24:29.611139 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:29.611112 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fa539900-5006-4699-878f-650cf6842b6e-config-volume\") pod \"dns-default-4kdkj\" (UID: \"fa539900-5006-4699-878f-650cf6842b6e\") " pod="openshift-dns/dns-default-4kdkj" Jul 24 11:24:29.611308 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:29.611156 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5ntn\" (UniqueName: \"kubernetes.io/projected/fa539900-5006-4699-878f-650cf6842b6e-kube-api-access-q5ntn\") pod \"dns-default-4kdkj\" (UID: \"fa539900-5006-4699-878f-650cf6842b6e\") " pod="openshift-dns/dns-default-4kdkj" Jul 24 11:24:29.611308 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:29.611176 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/20114f28-ad5a-4a2f-9c59-efe90df9b6d3-crio-socket\") pod \"insights-runtime-extractor-jtwpm\" (UID: \"20114f28-ad5a-4a2f-9c59-efe90df9b6d3\") " pod="openshift-insights/insights-runtime-extractor-jtwpm" Jul 24 11:24:29.611308 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:29.611197 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/20114f28-ad5a-4a2f-9c59-efe90df9b6d3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jtwpm\" (UID: \"20114f28-ad5a-4a2f-9c59-efe90df9b6d3\") " pod="openshift-insights/insights-runtime-extractor-jtwpm" Jul 24 11:24:29.611308 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:29.611251 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2gsm\" (UniqueName: \"kubernetes.io/projected/20114f28-ad5a-4a2f-9c59-efe90df9b6d3-kube-api-access-p2gsm\") pod \"insights-runtime-extractor-jtwpm\" (UID: \"20114f28-ad5a-4a2f-9c59-efe90df9b6d3\") " pod="openshift-insights/insights-runtime-extractor-jtwpm" Jul 24 11:24:29.611466 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:29.611308 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8bqbj\" (UniqueName: \"kubernetes.io/projected/9699ca38-0cdc-471f-8a03-4d65c1517a9f-kube-api-access-8bqbj\") pod \"ingress-canary-rv8d4\" (UID: \"9699ca38-0cdc-471f-8a03-4d65c1517a9f\") " pod="openshift-ingress-canary/ingress-canary-rv8d4" Jul 24 11:24:29.611466 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:29.611366 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9699ca38-0cdc-471f-8a03-4d65c1517a9f-cert\") pod \"ingress-canary-rv8d4\" (UID: \"9699ca38-0cdc-471f-8a03-4d65c1517a9f\") " pod="openshift-ingress-canary/ingress-canary-rv8d4" Jul 24 11:24:29.611466 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:29.611397 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/20114f28-ad5a-4a2f-9c59-efe90df9b6d3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jtwpm\" (UID: \"20114f28-ad5a-4a2f-9c59-efe90df9b6d3\") " pod="openshift-insights/insights-runtime-extractor-jtwpm" Jul 24 11:24:29.611466 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:29.611425 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fa539900-5006-4699-878f-650cf6842b6e-metrics-tls\") pod \"dns-default-4kdkj\" (UID: \"fa539900-5006-4699-878f-650cf6842b6e\") " pod="openshift-dns/dns-default-4kdkj" Jul 24 11:24:29.611466 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:29.611449 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/20114f28-ad5a-4a2f-9c59-efe90df9b6d3-data-volume\") pod \"insights-runtime-extractor-jtwpm\" (UID: \"20114f28-ad5a-4a2f-9c59-efe90df9b6d3\") " pod="openshift-insights/insights-runtime-extractor-jtwpm" Jul 24 11:24:29.611716 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:29.611485 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fa539900-5006-4699-878f-650cf6842b6e-tmp-dir\") pod \"dns-default-4kdkj\" (UID: \"fa539900-5006-4699-878f-650cf6842b6e\") " pod="openshift-dns/dns-default-4kdkj" Jul 24 11:24:29.611774 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:29.611745 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fa539900-5006-4699-878f-650cf6842b6e-tmp-dir\") pod \"dns-default-4kdkj\" (UID: \"fa539900-5006-4699-878f-650cf6842b6e\") " pod="openshift-dns/dns-default-4kdkj" Jul 24 11:24:29.611857 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:29.611838 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fa539900-5006-4699-878f-650cf6842b6e-config-volume\") pod \"dns-default-4kdkj\" (UID: \"fa539900-5006-4699-878f-650cf6842b6e\") " pod="openshift-dns/dns-default-4kdkj" Jul 24 11:24:29.615220 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:29.615190 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fa539900-5006-4699-878f-650cf6842b6e-metrics-tls\") pod \"dns-default-4kdkj\" (UID: \"fa539900-5006-4699-878f-650cf6842b6e\") " pod="openshift-dns/dns-default-4kdkj" Jul 24 11:24:29.615527 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:29.615504 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9699ca38-0cdc-471f-8a03-4d65c1517a9f-cert\") pod \"ingress-canary-rv8d4\" (UID: \"9699ca38-0cdc-471f-8a03-4d65c1517a9f\") " pod="openshift-ingress-canary/ingress-canary-rv8d4" Jul 24 11:24:29.622680 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:29.622652 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5ntn\" (UniqueName: \"kubernetes.io/projected/fa539900-5006-4699-878f-650cf6842b6e-kube-api-access-q5ntn\") pod \"dns-default-4kdkj\" (UID: \"fa539900-5006-4699-878f-650cf6842b6e\") " pod="openshift-dns/dns-default-4kdkj" Jul 24 11:24:29.623198 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:29.623169 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bqbj\" (UniqueName: \"kubernetes.io/projected/9699ca38-0cdc-471f-8a03-4d65c1517a9f-kube-api-access-8bqbj\") pod \"ingress-canary-rv8d4\" (UID: \"9699ca38-0cdc-471f-8a03-4d65c1517a9f\") " pod="openshift-ingress-canary/ingress-canary-rv8d4" Jul 24 11:24:29.680335 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:29.680302 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmcs7" Jul 24 11:24:29.680522 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:29.680386 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7hx7h" Jul 24 11:24:29.680522 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:29.680447 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6djk7" Jul 24 11:24:29.683113 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:29.683080 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 24 11:24:29.683113 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:29.683080 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wv7c6\"" Jul 24 11:24:29.683318 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:29.683128 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-p6szg\"" Jul 24 11:24:29.683424 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:29.683411 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 24 11:24:29.683475 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:29.683458 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 24 11:24:29.683524 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:29.683412 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 24 11:24:29.712745 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:29.712710 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/20114f28-ad5a-4a2f-9c59-efe90df9b6d3-crio-socket\") pod \"insights-runtime-extractor-jtwpm\" (UID: \"20114f28-ad5a-4a2f-9c59-efe90df9b6d3\") " pod="openshift-insights/insights-runtime-extractor-jtwpm" Jul 24 11:24:29.712890 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:29.712749 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/20114f28-ad5a-4a2f-9c59-efe90df9b6d3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jtwpm\" (UID: \"20114f28-ad5a-4a2f-9c59-efe90df9b6d3\") " pod="openshift-insights/insights-runtime-extractor-jtwpm" Jul 24 11:24:29.712890 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:29.712774 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2gsm\" (UniqueName: \"kubernetes.io/projected/20114f28-ad5a-4a2f-9c59-efe90df9b6d3-kube-api-access-p2gsm\") pod \"insights-runtime-extractor-jtwpm\" (UID: \"20114f28-ad5a-4a2f-9c59-efe90df9b6d3\") " pod="openshift-insights/insights-runtime-extractor-jtwpm" Jul 24 11:24:29.712890 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:29.712821 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/20114f28-ad5a-4a2f-9c59-efe90df9b6d3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jtwpm\" (UID: \"20114f28-ad5a-4a2f-9c59-efe90df9b6d3\") " pod="openshift-insights/insights-runtime-extractor-jtwpm" Jul 24 11:24:29.712890 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:29.712839 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/20114f28-ad5a-4a2f-9c59-efe90df9b6d3-crio-socket\") pod \"insights-runtime-extractor-jtwpm\" (UID: \"20114f28-ad5a-4a2f-9c59-efe90df9b6d3\") " pod="openshift-insights/insights-runtime-extractor-jtwpm" Jul 24 11:24:29.712890 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:29.712850 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/20114f28-ad5a-4a2f-9c59-efe90df9b6d3-data-volume\") pod \"insights-runtime-extractor-jtwpm\" (UID: \"20114f28-ad5a-4a2f-9c59-efe90df9b6d3\") " pod="openshift-insights/insights-runtime-extractor-jtwpm" Jul 24 11:24:29.713237 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:29.713218 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/20114f28-ad5a-4a2f-9c59-efe90df9b6d3-data-volume\") pod \"insights-runtime-extractor-jtwpm\" (UID: \"20114f28-ad5a-4a2f-9c59-efe90df9b6d3\") " pod="openshift-insights/insights-runtime-extractor-jtwpm" Jul 24 11:24:29.713385 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:29.713365 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/20114f28-ad5a-4a2f-9c59-efe90df9b6d3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jtwpm\" (UID: \"20114f28-ad5a-4a2f-9c59-efe90df9b6d3\") " pod="openshift-insights/insights-runtime-extractor-jtwpm" Jul 24 11:24:29.714948 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:29.714931 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/20114f28-ad5a-4a2f-9c59-efe90df9b6d3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jtwpm\" (UID: \"20114f28-ad5a-4a2f-9c59-efe90df9b6d3\") " pod="openshift-insights/insights-runtime-extractor-jtwpm" Jul 24 11:24:29.720689 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:29.720671 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2gsm\" (UniqueName: \"kubernetes.io/projected/20114f28-ad5a-4a2f-9c59-efe90df9b6d3-kube-api-access-p2gsm\") pod \"insights-runtime-extractor-jtwpm\" (UID: \"20114f28-ad5a-4a2f-9c59-efe90df9b6d3\") " pod="openshift-insights/insights-runtime-extractor-jtwpm" Jul 24 11:24:29.745661 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:29.745627 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4kdkj" Jul 24 11:24:29.758139 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:29.758106 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rv8d4" Jul 24 11:24:29.836415 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:29.836384 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jtwpm" Jul 24 11:24:29.980785 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:29.980754 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rv8d4"] Jul 24 11:24:29.985387 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:29.985364 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4kdkj"] Jul 24 11:24:29.985497 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:24:29.985360 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9699ca38_0cdc_471f_8a03_4d65c1517a9f.slice/crio-69b37e2fcc1f52d2104bb96e6e01f9c870086b3b02ec18e346ee054d4efc7348 WatchSource:0}: Error finding container 69b37e2fcc1f52d2104bb96e6e01f9c870086b3b02ec18e346ee054d4efc7348: Status 404 returned error can't find the container with id 69b37e2fcc1f52d2104bb96e6e01f9c870086b3b02ec18e346ee054d4efc7348 Jul 24 11:24:29.988738 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:24:29.988710 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa539900_5006_4699_878f_650cf6842b6e.slice/crio-5df784a14cbe67bc88bc21dde94d7ac6e903ceae6cb575230a5d0af5932b096f WatchSource:0}: Error finding container 5df784a14cbe67bc88bc21dde94d7ac6e903ceae6cb575230a5d0af5932b096f: Status 404 returned error can't find the container with id 5df784a14cbe67bc88bc21dde94d7ac6e903ceae6cb575230a5d0af5932b096f Jul 24 11:24:30.009975 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:30.009934 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jtwpm"] Jul 24 11:24:30.012805 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:24:30.012769 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20114f28_ad5a_4a2f_9c59_efe90df9b6d3.slice/crio-dc6d89080c1f42a198d5ad344d1687ad32f18c61fb768aca746c1df1c2cff9ed WatchSource:0}: Error finding container dc6d89080c1f42a198d5ad344d1687ad32f18c61fb768aca746c1df1c2cff9ed: Status 404 returned error can't find the container with id dc6d89080c1f42a198d5ad344d1687ad32f18c61fb768aca746c1df1c2cff9ed Jul 24 11:24:30.050201 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:30.050170 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jtwpm" event={"ID":"20114f28-ad5a-4a2f-9c59-efe90df9b6d3","Type":"ContainerStarted","Data":"dc6d89080c1f42a198d5ad344d1687ad32f18c61fb768aca746c1df1c2cff9ed"} Jul 24 11:24:30.051213 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:30.051191 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rv8d4" event={"ID":"9699ca38-0cdc-471f-8a03-4d65c1517a9f","Type":"ContainerStarted","Data":"69b37e2fcc1f52d2104bb96e6e01f9c870086b3b02ec18e346ee054d4efc7348"} Jul 24 11:24:30.052152 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:30.052132 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4kdkj" event={"ID":"fa539900-5006-4699-878f-650cf6842b6e","Type":"ContainerStarted","Data":"5df784a14cbe67bc88bc21dde94d7ac6e903ceae6cb575230a5d0af5932b096f"} Jul 24 11:24:33.063271 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:33.063228 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4kdkj" event={"ID":"fa539900-5006-4699-878f-650cf6842b6e","Type":"ContainerStarted","Data":"2763a5bdd98ccb7781d223bb34c097c44bfa78ad005e9cf9583e3ba45965323d"} Jul 24 11:24:33.063728 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:33.063316 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4kdkj" event={"ID":"fa539900-5006-4699-878f-650cf6842b6e","Type":"ContainerStarted","Data":"af359cdd8147a22c215ec647b180fc9e754ea6c351ba0980114700a0fc6c76ec"} Jul 24 11:24:33.063728 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:33.063348 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-4kdkj" Jul 24 11:24:33.084032 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:33.083966 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-4kdkj" podStartSLOduration=1.945650735 podStartE2EDuration="4.083946531s" totalImagesPullingTime="2.138295796s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 11:24:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 11:24:33.083475878 +0000 UTC m=+64.101530423" watchObservedRunningTime="2026-07-24 11:24:33.083946531 +0000 UTC m=+64.102001074" Jul 24 11:24:34.350855 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:34.350814 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e159073-9250-4ffc-aa96-224b8ae48029-metrics-certs\") pod \"network-metrics-daemon-hmcs7\" (UID: \"1e159073-9250-4ffc-aa96-224b8ae48029\") " pod="openshift-multus/network-metrics-daemon-hmcs7" Jul 24 11:24:34.351433 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:34.350875 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlzbx\" (UniqueName: \"kubernetes.io/projected/a5939932-1706-4bde-9ca9-9e03ae19d047-kube-api-access-mlzbx\") pod \"network-check-target-7hx7h\" (UID: \"a5939932-1706-4bde-9ca9-9e03ae19d047\") " pod="openshift-network-diagnostics/network-check-target-7hx7h" Jul 24 11:24:34.351433 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:34.350900 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cc095a00-6820-40bf-a3a4-24c63bf7869b-original-pull-secret\") pod \"global-pull-secret-syncer-6djk7\" (UID: \"cc095a00-6820-40bf-a3a4-24c63bf7869b\") " pod="kube-system/global-pull-secret-syncer-6djk7" Jul 24 11:24:34.353499 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:34.353469 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e159073-9250-4ffc-aa96-224b8ae48029-metrics-certs\") pod \"network-metrics-daemon-hmcs7\" (UID: \"1e159073-9250-4ffc-aa96-224b8ae48029\") " pod="openshift-multus/network-metrics-daemon-hmcs7" Jul 24 11:24:34.353625 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:34.353469 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cc095a00-6820-40bf-a3a4-24c63bf7869b-original-pull-secret\") pod \"global-pull-secret-syncer-6djk7\" (UID: \"cc095a00-6820-40bf-a3a4-24c63bf7869b\") " pod="kube-system/global-pull-secret-syncer-6djk7" Jul 24 11:24:34.353768 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:34.353741 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlzbx\" (UniqueName: \"kubernetes.io/projected/a5939932-1706-4bde-9ca9-9e03ae19d047-kube-api-access-mlzbx\") pod \"network-check-target-7hx7h\" (UID: \"a5939932-1706-4bde-9ca9-9e03ae19d047\") " pod="openshift-network-diagnostics/network-check-target-7hx7h" Jul 24 11:24:34.490438 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:34.490403 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmcs7" Jul 24 11:24:34.496588 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:34.496540 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6djk7" Jul 24 11:24:34.501856 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:34.501817 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7hx7h" Jul 24 11:24:34.840978 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:34.840941 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-htzr7"] Jul 24 11:24:34.850036 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:34.850004 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-htzr7" Jul 24 11:24:34.852458 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:34.852435 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 24 11:24:34.852655 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:34.852458 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-g74q9\"" Jul 24 11:24:34.855804 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:34.855782 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-htzr7"] Jul 24 11:24:34.955508 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:34.955465 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/1d3b27cf-8868-4b10-9b51-c5d308119027-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-htzr7\" (UID: \"1d3b27cf-8868-4b10-9b51-c5d308119027\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-htzr7" Jul 24 11:24:34.996671 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:34.996628 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-n7wb9" Jul 24 11:24:35.056692 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:35.056661 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/1d3b27cf-8868-4b10-9b51-c5d308119027-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-htzr7\" (UID: \"1d3b27cf-8868-4b10-9b51-c5d308119027\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-htzr7" Jul 24 11:24:35.058965 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:35.058941 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/1d3b27cf-8868-4b10-9b51-c5d308119027-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-htzr7\" (UID: \"1d3b27cf-8868-4b10-9b51-c5d308119027\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-htzr7" Jul 24 11:24:35.158862 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:35.158826 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-cc54d487f-966mt"] Jul 24 11:24:35.161619 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:35.161592 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-htzr7" Jul 24 11:24:35.161947 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:35.161929 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cc54d487f-966mt" Jul 24 11:24:35.164960 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:35.164934 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 24 11:24:35.164960 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:35.164953 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 24 11:24:35.165622 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:35.165601 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 24 11:24:35.165622 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:35.165611 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 24 11:24:35.165900 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:35.165871 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 24 11:24:35.165900 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:35.165893 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 24 11:24:35.166292 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:35.166275 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-q9wx9\"" Jul 24 11:24:35.166381 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:35.166312 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 24 11:24:35.174915 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:35.174885 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-cc54d487f-966mt"] Jul 24 11:24:35.258344 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:35.258308 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/da7f7e41-9a8f-443d-a971-ad994fac52b1-console-config\") pod \"console-cc54d487f-966mt\" (UID: \"da7f7e41-9a8f-443d-a971-ad994fac52b1\") " pod="openshift-console/console-cc54d487f-966mt" Jul 24 11:24:35.258537 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:35.258360 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/da7f7e41-9a8f-443d-a971-ad994fac52b1-console-oauth-config\") pod \"console-cc54d487f-966mt\" (UID: \"da7f7e41-9a8f-443d-a971-ad994fac52b1\") " pod="openshift-console/console-cc54d487f-966mt" Jul 24 11:24:35.258537 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:35.258384 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxh54\" (UniqueName: \"kubernetes.io/projected/da7f7e41-9a8f-443d-a971-ad994fac52b1-kube-api-access-xxh54\") pod \"console-cc54d487f-966mt\" (UID: \"da7f7e41-9a8f-443d-a971-ad994fac52b1\") " pod="openshift-console/console-cc54d487f-966mt" Jul 24 11:24:35.258537 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:35.258420 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/da7f7e41-9a8f-443d-a971-ad994fac52b1-service-ca\") pod \"console-cc54d487f-966mt\" (UID: \"da7f7e41-9a8f-443d-a971-ad994fac52b1\") " pod="openshift-console/console-cc54d487f-966mt" Jul 24 11:24:35.258537 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:35.258459 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/da7f7e41-9a8f-443d-a971-ad994fac52b1-oauth-serving-cert\") pod \"console-cc54d487f-966mt\" (UID: \"da7f7e41-9a8f-443d-a971-ad994fac52b1\") " pod="openshift-console/console-cc54d487f-966mt" Jul 24 11:24:35.258537 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:35.258489 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/da7f7e41-9a8f-443d-a971-ad994fac52b1-console-serving-cert\") pod \"console-cc54d487f-966mt\" (UID: \"da7f7e41-9a8f-443d-a971-ad994fac52b1\") " pod="openshift-console/console-cc54d487f-966mt" Jul 24 11:24:35.359887 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:35.359800 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/da7f7e41-9a8f-443d-a971-ad994fac52b1-console-config\") pod \"console-cc54d487f-966mt\" (UID: \"da7f7e41-9a8f-443d-a971-ad994fac52b1\") " pod="openshift-console/console-cc54d487f-966mt" Jul 24 11:24:35.359887 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:35.359838 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/da7f7e41-9a8f-443d-a971-ad994fac52b1-console-oauth-config\") pod \"console-cc54d487f-966mt\" (UID: \"da7f7e41-9a8f-443d-a971-ad994fac52b1\") " pod="openshift-console/console-cc54d487f-966mt" Jul 24 11:24:35.359887 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:35.359864 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxh54\" (UniqueName: \"kubernetes.io/projected/da7f7e41-9a8f-443d-a971-ad994fac52b1-kube-api-access-xxh54\") pod \"console-cc54d487f-966mt\" (UID: \"da7f7e41-9a8f-443d-a971-ad994fac52b1\") " pod="openshift-console/console-cc54d487f-966mt" Jul 24 11:24:35.360428 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:35.359892 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/da7f7e41-9a8f-443d-a971-ad994fac52b1-service-ca\") pod \"console-cc54d487f-966mt\" (UID: \"da7f7e41-9a8f-443d-a971-ad994fac52b1\") " pod="openshift-console/console-cc54d487f-966mt" Jul 24 11:24:35.360428 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:35.360069 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/da7f7e41-9a8f-443d-a971-ad994fac52b1-oauth-serving-cert\") pod \"console-cc54d487f-966mt\" (UID: \"da7f7e41-9a8f-443d-a971-ad994fac52b1\") " pod="openshift-console/console-cc54d487f-966mt" Jul 24 11:24:35.360428 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:35.360116 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/da7f7e41-9a8f-443d-a971-ad994fac52b1-console-serving-cert\") pod \"console-cc54d487f-966mt\" (UID: \"da7f7e41-9a8f-443d-a971-ad994fac52b1\") " pod="openshift-console/console-cc54d487f-966mt" Jul 24 11:24:35.360744 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:35.360717 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/da7f7e41-9a8f-443d-a971-ad994fac52b1-console-config\") pod \"console-cc54d487f-966mt\" (UID: \"da7f7e41-9a8f-443d-a971-ad994fac52b1\") " pod="openshift-console/console-cc54d487f-966mt" Jul 24 11:24:35.360882 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:35.360770 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/da7f7e41-9a8f-443d-a971-ad994fac52b1-service-ca\") pod \"console-cc54d487f-966mt\" (UID: \"da7f7e41-9a8f-443d-a971-ad994fac52b1\") " pod="openshift-console/console-cc54d487f-966mt" Jul 24 11:24:35.361013 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:35.360991 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/da7f7e41-9a8f-443d-a971-ad994fac52b1-oauth-serving-cert\") pod \"console-cc54d487f-966mt\" (UID: \"da7f7e41-9a8f-443d-a971-ad994fac52b1\") " pod="openshift-console/console-cc54d487f-966mt" Jul 24 11:24:35.362559 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:35.362539 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/da7f7e41-9a8f-443d-a971-ad994fac52b1-console-oauth-config\") pod \"console-cc54d487f-966mt\" (UID: \"da7f7e41-9a8f-443d-a971-ad994fac52b1\") " pod="openshift-console/console-cc54d487f-966mt" Jul 24 11:24:35.362739 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:35.362714 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/da7f7e41-9a8f-443d-a971-ad994fac52b1-console-serving-cert\") pod \"console-cc54d487f-966mt\" (UID: \"da7f7e41-9a8f-443d-a971-ad994fac52b1\") " pod="openshift-console/console-cc54d487f-966mt" Jul 24 11:24:35.372346 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:35.372323 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxh54\" (UniqueName: \"kubernetes.io/projected/da7f7e41-9a8f-443d-a971-ad994fac52b1-kube-api-access-xxh54\") pod \"console-cc54d487f-966mt\" (UID: \"da7f7e41-9a8f-443d-a971-ad994fac52b1\") " pod="openshift-console/console-cc54d487f-966mt" Jul 24 11:24:35.472899 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:35.472793 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cc54d487f-966mt" Jul 24 11:24:35.536628 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:35.536402 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7hx7h"] Jul 24 11:24:35.908935 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:35.908901 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6djk7"] Jul 24 11:24:35.911648 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:24:35.911616 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc095a00_6820_40bf_a3a4_24c63bf7869b.slice/crio-a41f323bfee09d8ac037d40f29b3c93014c0e11dbf7e3f331371dafbc538e6f5 WatchSource:0}: Error finding container a41f323bfee09d8ac037d40f29b3c93014c0e11dbf7e3f331371dafbc538e6f5: Status 404 returned error can't find the container with id a41f323bfee09d8ac037d40f29b3c93014c0e11dbf7e3f331371dafbc538e6f5 Jul 24 11:24:36.072948 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:36.072853 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jtwpm" event={"ID":"20114f28-ad5a-4a2f-9c59-efe90df9b6d3","Type":"ContainerStarted","Data":"783c9caf6f94ed93d375d103c1a3d0182478c066d6f650937b2ba383aae2bf61"} Jul 24 11:24:36.074321 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:36.074292 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rv8d4" event={"ID":"9699ca38-0cdc-471f-8a03-4d65c1517a9f","Type":"ContainerStarted","Data":"f3f5c2f90692d6c80c0df92fccf1cdc266f3e694185580a99f6a243f1da1408f"} Jul 24 11:24:36.075408 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:36.075384 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7hx7h" event={"ID":"a5939932-1706-4bde-9ca9-9e03ae19d047","Type":"ContainerStarted","Data":"0f84f323005c08c20add2a6fa1937071e0ffdbf43b63eebb86dbec9c3f3b9105"} Jul 24 11:24:36.076375 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:36.076355 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6djk7" event={"ID":"cc095a00-6820-40bf-a3a4-24c63bf7869b","Type":"ContainerStarted","Data":"a41f323bfee09d8ac037d40f29b3c93014c0e11dbf7e3f331371dafbc538e6f5"} Jul 24 11:24:36.089908 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:36.089864 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-rv8d4" podStartSLOduration=1.330076722 podStartE2EDuration="7.089836913s" totalImagesPullingTime="5.759760191s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 11:24:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 11:24:36.089107533 +0000 UTC m=+67.107162078" watchObservedRunningTime="2026-07-24 11:24:36.089836913 +0000 UTC m=+67.107891455" Jul 24 11:24:36.133769 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:36.133737 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-hmcs7"] Jul 24 11:24:36.137394 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:24:36.136981 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e159073_9250_4ffc_aa96_224b8ae48029.slice/crio-fff687e57eff01a6f304937fde8724b701c7973a4ebe4257c7c492a702fcfc2e WatchSource:0}: Error finding container fff687e57eff01a6f304937fde8724b701c7973a4ebe4257c7c492a702fcfc2e: Status 404 returned error can't find the container with id fff687e57eff01a6f304937fde8724b701c7973a4ebe4257c7c492a702fcfc2e Jul 24 11:24:36.137708 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:36.137650 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-cc54d487f-966mt"] Jul 24 11:24:36.138590 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:36.138552 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-htzr7"] Jul 24 11:24:36.141051 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:24:36.141025 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda7f7e41_9a8f_443d_a971_ad994fac52b1.slice/crio-ad32def7235b124c113d04adb270b6ad767678f2524536e6b199dd5d311a56d8 WatchSource:0}: Error finding container ad32def7235b124c113d04adb270b6ad767678f2524536e6b199dd5d311a56d8: Status 404 returned error can't find the container with id ad32def7235b124c113d04adb270b6ad767678f2524536e6b199dd5d311a56d8 Jul 24 11:24:36.141706 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:24:36.141682 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d3b27cf_8868_4b10_9b51_c5d308119027.slice/crio-8a1b71a76b6bd7533a094827a732073cd06ec10e6d41458793f99a86c1cb232f WatchSource:0}: Error finding container 8a1b71a76b6bd7533a094827a732073cd06ec10e6d41458793f99a86c1cb232f: Status 404 returned error can't find the container with id 8a1b71a76b6bd7533a094827a732073cd06ec10e6d41458793f99a86c1cb232f Jul 24 11:24:37.088218 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:37.088148 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cc54d487f-966mt" event={"ID":"da7f7e41-9a8f-443d-a971-ad994fac52b1","Type":"ContainerStarted","Data":"ad32def7235b124c113d04adb270b6ad767678f2524536e6b199dd5d311a56d8"} Jul 24 11:24:37.101015 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:37.100900 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-htzr7" event={"ID":"1d3b27cf-8868-4b10-9b51-c5d308119027","Type":"ContainerStarted","Data":"8a1b71a76b6bd7533a094827a732073cd06ec10e6d41458793f99a86c1cb232f"} Jul 24 11:24:37.104544 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:37.104512 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hmcs7" event={"ID":"1e159073-9250-4ffc-aa96-224b8ae48029","Type":"ContainerStarted","Data":"fff687e57eff01a6f304937fde8724b701c7973a4ebe4257c7c492a702fcfc2e"} Jul 24 11:24:37.137688 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:37.136684 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7c65b66cc6-bnrzc"] Jul 24 11:24:37.158125 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:37.158087 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c65b66cc6-bnrzc"] Jul 24 11:24:37.158300 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:37.158222 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c65b66cc6-bnrzc" Jul 24 11:24:37.169945 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:37.169709 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 24 11:24:37.275068 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:37.274725 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/58cf8cb4-73a0-4743-a007-142e6f3fa741-console-oauth-config\") pod \"console-7c65b66cc6-bnrzc\" (UID: \"58cf8cb4-73a0-4743-a007-142e6f3fa741\") " pod="openshift-console/console-7c65b66cc6-bnrzc" Jul 24 11:24:37.275068 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:37.274778 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmdt8\" (UniqueName: \"kubernetes.io/projected/58cf8cb4-73a0-4743-a007-142e6f3fa741-kube-api-access-cmdt8\") pod \"console-7c65b66cc6-bnrzc\" (UID: \"58cf8cb4-73a0-4743-a007-142e6f3fa741\") " pod="openshift-console/console-7c65b66cc6-bnrzc" Jul 24 11:24:37.275068 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:37.274837 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/58cf8cb4-73a0-4743-a007-142e6f3fa741-console-serving-cert\") pod \"console-7c65b66cc6-bnrzc\" (UID: \"58cf8cb4-73a0-4743-a007-142e6f3fa741\") " pod="openshift-console/console-7c65b66cc6-bnrzc" Jul 24 11:24:37.275068 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:37.274870 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/58cf8cb4-73a0-4743-a007-142e6f3fa741-service-ca\") pod \"console-7c65b66cc6-bnrzc\" (UID: \"58cf8cb4-73a0-4743-a007-142e6f3fa741\") " pod="openshift-console/console-7c65b66cc6-bnrzc" Jul 24 11:24:37.275068 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:37.274895 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/58cf8cb4-73a0-4743-a007-142e6f3fa741-oauth-serving-cert\") pod \"console-7c65b66cc6-bnrzc\" (UID: \"58cf8cb4-73a0-4743-a007-142e6f3fa741\") " pod="openshift-console/console-7c65b66cc6-bnrzc" Jul 24 11:24:37.275068 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:37.274920 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/58cf8cb4-73a0-4743-a007-142e6f3fa741-console-config\") pod \"console-7c65b66cc6-bnrzc\" (UID: \"58cf8cb4-73a0-4743-a007-142e6f3fa741\") " pod="openshift-console/console-7c65b66cc6-bnrzc" Jul 24 11:24:37.275068 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:37.274946 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58cf8cb4-73a0-4743-a007-142e6f3fa741-trusted-ca-bundle\") pod \"console-7c65b66cc6-bnrzc\" (UID: \"58cf8cb4-73a0-4743-a007-142e6f3fa741\") " pod="openshift-console/console-7c65b66cc6-bnrzc" Jul 24 11:24:37.377690 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:37.376415 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/58cf8cb4-73a0-4743-a007-142e6f3fa741-service-ca\") pod \"console-7c65b66cc6-bnrzc\" (UID: \"58cf8cb4-73a0-4743-a007-142e6f3fa741\") " pod="openshift-console/console-7c65b66cc6-bnrzc" Jul 24 11:24:37.377690 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:37.376466 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/58cf8cb4-73a0-4743-a007-142e6f3fa741-oauth-serving-cert\") pod \"console-7c65b66cc6-bnrzc\" (UID: \"58cf8cb4-73a0-4743-a007-142e6f3fa741\") " pod="openshift-console/console-7c65b66cc6-bnrzc" Jul 24 11:24:37.377690 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:37.376498 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/58cf8cb4-73a0-4743-a007-142e6f3fa741-console-config\") pod \"console-7c65b66cc6-bnrzc\" (UID: \"58cf8cb4-73a0-4743-a007-142e6f3fa741\") " pod="openshift-console/console-7c65b66cc6-bnrzc" Jul 24 11:24:37.377690 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:37.376525 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58cf8cb4-73a0-4743-a007-142e6f3fa741-trusted-ca-bundle\") pod \"console-7c65b66cc6-bnrzc\" (UID: \"58cf8cb4-73a0-4743-a007-142e6f3fa741\") " pod="openshift-console/console-7c65b66cc6-bnrzc" Jul 24 11:24:37.377690 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:37.376556 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/58cf8cb4-73a0-4743-a007-142e6f3fa741-console-oauth-config\") pod \"console-7c65b66cc6-bnrzc\" (UID: \"58cf8cb4-73a0-4743-a007-142e6f3fa741\") " pod="openshift-console/console-7c65b66cc6-bnrzc" Jul 24 11:24:37.377690 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:37.376629 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmdt8\" (UniqueName: \"kubernetes.io/projected/58cf8cb4-73a0-4743-a007-142e6f3fa741-kube-api-access-cmdt8\") pod \"console-7c65b66cc6-bnrzc\" (UID: \"58cf8cb4-73a0-4743-a007-142e6f3fa741\") " pod="openshift-console/console-7c65b66cc6-bnrzc" Jul 24 11:24:37.377690 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:37.376697 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/58cf8cb4-73a0-4743-a007-142e6f3fa741-console-serving-cert\") pod \"console-7c65b66cc6-bnrzc\" (UID: \"58cf8cb4-73a0-4743-a007-142e6f3fa741\") " pod="openshift-console/console-7c65b66cc6-bnrzc" Jul 24 11:24:37.381085 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:37.378789 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/58cf8cb4-73a0-4743-a007-142e6f3fa741-service-ca\") pod \"console-7c65b66cc6-bnrzc\" (UID: \"58cf8cb4-73a0-4743-a007-142e6f3fa741\") " pod="openshift-console/console-7c65b66cc6-bnrzc" Jul 24 11:24:37.381085 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:37.379333 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/58cf8cb4-73a0-4743-a007-142e6f3fa741-oauth-serving-cert\") pod \"console-7c65b66cc6-bnrzc\" (UID: \"58cf8cb4-73a0-4743-a007-142e6f3fa741\") " pod="openshift-console/console-7c65b66cc6-bnrzc" Jul 24 11:24:37.381085 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:37.381034 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/58cf8cb4-73a0-4743-a007-142e6f3fa741-console-config\") pod \"console-7c65b66cc6-bnrzc\" (UID: \"58cf8cb4-73a0-4743-a007-142e6f3fa741\") " pod="openshift-console/console-7c65b66cc6-bnrzc" Jul 24 11:24:37.381614 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:37.381546 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58cf8cb4-73a0-4743-a007-142e6f3fa741-trusted-ca-bundle\") pod \"console-7c65b66cc6-bnrzc\" (UID: \"58cf8cb4-73a0-4743-a007-142e6f3fa741\") " pod="openshift-console/console-7c65b66cc6-bnrzc" Jul 24 11:24:37.408012 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:37.407846 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/58cf8cb4-73a0-4743-a007-142e6f3fa741-console-oauth-config\") pod \"console-7c65b66cc6-bnrzc\" (UID: \"58cf8cb4-73a0-4743-a007-142e6f3fa741\") " pod="openshift-console/console-7c65b66cc6-bnrzc" Jul 24 11:24:37.408817 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:37.408763 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/58cf8cb4-73a0-4743-a007-142e6f3fa741-console-serving-cert\") pod \"console-7c65b66cc6-bnrzc\" (UID: \"58cf8cb4-73a0-4743-a007-142e6f3fa741\") " pod="openshift-console/console-7c65b66cc6-bnrzc" Jul 24 11:24:37.413455 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:37.413399 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmdt8\" (UniqueName: \"kubernetes.io/projected/58cf8cb4-73a0-4743-a007-142e6f3fa741-kube-api-access-cmdt8\") pod \"console-7c65b66cc6-bnrzc\" (UID: \"58cf8cb4-73a0-4743-a007-142e6f3fa741\") " pod="openshift-console/console-7c65b66cc6-bnrzc" Jul 24 11:24:37.480445 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:37.480139 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c65b66cc6-bnrzc" Jul 24 11:24:37.709795 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:37.709759 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c65b66cc6-bnrzc"] Jul 24 11:24:38.218302 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:24:38.218262 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58cf8cb4_73a0_4743_a007_142e6f3fa741.slice/crio-d1cb8420bbf5ad5e7576c76640056bea3b795219ca0f83f3a13ccb0f98f29060 WatchSource:0}: Error finding container d1cb8420bbf5ad5e7576c76640056bea3b795219ca0f83f3a13ccb0f98f29060: Status 404 returned error can't find the container with id d1cb8420bbf5ad5e7576c76640056bea3b795219ca0f83f3a13ccb0f98f29060 Jul 24 11:24:39.112989 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:39.112947 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c65b66cc6-bnrzc" event={"ID":"58cf8cb4-73a0-4743-a007-142e6f3fa741","Type":"ContainerStarted","Data":"d1cb8420bbf5ad5e7576c76640056bea3b795219ca0f83f3a13ccb0f98f29060"} Jul 24 11:24:43.068757 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:43.068723 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-4kdkj" Jul 24 11:24:45.134376 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:45.134337 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6djk7" event={"ID":"cc095a00-6820-40bf-a3a4-24c63bf7869b","Type":"ContainerStarted","Data":"55069aba733c6eeab6cb392157539d7ecb3a379c1d3dd9d63a0a15c9c45b4084"} Jul 24 11:24:45.136460 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:45.136425 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jtwpm" event={"ID":"20114f28-ad5a-4a2f-9c59-efe90df9b6d3","Type":"ContainerStarted","Data":"0993d95e4d9330057c4f55cee53ebdfb4eea2977b21bf37f30e070929e72d995"} Jul 24 11:24:45.138491 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:45.138464 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cc54d487f-966mt" event={"ID":"da7f7e41-9a8f-443d-a971-ad994fac52b1","Type":"ContainerStarted","Data":"b01f8009b7370006b0226cedcc8b70090f63d28a4ff4d2a10cd6161bb516e9c2"} Jul 24 11:24:45.140032 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:45.140002 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-htzr7" event={"ID":"1d3b27cf-8868-4b10-9b51-c5d308119027","Type":"ContainerStarted","Data":"a37c825918088bfb14c135f807e5d983dcca9042ffb5ebbee78a147f7f500628"} Jul 24 11:24:45.140212 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:45.140197 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-htzr7" Jul 24 11:24:45.142206 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:45.142136 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hmcs7" event={"ID":"1e159073-9250-4ffc-aa96-224b8ae48029","Type":"ContainerStarted","Data":"4df1e3bac771c40e7c862796402f96daa98fee950705484240b8b74c273a8269"} Jul 24 11:24:45.142752 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:45.142702 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hmcs7" event={"ID":"1e159073-9250-4ffc-aa96-224b8ae48029","Type":"ContainerStarted","Data":"4d35ac43af3db37d44034c5342bdf929abd2c5bca208046cfb66e39fb5fc5fef"} Jul 24 11:24:45.143833 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:45.143795 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7hx7h" event={"ID":"a5939932-1706-4bde-9ca9-9e03ae19d047","Type":"ContainerStarted","Data":"21b82e3dd14dea17ce3f7d1fefc22f4849fcfe1df7db6ce8eb3bb43cb90ce880"} Jul 24 11:24:45.143935 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:45.143850 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-7hx7h" Jul 24 11:24:45.145643 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:45.145621 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c65b66cc6-bnrzc" event={"ID":"58cf8cb4-73a0-4743-a007-142e6f3fa741","Type":"ContainerStarted","Data":"25b74c7f9c0a45dffa9c5525046bff39107497c68b8f3374667f54c137ff42a1"} Jul 24 11:24:45.146344 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:45.146324 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-htzr7" Jul 24 11:24:45.150562 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:45.150518 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-6djk7" podStartSLOduration=66.625311429 podStartE2EDuration="1m15.150501501s" totalImagesPullingTime="8.525190072s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 11:23:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 11:24:45.150069985 +0000 UTC m=+76.168124532" watchObservedRunningTime="2026-07-24 11:24:45.150501501 +0000 UTC m=+76.168556026" Jul 24 11:24:45.186710 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:45.186512 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-7hx7h" podStartSLOduration=66.50765269 podStartE2EDuration="1m15.186493015s" totalImagesPullingTime="8.678840325s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 11:23:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 11:24:45.167696854 +0000 UTC m=+76.185751399" watchObservedRunningTime="2026-07-24 11:24:45.186493015 +0000 UTC m=+76.204547560" Jul 24 11:24:45.186963 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:45.186919 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-cc54d487f-966mt" podStartSLOduration=1.893205201 podStartE2EDuration="10.186908651s" totalImagesPullingTime="8.29370345s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 11:24:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 11:24:45.186096588 +0000 UTC m=+76.204151132" watchObservedRunningTime="2026-07-24 11:24:45.186908651 +0000 UTC m=+76.204963173" Jul 24 11:24:45.202258 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:45.202199 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-htzr7" podStartSLOduration=2.909395447 podStartE2EDuration="11.202183578s" totalImagesPullingTime="8.292788131s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 11:24:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 11:24:45.201635596 +0000 UTC m=+76.219690141" watchObservedRunningTime="2026-07-24 11:24:45.202183578 +0000 UTC m=+76.220238151" Jul 24 11:24:45.224218 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:45.224164 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7c65b66cc6-bnrzc" podStartSLOduration=1.9115316070000001 podStartE2EDuration="8.224141558s" totalImagesPullingTime="6.312609951s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 11:24:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 11:24:45.222834609 +0000 UTC m=+76.240889153" watchObservedRunningTime="2026-07-24 11:24:45.224141558 +0000 UTC m=+76.242196103" Jul 24 11:24:45.240773 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:45.240724 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-hmcs7" podStartSLOduration=67.027659455 podStartE2EDuration="1m15.240707669s" totalImagesPullingTime="8.213048214s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 11:23:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 11:24:45.24038632 +0000 UTC m=+76.258440864" watchObservedRunningTime="2026-07-24 11:24:45.240707669 +0000 UTC m=+76.258762213" Jul 24 11:24:45.473138 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:45.473080 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-cc54d487f-966mt" Jul 24 11:24:45.473324 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:45.473174 2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-cc54d487f-966mt" Jul 24 11:24:45.478687 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:45.478659 2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-cc54d487f-966mt" Jul 24 11:24:45.959462 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:45.959429 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-f7c7k"] Jul 24 11:24:45.962754 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:45.962726 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-f7c7k" Jul 24 11:24:45.968982 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:45.968954 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 24 11:24:45.969685 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:45.969008 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 24 11:24:45.969685 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:45.969104 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 24 11:24:45.969685 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:45.969113 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 24 11:24:45.969685 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:45.969009 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 24 11:24:45.969685 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:45.969383 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-w9hbq\"" Jul 24 11:24:45.974820 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:45.974778 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-f7c7k"] Jul 24 11:24:46.046990 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:46.046955 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6917a111-1ee2-4b2f-a507-af521ce3700a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-f7c7k\" (UID: \"6917a111-1ee2-4b2f-a507-af521ce3700a\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-f7c7k" Jul 24 11:24:46.047193 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:46.047033 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6917a111-1ee2-4b2f-a507-af521ce3700a-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-f7c7k\" (UID: \"6917a111-1ee2-4b2f-a507-af521ce3700a\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-f7c7k" Jul 24 11:24:46.047193 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:46.047066 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zb7lt\" (UniqueName: \"kubernetes.io/projected/6917a111-1ee2-4b2f-a507-af521ce3700a-kube-api-access-zb7lt\") pod \"prometheus-operator-84d69f794d-f7c7k\" (UID: \"6917a111-1ee2-4b2f-a507-af521ce3700a\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-f7c7k" Jul 24 11:24:46.047193 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:46.047092 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/6917a111-1ee2-4b2f-a507-af521ce3700a-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-f7c7k\" (UID: \"6917a111-1ee2-4b2f-a507-af521ce3700a\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-f7c7k" Jul 24 11:24:46.147494 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:46.147459 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6917a111-1ee2-4b2f-a507-af521ce3700a-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-f7c7k\" (UID: \"6917a111-1ee2-4b2f-a507-af521ce3700a\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-f7c7k" Jul 24 11:24:46.147968 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:46.147506 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zb7lt\" (UniqueName: \"kubernetes.io/projected/6917a111-1ee2-4b2f-a507-af521ce3700a-kube-api-access-zb7lt\") pod \"prometheus-operator-84d69f794d-f7c7k\" (UID: \"6917a111-1ee2-4b2f-a507-af521ce3700a\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-f7c7k" Jul 24 11:24:46.147968 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:46.147541 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/6917a111-1ee2-4b2f-a507-af521ce3700a-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-f7c7k\" (UID: \"6917a111-1ee2-4b2f-a507-af521ce3700a\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-f7c7k" Jul 24 11:24:46.147968 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:46.147593 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6917a111-1ee2-4b2f-a507-af521ce3700a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-f7c7k\" (UID: \"6917a111-1ee2-4b2f-a507-af521ce3700a\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-f7c7k" Jul 24 11:24:46.147968 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:24:46.147709 2586 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 24 11:24:46.147968 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:24:46.147788 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6917a111-1ee2-4b2f-a507-af521ce3700a-prometheus-operator-tls podName:6917a111-1ee2-4b2f-a507-af521ce3700a nodeName:}" failed. No retries permitted until 2026-07-24 11:24:46.647765039 +0000 UTC m=+77.665819579 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/6917a111-1ee2-4b2f-a507-af521ce3700a-prometheus-operator-tls") pod "prometheus-operator-84d69f794d-f7c7k" (UID: "6917a111-1ee2-4b2f-a507-af521ce3700a") : secret "prometheus-operator-tls" not found Jul 24 11:24:46.148227 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:46.148202 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6917a111-1ee2-4b2f-a507-af521ce3700a-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-f7c7k\" (UID: \"6917a111-1ee2-4b2f-a507-af521ce3700a\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-f7c7k" Jul 24 11:24:46.150373 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:46.150340 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6917a111-1ee2-4b2f-a507-af521ce3700a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-f7c7k\" (UID: \"6917a111-1ee2-4b2f-a507-af521ce3700a\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-f7c7k" Jul 24 11:24:46.155483 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:46.155462 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-cc54d487f-966mt" Jul 24 11:24:46.158304 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:46.158285 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zb7lt\" (UniqueName: \"kubernetes.io/projected/6917a111-1ee2-4b2f-a507-af521ce3700a-kube-api-access-zb7lt\") pod \"prometheus-operator-84d69f794d-f7c7k\" (UID: \"6917a111-1ee2-4b2f-a507-af521ce3700a\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-f7c7k" Jul 24 11:24:46.652481 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:46.652443 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/6917a111-1ee2-4b2f-a507-af521ce3700a-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-f7c7k\" (UID: \"6917a111-1ee2-4b2f-a507-af521ce3700a\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-f7c7k" Jul 24 11:24:46.655030 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:46.655003 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/6917a111-1ee2-4b2f-a507-af521ce3700a-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-f7c7k\" (UID: \"6917a111-1ee2-4b2f-a507-af521ce3700a\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-f7c7k" Jul 24 11:24:46.872591 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:46.872551 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-f7c7k" Jul 24 11:24:47.481014 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:47.480979 2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7c65b66cc6-bnrzc" Jul 24 11:24:47.481483 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:47.481062 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7c65b66cc6-bnrzc" Jul 24 11:24:47.486539 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:47.486517 2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7c65b66cc6-bnrzc" Jul 24 11:24:48.163629 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:48.163566 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7c65b66cc6-bnrzc" Jul 24 11:24:48.198973 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:48.198944 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-f7c7k"] Jul 24 11:24:48.201676 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:24:48.201646 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6917a111_1ee2_4b2f_a507_af521ce3700a.slice/crio-e1f6b53de06944e5e04dbf37a240379e749e1e29a9932e6586c3dfcd6458267e WatchSource:0}: Error finding container e1f6b53de06944e5e04dbf37a240379e749e1e29a9932e6586c3dfcd6458267e: Status 404 returned error can't find the container with id e1f6b53de06944e5e04dbf37a240379e749e1e29a9932e6586c3dfcd6458267e Jul 24 11:24:48.232131 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:48.226346 2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-cc54d487f-966mt"] Jul 24 11:24:49.162864 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:49.162827 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-f7c7k" event={"ID":"6917a111-1ee2-4b2f-a507-af521ce3700a","Type":"ContainerStarted","Data":"e1f6b53de06944e5e04dbf37a240379e749e1e29a9932e6586c3dfcd6458267e"} Jul 24 11:24:49.164781 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:49.164748 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jtwpm" event={"ID":"20114f28-ad5a-4a2f-9c59-efe90df9b6d3","Type":"ContainerStarted","Data":"8945c608d532ee063e411b71739a980eaab6a5e5ef880c1328ad22b4d6409d1d"} Jul 24 11:24:49.182433 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:49.182378 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-jtwpm" podStartSLOduration=2.247896531 podStartE2EDuration="20.182358642s" totalImagesPullingTime="17.934462111s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 11:24:29 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 11:24:49.181842134 +0000 UTC m=+80.199896681" watchObservedRunningTime="2026-07-24 11:24:49.182358642 +0000 UTC m=+80.200413186" Jul 24 11:24:50.170517 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:50.170466 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-f7c7k" event={"ID":"6917a111-1ee2-4b2f-a507-af521ce3700a","Type":"ContainerStarted","Data":"7983b12b48d7383ed22e6f6e49f5813583683bdc92e57668571d425ea2a65c42"} Jul 24 11:24:50.170517 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:50.170526 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-f7c7k" event={"ID":"6917a111-1ee2-4b2f-a507-af521ce3700a","Type":"ContainerStarted","Data":"f9e1e89db68dfc56945f51ee92046f82df0a3e58959fbbc4e70c0d7ce31386cb"} Jul 24 11:24:50.192157 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:50.189233 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-84d69f794d-f7c7k" podStartSLOduration=3.617527834 podStartE2EDuration="5.189201075s" totalImagesPullingTime="1.571673241s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 11:24:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 11:24:50.188094509 +0000 UTC m=+81.206149050" watchObservedRunningTime="2026-07-24 11:24:50.189201075 +0000 UTC m=+81.207255621" Jul 24 11:24:52.340100 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:52.339956 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-rgmjd"] Jul 24 11:24:52.343000 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:52.342985 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-rgmjd" Jul 24 11:24:52.345538 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:52.345516 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 24 11:24:52.346134 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:52.346098 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 24 11:24:52.346386 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:52.346365 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-zlrn4\"" Jul 24 11:24:52.357629 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:52.357603 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-rgmjd"] Jul 24 11:24:52.364011 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:52.363989 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-cbtbl"] Jul 24 11:24:52.366820 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:52.366805 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-cbtbl" Jul 24 11:24:52.370701 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:52.370683 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-ctt42"] Jul 24 11:24:52.371377 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:52.371350 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-rb7k6\"" Jul 24 11:24:52.371557 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:52.371536 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 24 11:24:52.371646 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:52.371633 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 24 11:24:52.371690 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:52.371634 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 24 11:24:52.373758 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:52.373563 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ctt42" Jul 24 11:24:52.379383 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:52.379367 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 24 11:24:52.380247 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:52.380229 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-vm5r8\"" Jul 24 11:24:52.381320 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:52.381305 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 24 11:24:52.382039 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:52.382023 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 24 11:24:52.388438 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:52.388404 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-cbtbl"] Jul 24 11:24:52.390670 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:52.390650 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fd5b052c-2d49-4970-8d88-ce251beb86f6-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-rgmjd\" (UID: \"fd5b052c-2d49-4970-8d88-ce251beb86f6\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-rgmjd" Jul 24 11:24:52.390766 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:52.390689 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fd5b052c-2d49-4970-8d88-ce251beb86f6-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-rgmjd\" (UID: \"fd5b052c-2d49-4970-8d88-ce251beb86f6\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-rgmjd" Jul 24 11:24:52.390766 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:52.390730 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fd5b052c-2d49-4970-8d88-ce251beb86f6-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-rgmjd\" (UID: \"fd5b052c-2d49-4970-8d88-ce251beb86f6\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-rgmjd" Jul 24 11:24:52.390766 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:52.390750 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7z7r\" (UniqueName: \"kubernetes.io/projected/fd5b052c-2d49-4970-8d88-ce251beb86f6-kube-api-access-k7z7r\") pod \"openshift-state-metrics-b8f49f5c6-rgmjd\" (UID: \"fd5b052c-2d49-4970-8d88-ce251beb86f6\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-rgmjd" Jul 24 11:24:52.491981 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:52.491944 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7z7r\" (UniqueName: \"kubernetes.io/projected/fd5b052c-2d49-4970-8d88-ce251beb86f6-kube-api-access-k7z7r\") pod \"openshift-state-metrics-b8f49f5c6-rgmjd\" (UID: \"fd5b052c-2d49-4970-8d88-ce251beb86f6\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-rgmjd" Jul 24 11:24:52.491981 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:52.491989 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/363e784c-5048-43b9-b914-315e86a973f6-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-cbtbl\" (UID: \"363e784c-5048-43b9-b914-315e86a973f6\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-cbtbl" Jul 24 11:24:52.492259 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:52.492009 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c2fe5a06-c933-4213-9156-6fa4320dd55b-sys\") pod \"node-exporter-ctt42\" (UID: \"c2fe5a06-c933-4213-9156-6fa4320dd55b\") " pod="openshift-monitoring/node-exporter-ctt42" Jul 24 11:24:52.492259 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:52.492073 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c2fe5a06-c933-4213-9156-6fa4320dd55b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ctt42\" (UID: \"c2fe5a06-c933-4213-9156-6fa4320dd55b\") " pod="openshift-monitoring/node-exporter-ctt42" Jul 24 11:24:52.492259 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:52.492107 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fd5b052c-2d49-4970-8d88-ce251beb86f6-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-rgmjd\" (UID: \"fd5b052c-2d49-4970-8d88-ce251beb86f6\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-rgmjd" Jul 24 11:24:52.492259 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:52.492128 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/363e784c-5048-43b9-b914-315e86a973f6-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-cbtbl\" (UID: \"363e784c-5048-43b9-b914-315e86a973f6\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-cbtbl" Jul 24 11:24:52.492259 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:52.492157 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c2fe5a06-c933-4213-9156-6fa4320dd55b-root\") pod \"node-exporter-ctt42\" (UID: \"c2fe5a06-c933-4213-9156-6fa4320dd55b\") " pod="openshift-monitoring/node-exporter-ctt42" Jul 24 11:24:52.492259 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:52.492183 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c2fe5a06-c933-4213-9156-6fa4320dd55b-node-exporter-tls\") pod \"node-exporter-ctt42\" (UID: \"c2fe5a06-c933-4213-9156-6fa4320dd55b\") " pod="openshift-monitoring/node-exporter-ctt42" Jul 24 11:24:52.492259 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:52.492225 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/363e784c-5048-43b9-b914-315e86a973f6-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-cbtbl\" (UID: \"363e784c-5048-43b9-b914-315e86a973f6\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-cbtbl" Jul 24 11:24:52.492259 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:52.492241 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c2fe5a06-c933-4213-9156-6fa4320dd55b-node-exporter-textfile\") pod \"node-exporter-ctt42\" (UID: \"c2fe5a06-c933-4213-9156-6fa4320dd55b\") " pod="openshift-monitoring/node-exporter-ctt42" Jul 24 11:24:52.492259 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:52.492257 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2fe5a06-c933-4213-9156-6fa4320dd55b-metrics-client-ca\") pod \"node-exporter-ctt42\" (UID: \"c2fe5a06-c933-4213-9156-6fa4320dd55b\") " pod="openshift-monitoring/node-exporter-ctt42" Jul 24 11:24:52.492626 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:52.492304 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fd5b052c-2d49-4970-8d88-ce251beb86f6-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-rgmjd\" (UID: \"fd5b052c-2d49-4970-8d88-ce251beb86f6\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-rgmjd" Jul 24 11:24:52.492626 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:52.492346 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/363e784c-5048-43b9-b914-315e86a973f6-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-cbtbl\" (UID: \"363e784c-5048-43b9-b914-315e86a973f6\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-cbtbl" Jul 24 11:24:52.492626 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:52.492384 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/363e784c-5048-43b9-b914-315e86a973f6-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-cbtbl\" (UID: \"363e784c-5048-43b9-b914-315e86a973f6\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-cbtbl" Jul 24 11:24:52.492626 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:52.492409 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c2fe5a06-c933-4213-9156-6fa4320dd55b-node-exporter-accelerators-collector-config\") pod \"node-exporter-ctt42\" (UID: \"c2fe5a06-c933-4213-9156-6fa4320dd55b\") " pod="openshift-monitoring/node-exporter-ctt42" Jul 24 11:24:52.492626 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:52.492447 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hmm6\" (UniqueName: \"kubernetes.io/projected/363e784c-5048-43b9-b914-315e86a973f6-kube-api-access-2hmm6\") pod \"kube-state-metrics-56d9f944b4-cbtbl\" (UID: \"363e784c-5048-43b9-b914-315e86a973f6\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-cbtbl" Jul 24 11:24:52.492626 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:52.492477 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6nkbc\" (UniqueName: \"kubernetes.io/projected/c2fe5a06-c933-4213-9156-6fa4320dd55b-kube-api-access-6nkbc\") pod \"node-exporter-ctt42\" (UID: \"c2fe5a06-c933-4213-9156-6fa4320dd55b\") " pod="openshift-monitoring/node-exporter-ctt42" Jul 24 11:24:52.492626 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:52.492509 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fd5b052c-2d49-4970-8d88-ce251beb86f6-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-rgmjd\" (UID: \"fd5b052c-2d49-4970-8d88-ce251beb86f6\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-rgmjd" Jul 24 11:24:52.492626 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:52.492528 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c2fe5a06-c933-4213-9156-6fa4320dd55b-node-exporter-wtmp\") pod \"node-exporter-ctt42\" (UID: \"c2fe5a06-c933-4213-9156-6fa4320dd55b\") " pod="openshift-monitoring/node-exporter-ctt42" Jul 24 11:24:52.492919 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:24:52.492647 2586 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 24 11:24:52.492919 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:24:52.492720 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd5b052c-2d49-4970-8d88-ce251beb86f6-openshift-state-metrics-tls podName:fd5b052c-2d49-4970-8d88-ce251beb86f6 nodeName:}" failed. No retries permitted until 2026-07-24 11:24:52.992704561 +0000 UTC m=+84.010759087 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/fd5b052c-2d49-4970-8d88-ce251beb86f6-openshift-state-metrics-tls") pod "openshift-state-metrics-b8f49f5c6-rgmjd" (UID: "fd5b052c-2d49-4970-8d88-ce251beb86f6") : secret "openshift-state-metrics-tls" not found Jul 24 11:24:52.493004 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:52.492988 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fd5b052c-2d49-4970-8d88-ce251beb86f6-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-rgmjd\" (UID: \"fd5b052c-2d49-4970-8d88-ce251beb86f6\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-rgmjd" Jul 24 11:24:52.494654 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:52.494637 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fd5b052c-2d49-4970-8d88-ce251beb86f6-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-rgmjd\" (UID: \"fd5b052c-2d49-4970-8d88-ce251beb86f6\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-rgmjd" Jul 24 11:24:52.503819 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:52.503796 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7z7r\" (UniqueName: \"kubernetes.io/projected/fd5b052c-2d49-4970-8d88-ce251beb86f6-kube-api-access-k7z7r\") pod \"openshift-state-metrics-b8f49f5c6-rgmjd\" (UID: \"fd5b052c-2d49-4970-8d88-ce251beb86f6\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-rgmjd" Jul 24 11:24:52.593627 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:52.593495 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/363e784c-5048-43b9-b914-315e86a973f6-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-cbtbl\" (UID: \"363e784c-5048-43b9-b914-315e86a973f6\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-cbtbl" Jul 24 11:24:52.593627 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:52.593541 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c2fe5a06-c933-4213-9156-6fa4320dd55b-node-exporter-accelerators-collector-config\") pod \"node-exporter-ctt42\" (UID: \"c2fe5a06-c933-4213-9156-6fa4320dd55b\") " pod="openshift-monitoring/node-exporter-ctt42" Jul 24 11:24:52.593627 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:52.593564 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hmm6\" (UniqueName: \"kubernetes.io/projected/363e784c-5048-43b9-b914-315e86a973f6-kube-api-access-2hmm6\") pod \"kube-state-metrics-56d9f944b4-cbtbl\" (UID: \"363e784c-5048-43b9-b914-315e86a973f6\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-cbtbl" Jul 24 11:24:52.593627 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:52.593613 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nkbc\" (UniqueName: \"kubernetes.io/projected/c2fe5a06-c933-4213-9156-6fa4320dd55b-kube-api-access-6nkbc\") pod \"node-exporter-ctt42\" (UID: \"c2fe5a06-c933-4213-9156-6fa4320dd55b\") " pod="openshift-monitoring/node-exporter-ctt42" Jul 24 11:24:52.593978 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:52.593787 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c2fe5a06-c933-4213-9156-6fa4320dd55b-node-exporter-wtmp\") pod \"node-exporter-ctt42\" (UID: \"c2fe5a06-c933-4213-9156-6fa4320dd55b\") " pod="openshift-monitoring/node-exporter-ctt42" Jul 24 11:24:52.593978 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:52.593836 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/363e784c-5048-43b9-b914-315e86a973f6-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-cbtbl\" (UID: \"363e784c-5048-43b9-b914-315e86a973f6\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-cbtbl" Jul 24 11:24:52.593978 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:52.593874 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c2fe5a06-c933-4213-9156-6fa4320dd55b-sys\") pod \"node-exporter-ctt42\" (UID: \"c2fe5a06-c933-4213-9156-6fa4320dd55b\") " pod="openshift-monitoring/node-exporter-ctt42" Jul 24 11:24:52.593978 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:52.593902 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c2fe5a06-c933-4213-9156-6fa4320dd55b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ctt42\" (UID: \"c2fe5a06-c933-4213-9156-6fa4320dd55b\") " pod="openshift-monitoring/node-exporter-ctt42" Jul 24 11:24:52.593978 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:52.593926 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/363e784c-5048-43b9-b914-315e86a973f6-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-cbtbl\" (UID: \"363e784c-5048-43b9-b914-315e86a973f6\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-cbtbl" Jul 24 11:24:52.594240 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:52.593992 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c2fe5a06-c933-4213-9156-6fa4320dd55b-sys\") pod \"node-exporter-ctt42\" (UID: \"c2fe5a06-c933-4213-9156-6fa4320dd55b\") " pod="openshift-monitoring/node-exporter-ctt42" Jul 24 11:24:52.594240 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:52.593996 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c2fe5a06-c933-4213-9156-6fa4320dd55b-node-exporter-wtmp\") pod \"node-exporter-ctt42\" (UID: \"c2fe5a06-c933-4213-9156-6fa4320dd55b\") " pod="openshift-monitoring/node-exporter-ctt42" Jul 24 11:24:52.594240 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:52.594050 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c2fe5a06-c933-4213-9156-6fa4320dd55b-root\") pod \"node-exporter-ctt42\" (UID: \"c2fe5a06-c933-4213-9156-6fa4320dd55b\") " pod="openshift-monitoring/node-exporter-ctt42" Jul 24 11:24:52.594240 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:52.594092 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c2fe5a06-c933-4213-9156-6fa4320dd55b-node-exporter-tls\") pod \"node-exporter-ctt42\" (UID: \"c2fe5a06-c933-4213-9156-6fa4320dd55b\") " pod="openshift-monitoring/node-exporter-ctt42" Jul 24 11:24:52.594240 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:52.594127 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/363e784c-5048-43b9-b914-315e86a973f6-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-cbtbl\" (UID: \"363e784c-5048-43b9-b914-315e86a973f6\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-cbtbl" Jul 24 11:24:52.594240 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:52.594158 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c2fe5a06-c933-4213-9156-6fa4320dd55b-root\") pod \"node-exporter-ctt42\" (UID: \"c2fe5a06-c933-4213-9156-6fa4320dd55b\") " pod="openshift-monitoring/node-exporter-ctt42" Jul 24 11:24:52.594240 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:52.594184 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c2fe5a06-c933-4213-9156-6fa4320dd55b-node-exporter-textfile\") pod \"node-exporter-ctt42\" (UID: \"c2fe5a06-c933-4213-9156-6fa4320dd55b\") " pod="openshift-monitoring/node-exporter-ctt42" Jul 24 11:24:52.594240 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:52.594184 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c2fe5a06-c933-4213-9156-6fa4320dd55b-node-exporter-accelerators-collector-config\") pod \"node-exporter-ctt42\" (UID: \"c2fe5a06-c933-4213-9156-6fa4320dd55b\") " pod="openshift-monitoring/node-exporter-ctt42" Jul 24 11:24:52.594240 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:52.594208 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2fe5a06-c933-4213-9156-6fa4320dd55b-metrics-client-ca\") pod \"node-exporter-ctt42\" (UID: \"c2fe5a06-c933-4213-9156-6fa4320dd55b\") " pod="openshift-monitoring/node-exporter-ctt42" Jul 24 11:24:52.594683 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:52.594249 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/363e784c-5048-43b9-b914-315e86a973f6-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-cbtbl\" (UID: \"363e784c-5048-43b9-b914-315e86a973f6\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-cbtbl" Jul 24 11:24:52.594683 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:52.594257 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/363e784c-5048-43b9-b914-315e86a973f6-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-cbtbl\" (UID: \"363e784c-5048-43b9-b914-315e86a973f6\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-cbtbl" Jul 24 11:24:52.594683 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:52.594365 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/363e784c-5048-43b9-b914-315e86a973f6-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-cbtbl\" (UID: \"363e784c-5048-43b9-b914-315e86a973f6\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-cbtbl" Jul 24 11:24:52.594683 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:52.594526 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/363e784c-5048-43b9-b914-315e86a973f6-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-cbtbl\" (UID: \"363e784c-5048-43b9-b914-315e86a973f6\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-cbtbl" Jul 24 11:24:52.594683 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:52.594664 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c2fe5a06-c933-4213-9156-6fa4320dd55b-node-exporter-textfile\") pod \"node-exporter-ctt42\" (UID: \"c2fe5a06-c933-4213-9156-6fa4320dd55b\") " pod="openshift-monitoring/node-exporter-ctt42" Jul 24 11:24:52.594873 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:52.594701 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2fe5a06-c933-4213-9156-6fa4320dd55b-metrics-client-ca\") pod \"node-exporter-ctt42\" (UID: \"c2fe5a06-c933-4213-9156-6fa4320dd55b\") " pod="openshift-monitoring/node-exporter-ctt42" Jul 24 11:24:52.596931 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:52.596906 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c2fe5a06-c933-4213-9156-6fa4320dd55b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ctt42\" (UID: \"c2fe5a06-c933-4213-9156-6fa4320dd55b\") " pod="openshift-monitoring/node-exporter-ctt42" Jul 24 11:24:52.597044 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:52.597018 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/363e784c-5048-43b9-b914-315e86a973f6-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-cbtbl\" (UID: \"363e784c-5048-43b9-b914-315e86a973f6\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-cbtbl" Jul 24 11:24:52.597044 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:52.597031 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/363e784c-5048-43b9-b914-315e86a973f6-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-cbtbl\" (UID: \"363e784c-5048-43b9-b914-315e86a973f6\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-cbtbl" Jul 24 11:24:52.597369 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:52.597349 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c2fe5a06-c933-4213-9156-6fa4320dd55b-node-exporter-tls\") pod \"node-exporter-ctt42\" (UID: \"c2fe5a06-c933-4213-9156-6fa4320dd55b\") " pod="openshift-monitoring/node-exporter-ctt42" Jul 24 11:24:52.601379 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:52.601348 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hmm6\" (UniqueName: \"kubernetes.io/projected/363e784c-5048-43b9-b914-315e86a973f6-kube-api-access-2hmm6\") pod \"kube-state-metrics-56d9f944b4-cbtbl\" (UID: \"363e784c-5048-43b9-b914-315e86a973f6\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-cbtbl" Jul 24 11:24:52.601474 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:52.601399 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6nkbc\" (UniqueName: \"kubernetes.io/projected/c2fe5a06-c933-4213-9156-6fa4320dd55b-kube-api-access-6nkbc\") pod \"node-exporter-ctt42\" (UID: \"c2fe5a06-c933-4213-9156-6fa4320dd55b\") " pod="openshift-monitoring/node-exporter-ctt42" Jul 24 11:24:52.676363 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:52.676326 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-cbtbl" Jul 24 11:24:52.682509 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:52.682476 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ctt42" Jul 24 11:24:52.693259 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:24:52.693222 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2fe5a06_c933_4213_9156_6fa4320dd55b.slice/crio-52db8792f3fc85f911dbed9aa178cfc47da582f73fe4f3020850b9c263afae47 WatchSource:0}: Error finding container 52db8792f3fc85f911dbed9aa178cfc47da582f73fe4f3020850b9c263afae47: Status 404 returned error can't find the container with id 52db8792f3fc85f911dbed9aa178cfc47da582f73fe4f3020850b9c263afae47 Jul 24 11:24:52.811829 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:52.811803 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-cbtbl"] Jul 24 11:24:52.814412 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:24:52.814383 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod363e784c_5048_43b9_b914_315e86a973f6.slice/crio-20b3a7a9cefad8c37cae43112af33fe3fbf17ef563122e6586359df7c7dbb0e2 WatchSource:0}: Error finding container 20b3a7a9cefad8c37cae43112af33fe3fbf17ef563122e6586359df7c7dbb0e2: Status 404 returned error can't find the container with id 20b3a7a9cefad8c37cae43112af33fe3fbf17ef563122e6586359df7c7dbb0e2 Jul 24 11:24:52.997795 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:52.997760 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fd5b052c-2d49-4970-8d88-ce251beb86f6-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-rgmjd\" (UID: \"fd5b052c-2d49-4970-8d88-ce251beb86f6\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-rgmjd" Jul 24 11:24:52.999857 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:52.999838 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fd5b052c-2d49-4970-8d88-ce251beb86f6-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-rgmjd\" (UID: \"fd5b052c-2d49-4970-8d88-ce251beb86f6\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-rgmjd" Jul 24 11:24:53.187149 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:53.187114 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ctt42" event={"ID":"c2fe5a06-c933-4213-9156-6fa4320dd55b","Type":"ContainerStarted","Data":"52db8792f3fc85f911dbed9aa178cfc47da582f73fe4f3020850b9c263afae47"} Jul 24 11:24:53.188314 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:53.188290 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-cbtbl" event={"ID":"363e784c-5048-43b9-b914-315e86a973f6","Type":"ContainerStarted","Data":"20b3a7a9cefad8c37cae43112af33fe3fbf17ef563122e6586359df7c7dbb0e2"} Jul 24 11:24:53.251881 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:53.251793 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-rgmjd" Jul 24 11:24:53.356833 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:53.356197 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 24 11:24:53.362144 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:53.361246 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 24 11:24:53.367718 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:53.365714 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 24 11:24:53.367718 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:53.365878 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 24 11:24:53.367718 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:53.365955 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 24 11:24:53.367718 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:53.365714 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 24 11:24:53.367718 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:53.366101 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 24 11:24:53.367718 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:53.366241 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 24 11:24:53.367718 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:53.366435 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-f6bh8\"" Jul 24 11:24:53.367718 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:53.366482 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 24 11:24:53.367718 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:53.366674 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 24 11:24:53.367718 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:53.366768 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 24 11:24:53.378426 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:53.378399 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 24 11:24:53.410719 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:53.410687 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-rgmjd"] Jul 24 11:24:53.413919 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:24:53.413889 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd5b052c_2d49_4970_8d88_ce251beb86f6.slice/crio-c7d34f5920332f318c8d9c5b8de033db4dca16660765c9f237f616a174cbdb19 WatchSource:0}: Error finding container c7d34f5920332f318c8d9c5b8de033db4dca16660765c9f237f616a174cbdb19: Status 404 returned error can't find the container with id c7d34f5920332f318c8d9c5b8de033db4dca16660765c9f237f616a174cbdb19 Jul 24 11:24:53.501460 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:53.501428 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5l6jc\" (UniqueName: \"kubernetes.io/projected/249e6e6e-a7d0-43a7-99ea-c3f61ed26b50-kube-api-access-5l6jc\") pod \"alertmanager-main-0\" (UID: \"249e6e6e-a7d0-43a7-99ea-c3f61ed26b50\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 11:24:53.501606 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:53.501473 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/249e6e6e-a7d0-43a7-99ea-c3f61ed26b50-web-config\") pod \"alertmanager-main-0\" (UID: \"249e6e6e-a7d0-43a7-99ea-c3f61ed26b50\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 11:24:53.501606 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:53.501503 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/249e6e6e-a7d0-43a7-99ea-c3f61ed26b50-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"249e6e6e-a7d0-43a7-99ea-c3f61ed26b50\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 11:24:53.501606 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:53.501538 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/249e6e6e-a7d0-43a7-99ea-c3f61ed26b50-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"249e6e6e-a7d0-43a7-99ea-c3f61ed26b50\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 11:24:53.501606 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:53.501605 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/249e6e6e-a7d0-43a7-99ea-c3f61ed26b50-tls-assets\") pod \"alertmanager-main-0\" (UID: \"249e6e6e-a7d0-43a7-99ea-c3f61ed26b50\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 11:24:53.501812 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:53.501626 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/249e6e6e-a7d0-43a7-99ea-c3f61ed26b50-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"249e6e6e-a7d0-43a7-99ea-c3f61ed26b50\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 11:24:53.501812 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:53.501662 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/249e6e6e-a7d0-43a7-99ea-c3f61ed26b50-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"249e6e6e-a7d0-43a7-99ea-c3f61ed26b50\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 11:24:53.501812 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:53.501691 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/249e6e6e-a7d0-43a7-99ea-c3f61ed26b50-config-volume\") pod \"alertmanager-main-0\" (UID: \"249e6e6e-a7d0-43a7-99ea-c3f61ed26b50\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 11:24:53.501812 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:53.501757 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/249e6e6e-a7d0-43a7-99ea-c3f61ed26b50-config-out\") pod \"alertmanager-main-0\" (UID: \"249e6e6e-a7d0-43a7-99ea-c3f61ed26b50\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 11:24:53.501812 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:53.501795 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/249e6e6e-a7d0-43a7-99ea-c3f61ed26b50-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"249e6e6e-a7d0-43a7-99ea-c3f61ed26b50\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 11:24:53.502092 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:53.501833 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/249e6e6e-a7d0-43a7-99ea-c3f61ed26b50-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"249e6e6e-a7d0-43a7-99ea-c3f61ed26b50\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 11:24:53.502092 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:53.501882 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/249e6e6e-a7d0-43a7-99ea-c3f61ed26b50-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"249e6e6e-a7d0-43a7-99ea-c3f61ed26b50\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 11:24:53.502092 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:53.501933 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/249e6e6e-a7d0-43a7-99ea-c3f61ed26b50-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"249e6e6e-a7d0-43a7-99ea-c3f61ed26b50\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 11:24:53.604105 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:53.603255 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/249e6e6e-a7d0-43a7-99ea-c3f61ed26b50-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"249e6e6e-a7d0-43a7-99ea-c3f61ed26b50\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 11:24:53.604105 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:53.603310 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/249e6e6e-a7d0-43a7-99ea-c3f61ed26b50-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"249e6e6e-a7d0-43a7-99ea-c3f61ed26b50\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 11:24:53.604105 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:53.603341 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/249e6e6e-a7d0-43a7-99ea-c3f61ed26b50-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"249e6e6e-a7d0-43a7-99ea-c3f61ed26b50\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 11:24:53.604105 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:53.603377 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5l6jc\" (UniqueName: \"kubernetes.io/projected/249e6e6e-a7d0-43a7-99ea-c3f61ed26b50-kube-api-access-5l6jc\") pod \"alertmanager-main-0\" (UID: \"249e6e6e-a7d0-43a7-99ea-c3f61ed26b50\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 11:24:53.604105 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:53.603402 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/249e6e6e-a7d0-43a7-99ea-c3f61ed26b50-web-config\") pod \"alertmanager-main-0\" (UID: \"249e6e6e-a7d0-43a7-99ea-c3f61ed26b50\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 11:24:53.604105 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:53.603428 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/249e6e6e-a7d0-43a7-99ea-c3f61ed26b50-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"249e6e6e-a7d0-43a7-99ea-c3f61ed26b50\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 11:24:53.604105 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:53.603458 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/249e6e6e-a7d0-43a7-99ea-c3f61ed26b50-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"249e6e6e-a7d0-43a7-99ea-c3f61ed26b50\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 11:24:53.604105 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:53.603490 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/249e6e6e-a7d0-43a7-99ea-c3f61ed26b50-tls-assets\") pod \"alertmanager-main-0\" (UID: \"249e6e6e-a7d0-43a7-99ea-c3f61ed26b50\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 11:24:53.604105 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:53.603517 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/249e6e6e-a7d0-43a7-99ea-c3f61ed26b50-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"249e6e6e-a7d0-43a7-99ea-c3f61ed26b50\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 11:24:53.604105 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:53.603559 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/249e6e6e-a7d0-43a7-99ea-c3f61ed26b50-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"249e6e6e-a7d0-43a7-99ea-c3f61ed26b50\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 11:24:53.604105 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:53.603606 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/249e6e6e-a7d0-43a7-99ea-c3f61ed26b50-config-volume\") pod \"alertmanager-main-0\" (UID: \"249e6e6e-a7d0-43a7-99ea-c3f61ed26b50\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 11:24:53.604105 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:53.603630 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/249e6e6e-a7d0-43a7-99ea-c3f61ed26b50-config-out\") pod \"alertmanager-main-0\" (UID: \"249e6e6e-a7d0-43a7-99ea-c3f61ed26b50\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 11:24:53.604105 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:53.603654 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/249e6e6e-a7d0-43a7-99ea-c3f61ed26b50-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"249e6e6e-a7d0-43a7-99ea-c3f61ed26b50\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 11:24:53.606041 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:53.606003 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/249e6e6e-a7d0-43a7-99ea-c3f61ed26b50-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"249e6e6e-a7d0-43a7-99ea-c3f61ed26b50\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 11:24:53.607337 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:53.606507 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/249e6e6e-a7d0-43a7-99ea-c3f61ed26b50-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"249e6e6e-a7d0-43a7-99ea-c3f61ed26b50\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 11:24:53.607337 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:53.606828 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/249e6e6e-a7d0-43a7-99ea-c3f61ed26b50-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"249e6e6e-a7d0-43a7-99ea-c3f61ed26b50\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 11:24:53.607510 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:53.607386 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/249e6e6e-a7d0-43a7-99ea-c3f61ed26b50-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"249e6e6e-a7d0-43a7-99ea-c3f61ed26b50\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 11:24:53.608006 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:53.607956 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/249e6e6e-a7d0-43a7-99ea-c3f61ed26b50-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"249e6e6e-a7d0-43a7-99ea-c3f61ed26b50\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 11:24:53.608202 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:53.608156 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/249e6e6e-a7d0-43a7-99ea-c3f61ed26b50-web-config\") pod \"alertmanager-main-0\" (UID: \"249e6e6e-a7d0-43a7-99ea-c3f61ed26b50\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 11:24:53.609286 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:53.609261 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/249e6e6e-a7d0-43a7-99ea-c3f61ed26b50-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"249e6e6e-a7d0-43a7-99ea-c3f61ed26b50\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 11:24:53.609751 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:53.609705 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/249e6e6e-a7d0-43a7-99ea-c3f61ed26b50-tls-assets\") pod \"alertmanager-main-0\" (UID: \"249e6e6e-a7d0-43a7-99ea-c3f61ed26b50\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 11:24:53.610293 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:53.610259 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/249e6e6e-a7d0-43a7-99ea-c3f61ed26b50-config-volume\") pod \"alertmanager-main-0\" (UID: \"249e6e6e-a7d0-43a7-99ea-c3f61ed26b50\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 11:24:53.610399 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:53.610376 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/249e6e6e-a7d0-43a7-99ea-c3f61ed26b50-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"249e6e6e-a7d0-43a7-99ea-c3f61ed26b50\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 11:24:53.610850 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:53.610823 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/249e6e6e-a7d0-43a7-99ea-c3f61ed26b50-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"249e6e6e-a7d0-43a7-99ea-c3f61ed26b50\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 11:24:53.610951 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:53.610905 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/249e6e6e-a7d0-43a7-99ea-c3f61ed26b50-config-out\") pod \"alertmanager-main-0\" (UID: \"249e6e6e-a7d0-43a7-99ea-c3f61ed26b50\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 11:24:53.615415 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:53.615392 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5l6jc\" (UniqueName: \"kubernetes.io/projected/249e6e6e-a7d0-43a7-99ea-c3f61ed26b50-kube-api-access-5l6jc\") pod \"alertmanager-main-0\" (UID: \"249e6e6e-a7d0-43a7-99ea-c3f61ed26b50\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 11:24:53.675401 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:53.675367 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 24 11:24:53.844249 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:53.843958 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 24 11:24:53.846431 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:24:53.846400 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod249e6e6e_a7d0_43a7_99ea_c3f61ed26b50.slice/crio-fcfe5bcbbad3b7a63becc015a8b48f1b81019b763387b96ca34ae04d414a0b05 WatchSource:0}: Error finding container fcfe5bcbbad3b7a63becc015a8b48f1b81019b763387b96ca34ae04d414a0b05: Status 404 returned error can't find the container with id fcfe5bcbbad3b7a63becc015a8b48f1b81019b763387b96ca34ae04d414a0b05 Jul 24 11:24:54.193946 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:54.193917 2586 generic.go:356] "Generic (PLEG): container finished" podID="c2fe5a06-c933-4213-9156-6fa4320dd55b" containerID="940d779373569e0ad2bed6a2677b2b03d2033cd286f1cd6b606c64fb6d9bfb8c" exitCode=0 Jul 24 11:24:54.194119 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:54.194005 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ctt42" event={"ID":"c2fe5a06-c933-4213-9156-6fa4320dd55b","Type":"ContainerDied","Data":"940d779373569e0ad2bed6a2677b2b03d2033cd286f1cd6b606c64fb6d9bfb8c"} Jul 24 11:24:54.196143 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:54.196108 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-rgmjd" event={"ID":"fd5b052c-2d49-4970-8d88-ce251beb86f6","Type":"ContainerStarted","Data":"06d67e3ecddeb0cae82450c9db4b337dc16313d9768572f4f3d3e675339cf384"} Jul 24 11:24:54.196265 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:54.196173 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-rgmjd" event={"ID":"fd5b052c-2d49-4970-8d88-ce251beb86f6","Type":"ContainerStarted","Data":"412c161034e7e1e022dd65e822ea68ebdc3d0d63729b5f22026262ea4c84e868"} Jul 24 11:24:54.196265 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:54.196196 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-rgmjd" event={"ID":"fd5b052c-2d49-4970-8d88-ce251beb86f6","Type":"ContainerStarted","Data":"c7d34f5920332f318c8d9c5b8de033db4dca16660765c9f237f616a174cbdb19"} Jul 24 11:24:54.197373 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:54.197351 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"249e6e6e-a7d0-43a7-99ea-c3f61ed26b50","Type":"ContainerStarted","Data":"fcfe5bcbbad3b7a63becc015a8b48f1b81019b763387b96ca34ae04d414a0b05"} Jul 24 11:24:54.379539 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:54.379512 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-576cbf95bb-qwsgk"] Jul 24 11:24:54.388540 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:54.388513 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-576cbf95bb-qwsgk" Jul 24 11:24:54.391187 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:54.391163 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-7pjlhp730sfcb\"" Jul 24 11:24:54.391320 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:54.391185 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 24 11:24:54.391589 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:54.391412 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 24 11:24:54.391589 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:54.391442 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 24 11:24:54.391589 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:54.391523 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-fnxjr\"" Jul 24 11:24:54.391902 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:54.391882 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 24 11:24:54.392158 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:54.392125 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 24 11:24:54.395868 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:54.395848 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-576cbf95bb-qwsgk"] Jul 24 11:24:54.512777 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:54.512148 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/13076bfe-fda6-4c26-bb9d-dc48b24e3ed3-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-576cbf95bb-qwsgk\" (UID: \"13076bfe-fda6-4c26-bb9d-dc48b24e3ed3\") " pod="openshift-monitoring/thanos-querier-576cbf95bb-qwsgk" Jul 24 11:24:54.512777 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:54.512195 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/13076bfe-fda6-4c26-bb9d-dc48b24e3ed3-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-576cbf95bb-qwsgk\" (UID: \"13076bfe-fda6-4c26-bb9d-dc48b24e3ed3\") " pod="openshift-monitoring/thanos-querier-576cbf95bb-qwsgk" Jul 24 11:24:54.512777 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:54.512231 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/13076bfe-fda6-4c26-bb9d-dc48b24e3ed3-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-576cbf95bb-qwsgk\" (UID: \"13076bfe-fda6-4c26-bb9d-dc48b24e3ed3\") " pod="openshift-monitoring/thanos-querier-576cbf95bb-qwsgk" Jul 24 11:24:54.512777 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:54.512280 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/13076bfe-fda6-4c26-bb9d-dc48b24e3ed3-secret-grpc-tls\") pod \"thanos-querier-576cbf95bb-qwsgk\" (UID: \"13076bfe-fda6-4c26-bb9d-dc48b24e3ed3\") " pod="openshift-monitoring/thanos-querier-576cbf95bb-qwsgk" Jul 24 11:24:54.512777 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:54.512328 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/13076bfe-fda6-4c26-bb9d-dc48b24e3ed3-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-576cbf95bb-qwsgk\" (UID: \"13076bfe-fda6-4c26-bb9d-dc48b24e3ed3\") " pod="openshift-monitoring/thanos-querier-576cbf95bb-qwsgk" Jul 24 11:24:54.512777 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:54.512352 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/13076bfe-fda6-4c26-bb9d-dc48b24e3ed3-metrics-client-ca\") pod \"thanos-querier-576cbf95bb-qwsgk\" (UID: \"13076bfe-fda6-4c26-bb9d-dc48b24e3ed3\") " pod="openshift-monitoring/thanos-querier-576cbf95bb-qwsgk" Jul 24 11:24:54.512777 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:54.512385 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/13076bfe-fda6-4c26-bb9d-dc48b24e3ed3-secret-thanos-querier-tls\") pod \"thanos-querier-576cbf95bb-qwsgk\" (UID: \"13076bfe-fda6-4c26-bb9d-dc48b24e3ed3\") " pod="openshift-monitoring/thanos-querier-576cbf95bb-qwsgk" Jul 24 11:24:54.512777 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:54.512413 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzxj7\" (UniqueName: \"kubernetes.io/projected/13076bfe-fda6-4c26-bb9d-dc48b24e3ed3-kube-api-access-kzxj7\") pod \"thanos-querier-576cbf95bb-qwsgk\" (UID: \"13076bfe-fda6-4c26-bb9d-dc48b24e3ed3\") " pod="openshift-monitoring/thanos-querier-576cbf95bb-qwsgk" Jul 24 11:24:54.613514 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:54.613475 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/13076bfe-fda6-4c26-bb9d-dc48b24e3ed3-secret-grpc-tls\") pod \"thanos-querier-576cbf95bb-qwsgk\" (UID: \"13076bfe-fda6-4c26-bb9d-dc48b24e3ed3\") " pod="openshift-monitoring/thanos-querier-576cbf95bb-qwsgk" Jul 24 11:24:54.613714 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:54.613562 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/13076bfe-fda6-4c26-bb9d-dc48b24e3ed3-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-576cbf95bb-qwsgk\" (UID: \"13076bfe-fda6-4c26-bb9d-dc48b24e3ed3\") " pod="openshift-monitoring/thanos-querier-576cbf95bb-qwsgk" Jul 24 11:24:54.613714 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:54.613604 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/13076bfe-fda6-4c26-bb9d-dc48b24e3ed3-metrics-client-ca\") pod \"thanos-querier-576cbf95bb-qwsgk\" (UID: \"13076bfe-fda6-4c26-bb9d-dc48b24e3ed3\") " pod="openshift-monitoring/thanos-querier-576cbf95bb-qwsgk" Jul 24 11:24:54.613714 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:54.613640 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/13076bfe-fda6-4c26-bb9d-dc48b24e3ed3-secret-thanos-querier-tls\") pod \"thanos-querier-576cbf95bb-qwsgk\" (UID: \"13076bfe-fda6-4c26-bb9d-dc48b24e3ed3\") " pod="openshift-monitoring/thanos-querier-576cbf95bb-qwsgk" Jul 24 11:24:54.613714 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:54.613668 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzxj7\" (UniqueName: \"kubernetes.io/projected/13076bfe-fda6-4c26-bb9d-dc48b24e3ed3-kube-api-access-kzxj7\") pod \"thanos-querier-576cbf95bb-qwsgk\" (UID: \"13076bfe-fda6-4c26-bb9d-dc48b24e3ed3\") " pod="openshift-monitoring/thanos-querier-576cbf95bb-qwsgk" Jul 24 11:24:54.613714 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:54.613693 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/13076bfe-fda6-4c26-bb9d-dc48b24e3ed3-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-576cbf95bb-qwsgk\" (UID: \"13076bfe-fda6-4c26-bb9d-dc48b24e3ed3\") " pod="openshift-monitoring/thanos-querier-576cbf95bb-qwsgk" Jul 24 11:24:54.614000 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:54.613730 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/13076bfe-fda6-4c26-bb9d-dc48b24e3ed3-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-576cbf95bb-qwsgk\" (UID: \"13076bfe-fda6-4c26-bb9d-dc48b24e3ed3\") " pod="openshift-monitoring/thanos-querier-576cbf95bb-qwsgk" Jul 24 11:24:54.614000 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:54.613765 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/13076bfe-fda6-4c26-bb9d-dc48b24e3ed3-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-576cbf95bb-qwsgk\" (UID: \"13076bfe-fda6-4c26-bb9d-dc48b24e3ed3\") " pod="openshift-monitoring/thanos-querier-576cbf95bb-qwsgk" Jul 24 11:24:54.615462 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:54.615429 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/13076bfe-fda6-4c26-bb9d-dc48b24e3ed3-metrics-client-ca\") pod \"thanos-querier-576cbf95bb-qwsgk\" (UID: \"13076bfe-fda6-4c26-bb9d-dc48b24e3ed3\") " pod="openshift-monitoring/thanos-querier-576cbf95bb-qwsgk" Jul 24 11:24:54.618435 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:54.618386 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/13076bfe-fda6-4c26-bb9d-dc48b24e3ed3-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-576cbf95bb-qwsgk\" (UID: \"13076bfe-fda6-4c26-bb9d-dc48b24e3ed3\") " pod="openshift-monitoring/thanos-querier-576cbf95bb-qwsgk" Jul 24 11:24:54.619677 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:54.619609 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/13076bfe-fda6-4c26-bb9d-dc48b24e3ed3-secret-thanos-querier-tls\") pod \"thanos-querier-576cbf95bb-qwsgk\" (UID: \"13076bfe-fda6-4c26-bb9d-dc48b24e3ed3\") " pod="openshift-monitoring/thanos-querier-576cbf95bb-qwsgk" Jul 24 11:24:54.623037 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:54.622988 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/13076bfe-fda6-4c26-bb9d-dc48b24e3ed3-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-576cbf95bb-qwsgk\" (UID: \"13076bfe-fda6-4c26-bb9d-dc48b24e3ed3\") " pod="openshift-monitoring/thanos-querier-576cbf95bb-qwsgk" Jul 24 11:24:54.623308 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:54.623274 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/13076bfe-fda6-4c26-bb9d-dc48b24e3ed3-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-576cbf95bb-qwsgk\" (UID: \"13076bfe-fda6-4c26-bb9d-dc48b24e3ed3\") " pod="openshift-monitoring/thanos-querier-576cbf95bb-qwsgk" Jul 24 11:24:54.623435 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:54.623410 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/13076bfe-fda6-4c26-bb9d-dc48b24e3ed3-secret-grpc-tls\") pod \"thanos-querier-576cbf95bb-qwsgk\" (UID: \"13076bfe-fda6-4c26-bb9d-dc48b24e3ed3\") " pod="openshift-monitoring/thanos-querier-576cbf95bb-qwsgk" Jul 24 11:24:54.625205 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:54.625160 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/13076bfe-fda6-4c26-bb9d-dc48b24e3ed3-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-576cbf95bb-qwsgk\" (UID: \"13076bfe-fda6-4c26-bb9d-dc48b24e3ed3\") " pod="openshift-monitoring/thanos-querier-576cbf95bb-qwsgk" Jul 24 11:24:54.625950 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:54.625909 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzxj7\" (UniqueName: \"kubernetes.io/projected/13076bfe-fda6-4c26-bb9d-dc48b24e3ed3-kube-api-access-kzxj7\") pod \"thanos-querier-576cbf95bb-qwsgk\" (UID: \"13076bfe-fda6-4c26-bb9d-dc48b24e3ed3\") " pod="openshift-monitoring/thanos-querier-576cbf95bb-qwsgk" Jul 24 11:24:54.715316 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:54.715186 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-576cbf95bb-qwsgk" Jul 24 11:24:54.886077 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:54.885909 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-576cbf95bb-qwsgk"] Jul 24 11:24:54.978060 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:24:54.977996 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13076bfe_fda6_4c26_bb9d_dc48b24e3ed3.slice/crio-57d535b3461359913ef6016d99d38a4102679b72b8458fddb7279089c1815dc0 WatchSource:0}: Error finding container 57d535b3461359913ef6016d99d38a4102679b72b8458fddb7279089c1815dc0: Status 404 returned error can't find the container with id 57d535b3461359913ef6016d99d38a4102679b72b8458fddb7279089c1815dc0 Jul 24 11:24:55.203931 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:55.203896 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-576cbf95bb-qwsgk" event={"ID":"13076bfe-fda6-4c26-bb9d-dc48b24e3ed3","Type":"ContainerStarted","Data":"57d535b3461359913ef6016d99d38a4102679b72b8458fddb7279089c1815dc0"} Jul 24 11:24:55.206247 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:55.206218 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ctt42" event={"ID":"c2fe5a06-c933-4213-9156-6fa4320dd55b","Type":"ContainerStarted","Data":"0f05f72e53948a6eb4c28d065de19afe8f37f082ed6bddc3390a0db48335b87c"} Jul 24 11:24:55.206401 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:55.206273 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ctt42" event={"ID":"c2fe5a06-c933-4213-9156-6fa4320dd55b","Type":"ContainerStarted","Data":"5181731ae85ea3ac74f94d1514cd9ee21606c8c963fc06bdd8678ea14d93d35b"} Jul 24 11:24:55.208204 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:55.208183 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-cbtbl" event={"ID":"363e784c-5048-43b9-b914-315e86a973f6","Type":"ContainerStarted","Data":"5653cf71bda8bd732003aff5f9453f6c3e7de32da0c46a5608be2fe585685dcb"} Jul 24 11:24:55.208320 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:55.208227 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-cbtbl" event={"ID":"363e784c-5048-43b9-b914-315e86a973f6","Type":"ContainerStarted","Data":"09aea2b198b10966e4acb4bd6dea1663c1fefbbb664b35ef784e47da71762a1d"} Jul 24 11:24:55.208320 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:55.208247 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-cbtbl" event={"ID":"363e784c-5048-43b9-b914-315e86a973f6","Type":"ContainerStarted","Data":"2b630ca7d4a0c71f86be8e367c1cedd984430529efafdf435a6b6995246c8b06"} Jul 24 11:24:55.230290 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:55.230199 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-ctt42" podStartSLOduration=2.105991591 podStartE2EDuration="3.230183824s" totalImagesPullingTime="1.050495833s" totalInitContainerRuntime="73.6964ms" isStatefulPod=true podCreationTimestamp="2026-07-24 11:24:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 11:24:55.229049077 +0000 UTC m=+86.247103645" watchObservedRunningTime="2026-07-24 11:24:55.230183824 +0000 UTC m=+86.248238367" Jul 24 11:24:56.214454 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:56.214415 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-rgmjd" event={"ID":"fd5b052c-2d49-4970-8d88-ce251beb86f6","Type":"ContainerStarted","Data":"b90caeeca099cf95764130dd2b657493a2340f000b1ae7fdc7c8d6abb44661a6"} Jul 24 11:24:56.215948 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:56.215920 2586 generic.go:356] "Generic (PLEG): container finished" podID="249e6e6e-a7d0-43a7-99ea-c3f61ed26b50" containerID="4bb46fcfe4b1a2e13879d471bbfee1d1c8904b2e6d930f851e23c3e5c602d1d9" exitCode=0 Jul 24 11:24:56.216068 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:56.216003 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"249e6e6e-a7d0-43a7-99ea-c3f61ed26b50","Type":"ContainerDied","Data":"4bb46fcfe4b1a2e13879d471bbfee1d1c8904b2e6d930f851e23c3e5c602d1d9"} Jul 24 11:24:56.233685 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:56.233632 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-rgmjd" podStartSLOduration=2.727647981 podStartE2EDuration="4.233611623s" totalImagesPullingTime="1.505963642s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 11:24:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 11:24:56.232516859 +0000 UTC m=+87.250571415" watchObservedRunningTime="2026-07-24 11:24:56.233611623 +0000 UTC m=+87.251666170" Jul 24 11:24:56.233825 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:56.233738 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-cbtbl" podStartSLOduration=2.757825749 podStartE2EDuration="4.233732552s" totalImagesPullingTime="1.475906803s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 11:24:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 11:24:55.256536485 +0000 UTC m=+86.274591028" watchObservedRunningTime="2026-07-24 11:24:56.233732552 +0000 UTC m=+87.251787096" Jul 24 11:24:56.788300 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:56.788272 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5f58d9bdd-7gkpt"] Jul 24 11:24:56.792813 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:56.792794 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5f58d9bdd-7gkpt" Jul 24 11:24:56.795958 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:56.795938 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 24 11:24:56.796059 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:56.795972 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 24 11:24:56.796059 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:56.796005 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 24 11:24:56.796059 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:56.796023 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-gdh52\"" Jul 24 11:24:56.796192 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:56.795944 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 24 11:24:56.796244 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:56.796223 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-ctsgulne30pj\"" Jul 24 11:24:56.803414 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:56.803391 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5f58d9bdd-7gkpt"] Jul 24 11:24:56.934604 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:56.934558 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sw7gt\" (UniqueName: \"kubernetes.io/projected/e5c84ffe-91a4-4aa6-b46e-88296bdc3fa7-kube-api-access-sw7gt\") pod \"metrics-server-5f58d9bdd-7gkpt\" (UID: \"e5c84ffe-91a4-4aa6-b46e-88296bdc3fa7\") " pod="openshift-monitoring/metrics-server-5f58d9bdd-7gkpt" Jul 24 11:24:56.934710 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:56.934629 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5c84ffe-91a4-4aa6-b46e-88296bdc3fa7-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5f58d9bdd-7gkpt\" (UID: \"e5c84ffe-91a4-4aa6-b46e-88296bdc3fa7\") " pod="openshift-monitoring/metrics-server-5f58d9bdd-7gkpt" Jul 24 11:24:56.934710 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:56.934673 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/e5c84ffe-91a4-4aa6-b46e-88296bdc3fa7-secret-metrics-server-client-certs\") pod \"metrics-server-5f58d9bdd-7gkpt\" (UID: \"e5c84ffe-91a4-4aa6-b46e-88296bdc3fa7\") " pod="openshift-monitoring/metrics-server-5f58d9bdd-7gkpt" Jul 24 11:24:56.934710 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:56.934697 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e5c84ffe-91a4-4aa6-b46e-88296bdc3fa7-metrics-server-audit-profiles\") pod \"metrics-server-5f58d9bdd-7gkpt\" (UID: \"e5c84ffe-91a4-4aa6-b46e-88296bdc3fa7\") " pod="openshift-monitoring/metrics-server-5f58d9bdd-7gkpt" Jul 24 11:24:56.934865 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:56.934727 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e5c84ffe-91a4-4aa6-b46e-88296bdc3fa7-secret-metrics-server-tls\") pod \"metrics-server-5f58d9bdd-7gkpt\" (UID: \"e5c84ffe-91a4-4aa6-b46e-88296bdc3fa7\") " pod="openshift-monitoring/metrics-server-5f58d9bdd-7gkpt" Jul 24 11:24:56.934865 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:56.934826 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e5c84ffe-91a4-4aa6-b46e-88296bdc3fa7-client-ca-bundle\") pod \"metrics-server-5f58d9bdd-7gkpt\" (UID: \"e5c84ffe-91a4-4aa6-b46e-88296bdc3fa7\") " pod="openshift-monitoring/metrics-server-5f58d9bdd-7gkpt" Jul 24 11:24:56.935007 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:56.934866 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e5c84ffe-91a4-4aa6-b46e-88296bdc3fa7-audit-log\") pod \"metrics-server-5f58d9bdd-7gkpt\" (UID: \"e5c84ffe-91a4-4aa6-b46e-88296bdc3fa7\") " pod="openshift-monitoring/metrics-server-5f58d9bdd-7gkpt" Jul 24 11:24:57.035909 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:57.035827 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sw7gt\" (UniqueName: \"kubernetes.io/projected/e5c84ffe-91a4-4aa6-b46e-88296bdc3fa7-kube-api-access-sw7gt\") pod \"metrics-server-5f58d9bdd-7gkpt\" (UID: \"e5c84ffe-91a4-4aa6-b46e-88296bdc3fa7\") " pod="openshift-monitoring/metrics-server-5f58d9bdd-7gkpt" Jul 24 11:24:57.035909 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:57.035872 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5c84ffe-91a4-4aa6-b46e-88296bdc3fa7-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5f58d9bdd-7gkpt\" (UID: \"e5c84ffe-91a4-4aa6-b46e-88296bdc3fa7\") " pod="openshift-monitoring/metrics-server-5f58d9bdd-7gkpt" Jul 24 11:24:57.035909 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:57.035908 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/e5c84ffe-91a4-4aa6-b46e-88296bdc3fa7-secret-metrics-server-client-certs\") pod \"metrics-server-5f58d9bdd-7gkpt\" (UID: \"e5c84ffe-91a4-4aa6-b46e-88296bdc3fa7\") " pod="openshift-monitoring/metrics-server-5f58d9bdd-7gkpt" Jul 24 11:24:57.036178 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:57.035937 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e5c84ffe-91a4-4aa6-b46e-88296bdc3fa7-metrics-server-audit-profiles\") pod \"metrics-server-5f58d9bdd-7gkpt\" (UID: \"e5c84ffe-91a4-4aa6-b46e-88296bdc3fa7\") " pod="openshift-monitoring/metrics-server-5f58d9bdd-7gkpt" Jul 24 11:24:57.036178 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:57.035977 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e5c84ffe-91a4-4aa6-b46e-88296bdc3fa7-secret-metrics-server-tls\") pod \"metrics-server-5f58d9bdd-7gkpt\" (UID: \"e5c84ffe-91a4-4aa6-b46e-88296bdc3fa7\") " pod="openshift-monitoring/metrics-server-5f58d9bdd-7gkpt" Jul 24 11:24:57.036178 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:57.036021 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e5c84ffe-91a4-4aa6-b46e-88296bdc3fa7-client-ca-bundle\") pod \"metrics-server-5f58d9bdd-7gkpt\" (UID: \"e5c84ffe-91a4-4aa6-b46e-88296bdc3fa7\") " pod="openshift-monitoring/metrics-server-5f58d9bdd-7gkpt" Jul 24 11:24:57.036178 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:57.036052 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e5c84ffe-91a4-4aa6-b46e-88296bdc3fa7-audit-log\") pod \"metrics-server-5f58d9bdd-7gkpt\" (UID: \"e5c84ffe-91a4-4aa6-b46e-88296bdc3fa7\") " pod="openshift-monitoring/metrics-server-5f58d9bdd-7gkpt" Jul 24 11:24:57.036496 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:57.036468 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e5c84ffe-91a4-4aa6-b46e-88296bdc3fa7-audit-log\") pod \"metrics-server-5f58d9bdd-7gkpt\" (UID: \"e5c84ffe-91a4-4aa6-b46e-88296bdc3fa7\") " pod="openshift-monitoring/metrics-server-5f58d9bdd-7gkpt" Jul 24 11:24:57.036836 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:57.036804 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5c84ffe-91a4-4aa6-b46e-88296bdc3fa7-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5f58d9bdd-7gkpt\" (UID: \"e5c84ffe-91a4-4aa6-b46e-88296bdc3fa7\") " pod="openshift-monitoring/metrics-server-5f58d9bdd-7gkpt" Jul 24 11:24:57.037132 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:57.037111 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e5c84ffe-91a4-4aa6-b46e-88296bdc3fa7-metrics-server-audit-profiles\") pod \"metrics-server-5f58d9bdd-7gkpt\" (UID: \"e5c84ffe-91a4-4aa6-b46e-88296bdc3fa7\") " pod="openshift-monitoring/metrics-server-5f58d9bdd-7gkpt" Jul 24 11:24:57.038957 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:57.038934 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/e5c84ffe-91a4-4aa6-b46e-88296bdc3fa7-secret-metrics-server-client-certs\") pod \"metrics-server-5f58d9bdd-7gkpt\" (UID: \"e5c84ffe-91a4-4aa6-b46e-88296bdc3fa7\") " pod="openshift-monitoring/metrics-server-5f58d9bdd-7gkpt" Jul 24 11:24:57.039075 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:57.039012 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e5c84ffe-91a4-4aa6-b46e-88296bdc3fa7-secret-metrics-server-tls\") pod \"metrics-server-5f58d9bdd-7gkpt\" (UID: \"e5c84ffe-91a4-4aa6-b46e-88296bdc3fa7\") " pod="openshift-monitoring/metrics-server-5f58d9bdd-7gkpt" Jul 24 11:24:57.039146 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:57.039126 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e5c84ffe-91a4-4aa6-b46e-88296bdc3fa7-client-ca-bundle\") pod \"metrics-server-5f58d9bdd-7gkpt\" (UID: \"e5c84ffe-91a4-4aa6-b46e-88296bdc3fa7\") " pod="openshift-monitoring/metrics-server-5f58d9bdd-7gkpt" Jul 24 11:24:57.044469 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:57.044449 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sw7gt\" (UniqueName: \"kubernetes.io/projected/e5c84ffe-91a4-4aa6-b46e-88296bdc3fa7-kube-api-access-sw7gt\") pod \"metrics-server-5f58d9bdd-7gkpt\" (UID: \"e5c84ffe-91a4-4aa6-b46e-88296bdc3fa7\") " pod="openshift-monitoring/metrics-server-5f58d9bdd-7gkpt" Jul 24 11:24:57.104816 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:57.104781 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5f58d9bdd-7gkpt" Jul 24 11:24:57.113475 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:57.113447 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-c8d86d84f-rr6sn"] Jul 24 11:24:57.118041 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:57.118021 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c8d86d84f-rr6sn" Jul 24 11:24:57.131891 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:57.131824 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c8d86d84f-rr6sn"] Jul 24 11:24:57.225816 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:57.225711 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-576cbf95bb-qwsgk" event={"ID":"13076bfe-fda6-4c26-bb9d-dc48b24e3ed3","Type":"ContainerStarted","Data":"ddadaf89e78cfb44e7ca35d4875c71a58c5e012923621aa8d9adc0ca959199fb"} Jul 24 11:24:57.225816 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:57.225797 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-576cbf95bb-qwsgk" event={"ID":"13076bfe-fda6-4c26-bb9d-dc48b24e3ed3","Type":"ContainerStarted","Data":"a7d46f91b20331433dbaa84ca8e4a68a143c24d6386765b8b157b76007b02cd5"} Jul 24 11:24:57.226261 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:57.225839 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-576cbf95bb-qwsgk" event={"ID":"13076bfe-fda6-4c26-bb9d-dc48b24e3ed3","Type":"ContainerStarted","Data":"52b0916b0ea1d535ba8a2fea2bc27187c5a35a401dd786f978e70af0237d833c"} Jul 24 11:24:57.237562 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:57.237521 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5mvz\" (UniqueName: \"kubernetes.io/projected/c0fdbbf9-0615-4902-8830-1a1b60837c75-kube-api-access-b5mvz\") pod \"console-c8d86d84f-rr6sn\" (UID: \"c0fdbbf9-0615-4902-8830-1a1b60837c75\") " pod="openshift-console/console-c8d86d84f-rr6sn" Jul 24 11:24:57.237720 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:57.237565 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0fdbbf9-0615-4902-8830-1a1b60837c75-trusted-ca-bundle\") pod \"console-c8d86d84f-rr6sn\" (UID: \"c0fdbbf9-0615-4902-8830-1a1b60837c75\") " pod="openshift-console/console-c8d86d84f-rr6sn" Jul 24 11:24:57.237720 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:57.237683 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c0fdbbf9-0615-4902-8830-1a1b60837c75-console-serving-cert\") pod \"console-c8d86d84f-rr6sn\" (UID: \"c0fdbbf9-0615-4902-8830-1a1b60837c75\") " pod="openshift-console/console-c8d86d84f-rr6sn" Jul 24 11:24:57.237814 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:57.237782 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c0fdbbf9-0615-4902-8830-1a1b60837c75-console-oauth-config\") pod \"console-c8d86d84f-rr6sn\" (UID: \"c0fdbbf9-0615-4902-8830-1a1b60837c75\") " pod="openshift-console/console-c8d86d84f-rr6sn" Jul 24 11:24:57.237862 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:57.237816 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c0fdbbf9-0615-4902-8830-1a1b60837c75-oauth-serving-cert\") pod \"console-c8d86d84f-rr6sn\" (UID: \"c0fdbbf9-0615-4902-8830-1a1b60837c75\") " pod="openshift-console/console-c8d86d84f-rr6sn" Jul 24 11:24:57.237915 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:57.237894 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c0fdbbf9-0615-4902-8830-1a1b60837c75-service-ca\") pod \"console-c8d86d84f-rr6sn\" (UID: \"c0fdbbf9-0615-4902-8830-1a1b60837c75\") " pod="openshift-console/console-c8d86d84f-rr6sn" Jul 24 11:24:57.237978 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:57.237959 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c0fdbbf9-0615-4902-8830-1a1b60837c75-console-config\") pod \"console-c8d86d84f-rr6sn\" (UID: \"c0fdbbf9-0615-4902-8830-1a1b60837c75\") " pod="openshift-console/console-c8d86d84f-rr6sn" Jul 24 11:24:57.258666 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:57.258642 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5f58d9bdd-7gkpt"] Jul 24 11:24:57.260966 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:24:57.260937 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5c84ffe_91a4_4aa6_b46e_88296bdc3fa7.slice/crio-7b1ebe5e5c03239466d9818f7959b1e748f095b13f37411916c6cd04d5065878 WatchSource:0}: Error finding container 7b1ebe5e5c03239466d9818f7959b1e748f095b13f37411916c6cd04d5065878: Status 404 returned error can't find the container with id 7b1ebe5e5c03239466d9818f7959b1e748f095b13f37411916c6cd04d5065878 Jul 24 11:24:57.339354 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:57.339261 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5mvz\" (UniqueName: \"kubernetes.io/projected/c0fdbbf9-0615-4902-8830-1a1b60837c75-kube-api-access-b5mvz\") pod \"console-c8d86d84f-rr6sn\" (UID: \"c0fdbbf9-0615-4902-8830-1a1b60837c75\") " pod="openshift-console/console-c8d86d84f-rr6sn" Jul 24 11:24:57.339354 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:57.339312 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0fdbbf9-0615-4902-8830-1a1b60837c75-trusted-ca-bundle\") pod \"console-c8d86d84f-rr6sn\" (UID: \"c0fdbbf9-0615-4902-8830-1a1b60837c75\") " pod="openshift-console/console-c8d86d84f-rr6sn" Jul 24 11:24:57.339551 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:57.339373 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c0fdbbf9-0615-4902-8830-1a1b60837c75-console-serving-cert\") pod \"console-c8d86d84f-rr6sn\" (UID: \"c0fdbbf9-0615-4902-8830-1a1b60837c75\") " pod="openshift-console/console-c8d86d84f-rr6sn" Jul 24 11:24:57.339551 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:57.339434 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c0fdbbf9-0615-4902-8830-1a1b60837c75-console-oauth-config\") pod \"console-c8d86d84f-rr6sn\" (UID: \"c0fdbbf9-0615-4902-8830-1a1b60837c75\") " pod="openshift-console/console-c8d86d84f-rr6sn" Jul 24 11:24:57.339551 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:57.339463 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c0fdbbf9-0615-4902-8830-1a1b60837c75-oauth-serving-cert\") pod \"console-c8d86d84f-rr6sn\" (UID: \"c0fdbbf9-0615-4902-8830-1a1b60837c75\") " pod="openshift-console/console-c8d86d84f-rr6sn" Jul 24 11:24:57.339551 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:57.339531 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c0fdbbf9-0615-4902-8830-1a1b60837c75-service-ca\") pod \"console-c8d86d84f-rr6sn\" (UID: \"c0fdbbf9-0615-4902-8830-1a1b60837c75\") " pod="openshift-console/console-c8d86d84f-rr6sn" Jul 24 11:24:57.339776 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:57.339562 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c0fdbbf9-0615-4902-8830-1a1b60837c75-console-config\") pod \"console-c8d86d84f-rr6sn\" (UID: \"c0fdbbf9-0615-4902-8830-1a1b60837c75\") " pod="openshift-console/console-c8d86d84f-rr6sn" Jul 24 11:24:57.340344 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:57.340301 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c0fdbbf9-0615-4902-8830-1a1b60837c75-console-config\") pod \"console-c8d86d84f-rr6sn\" (UID: \"c0fdbbf9-0615-4902-8830-1a1b60837c75\") " pod="openshift-console/console-c8d86d84f-rr6sn" Jul 24 11:24:57.340344 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:57.340333 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0fdbbf9-0615-4902-8830-1a1b60837c75-trusted-ca-bundle\") pod \"console-c8d86d84f-rr6sn\" (UID: \"c0fdbbf9-0615-4902-8830-1a1b60837c75\") " pod="openshift-console/console-c8d86d84f-rr6sn" Jul 24 11:24:57.340344 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:57.340341 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c0fdbbf9-0615-4902-8830-1a1b60837c75-oauth-serving-cert\") pod \"console-c8d86d84f-rr6sn\" (UID: \"c0fdbbf9-0615-4902-8830-1a1b60837c75\") " pod="openshift-console/console-c8d86d84f-rr6sn" Jul 24 11:24:57.340563 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:57.340360 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c0fdbbf9-0615-4902-8830-1a1b60837c75-service-ca\") pod \"console-c8d86d84f-rr6sn\" (UID: \"c0fdbbf9-0615-4902-8830-1a1b60837c75\") " pod="openshift-console/console-c8d86d84f-rr6sn" Jul 24 11:24:57.342311 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:57.342293 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c0fdbbf9-0615-4902-8830-1a1b60837c75-console-serving-cert\") pod \"console-c8d86d84f-rr6sn\" (UID: \"c0fdbbf9-0615-4902-8830-1a1b60837c75\") " pod="openshift-console/console-c8d86d84f-rr6sn" Jul 24 11:24:57.342441 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:57.342423 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c0fdbbf9-0615-4902-8830-1a1b60837c75-console-oauth-config\") pod \"console-c8d86d84f-rr6sn\" (UID: \"c0fdbbf9-0615-4902-8830-1a1b60837c75\") " pod="openshift-console/console-c8d86d84f-rr6sn" Jul 24 11:24:57.352470 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:57.352446 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5mvz\" (UniqueName: \"kubernetes.io/projected/c0fdbbf9-0615-4902-8830-1a1b60837c75-kube-api-access-b5mvz\") pod \"console-c8d86d84f-rr6sn\" (UID: \"c0fdbbf9-0615-4902-8830-1a1b60837c75\") " pod="openshift-console/console-c8d86d84f-rr6sn" Jul 24 11:24:57.431843 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:57.431557 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c8d86d84f-rr6sn" Jul 24 11:24:57.636087 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:57.636000 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-886dfc5d6-xx882"] Jul 24 11:24:57.639744 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:57.639716 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-886dfc5d6-xx882" Jul 24 11:24:57.644843 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:57.642424 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-6mfs8\"" Jul 24 11:24:57.644843 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:57.642655 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 24 11:24:57.644843 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:57.642818 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 24 11:24:57.644843 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:57.642972 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 24 11:24:57.644843 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:57.643146 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 24 11:24:57.644843 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:57.643317 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 24 11:24:57.648778 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:57.648751 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 24 11:24:57.654445 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:57.654416 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-886dfc5d6-xx882"] Jul 24 11:24:57.748636 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:57.748592 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb9f5b60-94f4-4877-9045-601d9ff76ed2-serving-certs-ca-bundle\") pod \"telemeter-client-886dfc5d6-xx882\" (UID: \"cb9f5b60-94f4-4877-9045-601d9ff76ed2\") " pod="openshift-monitoring/telemeter-client-886dfc5d6-xx882" Jul 24 11:24:57.748636 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:57.748639 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/cb9f5b60-94f4-4877-9045-601d9ff76ed2-federate-client-tls\") pod \"telemeter-client-886dfc5d6-xx882\" (UID: \"cb9f5b60-94f4-4877-9045-601d9ff76ed2\") " pod="openshift-monitoring/telemeter-client-886dfc5d6-xx882" Jul 24 11:24:57.748857 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:57.748682 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cb9f5b60-94f4-4877-9045-601d9ff76ed2-metrics-client-ca\") pod \"telemeter-client-886dfc5d6-xx882\" (UID: \"cb9f5b60-94f4-4877-9045-601d9ff76ed2\") " pod="openshift-monitoring/telemeter-client-886dfc5d6-xx882" Jul 24 11:24:57.748857 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:57.748756 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/cb9f5b60-94f4-4877-9045-601d9ff76ed2-secret-telemeter-client\") pod \"telemeter-client-886dfc5d6-xx882\" (UID: \"cb9f5b60-94f4-4877-9045-601d9ff76ed2\") " pod="openshift-monitoring/telemeter-client-886dfc5d6-xx882" Jul 24 11:24:57.748857 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:57.748790 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4r467\" (UniqueName: \"kubernetes.io/projected/cb9f5b60-94f4-4877-9045-601d9ff76ed2-kube-api-access-4r467\") pod \"telemeter-client-886dfc5d6-xx882\" (UID: \"cb9f5b60-94f4-4877-9045-601d9ff76ed2\") " pod="openshift-monitoring/telemeter-client-886dfc5d6-xx882" Jul 24 11:24:57.748857 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:57.748817 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/cb9f5b60-94f4-4877-9045-601d9ff76ed2-telemeter-client-tls\") pod \"telemeter-client-886dfc5d6-xx882\" (UID: \"cb9f5b60-94f4-4877-9045-601d9ff76ed2\") " pod="openshift-monitoring/telemeter-client-886dfc5d6-xx882" Jul 24 11:24:57.749059 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:57.748878 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cb9f5b60-94f4-4877-9045-601d9ff76ed2-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-886dfc5d6-xx882\" (UID: \"cb9f5b60-94f4-4877-9045-601d9ff76ed2\") " pod="openshift-monitoring/telemeter-client-886dfc5d6-xx882" Jul 24 11:24:57.749059 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:57.748916 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb9f5b60-94f4-4877-9045-601d9ff76ed2-telemeter-trusted-ca-bundle\") pod \"telemeter-client-886dfc5d6-xx882\" (UID: \"cb9f5b60-94f4-4877-9045-601d9ff76ed2\") " pod="openshift-monitoring/telemeter-client-886dfc5d6-xx882" Jul 24 11:24:57.849944 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:57.849908 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/cb9f5b60-94f4-4877-9045-601d9ff76ed2-secret-telemeter-client\") pod \"telemeter-client-886dfc5d6-xx882\" (UID: \"cb9f5b60-94f4-4877-9045-601d9ff76ed2\") " pod="openshift-monitoring/telemeter-client-886dfc5d6-xx882" Jul 24 11:24:57.850100 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:57.849957 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4r467\" (UniqueName: \"kubernetes.io/projected/cb9f5b60-94f4-4877-9045-601d9ff76ed2-kube-api-access-4r467\") pod \"telemeter-client-886dfc5d6-xx882\" (UID: \"cb9f5b60-94f4-4877-9045-601d9ff76ed2\") " pod="openshift-monitoring/telemeter-client-886dfc5d6-xx882" Jul 24 11:24:57.850100 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:57.849981 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/cb9f5b60-94f4-4877-9045-601d9ff76ed2-telemeter-client-tls\") pod \"telemeter-client-886dfc5d6-xx882\" (UID: \"cb9f5b60-94f4-4877-9045-601d9ff76ed2\") " pod="openshift-monitoring/telemeter-client-886dfc5d6-xx882" Jul 24 11:24:57.850100 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:57.850019 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cb9f5b60-94f4-4877-9045-601d9ff76ed2-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-886dfc5d6-xx882\" (UID: \"cb9f5b60-94f4-4877-9045-601d9ff76ed2\") " pod="openshift-monitoring/telemeter-client-886dfc5d6-xx882" Jul 24 11:24:57.850100 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:57.850040 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb9f5b60-94f4-4877-9045-601d9ff76ed2-telemeter-trusted-ca-bundle\") pod \"telemeter-client-886dfc5d6-xx882\" (UID: \"cb9f5b60-94f4-4877-9045-601d9ff76ed2\") " pod="openshift-monitoring/telemeter-client-886dfc5d6-xx882" Jul 24 11:24:57.850300 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:57.850128 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb9f5b60-94f4-4877-9045-601d9ff76ed2-serving-certs-ca-bundle\") pod \"telemeter-client-886dfc5d6-xx882\" (UID: \"cb9f5b60-94f4-4877-9045-601d9ff76ed2\") " pod="openshift-monitoring/telemeter-client-886dfc5d6-xx882" Jul 24 11:24:57.850300 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:57.850151 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/cb9f5b60-94f4-4877-9045-601d9ff76ed2-federate-client-tls\") pod \"telemeter-client-886dfc5d6-xx882\" (UID: \"cb9f5b60-94f4-4877-9045-601d9ff76ed2\") " pod="openshift-monitoring/telemeter-client-886dfc5d6-xx882" Jul 24 11:24:57.850300 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:57.850179 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cb9f5b60-94f4-4877-9045-601d9ff76ed2-metrics-client-ca\") pod \"telemeter-client-886dfc5d6-xx882\" (UID: \"cb9f5b60-94f4-4877-9045-601d9ff76ed2\") " pod="openshift-monitoring/telemeter-client-886dfc5d6-xx882" Jul 24 11:24:57.850994 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:57.850940 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb9f5b60-94f4-4877-9045-601d9ff76ed2-serving-certs-ca-bundle\") pod \"telemeter-client-886dfc5d6-xx882\" (UID: \"cb9f5b60-94f4-4877-9045-601d9ff76ed2\") " pod="openshift-monitoring/telemeter-client-886dfc5d6-xx882" Jul 24 11:24:57.851125 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:57.851008 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cb9f5b60-94f4-4877-9045-601d9ff76ed2-metrics-client-ca\") pod \"telemeter-client-886dfc5d6-xx882\" (UID: \"cb9f5b60-94f4-4877-9045-601d9ff76ed2\") " pod="openshift-monitoring/telemeter-client-886dfc5d6-xx882" Jul 24 11:24:57.851234 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:57.851204 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb9f5b60-94f4-4877-9045-601d9ff76ed2-telemeter-trusted-ca-bundle\") pod \"telemeter-client-886dfc5d6-xx882\" (UID: \"cb9f5b60-94f4-4877-9045-601d9ff76ed2\") " pod="openshift-monitoring/telemeter-client-886dfc5d6-xx882" Jul 24 11:24:57.853095 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:57.853069 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/cb9f5b60-94f4-4877-9045-601d9ff76ed2-federate-client-tls\") pod \"telemeter-client-886dfc5d6-xx882\" (UID: \"cb9f5b60-94f4-4877-9045-601d9ff76ed2\") " pod="openshift-monitoring/telemeter-client-886dfc5d6-xx882" Jul 24 11:24:57.853211 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:57.853106 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/cb9f5b60-94f4-4877-9045-601d9ff76ed2-telemeter-client-tls\") pod \"telemeter-client-886dfc5d6-xx882\" (UID: \"cb9f5b60-94f4-4877-9045-601d9ff76ed2\") " pod="openshift-monitoring/telemeter-client-886dfc5d6-xx882" Jul 24 11:24:57.853565 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:57.853544 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cb9f5b60-94f4-4877-9045-601d9ff76ed2-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-886dfc5d6-xx882\" (UID: \"cb9f5b60-94f4-4877-9045-601d9ff76ed2\") " pod="openshift-monitoring/telemeter-client-886dfc5d6-xx882" Jul 24 11:24:57.853565 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:57.853559 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/cb9f5b60-94f4-4877-9045-601d9ff76ed2-secret-telemeter-client\") pod \"telemeter-client-886dfc5d6-xx882\" (UID: \"cb9f5b60-94f4-4877-9045-601d9ff76ed2\") " pod="openshift-monitoring/telemeter-client-886dfc5d6-xx882" Jul 24 11:24:57.858412 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:57.858392 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4r467\" (UniqueName: \"kubernetes.io/projected/cb9f5b60-94f4-4877-9045-601d9ff76ed2-kube-api-access-4r467\") pod \"telemeter-client-886dfc5d6-xx882\" (UID: \"cb9f5b60-94f4-4877-9045-601d9ff76ed2\") " pod="openshift-monitoring/telemeter-client-886dfc5d6-xx882" Jul 24 11:24:57.957533 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:57.957495 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-886dfc5d6-xx882" Jul 24 11:24:58.052731 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:58.052707 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c8d86d84f-rr6sn"] Jul 24 11:24:58.061726 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:24:58.061700 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0fdbbf9_0615_4902_8830_1a1b60837c75.slice/crio-b62ce8cb9bc391506b78f57264421d06e9d428b436152b4f09678c50793a653d WatchSource:0}: Error finding container b62ce8cb9bc391506b78f57264421d06e9d428b436152b4f09678c50793a653d: Status 404 returned error can't find the container with id b62ce8cb9bc391506b78f57264421d06e9d428b436152b4f09678c50793a653d Jul 24 11:24:58.145396 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:58.145311 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-886dfc5d6-xx882"] Jul 24 11:24:58.150118 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:24:58.150088 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb9f5b60_94f4_4877_9045_601d9ff76ed2.slice/crio-0e824530456882d3572022889fdb1f9e02a0d92a3defe6216767f4eb868602bb WatchSource:0}: Error finding container 0e824530456882d3572022889fdb1f9e02a0d92a3defe6216767f4eb868602bb: Status 404 returned error can't find the container with id 0e824530456882d3572022889fdb1f9e02a0d92a3defe6216767f4eb868602bb Jul 24 11:24:58.236794 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:58.236590 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-576cbf95bb-qwsgk" event={"ID":"13076bfe-fda6-4c26-bb9d-dc48b24e3ed3","Type":"ContainerStarted","Data":"f1066833223d7592e0688b7e3ca671de1ded3dc1260424a604959576cb961527"} Jul 24 11:24:58.236794 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:58.236701 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-576cbf95bb-qwsgk" event={"ID":"13076bfe-fda6-4c26-bb9d-dc48b24e3ed3","Type":"ContainerStarted","Data":"17767b4f8e1f185b74500ad97c503afa8903f70e6cc1f4032b5e7dd58e8a0f6b"} Jul 24 11:24:58.236794 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:58.236747 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-576cbf95bb-qwsgk" event={"ID":"13076bfe-fda6-4c26-bb9d-dc48b24e3ed3","Type":"ContainerStarted","Data":"a7c2f516f86f021672f9002a89eb345abe0bb5654ad27dbd7329f7ce069e64df"} Jul 24 11:24:58.237284 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:58.237179 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-576cbf95bb-qwsgk" Jul 24 11:24:58.238807 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:58.238783 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c8d86d84f-rr6sn" event={"ID":"c0fdbbf9-0615-4902-8830-1a1b60837c75","Type":"ContainerStarted","Data":"1094f94947ea75388ff9b034a6efe5f07ca454fd50096a661210e450cb42e7e9"} Jul 24 11:24:58.238899 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:58.238851 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c8d86d84f-rr6sn" event={"ID":"c0fdbbf9-0615-4902-8830-1a1b60837c75","Type":"ContainerStarted","Data":"b62ce8cb9bc391506b78f57264421d06e9d428b436152b4f09678c50793a653d"} Jul 24 11:24:58.240700 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:58.240676 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5f58d9bdd-7gkpt" event={"ID":"e5c84ffe-91a4-4aa6-b46e-88296bdc3fa7","Type":"ContainerStarted","Data":"7b1ebe5e5c03239466d9818f7959b1e748f095b13f37411916c6cd04d5065878"} Jul 24 11:24:58.242245 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:58.242223 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-886dfc5d6-xx882" event={"ID":"cb9f5b60-94f4-4877-9045-601d9ff76ed2","Type":"ContainerStarted","Data":"0e824530456882d3572022889fdb1f9e02a0d92a3defe6216767f4eb868602bb"} Jul 24 11:24:58.246059 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:58.246040 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"249e6e6e-a7d0-43a7-99ea-c3f61ed26b50","Type":"ContainerStarted","Data":"432527e639e889b1b960a5db2c76d70f3b24c19c1ee86800d1072b9ab5eac93f"} Jul 24 11:24:58.246374 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:58.246232 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"249e6e6e-a7d0-43a7-99ea-c3f61ed26b50","Type":"ContainerStarted","Data":"17934ac9212b5638755995578bdad64fe05f7c87bc349d59ab4324aaa362ded1"} Jul 24 11:24:58.246374 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:58.246281 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"249e6e6e-a7d0-43a7-99ea-c3f61ed26b50","Type":"ContainerStarted","Data":"419564cc1390a8aca80eab4ada2af03c3c380f4d7458afa7d67dcbf1105bd22c"} Jul 24 11:24:58.260224 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:58.260166 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-576cbf95bb-qwsgk" podStartSLOduration=1.546891081 podStartE2EDuration="4.260143727s" totalImagesPullingTime="2.713252646s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 11:24:54 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 11:24:58.25969448 +0000 UTC m=+89.277749023" watchObservedRunningTime="2026-07-24 11:24:58.260143727 +0000 UTC m=+89.278198273" Jul 24 11:24:58.283532 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:58.283433 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-c8d86d84f-rr6sn" podStartSLOduration=1.283415618 podStartE2EDuration="1.283415618s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 11:24:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 11:24:58.282841422 +0000 UTC m=+89.300895968" watchObservedRunningTime="2026-07-24 11:24:58.283415618 +0000 UTC m=+89.301470162" Jul 24 11:24:58.589439 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:58.589387 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 24 11:24:58.597812 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:58.597781 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:24:58.600800 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:58.600480 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 24 11:24:58.600800 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:58.600521 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-ap7vn0t29p6od\"" Jul 24 11:24:58.600800 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:58.600609 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 24 11:24:58.600800 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:58.600725 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 24 11:24:58.601089 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:58.600847 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 24 11:24:58.601089 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:58.600988 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-zgzsd\"" Jul 24 11:24:58.601089 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:58.600998 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 24 11:24:58.601241 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:58.601098 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 24 11:24:58.601372 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:58.601351 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 24 11:24:58.601542 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:58.601523 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 24 11:24:58.601542 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:58.601534 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 24 11:24:58.601935 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:58.601778 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 24 11:24:58.601935 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:58.601824 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 24 11:24:58.601935 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:58.601912 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 24 11:24:58.608305 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:58.608228 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 24 11:24:58.617430 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:58.617405 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 24 11:24:58.623746 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:58.623722 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 24 11:24:58.759009 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:58.758960 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cfd2e8a7-2990-40c3-9380-2dd24484e351-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cfd2e8a7-2990-40c3-9380-2dd24484e351\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:24:58.759165 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:58.759065 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/cfd2e8a7-2990-40c3-9380-2dd24484e351-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"cfd2e8a7-2990-40c3-9380-2dd24484e351\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:24:58.759165 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:58.759096 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2xjk\" (UniqueName: \"kubernetes.io/projected/cfd2e8a7-2990-40c3-9380-2dd24484e351-kube-api-access-l2xjk\") pod \"prometheus-k8s-0\" (UID: \"cfd2e8a7-2990-40c3-9380-2dd24484e351\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:24:58.759285 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:58.759215 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cfd2e8a7-2990-40c3-9380-2dd24484e351-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"cfd2e8a7-2990-40c3-9380-2dd24484e351\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:24:58.759344 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:58.759276 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/cfd2e8a7-2990-40c3-9380-2dd24484e351-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"cfd2e8a7-2990-40c3-9380-2dd24484e351\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:24:58.759344 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:58.759322 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cfd2e8a7-2990-40c3-9380-2dd24484e351-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"cfd2e8a7-2990-40c3-9380-2dd24484e351\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:24:58.759443 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:58.759349 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/cfd2e8a7-2990-40c3-9380-2dd24484e351-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"cfd2e8a7-2990-40c3-9380-2dd24484e351\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:24:58.759443 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:58.759380 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cfd2e8a7-2990-40c3-9380-2dd24484e351-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cfd2e8a7-2990-40c3-9380-2dd24484e351\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:24:58.759443 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:58.759409 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cfd2e8a7-2990-40c3-9380-2dd24484e351-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"cfd2e8a7-2990-40c3-9380-2dd24484e351\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:24:58.759443 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:58.759432 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/cfd2e8a7-2990-40c3-9380-2dd24484e351-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"cfd2e8a7-2990-40c3-9380-2dd24484e351\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:24:58.759649 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:58.759459 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/cfd2e8a7-2990-40c3-9380-2dd24484e351-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"cfd2e8a7-2990-40c3-9380-2dd24484e351\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:24:58.759649 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:58.759500 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/cfd2e8a7-2990-40c3-9380-2dd24484e351-config\") pod \"prometheus-k8s-0\" (UID: \"cfd2e8a7-2990-40c3-9380-2dd24484e351\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:24:58.759649 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:58.759568 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cfd2e8a7-2990-40c3-9380-2dd24484e351-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cfd2e8a7-2990-40c3-9380-2dd24484e351\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:24:58.759649 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:58.759613 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/cfd2e8a7-2990-40c3-9380-2dd24484e351-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"cfd2e8a7-2990-40c3-9380-2dd24484e351\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:24:58.759649 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:58.759642 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/cfd2e8a7-2990-40c3-9380-2dd24484e351-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"cfd2e8a7-2990-40c3-9380-2dd24484e351\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:24:58.759889 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:58.759669 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cfd2e8a7-2990-40c3-9380-2dd24484e351-config-out\") pod \"prometheus-k8s-0\" (UID: \"cfd2e8a7-2990-40c3-9380-2dd24484e351\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:24:58.759889 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:58.759689 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/cfd2e8a7-2990-40c3-9380-2dd24484e351-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"cfd2e8a7-2990-40c3-9380-2dd24484e351\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:24:58.759889 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:58.759719 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cfd2e8a7-2990-40c3-9380-2dd24484e351-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"cfd2e8a7-2990-40c3-9380-2dd24484e351\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:24:58.759889 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:58.759741 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cfd2e8a7-2990-40c3-9380-2dd24484e351-web-config\") pod \"prometheus-k8s-0\" (UID: \"cfd2e8a7-2990-40c3-9380-2dd24484e351\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:24:58.759889 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:58.759764 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cfd2e8a7-2990-40c3-9380-2dd24484e351-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"cfd2e8a7-2990-40c3-9380-2dd24484e351\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:24:58.861262 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:58.861174 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cfd2e8a7-2990-40c3-9380-2dd24484e351-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cfd2e8a7-2990-40c3-9380-2dd24484e351\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:24:58.861262 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:58.861221 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cfd2e8a7-2990-40c3-9380-2dd24484e351-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"cfd2e8a7-2990-40c3-9380-2dd24484e351\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:24:58.861262 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:58.861248 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/cfd2e8a7-2990-40c3-9380-2dd24484e351-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"cfd2e8a7-2990-40c3-9380-2dd24484e351\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:24:58.861745 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:58.861569 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/cfd2e8a7-2990-40c3-9380-2dd24484e351-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"cfd2e8a7-2990-40c3-9380-2dd24484e351\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:24:58.861745 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:58.861653 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/cfd2e8a7-2990-40c3-9380-2dd24484e351-config\") pod \"prometheus-k8s-0\" (UID: \"cfd2e8a7-2990-40c3-9380-2dd24484e351\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:24:58.861745 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:58.861730 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cfd2e8a7-2990-40c3-9380-2dd24484e351-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cfd2e8a7-2990-40c3-9380-2dd24484e351\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:24:58.861976 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:58.861757 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/cfd2e8a7-2990-40c3-9380-2dd24484e351-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"cfd2e8a7-2990-40c3-9380-2dd24484e351\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:24:58.861976 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:58.861785 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/cfd2e8a7-2990-40c3-9380-2dd24484e351-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"cfd2e8a7-2990-40c3-9380-2dd24484e351\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:24:58.861976 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:58.861813 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cfd2e8a7-2990-40c3-9380-2dd24484e351-config-out\") pod \"prometheus-k8s-0\" (UID: \"cfd2e8a7-2990-40c3-9380-2dd24484e351\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:24:58.861976 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:58.861836 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/cfd2e8a7-2990-40c3-9380-2dd24484e351-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"cfd2e8a7-2990-40c3-9380-2dd24484e351\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:24:58.861976 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:58.861883 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cfd2e8a7-2990-40c3-9380-2dd24484e351-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"cfd2e8a7-2990-40c3-9380-2dd24484e351\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:24:58.861976 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:58.861907 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cfd2e8a7-2990-40c3-9380-2dd24484e351-web-config\") pod \"prometheus-k8s-0\" (UID: \"cfd2e8a7-2990-40c3-9380-2dd24484e351\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:24:58.861976 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:58.861931 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cfd2e8a7-2990-40c3-9380-2dd24484e351-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"cfd2e8a7-2990-40c3-9380-2dd24484e351\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:24:58.861976 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:58.861962 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cfd2e8a7-2990-40c3-9380-2dd24484e351-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cfd2e8a7-2990-40c3-9380-2dd24484e351\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:24:58.862324 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:58.862000 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/cfd2e8a7-2990-40c3-9380-2dd24484e351-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"cfd2e8a7-2990-40c3-9380-2dd24484e351\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:24:58.862324 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:58.862023 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2xjk\" (UniqueName: \"kubernetes.io/projected/cfd2e8a7-2990-40c3-9380-2dd24484e351-kube-api-access-l2xjk\") pod \"prometheus-k8s-0\" (UID: \"cfd2e8a7-2990-40c3-9380-2dd24484e351\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:24:58.862324 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:58.862103 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cfd2e8a7-2990-40c3-9380-2dd24484e351-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"cfd2e8a7-2990-40c3-9380-2dd24484e351\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:24:58.862324 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:58.862127 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/cfd2e8a7-2990-40c3-9380-2dd24484e351-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"cfd2e8a7-2990-40c3-9380-2dd24484e351\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:24:58.862324 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:58.862156 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cfd2e8a7-2990-40c3-9380-2dd24484e351-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"cfd2e8a7-2990-40c3-9380-2dd24484e351\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:24:58.862324 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:58.862182 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/cfd2e8a7-2990-40c3-9380-2dd24484e351-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"cfd2e8a7-2990-40c3-9380-2dd24484e351\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:24:58.863964 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:58.863909 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cfd2e8a7-2990-40c3-9380-2dd24484e351-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cfd2e8a7-2990-40c3-9380-2dd24484e351\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:24:58.868986 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:58.867688 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cfd2e8a7-2990-40c3-9380-2dd24484e351-web-config\") pod \"prometheus-k8s-0\" (UID: \"cfd2e8a7-2990-40c3-9380-2dd24484e351\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:24:58.868986 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:58.868260 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cfd2e8a7-2990-40c3-9380-2dd24484e351-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cfd2e8a7-2990-40c3-9380-2dd24484e351\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:24:58.868986 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:58.868539 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cfd2e8a7-2990-40c3-9380-2dd24484e351-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cfd2e8a7-2990-40c3-9380-2dd24484e351\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:24:58.868986 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:58.868763 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cfd2e8a7-2990-40c3-9380-2dd24484e351-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"cfd2e8a7-2990-40c3-9380-2dd24484e351\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:24:58.868986 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:58.868878 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cfd2e8a7-2990-40c3-9380-2dd24484e351-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"cfd2e8a7-2990-40c3-9380-2dd24484e351\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:24:58.869292 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:58.869114 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/cfd2e8a7-2990-40c3-9380-2dd24484e351-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"cfd2e8a7-2990-40c3-9380-2dd24484e351\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:24:58.869405 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:58.869384 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/cfd2e8a7-2990-40c3-9380-2dd24484e351-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"cfd2e8a7-2990-40c3-9380-2dd24484e351\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:24:58.869546 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:58.869530 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/cfd2e8a7-2990-40c3-9380-2dd24484e351-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"cfd2e8a7-2990-40c3-9380-2dd24484e351\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:24:58.869879 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:58.869829 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/cfd2e8a7-2990-40c3-9380-2dd24484e351-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"cfd2e8a7-2990-40c3-9380-2dd24484e351\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:24:58.869970 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:58.869886 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/cfd2e8a7-2990-40c3-9380-2dd24484e351-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"cfd2e8a7-2990-40c3-9380-2dd24484e351\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:24:58.870201 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:58.870178 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cfd2e8a7-2990-40c3-9380-2dd24484e351-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"cfd2e8a7-2990-40c3-9380-2dd24484e351\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:24:58.870280 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:58.870204 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/cfd2e8a7-2990-40c3-9380-2dd24484e351-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"cfd2e8a7-2990-40c3-9380-2dd24484e351\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:24:58.871108 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:58.870902 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/cfd2e8a7-2990-40c3-9380-2dd24484e351-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"cfd2e8a7-2990-40c3-9380-2dd24484e351\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:24:58.871108 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:58.871063 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cfd2e8a7-2990-40c3-9380-2dd24484e351-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"cfd2e8a7-2990-40c3-9380-2dd24484e351\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:24:58.871243 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:58.871213 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cfd2e8a7-2990-40c3-9380-2dd24484e351-config-out\") pod \"prometheus-k8s-0\" (UID: \"cfd2e8a7-2990-40c3-9380-2dd24484e351\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:24:58.871832 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:58.871371 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/cfd2e8a7-2990-40c3-9380-2dd24484e351-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"cfd2e8a7-2990-40c3-9380-2dd24484e351\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:24:58.871832 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:58.871790 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/cfd2e8a7-2990-40c3-9380-2dd24484e351-config\") pod \"prometheus-k8s-0\" (UID: \"cfd2e8a7-2990-40c3-9380-2dd24484e351\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:24:58.874480 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:58.874458 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cfd2e8a7-2990-40c3-9380-2dd24484e351-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"cfd2e8a7-2990-40c3-9380-2dd24484e351\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:24:58.874667 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:58.874623 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2xjk\" (UniqueName: \"kubernetes.io/projected/cfd2e8a7-2990-40c3-9380-2dd24484e351-kube-api-access-l2xjk\") pod \"prometheus-k8s-0\" (UID: \"cfd2e8a7-2990-40c3-9380-2dd24484e351\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:24:58.920936 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:58.920897 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:24:59.120036 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:59.119926 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 24 11:24:59.124808 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:24:59.124776 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfd2e8a7_2990_40c3_9380_2dd24484e351.slice/crio-0f3a9930fc7390d395ad18a6d17d2727c4233c984b9b9df2ccf1c8874897fe03 WatchSource:0}: Error finding container 0f3a9930fc7390d395ad18a6d17d2727c4233c984b9b9df2ccf1c8874897fe03: Status 404 returned error can't find the container with id 0f3a9930fc7390d395ad18a6d17d2727c4233c984b9b9df2ccf1c8874897fe03 Jul 24 11:24:59.251510 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:59.251478 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5f58d9bdd-7gkpt" event={"ID":"e5c84ffe-91a4-4aa6-b46e-88296bdc3fa7","Type":"ContainerStarted","Data":"501632f7e0979ea268a54fa11cd281a8ce9f44d793064e49e538e784dd5f9c29"} Jul 24 11:24:59.254919 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:59.254849 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"249e6e6e-a7d0-43a7-99ea-c3f61ed26b50","Type":"ContainerStarted","Data":"78c39534537cdb60acc6cb1facc106df1a637018fdbfe8ec39cb928635f54eb1"} Jul 24 11:24:59.254919 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:59.254914 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"249e6e6e-a7d0-43a7-99ea-c3f61ed26b50","Type":"ContainerStarted","Data":"567a86d0a2313136ee160fe90d2d62ca3c17447976e68723c3ae354d2b7616df"} Jul 24 11:24:59.255099 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:59.254956 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"249e6e6e-a7d0-43a7-99ea-c3f61ed26b50","Type":"ContainerStarted","Data":"c2cc9c655d78a59b34c44c1a2250fe7e353d5db9d37b4dbd2ea039b7c37ef439"} Jul 24 11:24:59.256709 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:59.256682 2586 generic.go:356] "Generic (PLEG): container finished" podID="cfd2e8a7-2990-40c3-9380-2dd24484e351" containerID="b980fa9f903440e717f23633eae33df47d8c8d95c5efb1b15a3d4c84b5f1f536" exitCode=0 Jul 24 11:24:59.256817 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:59.256764 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cfd2e8a7-2990-40c3-9380-2dd24484e351","Type":"ContainerDied","Data":"b980fa9f903440e717f23633eae33df47d8c8d95c5efb1b15a3d4c84b5f1f536"} Jul 24 11:24:59.256857 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:59.256820 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cfd2e8a7-2990-40c3-9380-2dd24484e351","Type":"ContainerStarted","Data":"0f3a9930fc7390d395ad18a6d17d2727c4233c984b9b9df2ccf1c8874897fe03"} Jul 24 11:24:59.271522 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:59.271478 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5f58d9bdd-7gkpt" podStartSLOduration=1.521298717 podStartE2EDuration="3.271461892s" totalImagesPullingTime="1.750163175s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 11:24:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 11:24:59.27023336 +0000 UTC m=+90.288287905" watchObservedRunningTime="2026-07-24 11:24:59.271461892 +0000 UTC m=+90.289516435" Jul 24 11:24:59.295704 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:24:59.295662 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.181043057 podStartE2EDuration="6.295647961s" totalImagesPullingTime="3.098582729s" totalInitContainerRuntime="16.022175ms" isStatefulPod=false podCreationTimestamp="2026-07-24 11:24:53 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 11:24:59.29423893 +0000 UTC m=+90.312293498" watchObservedRunningTime="2026-07-24 11:24:59.295647961 +0000 UTC m=+90.313702504" Jul 24 11:25:01.269226 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:01.269187 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-886dfc5d6-xx882" event={"ID":"cb9f5b60-94f4-4877-9045-601d9ff76ed2","Type":"ContainerStarted","Data":"7584c12a73042af645f719aec8f1704a456147af14141d7308e7daddbbbd9caf"} Jul 24 11:25:01.269713 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:01.269256 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-886dfc5d6-xx882" event={"ID":"cb9f5b60-94f4-4877-9045-601d9ff76ed2","Type":"ContainerStarted","Data":"403e5d811dcd27078d01ae1059d57b829e57903a5e7655ad25fb14262f0ff7fe"} Jul 24 11:25:01.269713 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:01.269281 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-886dfc5d6-xx882" event={"ID":"cb9f5b60-94f4-4877-9045-601d9ff76ed2","Type":"ContainerStarted","Data":"01718de007baa5174e4099527727505fabb2611dfb6a2b056bda35f0b3e2ea12"} Jul 24 11:25:01.297412 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:01.297356 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-886dfc5d6-xx882" podStartSLOduration=2.136046873 podStartE2EDuration="4.297338281s" totalImagesPullingTime="2.161291408s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 11:24:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 11:25:01.296716279 +0000 UTC m=+92.314770826" watchObservedRunningTime="2026-07-24 11:25:01.297338281 +0000 UTC m=+92.315392827" Jul 24 11:25:02.117003 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:02.116869 2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c8d86d84f-rr6sn"] Jul 24 11:25:03.284973 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:03.284914 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cfd2e8a7-2990-40c3-9380-2dd24484e351","Type":"ContainerStarted","Data":"3a68ef515baad11890f86afd3820c6bd0f45affc60c3e9b1589b61896e62a6a6"} Jul 24 11:25:03.285379 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:03.285035 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cfd2e8a7-2990-40c3-9380-2dd24484e351","Type":"ContainerStarted","Data":"7dd9bfed91e438371f59d12d258331d553a787f1abe26595903834f47ed3f985"} Jul 24 11:25:03.285379 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:03.285085 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cfd2e8a7-2990-40c3-9380-2dd24484e351","Type":"ContainerStarted","Data":"876256856ea1cf89a565e0872c4ab9b657c7eb3c4fb10dd2e6e08a417554f7ee"} Jul 24 11:25:03.285379 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:03.285126 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cfd2e8a7-2990-40c3-9380-2dd24484e351","Type":"ContainerStarted","Data":"0cdd0217baf75e5aa2658f150cc91128534f386928e7e2ffcc1b727c72ee120d"} Jul 24 11:25:04.263451 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:04.263421 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-576cbf95bb-qwsgk" Jul 24 11:25:04.293276 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:04.293244 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cfd2e8a7-2990-40c3-9380-2dd24484e351","Type":"ContainerStarted","Data":"59106c718c84834bf701d3b49f9c7aaf9108f8b2741e1f68f1b48d7acf9fb5e9"} Jul 24 11:25:04.293641 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:04.293307 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cfd2e8a7-2990-40c3-9380-2dd24484e351","Type":"ContainerStarted","Data":"cffa7eea18101b7071533f73f7fca4d066b906bce0492c9235913d6cddadcbaf"} Jul 24 11:25:04.330134 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:04.330076 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.56999317 podStartE2EDuration="6.330054313s" totalImagesPullingTime="3.734870926s" totalInitContainerRuntime="25.190217ms" isStatefulPod=false podCreationTimestamp="2026-07-24 11:24:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 11:25:04.327516404 +0000 UTC m=+95.345570986" watchObservedRunningTime="2026-07-24 11:25:04.330054313 +0000 UTC m=+95.348108860" Jul 24 11:25:07.431950 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:07.431911 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-c8d86d84f-rr6sn" Jul 24 11:25:08.921054 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:08.921012 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:25:13.024399 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:13.024361 2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7c65b66cc6-bnrzc"] Jul 24 11:25:14.184749 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:14.184699 2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-cc54d487f-966mt" podUID="da7f7e41-9a8f-443d-a971-ad994fac52b1" containerName="console" containerID="cri-o://b01f8009b7370006b0226cedcc8b70090f63d28a4ff4d2a10cd6161bb516e9c2" gracePeriod=15 Jul 24 11:25:14.975960 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:14.975928 2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cc54d487f-966mt" Jul 24 11:25:15.117744 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:15.117670 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xxh54\" (UniqueName: \"kubernetes.io/projected/da7f7e41-9a8f-443d-a971-ad994fac52b1-kube-api-access-xxh54\") pod \"da7f7e41-9a8f-443d-a971-ad994fac52b1\" (UID: \"da7f7e41-9a8f-443d-a971-ad994fac52b1\") " Jul 24 11:25:15.117744 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:15.117717 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/da7f7e41-9a8f-443d-a971-ad994fac52b1-console-oauth-config\") pod \"da7f7e41-9a8f-443d-a971-ad994fac52b1\" (UID: \"da7f7e41-9a8f-443d-a971-ad994fac52b1\") " Jul 24 11:25:15.117985 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:15.117760 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/da7f7e41-9a8f-443d-a971-ad994fac52b1-console-config\") pod \"da7f7e41-9a8f-443d-a971-ad994fac52b1\" (UID: \"da7f7e41-9a8f-443d-a971-ad994fac52b1\") " Jul 24 11:25:15.117985 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:15.117810 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/da7f7e41-9a8f-443d-a971-ad994fac52b1-oauth-serving-cert\") pod \"da7f7e41-9a8f-443d-a971-ad994fac52b1\" (UID: \"da7f7e41-9a8f-443d-a971-ad994fac52b1\") " Jul 24 11:25:15.117985 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:15.117828 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/da7f7e41-9a8f-443d-a971-ad994fac52b1-service-ca\") pod \"da7f7e41-9a8f-443d-a971-ad994fac52b1\" (UID: \"da7f7e41-9a8f-443d-a971-ad994fac52b1\") " Jul 24 11:25:15.117985 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:15.117847 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/da7f7e41-9a8f-443d-a971-ad994fac52b1-console-serving-cert\") pod \"da7f7e41-9a8f-443d-a971-ad994fac52b1\" (UID: \"da7f7e41-9a8f-443d-a971-ad994fac52b1\") " Jul 24 11:25:15.118304 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:15.118270 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da7f7e41-9a8f-443d-a971-ad994fac52b1-console-config" (OuterVolumeSpecName: "console-config") pod "da7f7e41-9a8f-443d-a971-ad994fac52b1" (UID: "da7f7e41-9a8f-443d-a971-ad994fac52b1"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 11:25:15.118396 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:15.118325 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da7f7e41-9a8f-443d-a971-ad994fac52b1-service-ca" (OuterVolumeSpecName: "service-ca") pod "da7f7e41-9a8f-443d-a971-ad994fac52b1" (UID: "da7f7e41-9a8f-443d-a971-ad994fac52b1"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 11:25:15.118396 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:15.118320 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da7f7e41-9a8f-443d-a971-ad994fac52b1-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "da7f7e41-9a8f-443d-a971-ad994fac52b1" (UID: "da7f7e41-9a8f-443d-a971-ad994fac52b1"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 11:25:15.120147 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:15.120117 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da7f7e41-9a8f-443d-a971-ad994fac52b1-kube-api-access-xxh54" (OuterVolumeSpecName: "kube-api-access-xxh54") pod "da7f7e41-9a8f-443d-a971-ad994fac52b1" (UID: "da7f7e41-9a8f-443d-a971-ad994fac52b1"). InnerVolumeSpecName "kube-api-access-xxh54". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 11:25:15.120147 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:15.120124 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da7f7e41-9a8f-443d-a971-ad994fac52b1-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "da7f7e41-9a8f-443d-a971-ad994fac52b1" (UID: "da7f7e41-9a8f-443d-a971-ad994fac52b1"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 11:25:15.120327 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:15.120184 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da7f7e41-9a8f-443d-a971-ad994fac52b1-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "da7f7e41-9a8f-443d-a971-ad994fac52b1" (UID: "da7f7e41-9a8f-443d-a971-ad994fac52b1"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 11:25:15.219168 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:15.219132 2586 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/da7f7e41-9a8f-443d-a971-ad994fac52b1-console-config\") on node \"ip-10-0-137-219.ec2.internal\" DevicePath \"\"" Jul 24 11:25:15.219168 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:15.219161 2586 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/da7f7e41-9a8f-443d-a971-ad994fac52b1-oauth-serving-cert\") on node \"ip-10-0-137-219.ec2.internal\" DevicePath \"\"" Jul 24 11:25:15.219168 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:15.219170 2586 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/da7f7e41-9a8f-443d-a971-ad994fac52b1-service-ca\") on node \"ip-10-0-137-219.ec2.internal\" DevicePath \"\"" Jul 24 11:25:15.219168 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:15.219179 2586 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/da7f7e41-9a8f-443d-a971-ad994fac52b1-console-serving-cert\") on node \"ip-10-0-137-219.ec2.internal\" DevicePath \"\"" Jul 24 11:25:15.219653 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:15.219187 2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xxh54\" (UniqueName: \"kubernetes.io/projected/da7f7e41-9a8f-443d-a971-ad994fac52b1-kube-api-access-xxh54\") on node \"ip-10-0-137-219.ec2.internal\" DevicePath \"\"" Jul 24 11:25:15.219653 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:15.219196 2586 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/da7f7e41-9a8f-443d-a971-ad994fac52b1-console-oauth-config\") on node \"ip-10-0-137-219.ec2.internal\" DevicePath \"\"" Jul 24 11:25:15.342796 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:15.342750 2586 generic.go:356] "Generic (PLEG): container finished" podID="da7f7e41-9a8f-443d-a971-ad994fac52b1" containerID="b01f8009b7370006b0226cedcc8b70090f63d28a4ff4d2a10cd6161bb516e9c2" exitCode=0 Jul 24 11:25:15.342796 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:15.342799 2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cc54d487f-966mt" Jul 24 11:25:15.343018 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:15.342816 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cc54d487f-966mt" event={"ID":"da7f7e41-9a8f-443d-a971-ad994fac52b1","Type":"ContainerDied","Data":"b01f8009b7370006b0226cedcc8b70090f63d28a4ff4d2a10cd6161bb516e9c2"} Jul 24 11:25:15.343018 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:15.342867 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cc54d487f-966mt" event={"ID":"da7f7e41-9a8f-443d-a971-ad994fac52b1","Type":"ContainerDied","Data":"ad32def7235b124c113d04adb270b6ad767678f2524536e6b199dd5d311a56d8"} Jul 24 11:25:15.343018 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:15.342894 2586 scope.go:117] "RemoveContainer" containerID="b01f8009b7370006b0226cedcc8b70090f63d28a4ff4d2a10cd6161bb516e9c2" Jul 24 11:25:15.352065 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:15.352043 2586 scope.go:117] "RemoveContainer" containerID="b01f8009b7370006b0226cedcc8b70090f63d28a4ff4d2a10cd6161bb516e9c2" Jul 24 11:25:15.352302 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:25:15.352284 2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b01f8009b7370006b0226cedcc8b70090f63d28a4ff4d2a10cd6161bb516e9c2\": container with ID starting with b01f8009b7370006b0226cedcc8b70090f63d28a4ff4d2a10cd6161bb516e9c2 not found: ID does not exist" containerID="b01f8009b7370006b0226cedcc8b70090f63d28a4ff4d2a10cd6161bb516e9c2" Jul 24 11:25:15.352344 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:15.352308 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b01f8009b7370006b0226cedcc8b70090f63d28a4ff4d2a10cd6161bb516e9c2"} err="failed to get container status \"b01f8009b7370006b0226cedcc8b70090f63d28a4ff4d2a10cd6161bb516e9c2\": rpc error: code = NotFound desc = could not find container \"b01f8009b7370006b0226cedcc8b70090f63d28a4ff4d2a10cd6161bb516e9c2\": container with ID starting with b01f8009b7370006b0226cedcc8b70090f63d28a4ff4d2a10cd6161bb516e9c2 not found: ID does not exist" Jul 24 11:25:15.364213 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:15.364187 2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-cc54d487f-966mt"] Jul 24 11:25:15.368987 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:15.368934 2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-cc54d487f-966mt"] Jul 24 11:25:15.683737 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:15.683709 2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da7f7e41-9a8f-443d-a971-ad994fac52b1" path="/var/lib/kubelet/pods/da7f7e41-9a8f-443d-a971-ad994fac52b1/volumes" Jul 24 11:25:16.153071 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:16.152995 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-7hx7h" Jul 24 11:25:17.105816 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:17.105779 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5f58d9bdd-7gkpt" Jul 24 11:25:17.106216 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:17.105845 2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5f58d9bdd-7gkpt" Jul 24 11:25:27.141249 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:27.141180 2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-c8d86d84f-rr6sn" podUID="c0fdbbf9-0615-4902-8830-1a1b60837c75" containerName="console" containerID="cri-o://1094f94947ea75388ff9b034a6efe5f07ca454fd50096a661210e450cb42e7e9" gracePeriod=15 Jul 24 11:25:27.393917 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:27.393830 2586 generic.go:356] "Generic (PLEG): container finished" podID="c0fdbbf9-0615-4902-8830-1a1b60837c75" containerID="1094f94947ea75388ff9b034a6efe5f07ca454fd50096a661210e450cb42e7e9" exitCode=0 Jul 24 11:25:27.394059 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:27.393911 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c8d86d84f-rr6sn" event={"ID":"c0fdbbf9-0615-4902-8830-1a1b60837c75","Type":"ContainerDied","Data":"1094f94947ea75388ff9b034a6efe5f07ca454fd50096a661210e450cb42e7e9"} Jul 24 11:25:27.449030 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:27.449003 2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c8d86d84f-rr6sn" Jul 24 11:25:27.526842 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:27.526811 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c0fdbbf9-0615-4902-8830-1a1b60837c75-console-serving-cert\") pod \"c0fdbbf9-0615-4902-8830-1a1b60837c75\" (UID: \"c0fdbbf9-0615-4902-8830-1a1b60837c75\") " Jul 24 11:25:27.527030 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:27.526858 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c0fdbbf9-0615-4902-8830-1a1b60837c75-service-ca\") pod \"c0fdbbf9-0615-4902-8830-1a1b60837c75\" (UID: \"c0fdbbf9-0615-4902-8830-1a1b60837c75\") " Jul 24 11:25:27.527030 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:27.526887 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c0fdbbf9-0615-4902-8830-1a1b60837c75-console-config\") pod \"c0fdbbf9-0615-4902-8830-1a1b60837c75\" (UID: \"c0fdbbf9-0615-4902-8830-1a1b60837c75\") " Jul 24 11:25:27.527030 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:27.526924 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c0fdbbf9-0615-4902-8830-1a1b60837c75-console-oauth-config\") pod \"c0fdbbf9-0615-4902-8830-1a1b60837c75\" (UID: \"c0fdbbf9-0615-4902-8830-1a1b60837c75\") " Jul 24 11:25:27.527030 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:27.526953 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b5mvz\" (UniqueName: \"kubernetes.io/projected/c0fdbbf9-0615-4902-8830-1a1b60837c75-kube-api-access-b5mvz\") pod \"c0fdbbf9-0615-4902-8830-1a1b60837c75\" (UID: \"c0fdbbf9-0615-4902-8830-1a1b60837c75\") " Jul 24 11:25:27.527229 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:27.527069 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c0fdbbf9-0615-4902-8830-1a1b60837c75-oauth-serving-cert\") pod \"c0fdbbf9-0615-4902-8830-1a1b60837c75\" (UID: \"c0fdbbf9-0615-4902-8830-1a1b60837c75\") " Jul 24 11:25:27.527229 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:27.527164 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0fdbbf9-0615-4902-8830-1a1b60837c75-trusted-ca-bundle\") pod \"c0fdbbf9-0615-4902-8830-1a1b60837c75\" (UID: \"c0fdbbf9-0615-4902-8830-1a1b60837c75\") " Jul 24 11:25:27.527382 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:27.527353 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c0fdbbf9-0615-4902-8830-1a1b60837c75-console-config" (OuterVolumeSpecName: "console-config") pod "c0fdbbf9-0615-4902-8830-1a1b60837c75" (UID: "c0fdbbf9-0615-4902-8830-1a1b60837c75"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 11:25:27.527382 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:27.527361 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c0fdbbf9-0615-4902-8830-1a1b60837c75-service-ca" (OuterVolumeSpecName: "service-ca") pod "c0fdbbf9-0615-4902-8830-1a1b60837c75" (UID: "c0fdbbf9-0615-4902-8830-1a1b60837c75"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 11:25:27.527492 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:27.527446 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c0fdbbf9-0615-4902-8830-1a1b60837c75-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c0fdbbf9-0615-4902-8830-1a1b60837c75" (UID: "c0fdbbf9-0615-4902-8830-1a1b60837c75"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 11:25:27.527492 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:27.527474 2586 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c0fdbbf9-0615-4902-8830-1a1b60837c75-service-ca\") on node \"ip-10-0-137-219.ec2.internal\" DevicePath \"\"" Jul 24 11:25:27.527682 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:27.527493 2586 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c0fdbbf9-0615-4902-8830-1a1b60837c75-console-config\") on node \"ip-10-0-137-219.ec2.internal\" DevicePath \"\"" Jul 24 11:25:27.527789 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:27.527765 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c0fdbbf9-0615-4902-8830-1a1b60837c75-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "c0fdbbf9-0615-4902-8830-1a1b60837c75" (UID: "c0fdbbf9-0615-4902-8830-1a1b60837c75"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 11:25:27.529162 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:27.529137 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c0fdbbf9-0615-4902-8830-1a1b60837c75-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c0fdbbf9-0615-4902-8830-1a1b60837c75" (UID: "c0fdbbf9-0615-4902-8830-1a1b60837c75"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 11:25:27.529255 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:27.529179 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c0fdbbf9-0615-4902-8830-1a1b60837c75-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c0fdbbf9-0615-4902-8830-1a1b60837c75" (UID: "c0fdbbf9-0615-4902-8830-1a1b60837c75"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 11:25:27.529255 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:27.529188 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0fdbbf9-0615-4902-8830-1a1b60837c75-kube-api-access-b5mvz" (OuterVolumeSpecName: "kube-api-access-b5mvz") pod "c0fdbbf9-0615-4902-8830-1a1b60837c75" (UID: "c0fdbbf9-0615-4902-8830-1a1b60837c75"). InnerVolumeSpecName "kube-api-access-b5mvz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 11:25:27.628024 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:27.627990 2586 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0fdbbf9-0615-4902-8830-1a1b60837c75-trusted-ca-bundle\") on node \"ip-10-0-137-219.ec2.internal\" DevicePath \"\"" Jul 24 11:25:27.628024 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:27.628017 2586 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c0fdbbf9-0615-4902-8830-1a1b60837c75-console-serving-cert\") on node \"ip-10-0-137-219.ec2.internal\" DevicePath \"\"" Jul 24 11:25:27.628024 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:27.628027 2586 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c0fdbbf9-0615-4902-8830-1a1b60837c75-console-oauth-config\") on node \"ip-10-0-137-219.ec2.internal\" DevicePath \"\"" Jul 24 11:25:27.628242 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:27.628037 2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b5mvz\" (UniqueName: \"kubernetes.io/projected/c0fdbbf9-0615-4902-8830-1a1b60837c75-kube-api-access-b5mvz\") on node \"ip-10-0-137-219.ec2.internal\" DevicePath \"\"" Jul 24 11:25:27.628242 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:27.628048 2586 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c0fdbbf9-0615-4902-8830-1a1b60837c75-oauth-serving-cert\") on node \"ip-10-0-137-219.ec2.internal\" DevicePath \"\"" Jul 24 11:25:28.399497 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:28.399470 2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c8d86d84f-rr6sn" Jul 24 11:25:28.399925 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:28.399505 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c8d86d84f-rr6sn" event={"ID":"c0fdbbf9-0615-4902-8830-1a1b60837c75","Type":"ContainerDied","Data":"b62ce8cb9bc391506b78f57264421d06e9d428b436152b4f09678c50793a653d"} Jul 24 11:25:28.399925 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:28.399560 2586 scope.go:117] "RemoveContainer" containerID="1094f94947ea75388ff9b034a6efe5f07ca454fd50096a661210e450cb42e7e9" Jul 24 11:25:28.416126 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:28.416100 2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c8d86d84f-rr6sn"] Jul 24 11:25:28.420036 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:28.420015 2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-c8d86d84f-rr6sn"] Jul 24 11:25:29.684498 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:29.684462 2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c0fdbbf9-0615-4902-8830-1a1b60837c75" path="/var/lib/kubelet/pods/c0fdbbf9-0615-4902-8830-1a1b60837c75/volumes" Jul 24 11:25:37.110542 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:37.110507 2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5f58d9bdd-7gkpt" Jul 24 11:25:37.114279 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:37.114253 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5f58d9bdd-7gkpt" Jul 24 11:25:38.045775 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:38.045729 2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7c65b66cc6-bnrzc" podUID="58cf8cb4-73a0-4743-a007-142e6f3fa741" containerName="console" containerID="cri-o://25b74c7f9c0a45dffa9c5525046bff39107497c68b8f3374667f54c137ff42a1" gracePeriod=15 Jul 24 11:25:38.159376 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:38.159342 2586 patch_prober.go:28] interesting pod/console-7c65b66cc6-bnrzc container/console namespace/openshift-console: Readiness probe status=failure output="Get \"https://10.134.0.11:8443/health\": dial tcp 10.134.0.11:8443: connect: connection refused" start-of-body= Jul 24 11:25:38.159736 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:38.159404 2586 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/console-7c65b66cc6-bnrzc" podUID="58cf8cb4-73a0-4743-a007-142e6f3fa741" containerName="console" probeResult="failure" output="Get \"https://10.134.0.11:8443/health\": dial tcp 10.134.0.11:8443: connect: connection refused" Jul 24 11:25:38.291740 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:38.291712 2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c65b66cc6-bnrzc" Jul 24 11:25:38.425332 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:38.425297 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/58cf8cb4-73a0-4743-a007-142e6f3fa741-console-serving-cert\") pod \"58cf8cb4-73a0-4743-a007-142e6f3fa741\" (UID: \"58cf8cb4-73a0-4743-a007-142e6f3fa741\") " Jul 24 11:25:38.425513 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:38.425357 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/58cf8cb4-73a0-4743-a007-142e6f3fa741-console-config\") pod \"58cf8cb4-73a0-4743-a007-142e6f3fa741\" (UID: \"58cf8cb4-73a0-4743-a007-142e6f3fa741\") " Jul 24 11:25:38.425513 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:38.425393 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/58cf8cb4-73a0-4743-a007-142e6f3fa741-oauth-serving-cert\") pod \"58cf8cb4-73a0-4743-a007-142e6f3fa741\" (UID: \"58cf8cb4-73a0-4743-a007-142e6f3fa741\") " Jul 24 11:25:38.425513 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:38.425414 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cmdt8\" (UniqueName: \"kubernetes.io/projected/58cf8cb4-73a0-4743-a007-142e6f3fa741-kube-api-access-cmdt8\") pod \"58cf8cb4-73a0-4743-a007-142e6f3fa741\" (UID: \"58cf8cb4-73a0-4743-a007-142e6f3fa741\") " Jul 24 11:25:38.425513 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:38.425435 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/58cf8cb4-73a0-4743-a007-142e6f3fa741-console-oauth-config\") pod \"58cf8cb4-73a0-4743-a007-142e6f3fa741\" (UID: \"58cf8cb4-73a0-4743-a007-142e6f3fa741\") " Jul 24 11:25:38.425513 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:38.425476 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58cf8cb4-73a0-4743-a007-142e6f3fa741-trusted-ca-bundle\") pod \"58cf8cb4-73a0-4743-a007-142e6f3fa741\" (UID: \"58cf8cb4-73a0-4743-a007-142e6f3fa741\") " Jul 24 11:25:38.425513 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:38.425499 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/58cf8cb4-73a0-4743-a007-142e6f3fa741-service-ca\") pod \"58cf8cb4-73a0-4743-a007-142e6f3fa741\" (UID: \"58cf8cb4-73a0-4743-a007-142e6f3fa741\") " Jul 24 11:25:38.425973 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:38.425940 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58cf8cb4-73a0-4743-a007-142e6f3fa741-console-config" (OuterVolumeSpecName: "console-config") pod "58cf8cb4-73a0-4743-a007-142e6f3fa741" (UID: "58cf8cb4-73a0-4743-a007-142e6f3fa741"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 11:25:38.426097 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:38.425976 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58cf8cb4-73a0-4743-a007-142e6f3fa741-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "58cf8cb4-73a0-4743-a007-142e6f3fa741" (UID: "58cf8cb4-73a0-4743-a007-142e6f3fa741"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 11:25:38.426097 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:38.426085 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58cf8cb4-73a0-4743-a007-142e6f3fa741-service-ca" (OuterVolumeSpecName: "service-ca") pod "58cf8cb4-73a0-4743-a007-142e6f3fa741" (UID: "58cf8cb4-73a0-4743-a007-142e6f3fa741"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 11:25:38.426236 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:38.426121 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58cf8cb4-73a0-4743-a007-142e6f3fa741-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "58cf8cb4-73a0-4743-a007-142e6f3fa741" (UID: "58cf8cb4-73a0-4743-a007-142e6f3fa741"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 11:25:38.427817 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:38.427797 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58cf8cb4-73a0-4743-a007-142e6f3fa741-kube-api-access-cmdt8" (OuterVolumeSpecName: "kube-api-access-cmdt8") pod "58cf8cb4-73a0-4743-a007-142e6f3fa741" (UID: "58cf8cb4-73a0-4743-a007-142e6f3fa741"). InnerVolumeSpecName "kube-api-access-cmdt8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 11:25:38.428075 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:38.428049 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58cf8cb4-73a0-4743-a007-142e6f3fa741-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "58cf8cb4-73a0-4743-a007-142e6f3fa741" (UID: "58cf8cb4-73a0-4743-a007-142e6f3fa741"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 11:25:38.428151 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:38.428123 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58cf8cb4-73a0-4743-a007-142e6f3fa741-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "58cf8cb4-73a0-4743-a007-142e6f3fa741" (UID: "58cf8cb4-73a0-4743-a007-142e6f3fa741"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 11:25:38.453374 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:38.453348 2586 generic.go:356] "Generic (PLEG): container finished" podID="58cf8cb4-73a0-4743-a007-142e6f3fa741" containerID="25b74c7f9c0a45dffa9c5525046bff39107497c68b8f3374667f54c137ff42a1" exitCode=0 Jul 24 11:25:38.453500 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:38.453383 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c65b66cc6-bnrzc" event={"ID":"58cf8cb4-73a0-4743-a007-142e6f3fa741","Type":"ContainerDied","Data":"25b74c7f9c0a45dffa9c5525046bff39107497c68b8f3374667f54c137ff42a1"} Jul 24 11:25:38.453500 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:38.453404 2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c65b66cc6-bnrzc" Jul 24 11:25:38.453500 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:38.453446 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c65b66cc6-bnrzc" event={"ID":"58cf8cb4-73a0-4743-a007-142e6f3fa741","Type":"ContainerDied","Data":"d1cb8420bbf5ad5e7576c76640056bea3b795219ca0f83f3a13ccb0f98f29060"} Jul 24 11:25:38.453500 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:38.453468 2586 scope.go:117] "RemoveContainer" containerID="25b74c7f9c0a45dffa9c5525046bff39107497c68b8f3374667f54c137ff42a1" Jul 24 11:25:38.462446 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:38.462429 2586 scope.go:117] "RemoveContainer" containerID="25b74c7f9c0a45dffa9c5525046bff39107497c68b8f3374667f54c137ff42a1" Jul 24 11:25:38.462708 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:25:38.462691 2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"25b74c7f9c0a45dffa9c5525046bff39107497c68b8f3374667f54c137ff42a1\": container with ID starting with 25b74c7f9c0a45dffa9c5525046bff39107497c68b8f3374667f54c137ff42a1 not found: ID does not exist" containerID="25b74c7f9c0a45dffa9c5525046bff39107497c68b8f3374667f54c137ff42a1" Jul 24 11:25:38.462751 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:38.462717 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25b74c7f9c0a45dffa9c5525046bff39107497c68b8f3374667f54c137ff42a1"} err="failed to get container status \"25b74c7f9c0a45dffa9c5525046bff39107497c68b8f3374667f54c137ff42a1\": rpc error: code = NotFound desc = could not find container \"25b74c7f9c0a45dffa9c5525046bff39107497c68b8f3374667f54c137ff42a1\": container with ID starting with 25b74c7f9c0a45dffa9c5525046bff39107497c68b8f3374667f54c137ff42a1 not found: ID does not exist" Jul 24 11:25:38.473865 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:38.473840 2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7c65b66cc6-bnrzc"] Jul 24 11:25:38.479317 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:38.479295 2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7c65b66cc6-bnrzc"] Jul 24 11:25:38.527129 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:38.527099 2586 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/58cf8cb4-73a0-4743-a007-142e6f3fa741-console-config\") on node \"ip-10-0-137-219.ec2.internal\" DevicePath \"\"" Jul 24 11:25:38.527129 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:38.527127 2586 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/58cf8cb4-73a0-4743-a007-142e6f3fa741-oauth-serving-cert\") on node \"ip-10-0-137-219.ec2.internal\" DevicePath \"\"" Jul 24 11:25:38.527326 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:38.527139 2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cmdt8\" (UniqueName: \"kubernetes.io/projected/58cf8cb4-73a0-4743-a007-142e6f3fa741-kube-api-access-cmdt8\") on node \"ip-10-0-137-219.ec2.internal\" DevicePath \"\"" Jul 24 11:25:38.527326 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:38.527150 2586 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/58cf8cb4-73a0-4743-a007-142e6f3fa741-console-oauth-config\") on node \"ip-10-0-137-219.ec2.internal\" DevicePath \"\"" Jul 24 11:25:38.527326 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:38.527158 2586 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58cf8cb4-73a0-4743-a007-142e6f3fa741-trusted-ca-bundle\") on node \"ip-10-0-137-219.ec2.internal\" DevicePath \"\"" Jul 24 11:25:38.527326 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:38.527166 2586 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/58cf8cb4-73a0-4743-a007-142e6f3fa741-service-ca\") on node \"ip-10-0-137-219.ec2.internal\" DevicePath \"\"" Jul 24 11:25:38.527326 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:38.527175 2586 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/58cf8cb4-73a0-4743-a007-142e6f3fa741-console-serving-cert\") on node \"ip-10-0-137-219.ec2.internal\" DevicePath \"\"" Jul 24 11:25:39.684452 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:39.684418 2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58cf8cb4-73a0-4743-a007-142e6f3fa741" path="/var/lib/kubelet/pods/58cf8cb4-73a0-4743-a007-142e6f3fa741/volumes" Jul 24 11:25:58.921473 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:58.921429 2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:25:58.940723 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:58.940694 2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:25:59.551781 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:25:59.551754 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:26:12.824135 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:12.824099 2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 24 11:26:12.824692 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:12.824384 2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="249e6e6e-a7d0-43a7-99ea-c3f61ed26b50" containerName="alertmanager" containerID="cri-o://419564cc1390a8aca80eab4ada2af03c3c380f4d7458afa7d67dcbf1105bd22c" gracePeriod=120 Jul 24 11:26:12.824692 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:12.824454 2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="249e6e6e-a7d0-43a7-99ea-c3f61ed26b50" containerName="kube-rbac-proxy-web" containerID="cri-o://432527e639e889b1b960a5db2c76d70f3b24c19c1ee86800d1072b9ab5eac93f" gracePeriod=120 Jul 24 11:26:12.824692 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:12.824454 2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="249e6e6e-a7d0-43a7-99ea-c3f61ed26b50" containerName="kube-rbac-proxy-metric" containerID="cri-o://c2cc9c655d78a59b34c44c1a2250fe7e353d5db9d37b4dbd2ea039b7c37ef439" gracePeriod=120 Jul 24 11:26:12.824692 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:12.824482 2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="249e6e6e-a7d0-43a7-99ea-c3f61ed26b50" containerName="kube-rbac-proxy" containerID="cri-o://78c39534537cdb60acc6cb1facc106df1a637018fdbfe8ec39cb928635f54eb1" gracePeriod=120 Jul 24 11:26:12.824692 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:12.824516 2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="249e6e6e-a7d0-43a7-99ea-c3f61ed26b50" containerName="config-reloader" containerID="cri-o://17934ac9212b5638755995578bdad64fe05f7c87bc349d59ab4324aaa362ded1" gracePeriod=120 Jul 24 11:26:12.824692 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:12.824539 2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="249e6e6e-a7d0-43a7-99ea-c3f61ed26b50" containerName="prom-label-proxy" containerID="cri-o://567a86d0a2313136ee160fe90d2d62ca3c17447976e68723c3ae354d2b7616df" gracePeriod=120 Jul 24 11:26:13.595783 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:13.595752 2586 generic.go:356] "Generic (PLEG): container finished" podID="249e6e6e-a7d0-43a7-99ea-c3f61ed26b50" containerID="567a86d0a2313136ee160fe90d2d62ca3c17447976e68723c3ae354d2b7616df" exitCode=0 Jul 24 11:26:13.595783 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:13.595776 2586 generic.go:356] "Generic (PLEG): container finished" podID="249e6e6e-a7d0-43a7-99ea-c3f61ed26b50" containerID="c2cc9c655d78a59b34c44c1a2250fe7e353d5db9d37b4dbd2ea039b7c37ef439" exitCode=0 Jul 24 11:26:13.595783 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:13.595784 2586 generic.go:356] "Generic (PLEG): container finished" podID="249e6e6e-a7d0-43a7-99ea-c3f61ed26b50" containerID="78c39534537cdb60acc6cb1facc106df1a637018fdbfe8ec39cb928635f54eb1" exitCode=0 Jul 24 11:26:13.595783 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:13.595793 2586 generic.go:356] "Generic (PLEG): container finished" podID="249e6e6e-a7d0-43a7-99ea-c3f61ed26b50" containerID="17934ac9212b5638755995578bdad64fe05f7c87bc349d59ab4324aaa362ded1" exitCode=0 Jul 24 11:26:13.595783 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:13.595801 2586 generic.go:356] "Generic (PLEG): container finished" podID="249e6e6e-a7d0-43a7-99ea-c3f61ed26b50" containerID="419564cc1390a8aca80eab4ada2af03c3c380f4d7458afa7d67dcbf1105bd22c" exitCode=0 Jul 24 11:26:13.596078 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:13.595829 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"249e6e6e-a7d0-43a7-99ea-c3f61ed26b50","Type":"ContainerDied","Data":"567a86d0a2313136ee160fe90d2d62ca3c17447976e68723c3ae354d2b7616df"} Jul 24 11:26:13.596078 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:13.595900 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"249e6e6e-a7d0-43a7-99ea-c3f61ed26b50","Type":"ContainerDied","Data":"c2cc9c655d78a59b34c44c1a2250fe7e353d5db9d37b4dbd2ea039b7c37ef439"} Jul 24 11:26:13.596078 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:13.595928 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"249e6e6e-a7d0-43a7-99ea-c3f61ed26b50","Type":"ContainerDied","Data":"78c39534537cdb60acc6cb1facc106df1a637018fdbfe8ec39cb928635f54eb1"} Jul 24 11:26:13.596078 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:13.595952 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"249e6e6e-a7d0-43a7-99ea-c3f61ed26b50","Type":"ContainerDied","Data":"17934ac9212b5638755995578bdad64fe05f7c87bc349d59ab4324aaa362ded1"} Jul 24 11:26:13.596078 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:13.595977 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"249e6e6e-a7d0-43a7-99ea-c3f61ed26b50","Type":"ContainerDied","Data":"419564cc1390a8aca80eab4ada2af03c3c380f4d7458afa7d67dcbf1105bd22c"} Jul 24 11:26:14.074659 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.074633 2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 24 11:26:14.143270 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.143172 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/249e6e6e-a7d0-43a7-99ea-c3f61ed26b50-alertmanager-main-db\") pod \"249e6e6e-a7d0-43a7-99ea-c3f61ed26b50\" (UID: \"249e6e6e-a7d0-43a7-99ea-c3f61ed26b50\") " Jul 24 11:26:14.143270 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.143224 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/249e6e6e-a7d0-43a7-99ea-c3f61ed26b50-config-volume\") pod \"249e6e6e-a7d0-43a7-99ea-c3f61ed26b50\" (UID: \"249e6e6e-a7d0-43a7-99ea-c3f61ed26b50\") " Jul 24 11:26:14.143270 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.143255 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/249e6e6e-a7d0-43a7-99ea-c3f61ed26b50-secret-alertmanager-kube-rbac-proxy-metric\") pod \"249e6e6e-a7d0-43a7-99ea-c3f61ed26b50\" (UID: \"249e6e6e-a7d0-43a7-99ea-c3f61ed26b50\") " Jul 24 11:26:14.143625 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.143312 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5l6jc\" (UniqueName: \"kubernetes.io/projected/249e6e6e-a7d0-43a7-99ea-c3f61ed26b50-kube-api-access-5l6jc\") pod \"249e6e6e-a7d0-43a7-99ea-c3f61ed26b50\" (UID: \"249e6e6e-a7d0-43a7-99ea-c3f61ed26b50\") " Jul 24 11:26:14.143625 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.143336 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/249e6e6e-a7d0-43a7-99ea-c3f61ed26b50-secret-alertmanager-main-tls\") pod \"249e6e6e-a7d0-43a7-99ea-c3f61ed26b50\" (UID: \"249e6e6e-a7d0-43a7-99ea-c3f61ed26b50\") " Jul 24 11:26:14.143625 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.143357 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/249e6e6e-a7d0-43a7-99ea-c3f61ed26b50-metrics-client-ca\") pod \"249e6e6e-a7d0-43a7-99ea-c3f61ed26b50\" (UID: \"249e6e6e-a7d0-43a7-99ea-c3f61ed26b50\") " Jul 24 11:26:14.143625 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.143409 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/249e6e6e-a7d0-43a7-99ea-c3f61ed26b50-alertmanager-trusted-ca-bundle\") pod \"249e6e6e-a7d0-43a7-99ea-c3f61ed26b50\" (UID: \"249e6e6e-a7d0-43a7-99ea-c3f61ed26b50\") " Jul 24 11:26:14.143625 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.143566 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/249e6e6e-a7d0-43a7-99ea-c3f61ed26b50-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "249e6e6e-a7d0-43a7-99ea-c3f61ed26b50" (UID: "249e6e6e-a7d0-43a7-99ea-c3f61ed26b50"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 11:26:14.143878 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.143645 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/249e6e6e-a7d0-43a7-99ea-c3f61ed26b50-tls-assets\") pod \"249e6e6e-a7d0-43a7-99ea-c3f61ed26b50\" (UID: \"249e6e6e-a7d0-43a7-99ea-c3f61ed26b50\") " Jul 24 11:26:14.143878 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.143757 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/249e6e6e-a7d0-43a7-99ea-c3f61ed26b50-cluster-tls-config\") pod \"249e6e6e-a7d0-43a7-99ea-c3f61ed26b50\" (UID: \"249e6e6e-a7d0-43a7-99ea-c3f61ed26b50\") " Jul 24 11:26:14.143878 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.143812 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/249e6e6e-a7d0-43a7-99ea-c3f61ed26b50-secret-alertmanager-kube-rbac-proxy-web\") pod \"249e6e6e-a7d0-43a7-99ea-c3f61ed26b50\" (UID: \"249e6e6e-a7d0-43a7-99ea-c3f61ed26b50\") " Jul 24 11:26:14.143878 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.143851 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/249e6e6e-a7d0-43a7-99ea-c3f61ed26b50-config-out\") pod \"249e6e6e-a7d0-43a7-99ea-c3f61ed26b50\" (UID: \"249e6e6e-a7d0-43a7-99ea-c3f61ed26b50\") " Jul 24 11:26:14.143878 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.143862 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/249e6e6e-a7d0-43a7-99ea-c3f61ed26b50-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "249e6e6e-a7d0-43a7-99ea-c3f61ed26b50" (UID: "249e6e6e-a7d0-43a7-99ea-c3f61ed26b50"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 11:26:14.144142 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.143880 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/249e6e6e-a7d0-43a7-99ea-c3f61ed26b50-web-config\") pod \"249e6e6e-a7d0-43a7-99ea-c3f61ed26b50\" (UID: \"249e6e6e-a7d0-43a7-99ea-c3f61ed26b50\") " Jul 24 11:26:14.144142 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.143907 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/249e6e6e-a7d0-43a7-99ea-c3f61ed26b50-secret-alertmanager-kube-rbac-proxy\") pod \"249e6e6e-a7d0-43a7-99ea-c3f61ed26b50\" (UID: \"249e6e6e-a7d0-43a7-99ea-c3f61ed26b50\") " Jul 24 11:26:14.144249 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.144206 2586 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/249e6e6e-a7d0-43a7-99ea-c3f61ed26b50-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-137-219.ec2.internal\" DevicePath \"\"" Jul 24 11:26:14.144249 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.144225 2586 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/249e6e6e-a7d0-43a7-99ea-c3f61ed26b50-alertmanager-main-db\") on node \"ip-10-0-137-219.ec2.internal\" DevicePath \"\"" Jul 24 11:26:14.144807 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.144779 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/249e6e6e-a7d0-43a7-99ea-c3f61ed26b50-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "249e6e6e-a7d0-43a7-99ea-c3f61ed26b50" (UID: "249e6e6e-a7d0-43a7-99ea-c3f61ed26b50"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 11:26:14.146071 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.146046 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/249e6e6e-a7d0-43a7-99ea-c3f61ed26b50-kube-api-access-5l6jc" (OuterVolumeSpecName: "kube-api-access-5l6jc") pod "249e6e6e-a7d0-43a7-99ea-c3f61ed26b50" (UID: "249e6e6e-a7d0-43a7-99ea-c3f61ed26b50"). InnerVolumeSpecName "kube-api-access-5l6jc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 11:26:14.146662 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.146563 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/249e6e6e-a7d0-43a7-99ea-c3f61ed26b50-config-volume" (OuterVolumeSpecName: "config-volume") pod "249e6e6e-a7d0-43a7-99ea-c3f61ed26b50" (UID: "249e6e6e-a7d0-43a7-99ea-c3f61ed26b50"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 11:26:14.146662 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.146626 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/249e6e6e-a7d0-43a7-99ea-c3f61ed26b50-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "249e6e6e-a7d0-43a7-99ea-c3f61ed26b50" (UID: "249e6e6e-a7d0-43a7-99ea-c3f61ed26b50"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 11:26:14.146827 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.146715 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/249e6e6e-a7d0-43a7-99ea-c3f61ed26b50-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "249e6e6e-a7d0-43a7-99ea-c3f61ed26b50" (UID: "249e6e6e-a7d0-43a7-99ea-c3f61ed26b50"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 11:26:14.147621 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.147555 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/249e6e6e-a7d0-43a7-99ea-c3f61ed26b50-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "249e6e6e-a7d0-43a7-99ea-c3f61ed26b50" (UID: "249e6e6e-a7d0-43a7-99ea-c3f61ed26b50"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 11:26:14.147710 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.147689 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/249e6e6e-a7d0-43a7-99ea-c3f61ed26b50-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "249e6e6e-a7d0-43a7-99ea-c3f61ed26b50" (UID: "249e6e6e-a7d0-43a7-99ea-c3f61ed26b50"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 11:26:14.147940 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.147918 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/249e6e6e-a7d0-43a7-99ea-c3f61ed26b50-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "249e6e6e-a7d0-43a7-99ea-c3f61ed26b50" (UID: "249e6e6e-a7d0-43a7-99ea-c3f61ed26b50"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 11:26:14.148321 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.148304 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/249e6e6e-a7d0-43a7-99ea-c3f61ed26b50-config-out" (OuterVolumeSpecName: "config-out") pod "249e6e6e-a7d0-43a7-99ea-c3f61ed26b50" (UID: "249e6e6e-a7d0-43a7-99ea-c3f61ed26b50"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 11:26:14.152084 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.152061 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/249e6e6e-a7d0-43a7-99ea-c3f61ed26b50-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "249e6e6e-a7d0-43a7-99ea-c3f61ed26b50" (UID: "249e6e6e-a7d0-43a7-99ea-c3f61ed26b50"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 11:26:14.160812 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.160789 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/249e6e6e-a7d0-43a7-99ea-c3f61ed26b50-web-config" (OuterVolumeSpecName: "web-config") pod "249e6e6e-a7d0-43a7-99ea-c3f61ed26b50" (UID: "249e6e6e-a7d0-43a7-99ea-c3f61ed26b50"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 11:26:14.245453 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.245414 2586 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/249e6e6e-a7d0-43a7-99ea-c3f61ed26b50-config-volume\") on node \"ip-10-0-137-219.ec2.internal\" DevicePath \"\"" Jul 24 11:26:14.245453 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.245450 2586 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/249e6e6e-a7d0-43a7-99ea-c3f61ed26b50-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-137-219.ec2.internal\" DevicePath \"\"" Jul 24 11:26:14.245713 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.245467 2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5l6jc\" (UniqueName: \"kubernetes.io/projected/249e6e6e-a7d0-43a7-99ea-c3f61ed26b50-kube-api-access-5l6jc\") on node \"ip-10-0-137-219.ec2.internal\" DevicePath \"\"" Jul 24 11:26:14.245713 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.245481 2586 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/249e6e6e-a7d0-43a7-99ea-c3f61ed26b50-secret-alertmanager-main-tls\") on node \"ip-10-0-137-219.ec2.internal\" DevicePath \"\"" Jul 24 11:26:14.245713 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.245492 2586 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/249e6e6e-a7d0-43a7-99ea-c3f61ed26b50-metrics-client-ca\") on node \"ip-10-0-137-219.ec2.internal\" DevicePath \"\"" Jul 24 11:26:14.245713 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.245503 2586 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/249e6e6e-a7d0-43a7-99ea-c3f61ed26b50-tls-assets\") on node \"ip-10-0-137-219.ec2.internal\" DevicePath \"\"" Jul 24 11:26:14.245713 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.245513 2586 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/249e6e6e-a7d0-43a7-99ea-c3f61ed26b50-cluster-tls-config\") on node \"ip-10-0-137-219.ec2.internal\" DevicePath \"\"" Jul 24 11:26:14.245713 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.245525 2586 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/249e6e6e-a7d0-43a7-99ea-c3f61ed26b50-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-137-219.ec2.internal\" DevicePath \"\"" Jul 24 11:26:14.245713 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.245537 2586 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/249e6e6e-a7d0-43a7-99ea-c3f61ed26b50-config-out\") on node \"ip-10-0-137-219.ec2.internal\" DevicePath \"\"" Jul 24 11:26:14.245713 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.245548 2586 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/249e6e6e-a7d0-43a7-99ea-c3f61ed26b50-web-config\") on node \"ip-10-0-137-219.ec2.internal\" DevicePath \"\"" Jul 24 11:26:14.245713 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.245558 2586 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/249e6e6e-a7d0-43a7-99ea-c3f61ed26b50-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-137-219.ec2.internal\" DevicePath \"\"" Jul 24 11:26:14.602355 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.602320 2586 generic.go:356] "Generic (PLEG): container finished" podID="249e6e6e-a7d0-43a7-99ea-c3f61ed26b50" containerID="432527e639e889b1b960a5db2c76d70f3b24c19c1ee86800d1072b9ab5eac93f" exitCode=0 Jul 24 11:26:14.602528 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.602364 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"249e6e6e-a7d0-43a7-99ea-c3f61ed26b50","Type":"ContainerDied","Data":"432527e639e889b1b960a5db2c76d70f3b24c19c1ee86800d1072b9ab5eac93f"} Jul 24 11:26:14.602528 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.602403 2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 24 11:26:14.602528 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.602446 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"249e6e6e-a7d0-43a7-99ea-c3f61ed26b50","Type":"ContainerDied","Data":"fcfe5bcbbad3b7a63becc015a8b48f1b81019b763387b96ca34ae04d414a0b05"} Jul 24 11:26:14.602528 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.602480 2586 scope.go:117] "RemoveContainer" containerID="567a86d0a2313136ee160fe90d2d62ca3c17447976e68723c3ae354d2b7616df" Jul 24 11:26:14.610468 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.610447 2586 scope.go:117] "RemoveContainer" containerID="c2cc9c655d78a59b34c44c1a2250fe7e353d5db9d37b4dbd2ea039b7c37ef439" Jul 24 11:26:14.617963 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.617943 2586 scope.go:117] "RemoveContainer" containerID="78c39534537cdb60acc6cb1facc106df1a637018fdbfe8ec39cb928635f54eb1" Jul 24 11:26:14.626035 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.626016 2586 scope.go:117] "RemoveContainer" containerID="432527e639e889b1b960a5db2c76d70f3b24c19c1ee86800d1072b9ab5eac93f" Jul 24 11:26:14.628051 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.628026 2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 24 11:26:14.630247 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.630228 2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 24 11:26:14.634309 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.634294 2586 scope.go:117] "RemoveContainer" containerID="17934ac9212b5638755995578bdad64fe05f7c87bc349d59ab4324aaa362ded1" Jul 24 11:26:14.641250 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.641231 2586 scope.go:117] "RemoveContainer" containerID="419564cc1390a8aca80eab4ada2af03c3c380f4d7458afa7d67dcbf1105bd22c" Jul 24 11:26:14.648264 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.648244 2586 scope.go:117] "RemoveContainer" containerID="4bb46fcfe4b1a2e13879d471bbfee1d1c8904b2e6d930f851e23c3e5c602d1d9" Jul 24 11:26:14.655617 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.655599 2586 scope.go:117] "RemoveContainer" containerID="567a86d0a2313136ee160fe90d2d62ca3c17447976e68723c3ae354d2b7616df" Jul 24 11:26:14.655883 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:26:14.655865 2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"567a86d0a2313136ee160fe90d2d62ca3c17447976e68723c3ae354d2b7616df\": container with ID starting with 567a86d0a2313136ee160fe90d2d62ca3c17447976e68723c3ae354d2b7616df not found: ID does not exist" containerID="567a86d0a2313136ee160fe90d2d62ca3c17447976e68723c3ae354d2b7616df" Jul 24 11:26:14.655947 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.655890 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"567a86d0a2313136ee160fe90d2d62ca3c17447976e68723c3ae354d2b7616df"} err="failed to get container status \"567a86d0a2313136ee160fe90d2d62ca3c17447976e68723c3ae354d2b7616df\": rpc error: code = NotFound desc = could not find container \"567a86d0a2313136ee160fe90d2d62ca3c17447976e68723c3ae354d2b7616df\": container with ID starting with 567a86d0a2313136ee160fe90d2d62ca3c17447976e68723c3ae354d2b7616df not found: ID does not exist" Jul 24 11:26:14.655947 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.655908 2586 scope.go:117] "RemoveContainer" containerID="c2cc9c655d78a59b34c44c1a2250fe7e353d5db9d37b4dbd2ea039b7c37ef439" Jul 24 11:26:14.656167 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:26:14.656150 2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c2cc9c655d78a59b34c44c1a2250fe7e353d5db9d37b4dbd2ea039b7c37ef439\": container with ID starting with c2cc9c655d78a59b34c44c1a2250fe7e353d5db9d37b4dbd2ea039b7c37ef439 not found: ID does not exist" containerID="c2cc9c655d78a59b34c44c1a2250fe7e353d5db9d37b4dbd2ea039b7c37ef439" Jul 24 11:26:14.656208 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.656174 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2cc9c655d78a59b34c44c1a2250fe7e353d5db9d37b4dbd2ea039b7c37ef439"} err="failed to get container status \"c2cc9c655d78a59b34c44c1a2250fe7e353d5db9d37b4dbd2ea039b7c37ef439\": rpc error: code = NotFound desc = could not find container \"c2cc9c655d78a59b34c44c1a2250fe7e353d5db9d37b4dbd2ea039b7c37ef439\": container with ID starting with c2cc9c655d78a59b34c44c1a2250fe7e353d5db9d37b4dbd2ea039b7c37ef439 not found: ID does not exist" Jul 24 11:26:14.656208 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.656194 2586 scope.go:117] "RemoveContainer" containerID="78c39534537cdb60acc6cb1facc106df1a637018fdbfe8ec39cb928635f54eb1" Jul 24 11:26:14.656407 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:26:14.656392 2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"78c39534537cdb60acc6cb1facc106df1a637018fdbfe8ec39cb928635f54eb1\": container with ID starting with 78c39534537cdb60acc6cb1facc106df1a637018fdbfe8ec39cb928635f54eb1 not found: ID does not exist" containerID="78c39534537cdb60acc6cb1facc106df1a637018fdbfe8ec39cb928635f54eb1" Jul 24 11:26:14.656442 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.656411 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78c39534537cdb60acc6cb1facc106df1a637018fdbfe8ec39cb928635f54eb1"} err="failed to get container status \"78c39534537cdb60acc6cb1facc106df1a637018fdbfe8ec39cb928635f54eb1\": rpc error: code = NotFound desc = could not find container \"78c39534537cdb60acc6cb1facc106df1a637018fdbfe8ec39cb928635f54eb1\": container with ID starting with 78c39534537cdb60acc6cb1facc106df1a637018fdbfe8ec39cb928635f54eb1 not found: ID does not exist" Jul 24 11:26:14.656442 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.656423 2586 scope.go:117] "RemoveContainer" containerID="432527e639e889b1b960a5db2c76d70f3b24c19c1ee86800d1072b9ab5eac93f" Jul 24 11:26:14.656643 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:26:14.656623 2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"432527e639e889b1b960a5db2c76d70f3b24c19c1ee86800d1072b9ab5eac93f\": container with ID starting with 432527e639e889b1b960a5db2c76d70f3b24c19c1ee86800d1072b9ab5eac93f not found: ID does not exist" containerID="432527e639e889b1b960a5db2c76d70f3b24c19c1ee86800d1072b9ab5eac93f" Jul 24 11:26:14.656691 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.656650 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"432527e639e889b1b960a5db2c76d70f3b24c19c1ee86800d1072b9ab5eac93f"} err="failed to get container status \"432527e639e889b1b960a5db2c76d70f3b24c19c1ee86800d1072b9ab5eac93f\": rpc error: code = NotFound desc = could not find container \"432527e639e889b1b960a5db2c76d70f3b24c19c1ee86800d1072b9ab5eac93f\": container with ID starting with 432527e639e889b1b960a5db2c76d70f3b24c19c1ee86800d1072b9ab5eac93f not found: ID does not exist" Jul 24 11:26:14.656691 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.656669 2586 scope.go:117] "RemoveContainer" containerID="17934ac9212b5638755995578bdad64fe05f7c87bc349d59ab4324aaa362ded1" Jul 24 11:26:14.656885 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:26:14.656865 2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"17934ac9212b5638755995578bdad64fe05f7c87bc349d59ab4324aaa362ded1\": container with ID starting with 17934ac9212b5638755995578bdad64fe05f7c87bc349d59ab4324aaa362ded1 not found: ID does not exist" containerID="17934ac9212b5638755995578bdad64fe05f7c87bc349d59ab4324aaa362ded1" Jul 24 11:26:14.656924 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.656892 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17934ac9212b5638755995578bdad64fe05f7c87bc349d59ab4324aaa362ded1"} err="failed to get container status \"17934ac9212b5638755995578bdad64fe05f7c87bc349d59ab4324aaa362ded1\": rpc error: code = NotFound desc = could not find container \"17934ac9212b5638755995578bdad64fe05f7c87bc349d59ab4324aaa362ded1\": container with ID starting with 17934ac9212b5638755995578bdad64fe05f7c87bc349d59ab4324aaa362ded1 not found: ID does not exist" Jul 24 11:26:14.656924 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.656906 2586 scope.go:117] "RemoveContainer" containerID="419564cc1390a8aca80eab4ada2af03c3c380f4d7458afa7d67dcbf1105bd22c" Jul 24 11:26:14.657113 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:26:14.657098 2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"419564cc1390a8aca80eab4ada2af03c3c380f4d7458afa7d67dcbf1105bd22c\": container with ID starting with 419564cc1390a8aca80eab4ada2af03c3c380f4d7458afa7d67dcbf1105bd22c not found: ID does not exist" containerID="419564cc1390a8aca80eab4ada2af03c3c380f4d7458afa7d67dcbf1105bd22c" Jul 24 11:26:14.657148 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.657119 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"419564cc1390a8aca80eab4ada2af03c3c380f4d7458afa7d67dcbf1105bd22c"} err="failed to get container status \"419564cc1390a8aca80eab4ada2af03c3c380f4d7458afa7d67dcbf1105bd22c\": rpc error: code = NotFound desc = could not find container \"419564cc1390a8aca80eab4ada2af03c3c380f4d7458afa7d67dcbf1105bd22c\": container with ID starting with 419564cc1390a8aca80eab4ada2af03c3c380f4d7458afa7d67dcbf1105bd22c not found: ID does not exist" Jul 24 11:26:14.657148 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.657134 2586 scope.go:117] "RemoveContainer" containerID="4bb46fcfe4b1a2e13879d471bbfee1d1c8904b2e6d930f851e23c3e5c602d1d9" Jul 24 11:26:14.657383 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:26:14.657365 2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4bb46fcfe4b1a2e13879d471bbfee1d1c8904b2e6d930f851e23c3e5c602d1d9\": container with ID starting with 4bb46fcfe4b1a2e13879d471bbfee1d1c8904b2e6d930f851e23c3e5c602d1d9 not found: ID does not exist" containerID="4bb46fcfe4b1a2e13879d471bbfee1d1c8904b2e6d930f851e23c3e5c602d1d9" Jul 24 11:26:14.657480 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.657384 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4bb46fcfe4b1a2e13879d471bbfee1d1c8904b2e6d930f851e23c3e5c602d1d9"} err="failed to get container status \"4bb46fcfe4b1a2e13879d471bbfee1d1c8904b2e6d930f851e23c3e5c602d1d9\": rpc error: code = NotFound desc = could not find container \"4bb46fcfe4b1a2e13879d471bbfee1d1c8904b2e6d930f851e23c3e5c602d1d9\": container with ID starting with 4bb46fcfe4b1a2e13879d471bbfee1d1c8904b2e6d930f851e23c3e5c602d1d9 not found: ID does not exist" Jul 24 11:26:14.659722 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.659703 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 24 11:26:14.660013 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.660002 2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="249e6e6e-a7d0-43a7-99ea-c3f61ed26b50" containerName="kube-rbac-proxy" Jul 24 11:26:14.660064 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.660015 2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="249e6e6e-a7d0-43a7-99ea-c3f61ed26b50" containerName="kube-rbac-proxy" Jul 24 11:26:14.660064 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.660028 2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="249e6e6e-a7d0-43a7-99ea-c3f61ed26b50" containerName="init-config-reloader" Jul 24 11:26:14.660064 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.660033 2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="249e6e6e-a7d0-43a7-99ea-c3f61ed26b50" containerName="init-config-reloader" Jul 24 11:26:14.660064 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.660042 2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0fdbbf9-0615-4902-8830-1a1b60837c75" containerName="console" Jul 24 11:26:14.660064 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.660050 2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0fdbbf9-0615-4902-8830-1a1b60837c75" containerName="console" Jul 24 11:26:14.660064 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.660060 2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="249e6e6e-a7d0-43a7-99ea-c3f61ed26b50" containerName="config-reloader" Jul 24 11:26:14.660237 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.660065 2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="249e6e6e-a7d0-43a7-99ea-c3f61ed26b50" containerName="config-reloader" Jul 24 11:26:14.660237 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.660073 2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="249e6e6e-a7d0-43a7-99ea-c3f61ed26b50" containerName="kube-rbac-proxy-web" Jul 24 11:26:14.660237 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.660079 2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="249e6e6e-a7d0-43a7-99ea-c3f61ed26b50" containerName="kube-rbac-proxy-web" Jul 24 11:26:14.660237 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.660088 2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="249e6e6e-a7d0-43a7-99ea-c3f61ed26b50" containerName="kube-rbac-proxy-metric" Jul 24 11:26:14.660237 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.660095 2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="249e6e6e-a7d0-43a7-99ea-c3f61ed26b50" containerName="kube-rbac-proxy-metric" Jul 24 11:26:14.660237 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.660101 2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="249e6e6e-a7d0-43a7-99ea-c3f61ed26b50" containerName="alertmanager" Jul 24 11:26:14.660237 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.660106 2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="249e6e6e-a7d0-43a7-99ea-c3f61ed26b50" containerName="alertmanager" Jul 24 11:26:14.660237 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.660112 2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="249e6e6e-a7d0-43a7-99ea-c3f61ed26b50" containerName="prom-label-proxy" Jul 24 11:26:14.660237 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.660117 2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="249e6e6e-a7d0-43a7-99ea-c3f61ed26b50" containerName="prom-label-proxy" Jul 24 11:26:14.660237 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.660124 2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da7f7e41-9a8f-443d-a971-ad994fac52b1" containerName="console" Jul 24 11:26:14.660237 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.660129 2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="da7f7e41-9a8f-443d-a971-ad994fac52b1" containerName="console" Jul 24 11:26:14.660237 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.660135 2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58cf8cb4-73a0-4743-a007-142e6f3fa741" containerName="console" Jul 24 11:26:14.660237 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.660140 2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="58cf8cb4-73a0-4743-a007-142e6f3fa741" containerName="console" Jul 24 11:26:14.660237 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.660184 2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="249e6e6e-a7d0-43a7-99ea-c3f61ed26b50" containerName="kube-rbac-proxy" Jul 24 11:26:14.660237 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.660192 2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="58cf8cb4-73a0-4743-a007-142e6f3fa741" containerName="console" Jul 24 11:26:14.660237 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.660198 2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="249e6e6e-a7d0-43a7-99ea-c3f61ed26b50" containerName="alertmanager" Jul 24 11:26:14.660237 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.660206 2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="249e6e6e-a7d0-43a7-99ea-c3f61ed26b50" containerName="config-reloader" Jul 24 11:26:14.660237 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.660211 2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="249e6e6e-a7d0-43a7-99ea-c3f61ed26b50" containerName="prom-label-proxy" Jul 24 11:26:14.660237 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.660217 2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0fdbbf9-0615-4902-8830-1a1b60837c75" containerName="console" Jul 24 11:26:14.660237 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.660222 2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="249e6e6e-a7d0-43a7-99ea-c3f61ed26b50" containerName="kube-rbac-proxy-metric" Jul 24 11:26:14.660237 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.660227 2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="da7f7e41-9a8f-443d-a971-ad994fac52b1" containerName="console" Jul 24 11:26:14.660237 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.660232 2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="249e6e6e-a7d0-43a7-99ea-c3f61ed26b50" containerName="kube-rbac-proxy-web" Jul 24 11:26:14.664276 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.664257 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 24 11:26:14.666786 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.666768 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 24 11:26:14.666873 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.666770 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 24 11:26:14.667101 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.667080 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-f6bh8\"" Jul 24 11:26:14.667101 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.667095 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 24 11:26:14.667254 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.667128 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 24 11:26:14.667254 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.667128 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 24 11:26:14.667254 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.667080 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 24 11:26:14.667254 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.667209 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 24 11:26:14.667476 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.667367 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 24 11:26:14.672553 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.672531 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 24 11:26:14.680060 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.680034 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 24 11:26:14.749309 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.749269 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/cdc11576-1131-4b70-9303-39286a350051-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"cdc11576-1131-4b70-9303-39286a350051\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 11:26:14.749309 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.749318 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/cdc11576-1131-4b70-9303-39286a350051-config-volume\") pod \"alertmanager-main-0\" (UID: \"cdc11576-1131-4b70-9303-39286a350051\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 11:26:14.749487 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.749350 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cdc11576-1131-4b70-9303-39286a350051-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"cdc11576-1131-4b70-9303-39286a350051\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 11:26:14.749487 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.749370 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/cdc11576-1131-4b70-9303-39286a350051-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"cdc11576-1131-4b70-9303-39286a350051\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 11:26:14.749487 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.749392 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/cdc11576-1131-4b70-9303-39286a350051-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"cdc11576-1131-4b70-9303-39286a350051\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 11:26:14.749487 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.749418 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cdc11576-1131-4b70-9303-39286a350051-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"cdc11576-1131-4b70-9303-39286a350051\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 11:26:14.749667 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.749479 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mtnk\" (UniqueName: \"kubernetes.io/projected/cdc11576-1131-4b70-9303-39286a350051-kube-api-access-6mtnk\") pod \"alertmanager-main-0\" (UID: \"cdc11576-1131-4b70-9303-39286a350051\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 11:26:14.749667 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.749510 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cdc11576-1131-4b70-9303-39286a350051-tls-assets\") pod \"alertmanager-main-0\" (UID: \"cdc11576-1131-4b70-9303-39286a350051\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 11:26:14.749667 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.749532 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cdc11576-1131-4b70-9303-39286a350051-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"cdc11576-1131-4b70-9303-39286a350051\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 11:26:14.749667 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.749553 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cdc11576-1131-4b70-9303-39286a350051-config-out\") pod \"alertmanager-main-0\" (UID: \"cdc11576-1131-4b70-9303-39286a350051\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 11:26:14.749667 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.749594 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cdc11576-1131-4b70-9303-39286a350051-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"cdc11576-1131-4b70-9303-39286a350051\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 11:26:14.749667 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.749637 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cdc11576-1131-4b70-9303-39286a350051-web-config\") pod \"alertmanager-main-0\" (UID: \"cdc11576-1131-4b70-9303-39286a350051\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 11:26:14.749667 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.749661 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/cdc11576-1131-4b70-9303-39286a350051-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"cdc11576-1131-4b70-9303-39286a350051\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 11:26:14.850418 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.850372 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cdc11576-1131-4b70-9303-39286a350051-config-out\") pod \"alertmanager-main-0\" (UID: \"cdc11576-1131-4b70-9303-39286a350051\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 11:26:14.850418 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.850419 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cdc11576-1131-4b70-9303-39286a350051-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"cdc11576-1131-4b70-9303-39286a350051\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 11:26:14.850650 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.850437 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cdc11576-1131-4b70-9303-39286a350051-web-config\") pod \"alertmanager-main-0\" (UID: \"cdc11576-1131-4b70-9303-39286a350051\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 11:26:14.850650 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.850454 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/cdc11576-1131-4b70-9303-39286a350051-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"cdc11576-1131-4b70-9303-39286a350051\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 11:26:14.850650 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.850484 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/cdc11576-1131-4b70-9303-39286a350051-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"cdc11576-1131-4b70-9303-39286a350051\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 11:26:14.850650 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.850515 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/cdc11576-1131-4b70-9303-39286a350051-config-volume\") pod \"alertmanager-main-0\" (UID: \"cdc11576-1131-4b70-9303-39286a350051\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 11:26:14.850650 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.850539 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cdc11576-1131-4b70-9303-39286a350051-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"cdc11576-1131-4b70-9303-39286a350051\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 11:26:14.850650 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.850557 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/cdc11576-1131-4b70-9303-39286a350051-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"cdc11576-1131-4b70-9303-39286a350051\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 11:26:14.850929 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.850684 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/cdc11576-1131-4b70-9303-39286a350051-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"cdc11576-1131-4b70-9303-39286a350051\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 11:26:14.850929 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.850728 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cdc11576-1131-4b70-9303-39286a350051-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"cdc11576-1131-4b70-9303-39286a350051\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 11:26:14.850929 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.850759 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mtnk\" (UniqueName: \"kubernetes.io/projected/cdc11576-1131-4b70-9303-39286a350051-kube-api-access-6mtnk\") pod \"alertmanager-main-0\" (UID: \"cdc11576-1131-4b70-9303-39286a350051\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 11:26:14.850929 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.850785 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cdc11576-1131-4b70-9303-39286a350051-tls-assets\") pod \"alertmanager-main-0\" (UID: \"cdc11576-1131-4b70-9303-39286a350051\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 11:26:14.850929 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.850811 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cdc11576-1131-4b70-9303-39286a350051-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"cdc11576-1131-4b70-9303-39286a350051\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 11:26:14.851244 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.850954 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/cdc11576-1131-4b70-9303-39286a350051-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"cdc11576-1131-4b70-9303-39286a350051\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 11:26:14.851398 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.851374 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cdc11576-1131-4b70-9303-39286a350051-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"cdc11576-1131-4b70-9303-39286a350051\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 11:26:14.851606 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.851565 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cdc11576-1131-4b70-9303-39286a350051-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"cdc11576-1131-4b70-9303-39286a350051\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 11:26:14.853685 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.853626 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cdc11576-1131-4b70-9303-39286a350051-config-out\") pod \"alertmanager-main-0\" (UID: \"cdc11576-1131-4b70-9303-39286a350051\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 11:26:14.853685 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.853651 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/cdc11576-1131-4b70-9303-39286a350051-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"cdc11576-1131-4b70-9303-39286a350051\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 11:26:14.853842 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.853689 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cdc11576-1131-4b70-9303-39286a350051-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"cdc11576-1131-4b70-9303-39286a350051\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 11:26:14.853842 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.853816 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cdc11576-1131-4b70-9303-39286a350051-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"cdc11576-1131-4b70-9303-39286a350051\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 11:26:14.853842 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.853827 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cdc11576-1131-4b70-9303-39286a350051-web-config\") pod \"alertmanager-main-0\" (UID: \"cdc11576-1131-4b70-9303-39286a350051\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 11:26:14.854257 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.854235 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cdc11576-1131-4b70-9303-39286a350051-tls-assets\") pod \"alertmanager-main-0\" (UID: \"cdc11576-1131-4b70-9303-39286a350051\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 11:26:14.854297 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.854286 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/cdc11576-1131-4b70-9303-39286a350051-config-volume\") pod \"alertmanager-main-0\" (UID: \"cdc11576-1131-4b70-9303-39286a350051\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 11:26:14.854361 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.854347 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/cdc11576-1131-4b70-9303-39286a350051-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"cdc11576-1131-4b70-9303-39286a350051\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 11:26:14.855485 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.855468 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/cdc11576-1131-4b70-9303-39286a350051-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"cdc11576-1131-4b70-9303-39286a350051\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 11:26:14.860244 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.860225 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mtnk\" (UniqueName: \"kubernetes.io/projected/cdc11576-1131-4b70-9303-39286a350051-kube-api-access-6mtnk\") pod \"alertmanager-main-0\" (UID: \"cdc11576-1131-4b70-9303-39286a350051\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 11:26:14.975625 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:14.975556 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 24 11:26:15.116969 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:15.116942 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 24 11:26:15.119293 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:26:15.119265 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdc11576_1131_4b70_9303_39286a350051.slice/crio-e522348f453cc43a66f4af48b8d5a5b325a16d8181c2b9cd84148c503f9a7b2b WatchSource:0}: Error finding container e522348f453cc43a66f4af48b8d5a5b325a16d8181c2b9cd84148c503f9a7b2b: Status 404 returned error can't find the container with id e522348f453cc43a66f4af48b8d5a5b325a16d8181c2b9cd84148c503f9a7b2b Jul 24 11:26:15.607279 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:15.607236 2586 generic.go:356] "Generic (PLEG): container finished" podID="cdc11576-1131-4b70-9303-39286a350051" containerID="dadd745a8f7ac1b7de28f3cb1386c871c9f69e85c56b720556cec4d97b087025" exitCode=0 Jul 24 11:26:15.607463 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:15.607319 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cdc11576-1131-4b70-9303-39286a350051","Type":"ContainerDied","Data":"dadd745a8f7ac1b7de28f3cb1386c871c9f69e85c56b720556cec4d97b087025"} Jul 24 11:26:15.607463 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:15.607385 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cdc11576-1131-4b70-9303-39286a350051","Type":"ContainerStarted","Data":"e522348f453cc43a66f4af48b8d5a5b325a16d8181c2b9cd84148c503f9a7b2b"} Jul 24 11:26:15.684535 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:15.684507 2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="249e6e6e-a7d0-43a7-99ea-c3f61ed26b50" path="/var/lib/kubelet/pods/249e6e6e-a7d0-43a7-99ea-c3f61ed26b50/volumes" Jul 24 11:26:16.616065 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:16.616030 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cdc11576-1131-4b70-9303-39286a350051","Type":"ContainerStarted","Data":"159e6fa9f09aae0758cc14a5f39e52bf27da160c80e3cd8340d4bfdf05b6daad"} Jul 24 11:26:16.616458 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:16.616129 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cdc11576-1131-4b70-9303-39286a350051","Type":"ContainerStarted","Data":"7b9da058724281ca539118a01ed76d818960220f3f1973b5fb241a748216a6c1"} Jul 24 11:26:16.616458 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:16.616168 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cdc11576-1131-4b70-9303-39286a350051","Type":"ContainerStarted","Data":"36518fe38f25494af3cbe14067a0d29434776056a6818a55960584e990f0c616"} Jul 24 11:26:16.616458 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:16.616196 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cdc11576-1131-4b70-9303-39286a350051","Type":"ContainerStarted","Data":"a5ad0c15c8a40db8ee7b0785770b875a02fe824a13c0c2a8b89883d936d54a27"} Jul 24 11:26:16.616458 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:16.616218 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cdc11576-1131-4b70-9303-39286a350051","Type":"ContainerStarted","Data":"e0ae36237ee7e6f41d5b7d5625d31b799464de9927b91202ea6380bc2f51b9cd"} Jul 24 11:26:16.616458 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:16.616255 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cdc11576-1131-4b70-9303-39286a350051","Type":"ContainerStarted","Data":"79b0df070b6a5cc3fbc930e3cdcbd5f89fe1886efb7160599d7bb3d58e45e5dc"} Jul 24 11:26:16.643898 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:16.643841 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.6305010319999997 podStartE2EDuration="2.643821227s" totalImagesPullingTime="0s" totalInitContainerRuntime="13.320195ms" isStatefulPod=false podCreationTimestamp="2026-07-24 11:26:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 11:26:16.641946129 +0000 UTC m=+167.660000676" watchObservedRunningTime="2026-07-24 11:26:16.643821227 +0000 UTC m=+167.661875774" Jul 24 11:26:17.173139 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.173104 2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 24 11:26:17.173437 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.173406 2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="cfd2e8a7-2990-40c3-9380-2dd24484e351" containerName="prometheus" containerID="cri-o://0cdd0217baf75e5aa2658f150cc91128534f386928e7e2ffcc1b727c72ee120d" gracePeriod=600 Jul 24 11:26:17.173531 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.173450 2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="cfd2e8a7-2990-40c3-9380-2dd24484e351" containerName="kube-rbac-proxy" containerID="cri-o://cffa7eea18101b7071533f73f7fca4d066b906bce0492c9235913d6cddadcbaf" gracePeriod=600 Jul 24 11:26:17.173531 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.173493 2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="cfd2e8a7-2990-40c3-9380-2dd24484e351" containerName="kube-rbac-proxy-thanos" containerID="cri-o://59106c718c84834bf701d3b49f9c7aaf9108f8b2741e1f68f1b48d7acf9fb5e9" gracePeriod=600 Jul 24 11:26:17.173670 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.173524 2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="cfd2e8a7-2990-40c3-9380-2dd24484e351" containerName="thanos-sidecar" containerID="cri-o://7dd9bfed91e438371f59d12d258331d553a787f1abe26595903834f47ed3f985" gracePeriod=600 Jul 24 11:26:17.173670 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.173468 2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="cfd2e8a7-2990-40c3-9380-2dd24484e351" containerName="kube-rbac-proxy-web" containerID="cri-o://3a68ef515baad11890f86afd3820c6bd0f45affc60c3e9b1589b61896e62a6a6" gracePeriod=600 Jul 24 11:26:17.173670 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.173460 2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="cfd2e8a7-2990-40c3-9380-2dd24484e351" containerName="config-reloader" containerID="cri-o://876256856ea1cf89a565e0872c4ab9b657c7eb3c4fb10dd2e6e08a417554f7ee" gracePeriod=600 Jul 24 11:26:17.528051 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.528026 2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:26:17.576649 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.576616 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/cfd2e8a7-2990-40c3-9380-2dd24484e351-prometheus-k8s-rulefiles-1\") pod \"cfd2e8a7-2990-40c3-9380-2dd24484e351\" (UID: \"cfd2e8a7-2990-40c3-9380-2dd24484e351\") " Jul 24 11:26:17.576825 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.576673 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cfd2e8a7-2990-40c3-9380-2dd24484e351-config-out\") pod \"cfd2e8a7-2990-40c3-9380-2dd24484e351\" (UID: \"cfd2e8a7-2990-40c3-9380-2dd24484e351\") " Jul 24 11:26:17.576825 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.576719 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cfd2e8a7-2990-40c3-9380-2dd24484e351-configmap-kubelet-serving-ca-bundle\") pod \"cfd2e8a7-2990-40c3-9380-2dd24484e351\" (UID: \"cfd2e8a7-2990-40c3-9380-2dd24484e351\") " Jul 24 11:26:17.576825 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.576749 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/cfd2e8a7-2990-40c3-9380-2dd24484e351-prometheus-k8s-rulefiles-0\") pod \"cfd2e8a7-2990-40c3-9380-2dd24484e351\" (UID: \"cfd2e8a7-2990-40c3-9380-2dd24484e351\") " Jul 24 11:26:17.576825 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.576772 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cfd2e8a7-2990-40c3-9380-2dd24484e351-web-config\") pod \"cfd2e8a7-2990-40c3-9380-2dd24484e351\" (UID: \"cfd2e8a7-2990-40c3-9380-2dd24484e351\") " Jul 24 11:26:17.576825 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.576798 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/cfd2e8a7-2990-40c3-9380-2dd24484e351-thanos-prometheus-http-client-file\") pod \"cfd2e8a7-2990-40c3-9380-2dd24484e351\" (UID: \"cfd2e8a7-2990-40c3-9380-2dd24484e351\") " Jul 24 11:26:17.576825 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.576820 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cfd2e8a7-2990-40c3-9380-2dd24484e351-secret-kube-rbac-proxy\") pod \"cfd2e8a7-2990-40c3-9380-2dd24484e351\" (UID: \"cfd2e8a7-2990-40c3-9380-2dd24484e351\") " Jul 24 11:26:17.577131 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.576846 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l2xjk\" (UniqueName: \"kubernetes.io/projected/cfd2e8a7-2990-40c3-9380-2dd24484e351-kube-api-access-l2xjk\") pod \"cfd2e8a7-2990-40c3-9380-2dd24484e351\" (UID: \"cfd2e8a7-2990-40c3-9380-2dd24484e351\") " Jul 24 11:26:17.577131 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.576884 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/cfd2e8a7-2990-40c3-9380-2dd24484e351-config\") pod \"cfd2e8a7-2990-40c3-9380-2dd24484e351\" (UID: \"cfd2e8a7-2990-40c3-9380-2dd24484e351\") " Jul 24 11:26:17.577131 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.576909 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cfd2e8a7-2990-40c3-9380-2dd24484e351-secret-grpc-tls\") pod \"cfd2e8a7-2990-40c3-9380-2dd24484e351\" (UID: \"cfd2e8a7-2990-40c3-9380-2dd24484e351\") " Jul 24 11:26:17.577131 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.576936 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cfd2e8a7-2990-40c3-9380-2dd24484e351-tls-assets\") pod \"cfd2e8a7-2990-40c3-9380-2dd24484e351\" (UID: \"cfd2e8a7-2990-40c3-9380-2dd24484e351\") " Jul 24 11:26:17.577131 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.576960 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cfd2e8a7-2990-40c3-9380-2dd24484e351-prometheus-trusted-ca-bundle\") pod \"cfd2e8a7-2990-40c3-9380-2dd24484e351\" (UID: \"cfd2e8a7-2990-40c3-9380-2dd24484e351\") " Jul 24 11:26:17.577131 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.576994 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cfd2e8a7-2990-40c3-9380-2dd24484e351-configmap-serving-certs-ca-bundle\") pod \"cfd2e8a7-2990-40c3-9380-2dd24484e351\" (UID: \"cfd2e8a7-2990-40c3-9380-2dd24484e351\") " Jul 24 11:26:17.577131 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.577015 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cfd2e8a7-2990-40c3-9380-2dd24484e351-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "cfd2e8a7-2990-40c3-9380-2dd24484e351" (UID: "cfd2e8a7-2990-40c3-9380-2dd24484e351"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 11:26:17.577131 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.577040 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cfd2e8a7-2990-40c3-9380-2dd24484e351-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"cfd2e8a7-2990-40c3-9380-2dd24484e351\" (UID: \"cfd2e8a7-2990-40c3-9380-2dd24484e351\") " Jul 24 11:26:17.577131 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.577087 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/cfd2e8a7-2990-40c3-9380-2dd24484e351-prometheus-k8s-rulefiles-2\") pod \"cfd2e8a7-2990-40c3-9380-2dd24484e351\" (UID: \"cfd2e8a7-2990-40c3-9380-2dd24484e351\") " Jul 24 11:26:17.577131 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.577112 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/cfd2e8a7-2990-40c3-9380-2dd24484e351-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"cfd2e8a7-2990-40c3-9380-2dd24484e351\" (UID: \"cfd2e8a7-2990-40c3-9380-2dd24484e351\") " Jul 24 11:26:17.577683 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.577144 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cfd2e8a7-2990-40c3-9380-2dd24484e351-configmap-metrics-client-ca\") pod \"cfd2e8a7-2990-40c3-9380-2dd24484e351\" (UID: \"cfd2e8a7-2990-40c3-9380-2dd24484e351\") " Jul 24 11:26:17.577683 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.577180 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/cfd2e8a7-2990-40c3-9380-2dd24484e351-prometheus-k8s-db\") pod \"cfd2e8a7-2990-40c3-9380-2dd24484e351\" (UID: \"cfd2e8a7-2990-40c3-9380-2dd24484e351\") " Jul 24 11:26:17.577683 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.577223 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/cfd2e8a7-2990-40c3-9380-2dd24484e351-secret-prometheus-k8s-tls\") pod \"cfd2e8a7-2990-40c3-9380-2dd24484e351\" (UID: \"cfd2e8a7-2990-40c3-9380-2dd24484e351\") " Jul 24 11:26:17.577683 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.577248 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/cfd2e8a7-2990-40c3-9380-2dd24484e351-secret-metrics-client-certs\") pod \"cfd2e8a7-2990-40c3-9380-2dd24484e351\" (UID: \"cfd2e8a7-2990-40c3-9380-2dd24484e351\") " Jul 24 11:26:17.577683 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.577394 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cfd2e8a7-2990-40c3-9380-2dd24484e351-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "cfd2e8a7-2990-40c3-9380-2dd24484e351" (UID: "cfd2e8a7-2990-40c3-9380-2dd24484e351"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 11:26:17.577683 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.577556 2586 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cfd2e8a7-2990-40c3-9380-2dd24484e351-prometheus-trusted-ca-bundle\") on node \"ip-10-0-137-219.ec2.internal\" DevicePath \"\"" Jul 24 11:26:17.577683 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.577600 2586 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/cfd2e8a7-2990-40c3-9380-2dd24484e351-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-137-219.ec2.internal\" DevicePath \"\"" Jul 24 11:26:17.577683 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.577649 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cfd2e8a7-2990-40c3-9380-2dd24484e351-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "cfd2e8a7-2990-40c3-9380-2dd24484e351" (UID: "cfd2e8a7-2990-40c3-9380-2dd24484e351"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 11:26:17.578140 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.578116 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cfd2e8a7-2990-40c3-9380-2dd24484e351-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "cfd2e8a7-2990-40c3-9380-2dd24484e351" (UID: "cfd2e8a7-2990-40c3-9380-2dd24484e351"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 11:26:17.578736 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.578460 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cfd2e8a7-2990-40c3-9380-2dd24484e351-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "cfd2e8a7-2990-40c3-9380-2dd24484e351" (UID: "cfd2e8a7-2990-40c3-9380-2dd24484e351"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 11:26:17.579723 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.579427 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cfd2e8a7-2990-40c3-9380-2dd24484e351-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "cfd2e8a7-2990-40c3-9380-2dd24484e351" (UID: "cfd2e8a7-2990-40c3-9380-2dd24484e351"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 11:26:17.579939 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.579874 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cfd2e8a7-2990-40c3-9380-2dd24484e351-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "cfd2e8a7-2990-40c3-9380-2dd24484e351" (UID: "cfd2e8a7-2990-40c3-9380-2dd24484e351"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 11:26:17.580052 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.580032 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cfd2e8a7-2990-40c3-9380-2dd24484e351-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "cfd2e8a7-2990-40c3-9380-2dd24484e351" (UID: "cfd2e8a7-2990-40c3-9380-2dd24484e351"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 11:26:17.580113 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.580065 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cfd2e8a7-2990-40c3-9380-2dd24484e351-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "cfd2e8a7-2990-40c3-9380-2dd24484e351" (UID: "cfd2e8a7-2990-40c3-9380-2dd24484e351"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 11:26:17.580313 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.580273 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cfd2e8a7-2990-40c3-9380-2dd24484e351-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "cfd2e8a7-2990-40c3-9380-2dd24484e351" (UID: "cfd2e8a7-2990-40c3-9380-2dd24484e351"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 11:26:17.580796 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.580769 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cfd2e8a7-2990-40c3-9380-2dd24484e351-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "cfd2e8a7-2990-40c3-9380-2dd24484e351" (UID: "cfd2e8a7-2990-40c3-9380-2dd24484e351"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 11:26:17.580897 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.580847 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cfd2e8a7-2990-40c3-9380-2dd24484e351-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "cfd2e8a7-2990-40c3-9380-2dd24484e351" (UID: "cfd2e8a7-2990-40c3-9380-2dd24484e351"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 11:26:17.581333 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.581289 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cfd2e8a7-2990-40c3-9380-2dd24484e351-kube-api-access-l2xjk" (OuterVolumeSpecName: "kube-api-access-l2xjk") pod "cfd2e8a7-2990-40c3-9380-2dd24484e351" (UID: "cfd2e8a7-2990-40c3-9380-2dd24484e351"). InnerVolumeSpecName "kube-api-access-l2xjk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 11:26:17.581998 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.581974 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cfd2e8a7-2990-40c3-9380-2dd24484e351-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "cfd2e8a7-2990-40c3-9380-2dd24484e351" (UID: "cfd2e8a7-2990-40c3-9380-2dd24484e351"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 11:26:17.582153 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.582113 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cfd2e8a7-2990-40c3-9380-2dd24484e351-config-out" (OuterVolumeSpecName: "config-out") pod "cfd2e8a7-2990-40c3-9380-2dd24484e351" (UID: "cfd2e8a7-2990-40c3-9380-2dd24484e351"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 11:26:17.582428 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.582388 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cfd2e8a7-2990-40c3-9380-2dd24484e351-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "cfd2e8a7-2990-40c3-9380-2dd24484e351" (UID: "cfd2e8a7-2990-40c3-9380-2dd24484e351"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 11:26:17.582521 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.582476 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cfd2e8a7-2990-40c3-9380-2dd24484e351-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "cfd2e8a7-2990-40c3-9380-2dd24484e351" (UID: "cfd2e8a7-2990-40c3-9380-2dd24484e351"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 11:26:17.582850 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.582826 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cfd2e8a7-2990-40c3-9380-2dd24484e351-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "cfd2e8a7-2990-40c3-9380-2dd24484e351" (UID: "cfd2e8a7-2990-40c3-9380-2dd24484e351"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 11:26:17.583354 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.583331 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cfd2e8a7-2990-40c3-9380-2dd24484e351-config" (OuterVolumeSpecName: "config") pod "cfd2e8a7-2990-40c3-9380-2dd24484e351" (UID: "cfd2e8a7-2990-40c3-9380-2dd24484e351"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 11:26:17.592934 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.592912 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cfd2e8a7-2990-40c3-9380-2dd24484e351-web-config" (OuterVolumeSpecName: "web-config") pod "cfd2e8a7-2990-40c3-9380-2dd24484e351" (UID: "cfd2e8a7-2990-40c3-9380-2dd24484e351"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 11:26:17.623500 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.623466 2586 generic.go:356] "Generic (PLEG): container finished" podID="cfd2e8a7-2990-40c3-9380-2dd24484e351" containerID="59106c718c84834bf701d3b49f9c7aaf9108f8b2741e1f68f1b48d7acf9fb5e9" exitCode=0 Jul 24 11:26:17.623500 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.623493 2586 generic.go:356] "Generic (PLEG): container finished" podID="cfd2e8a7-2990-40c3-9380-2dd24484e351" containerID="cffa7eea18101b7071533f73f7fca4d066b906bce0492c9235913d6cddadcbaf" exitCode=0 Jul 24 11:26:17.623500 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.623500 2586 generic.go:356] "Generic (PLEG): container finished" podID="cfd2e8a7-2990-40c3-9380-2dd24484e351" containerID="3a68ef515baad11890f86afd3820c6bd0f45affc60c3e9b1589b61896e62a6a6" exitCode=0 Jul 24 11:26:17.623500 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.623508 2586 generic.go:356] "Generic (PLEG): container finished" podID="cfd2e8a7-2990-40c3-9380-2dd24484e351" containerID="7dd9bfed91e438371f59d12d258331d553a787f1abe26595903834f47ed3f985" exitCode=0 Jul 24 11:26:17.623994 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.623513 2586 generic.go:356] "Generic (PLEG): container finished" podID="cfd2e8a7-2990-40c3-9380-2dd24484e351" containerID="876256856ea1cf89a565e0872c4ab9b657c7eb3c4fb10dd2e6e08a417554f7ee" exitCode=0 Jul 24 11:26:17.623994 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.623519 2586 generic.go:356] "Generic (PLEG): container finished" podID="cfd2e8a7-2990-40c3-9380-2dd24484e351" containerID="0cdd0217baf75e5aa2658f150cc91128534f386928e7e2ffcc1b727c72ee120d" exitCode=0 Jul 24 11:26:17.623994 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.623539 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cfd2e8a7-2990-40c3-9380-2dd24484e351","Type":"ContainerDied","Data":"59106c718c84834bf701d3b49f9c7aaf9108f8b2741e1f68f1b48d7acf9fb5e9"} Jul 24 11:26:17.623994 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.623555 2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:26:17.623994 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.623618 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cfd2e8a7-2990-40c3-9380-2dd24484e351","Type":"ContainerDied","Data":"cffa7eea18101b7071533f73f7fca4d066b906bce0492c9235913d6cddadcbaf"} Jul 24 11:26:17.623994 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.623648 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cfd2e8a7-2990-40c3-9380-2dd24484e351","Type":"ContainerDied","Data":"3a68ef515baad11890f86afd3820c6bd0f45affc60c3e9b1589b61896e62a6a6"} Jul 24 11:26:17.623994 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.623673 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cfd2e8a7-2990-40c3-9380-2dd24484e351","Type":"ContainerDied","Data":"7dd9bfed91e438371f59d12d258331d553a787f1abe26595903834f47ed3f985"} Jul 24 11:26:17.623994 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.623691 2586 scope.go:117] "RemoveContainer" containerID="59106c718c84834bf701d3b49f9c7aaf9108f8b2741e1f68f1b48d7acf9fb5e9" Jul 24 11:26:17.623994 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.623696 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cfd2e8a7-2990-40c3-9380-2dd24484e351","Type":"ContainerDied","Data":"876256856ea1cf89a565e0872c4ab9b657c7eb3c4fb10dd2e6e08a417554f7ee"} Jul 24 11:26:17.623994 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.623792 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cfd2e8a7-2990-40c3-9380-2dd24484e351","Type":"ContainerDied","Data":"0cdd0217baf75e5aa2658f150cc91128534f386928e7e2ffcc1b727c72ee120d"} Jul 24 11:26:17.623994 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.623816 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cfd2e8a7-2990-40c3-9380-2dd24484e351","Type":"ContainerDied","Data":"0f3a9930fc7390d395ad18a6d17d2727c4233c984b9b9df2ccf1c8874897fe03"} Jul 24 11:26:17.631933 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.631917 2586 scope.go:117] "RemoveContainer" containerID="cffa7eea18101b7071533f73f7fca4d066b906bce0492c9235913d6cddadcbaf" Jul 24 11:26:17.639188 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.639173 2586 scope.go:117] "RemoveContainer" containerID="3a68ef515baad11890f86afd3820c6bd0f45affc60c3e9b1589b61896e62a6a6" Jul 24 11:26:17.646390 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.646296 2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 24 11:26:17.646463 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.646433 2586 scope.go:117] "RemoveContainer" containerID="7dd9bfed91e438371f59d12d258331d553a787f1abe26595903834f47ed3f985" Jul 24 11:26:17.666599 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.651725 2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 24 11:26:17.676920 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.676887 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 24 11:26:17.677265 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.677241 2586 scope.go:117] "RemoveContainer" containerID="876256856ea1cf89a565e0872c4ab9b657c7eb3c4fb10dd2e6e08a417554f7ee" Jul 24 11:26:17.677372 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.677267 2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cfd2e8a7-2990-40c3-9380-2dd24484e351" containerName="prometheus" Jul 24 11:26:17.677372 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.677280 2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="cfd2e8a7-2990-40c3-9380-2dd24484e351" containerName="prometheus" Jul 24 11:26:17.677372 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.677288 2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cfd2e8a7-2990-40c3-9380-2dd24484e351" containerName="kube-rbac-proxy-thanos" Jul 24 11:26:17.677372 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.677295 2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="cfd2e8a7-2990-40c3-9380-2dd24484e351" containerName="kube-rbac-proxy-thanos" Jul 24 11:26:17.677372 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.677311 2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cfd2e8a7-2990-40c3-9380-2dd24484e351" containerName="config-reloader" Jul 24 11:26:17.677372 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.677320 2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="cfd2e8a7-2990-40c3-9380-2dd24484e351" containerName="config-reloader" Jul 24 11:26:17.677372 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.677326 2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cfd2e8a7-2990-40c3-9380-2dd24484e351" containerName="thanos-sidecar" Jul 24 11:26:17.677372 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.677332 2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="cfd2e8a7-2990-40c3-9380-2dd24484e351" containerName="thanos-sidecar" Jul 24 11:26:17.677372 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.677346 2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cfd2e8a7-2990-40c3-9380-2dd24484e351" containerName="kube-rbac-proxy" Jul 24 11:26:17.677372 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.677352 2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="cfd2e8a7-2990-40c3-9380-2dd24484e351" containerName="kube-rbac-proxy" Jul 24 11:26:17.677372 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.677367 2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cfd2e8a7-2990-40c3-9380-2dd24484e351" containerName="init-config-reloader" Jul 24 11:26:17.677372 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.677377 2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="cfd2e8a7-2990-40c3-9380-2dd24484e351" containerName="init-config-reloader" Jul 24 11:26:17.677842 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.677389 2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cfd2e8a7-2990-40c3-9380-2dd24484e351" containerName="kube-rbac-proxy-web" Jul 24 11:26:17.677842 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.677395 2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="cfd2e8a7-2990-40c3-9380-2dd24484e351" containerName="kube-rbac-proxy-web" Jul 24 11:26:17.677842 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.677443 2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="cfd2e8a7-2990-40c3-9380-2dd24484e351" containerName="kube-rbac-proxy-thanos" Jul 24 11:26:17.677842 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.677451 2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="cfd2e8a7-2990-40c3-9380-2dd24484e351" containerName="kube-rbac-proxy-web" Jul 24 11:26:17.677842 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.677460 2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="cfd2e8a7-2990-40c3-9380-2dd24484e351" containerName="kube-rbac-proxy" Jul 24 11:26:17.677842 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.677469 2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="cfd2e8a7-2990-40c3-9380-2dd24484e351" containerName="thanos-sidecar" Jul 24 11:26:17.677842 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.677475 2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="cfd2e8a7-2990-40c3-9380-2dd24484e351" containerName="config-reloader" Jul 24 11:26:17.677842 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.677481 2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="cfd2e8a7-2990-40c3-9380-2dd24484e351" containerName="prometheus" Jul 24 11:26:17.678345 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.678224 2586 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/cfd2e8a7-2990-40c3-9380-2dd24484e351-prometheus-k8s-db\") on node \"ip-10-0-137-219.ec2.internal\" DevicePath \"\"" Jul 24 11:26:17.678345 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.678248 2586 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/cfd2e8a7-2990-40c3-9380-2dd24484e351-secret-prometheus-k8s-tls\") on node \"ip-10-0-137-219.ec2.internal\" DevicePath \"\"" Jul 24 11:26:17.678345 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.678265 2586 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/cfd2e8a7-2990-40c3-9380-2dd24484e351-secret-metrics-client-certs\") on node \"ip-10-0-137-219.ec2.internal\" DevicePath \"\"" Jul 24 11:26:17.678345 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.678280 2586 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cfd2e8a7-2990-40c3-9380-2dd24484e351-config-out\") on node \"ip-10-0-137-219.ec2.internal\" DevicePath \"\"" Jul 24 11:26:17.678345 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.678296 2586 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cfd2e8a7-2990-40c3-9380-2dd24484e351-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-137-219.ec2.internal\" DevicePath \"\"" Jul 24 11:26:17.678345 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.678311 2586 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/cfd2e8a7-2990-40c3-9380-2dd24484e351-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-137-219.ec2.internal\" DevicePath \"\"" Jul 24 11:26:17.678345 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.678328 2586 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cfd2e8a7-2990-40c3-9380-2dd24484e351-web-config\") on node \"ip-10-0-137-219.ec2.internal\" DevicePath \"\"" Jul 24 11:26:17.678345 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.678343 2586 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/cfd2e8a7-2990-40c3-9380-2dd24484e351-thanos-prometheus-http-client-file\") on node \"ip-10-0-137-219.ec2.internal\" DevicePath \"\"" Jul 24 11:26:17.679176 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.678357 2586 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cfd2e8a7-2990-40c3-9380-2dd24484e351-secret-kube-rbac-proxy\") on node \"ip-10-0-137-219.ec2.internal\" DevicePath \"\"" Jul 24 11:26:17.679176 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.678369 2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l2xjk\" (UniqueName: \"kubernetes.io/projected/cfd2e8a7-2990-40c3-9380-2dd24484e351-kube-api-access-l2xjk\") on node \"ip-10-0-137-219.ec2.internal\" DevicePath \"\"" Jul 24 11:26:17.679176 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.678382 2586 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/cfd2e8a7-2990-40c3-9380-2dd24484e351-config\") on node \"ip-10-0-137-219.ec2.internal\" DevicePath \"\"" Jul 24 11:26:17.679176 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.678395 2586 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cfd2e8a7-2990-40c3-9380-2dd24484e351-secret-grpc-tls\") on node \"ip-10-0-137-219.ec2.internal\" DevicePath \"\"" Jul 24 11:26:17.679176 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.678408 2586 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cfd2e8a7-2990-40c3-9380-2dd24484e351-tls-assets\") on node \"ip-10-0-137-219.ec2.internal\" DevicePath \"\"" Jul 24 11:26:17.679176 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.678422 2586 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cfd2e8a7-2990-40c3-9380-2dd24484e351-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-137-219.ec2.internal\" DevicePath \"\"" Jul 24 11:26:17.679176 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.678436 2586 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cfd2e8a7-2990-40c3-9380-2dd24484e351-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-137-219.ec2.internal\" DevicePath \"\"" Jul 24 11:26:17.679176 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.678451 2586 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/cfd2e8a7-2990-40c3-9380-2dd24484e351-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-137-219.ec2.internal\" DevicePath \"\"" Jul 24 11:26:17.679176 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.678466 2586 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/cfd2e8a7-2990-40c3-9380-2dd24484e351-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-137-219.ec2.internal\" DevicePath \"\"" Jul 24 11:26:17.679176 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.678481 2586 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cfd2e8a7-2990-40c3-9380-2dd24484e351-configmap-metrics-client-ca\") on node \"ip-10-0-137-219.ec2.internal\" DevicePath \"\"" Jul 24 11:26:17.682162 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.682142 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:26:17.686277 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.685531 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 24 11:26:17.686277 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.685630 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-zgzsd\"" Jul 24 11:26:17.686277 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.686217 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 24 11:26:17.687814 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.687789 2586 scope.go:117] "RemoveContainer" containerID="0cdd0217baf75e5aa2658f150cc91128534f386928e7e2ffcc1b727c72ee120d" Jul 24 11:26:17.688155 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.688077 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 24 11:26:17.692164 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.690080 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-ap7vn0t29p6od\"" Jul 24 11:26:17.692164 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.690408 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 24 11:26:17.692164 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.690744 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 24 11:26:17.692164 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.690819 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 24 11:26:17.692164 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.691094 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 24 11:26:17.692164 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.691128 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 24 11:26:17.692164 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.691558 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 24 11:26:17.692164 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.691989 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 24 11:26:17.693816 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.692229 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 24 11:26:17.693816 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.692533 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 24 11:26:17.697103 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.696809 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 24 11:26:17.700157 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.698247 2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cfd2e8a7-2990-40c3-9380-2dd24484e351" path="/var/lib/kubelet/pods/cfd2e8a7-2990-40c3-9380-2dd24484e351/volumes" Jul 24 11:26:17.700420 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.700399 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 24 11:26:17.700686 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.700655 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 24 11:26:17.706794 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.706777 2586 scope.go:117] "RemoveContainer" containerID="b980fa9f903440e717f23633eae33df47d8c8d95c5efb1b15a3d4c84b5f1f536" Jul 24 11:26:17.713916 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.713898 2586 scope.go:117] "RemoveContainer" containerID="59106c718c84834bf701d3b49f9c7aaf9108f8b2741e1f68f1b48d7acf9fb5e9" Jul 24 11:26:17.714197 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:26:17.714171 2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"59106c718c84834bf701d3b49f9c7aaf9108f8b2741e1f68f1b48d7acf9fb5e9\": container with ID starting with 59106c718c84834bf701d3b49f9c7aaf9108f8b2741e1f68f1b48d7acf9fb5e9 not found: ID does not exist" containerID="59106c718c84834bf701d3b49f9c7aaf9108f8b2741e1f68f1b48d7acf9fb5e9" Jul 24 11:26:17.714275 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.714212 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59106c718c84834bf701d3b49f9c7aaf9108f8b2741e1f68f1b48d7acf9fb5e9"} err="failed to get container status \"59106c718c84834bf701d3b49f9c7aaf9108f8b2741e1f68f1b48d7acf9fb5e9\": rpc error: code = NotFound desc = could not find container \"59106c718c84834bf701d3b49f9c7aaf9108f8b2741e1f68f1b48d7acf9fb5e9\": container with ID starting with 59106c718c84834bf701d3b49f9c7aaf9108f8b2741e1f68f1b48d7acf9fb5e9 not found: ID does not exist" Jul 24 11:26:17.714275 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.714261 2586 scope.go:117] "RemoveContainer" containerID="cffa7eea18101b7071533f73f7fca4d066b906bce0492c9235913d6cddadcbaf" Jul 24 11:26:17.715352 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:26:17.714612 2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cffa7eea18101b7071533f73f7fca4d066b906bce0492c9235913d6cddadcbaf\": container with ID starting with cffa7eea18101b7071533f73f7fca4d066b906bce0492c9235913d6cddadcbaf not found: ID does not exist" containerID="cffa7eea18101b7071533f73f7fca4d066b906bce0492c9235913d6cddadcbaf" Jul 24 11:26:17.715352 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.714699 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cffa7eea18101b7071533f73f7fca4d066b906bce0492c9235913d6cddadcbaf"} err="failed to get container status \"cffa7eea18101b7071533f73f7fca4d066b906bce0492c9235913d6cddadcbaf\": rpc error: code = NotFound desc = could not find container \"cffa7eea18101b7071533f73f7fca4d066b906bce0492c9235913d6cddadcbaf\": container with ID starting with cffa7eea18101b7071533f73f7fca4d066b906bce0492c9235913d6cddadcbaf not found: ID does not exist" Jul 24 11:26:17.715352 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.714747 2586 scope.go:117] "RemoveContainer" containerID="3a68ef515baad11890f86afd3820c6bd0f45affc60c3e9b1589b61896e62a6a6" Jul 24 11:26:17.715352 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:26:17.715073 2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a68ef515baad11890f86afd3820c6bd0f45affc60c3e9b1589b61896e62a6a6\": container with ID starting with 3a68ef515baad11890f86afd3820c6bd0f45affc60c3e9b1589b61896e62a6a6 not found: ID does not exist" containerID="3a68ef515baad11890f86afd3820c6bd0f45affc60c3e9b1589b61896e62a6a6" Jul 24 11:26:17.715352 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.715300 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a68ef515baad11890f86afd3820c6bd0f45affc60c3e9b1589b61896e62a6a6"} err="failed to get container status \"3a68ef515baad11890f86afd3820c6bd0f45affc60c3e9b1589b61896e62a6a6\": rpc error: code = NotFound desc = could not find container \"3a68ef515baad11890f86afd3820c6bd0f45affc60c3e9b1589b61896e62a6a6\": container with ID starting with 3a68ef515baad11890f86afd3820c6bd0f45affc60c3e9b1589b61896e62a6a6 not found: ID does not exist" Jul 24 11:26:17.715352 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.715321 2586 scope.go:117] "RemoveContainer" containerID="7dd9bfed91e438371f59d12d258331d553a787f1abe26595903834f47ed3f985" Jul 24 11:26:17.715864 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:26:17.715696 2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7dd9bfed91e438371f59d12d258331d553a787f1abe26595903834f47ed3f985\": container with ID starting with 7dd9bfed91e438371f59d12d258331d553a787f1abe26595903834f47ed3f985 not found: ID does not exist" containerID="7dd9bfed91e438371f59d12d258331d553a787f1abe26595903834f47ed3f985" Jul 24 11:26:17.715864 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.715724 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7dd9bfed91e438371f59d12d258331d553a787f1abe26595903834f47ed3f985"} err="failed to get container status \"7dd9bfed91e438371f59d12d258331d553a787f1abe26595903834f47ed3f985\": rpc error: code = NotFound desc = could not find container \"7dd9bfed91e438371f59d12d258331d553a787f1abe26595903834f47ed3f985\": container with ID starting with 7dd9bfed91e438371f59d12d258331d553a787f1abe26595903834f47ed3f985 not found: ID does not exist" Jul 24 11:26:17.715864 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.715743 2586 scope.go:117] "RemoveContainer" containerID="876256856ea1cf89a565e0872c4ab9b657c7eb3c4fb10dd2e6e08a417554f7ee" Jul 24 11:26:17.716010 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:26:17.715997 2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"876256856ea1cf89a565e0872c4ab9b657c7eb3c4fb10dd2e6e08a417554f7ee\": container with ID starting with 876256856ea1cf89a565e0872c4ab9b657c7eb3c4fb10dd2e6e08a417554f7ee not found: ID does not exist" containerID="876256856ea1cf89a565e0872c4ab9b657c7eb3c4fb10dd2e6e08a417554f7ee" Jul 24 11:26:17.716060 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.716019 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"876256856ea1cf89a565e0872c4ab9b657c7eb3c4fb10dd2e6e08a417554f7ee"} err="failed to get container status \"876256856ea1cf89a565e0872c4ab9b657c7eb3c4fb10dd2e6e08a417554f7ee\": rpc error: code = NotFound desc = could not find container \"876256856ea1cf89a565e0872c4ab9b657c7eb3c4fb10dd2e6e08a417554f7ee\": container with ID starting with 876256856ea1cf89a565e0872c4ab9b657c7eb3c4fb10dd2e6e08a417554f7ee not found: ID does not exist" Jul 24 11:26:17.716060 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.716040 2586 scope.go:117] "RemoveContainer" containerID="0cdd0217baf75e5aa2658f150cc91128534f386928e7e2ffcc1b727c72ee120d" Jul 24 11:26:17.716284 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:26:17.716262 2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0cdd0217baf75e5aa2658f150cc91128534f386928e7e2ffcc1b727c72ee120d\": container with ID starting with 0cdd0217baf75e5aa2658f150cc91128534f386928e7e2ffcc1b727c72ee120d not found: ID does not exist" containerID="0cdd0217baf75e5aa2658f150cc91128534f386928e7e2ffcc1b727c72ee120d" Jul 24 11:26:17.716325 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.716288 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0cdd0217baf75e5aa2658f150cc91128534f386928e7e2ffcc1b727c72ee120d"} err="failed to get container status \"0cdd0217baf75e5aa2658f150cc91128534f386928e7e2ffcc1b727c72ee120d\": rpc error: code = NotFound desc = could not find container \"0cdd0217baf75e5aa2658f150cc91128534f386928e7e2ffcc1b727c72ee120d\": container with ID starting with 0cdd0217baf75e5aa2658f150cc91128534f386928e7e2ffcc1b727c72ee120d not found: ID does not exist" Jul 24 11:26:17.716325 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.716301 2586 scope.go:117] "RemoveContainer" containerID="b980fa9f903440e717f23633eae33df47d8c8d95c5efb1b15a3d4c84b5f1f536" Jul 24 11:26:17.716545 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:26:17.716525 2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b980fa9f903440e717f23633eae33df47d8c8d95c5efb1b15a3d4c84b5f1f536\": container with ID starting with b980fa9f903440e717f23633eae33df47d8c8d95c5efb1b15a3d4c84b5f1f536 not found: ID does not exist" containerID="b980fa9f903440e717f23633eae33df47d8c8d95c5efb1b15a3d4c84b5f1f536" Jul 24 11:26:17.716620 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.716552 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b980fa9f903440e717f23633eae33df47d8c8d95c5efb1b15a3d4c84b5f1f536"} err="failed to get container status \"b980fa9f903440e717f23633eae33df47d8c8d95c5efb1b15a3d4c84b5f1f536\": rpc error: code = NotFound desc = could not find container \"b980fa9f903440e717f23633eae33df47d8c8d95c5efb1b15a3d4c84b5f1f536\": container with ID starting with b980fa9f903440e717f23633eae33df47d8c8d95c5efb1b15a3d4c84b5f1f536 not found: ID does not exist" Jul 24 11:26:17.716984 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.716570 2586 scope.go:117] "RemoveContainer" containerID="59106c718c84834bf701d3b49f9c7aaf9108f8b2741e1f68f1b48d7acf9fb5e9" Jul 24 11:26:17.717232 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.717215 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59106c718c84834bf701d3b49f9c7aaf9108f8b2741e1f68f1b48d7acf9fb5e9"} err="failed to get container status \"59106c718c84834bf701d3b49f9c7aaf9108f8b2741e1f68f1b48d7acf9fb5e9\": rpc error: code = NotFound desc = could not find container \"59106c718c84834bf701d3b49f9c7aaf9108f8b2741e1f68f1b48d7acf9fb5e9\": container with ID starting with 59106c718c84834bf701d3b49f9c7aaf9108f8b2741e1f68f1b48d7acf9fb5e9 not found: ID does not exist" Jul 24 11:26:17.717281 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.717233 2586 scope.go:117] "RemoveContainer" containerID="cffa7eea18101b7071533f73f7fca4d066b906bce0492c9235913d6cddadcbaf" Jul 24 11:26:17.717475 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.717456 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cffa7eea18101b7071533f73f7fca4d066b906bce0492c9235913d6cddadcbaf"} err="failed to get container status \"cffa7eea18101b7071533f73f7fca4d066b906bce0492c9235913d6cddadcbaf\": rpc error: code = NotFound desc = could not find container \"cffa7eea18101b7071533f73f7fca4d066b906bce0492c9235913d6cddadcbaf\": container with ID starting with cffa7eea18101b7071533f73f7fca4d066b906bce0492c9235913d6cddadcbaf not found: ID does not exist" Jul 24 11:26:17.717511 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.717476 2586 scope.go:117] "RemoveContainer" containerID="3a68ef515baad11890f86afd3820c6bd0f45affc60c3e9b1589b61896e62a6a6" Jul 24 11:26:17.717685 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.717669 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a68ef515baad11890f86afd3820c6bd0f45affc60c3e9b1589b61896e62a6a6"} err="failed to get container status \"3a68ef515baad11890f86afd3820c6bd0f45affc60c3e9b1589b61896e62a6a6\": rpc error: code = NotFound desc = could not find container \"3a68ef515baad11890f86afd3820c6bd0f45affc60c3e9b1589b61896e62a6a6\": container with ID starting with 3a68ef515baad11890f86afd3820c6bd0f45affc60c3e9b1589b61896e62a6a6 not found: ID does not exist" Jul 24 11:26:17.717737 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.717686 2586 scope.go:117] "RemoveContainer" containerID="7dd9bfed91e438371f59d12d258331d553a787f1abe26595903834f47ed3f985" Jul 24 11:26:17.717869 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.717855 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7dd9bfed91e438371f59d12d258331d553a787f1abe26595903834f47ed3f985"} err="failed to get container status \"7dd9bfed91e438371f59d12d258331d553a787f1abe26595903834f47ed3f985\": rpc error: code = NotFound desc = could not find container \"7dd9bfed91e438371f59d12d258331d553a787f1abe26595903834f47ed3f985\": container with ID starting with 7dd9bfed91e438371f59d12d258331d553a787f1abe26595903834f47ed3f985 not found: ID does not exist" Jul 24 11:26:17.717907 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.717870 2586 scope.go:117] "RemoveContainer" containerID="876256856ea1cf89a565e0872c4ab9b657c7eb3c4fb10dd2e6e08a417554f7ee" Jul 24 11:26:17.718052 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.718038 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"876256856ea1cf89a565e0872c4ab9b657c7eb3c4fb10dd2e6e08a417554f7ee"} err="failed to get container status \"876256856ea1cf89a565e0872c4ab9b657c7eb3c4fb10dd2e6e08a417554f7ee\": rpc error: code = NotFound desc = could not find container \"876256856ea1cf89a565e0872c4ab9b657c7eb3c4fb10dd2e6e08a417554f7ee\": container with ID starting with 876256856ea1cf89a565e0872c4ab9b657c7eb3c4fb10dd2e6e08a417554f7ee not found: ID does not exist" Jul 24 11:26:17.718103 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.718052 2586 scope.go:117] "RemoveContainer" containerID="0cdd0217baf75e5aa2658f150cc91128534f386928e7e2ffcc1b727c72ee120d" Jul 24 11:26:17.718275 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.718258 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0cdd0217baf75e5aa2658f150cc91128534f386928e7e2ffcc1b727c72ee120d"} err="failed to get container status \"0cdd0217baf75e5aa2658f150cc91128534f386928e7e2ffcc1b727c72ee120d\": rpc error: code = NotFound desc = could not find container \"0cdd0217baf75e5aa2658f150cc91128534f386928e7e2ffcc1b727c72ee120d\": container with ID starting with 0cdd0217baf75e5aa2658f150cc91128534f386928e7e2ffcc1b727c72ee120d not found: ID does not exist" Jul 24 11:26:17.718331 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.718275 2586 scope.go:117] "RemoveContainer" containerID="b980fa9f903440e717f23633eae33df47d8c8d95c5efb1b15a3d4c84b5f1f536" Jul 24 11:26:17.718464 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.718449 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b980fa9f903440e717f23633eae33df47d8c8d95c5efb1b15a3d4c84b5f1f536"} err="failed to get container status \"b980fa9f903440e717f23633eae33df47d8c8d95c5efb1b15a3d4c84b5f1f536\": rpc error: code = NotFound desc = could not find container \"b980fa9f903440e717f23633eae33df47d8c8d95c5efb1b15a3d4c84b5f1f536\": container with ID starting with b980fa9f903440e717f23633eae33df47d8c8d95c5efb1b15a3d4c84b5f1f536 not found: ID does not exist" Jul 24 11:26:17.718503 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.718464 2586 scope.go:117] "RemoveContainer" containerID="59106c718c84834bf701d3b49f9c7aaf9108f8b2741e1f68f1b48d7acf9fb5e9" Jul 24 11:26:17.718653 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.718639 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59106c718c84834bf701d3b49f9c7aaf9108f8b2741e1f68f1b48d7acf9fb5e9"} err="failed to get container status \"59106c718c84834bf701d3b49f9c7aaf9108f8b2741e1f68f1b48d7acf9fb5e9\": rpc error: code = NotFound desc = could not find container \"59106c718c84834bf701d3b49f9c7aaf9108f8b2741e1f68f1b48d7acf9fb5e9\": container with ID starting with 59106c718c84834bf701d3b49f9c7aaf9108f8b2741e1f68f1b48d7acf9fb5e9 not found: ID does not exist" Jul 24 11:26:17.718698 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.718653 2586 scope.go:117] "RemoveContainer" containerID="cffa7eea18101b7071533f73f7fca4d066b906bce0492c9235913d6cddadcbaf" Jul 24 11:26:17.718825 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.718811 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cffa7eea18101b7071533f73f7fca4d066b906bce0492c9235913d6cddadcbaf"} err="failed to get container status \"cffa7eea18101b7071533f73f7fca4d066b906bce0492c9235913d6cddadcbaf\": rpc error: code = NotFound desc = could not find container \"cffa7eea18101b7071533f73f7fca4d066b906bce0492c9235913d6cddadcbaf\": container with ID starting with cffa7eea18101b7071533f73f7fca4d066b906bce0492c9235913d6cddadcbaf not found: ID does not exist" Jul 24 11:26:17.718890 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.718825 2586 scope.go:117] "RemoveContainer" containerID="3a68ef515baad11890f86afd3820c6bd0f45affc60c3e9b1589b61896e62a6a6" Jul 24 11:26:17.718992 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.718979 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a68ef515baad11890f86afd3820c6bd0f45affc60c3e9b1589b61896e62a6a6"} err="failed to get container status \"3a68ef515baad11890f86afd3820c6bd0f45affc60c3e9b1589b61896e62a6a6\": rpc error: code = NotFound desc = could not find container \"3a68ef515baad11890f86afd3820c6bd0f45affc60c3e9b1589b61896e62a6a6\": container with ID starting with 3a68ef515baad11890f86afd3820c6bd0f45affc60c3e9b1589b61896e62a6a6 not found: ID does not exist" Jul 24 11:26:17.719054 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.718992 2586 scope.go:117] "RemoveContainer" containerID="7dd9bfed91e438371f59d12d258331d553a787f1abe26595903834f47ed3f985" Jul 24 11:26:17.719200 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.719182 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7dd9bfed91e438371f59d12d258331d553a787f1abe26595903834f47ed3f985"} err="failed to get container status \"7dd9bfed91e438371f59d12d258331d553a787f1abe26595903834f47ed3f985\": rpc error: code = NotFound desc = could not find container \"7dd9bfed91e438371f59d12d258331d553a787f1abe26595903834f47ed3f985\": container with ID starting with 7dd9bfed91e438371f59d12d258331d553a787f1abe26595903834f47ed3f985 not found: ID does not exist" Jul 24 11:26:17.719244 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.719200 2586 scope.go:117] "RemoveContainer" containerID="876256856ea1cf89a565e0872c4ab9b657c7eb3c4fb10dd2e6e08a417554f7ee" Jul 24 11:26:17.719371 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.719357 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"876256856ea1cf89a565e0872c4ab9b657c7eb3c4fb10dd2e6e08a417554f7ee"} err="failed to get container status \"876256856ea1cf89a565e0872c4ab9b657c7eb3c4fb10dd2e6e08a417554f7ee\": rpc error: code = NotFound desc = could not find container \"876256856ea1cf89a565e0872c4ab9b657c7eb3c4fb10dd2e6e08a417554f7ee\": container with ID starting with 876256856ea1cf89a565e0872c4ab9b657c7eb3c4fb10dd2e6e08a417554f7ee not found: ID does not exist" Jul 24 11:26:17.719417 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.719371 2586 scope.go:117] "RemoveContainer" containerID="0cdd0217baf75e5aa2658f150cc91128534f386928e7e2ffcc1b727c72ee120d" Jul 24 11:26:17.719588 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.719561 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0cdd0217baf75e5aa2658f150cc91128534f386928e7e2ffcc1b727c72ee120d"} err="failed to get container status \"0cdd0217baf75e5aa2658f150cc91128534f386928e7e2ffcc1b727c72ee120d\": rpc error: code = NotFound desc = could not find container \"0cdd0217baf75e5aa2658f150cc91128534f386928e7e2ffcc1b727c72ee120d\": container with ID starting with 0cdd0217baf75e5aa2658f150cc91128534f386928e7e2ffcc1b727c72ee120d not found: ID does not exist" Jul 24 11:26:17.719627 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.719591 2586 scope.go:117] "RemoveContainer" containerID="b980fa9f903440e717f23633eae33df47d8c8d95c5efb1b15a3d4c84b5f1f536" Jul 24 11:26:17.719797 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.719782 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b980fa9f903440e717f23633eae33df47d8c8d95c5efb1b15a3d4c84b5f1f536"} err="failed to get container status \"b980fa9f903440e717f23633eae33df47d8c8d95c5efb1b15a3d4c84b5f1f536\": rpc error: code = NotFound desc = could not find container \"b980fa9f903440e717f23633eae33df47d8c8d95c5efb1b15a3d4c84b5f1f536\": container with ID starting with b980fa9f903440e717f23633eae33df47d8c8d95c5efb1b15a3d4c84b5f1f536 not found: ID does not exist" Jul 24 11:26:17.719849 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.719797 2586 scope.go:117] "RemoveContainer" containerID="59106c718c84834bf701d3b49f9c7aaf9108f8b2741e1f68f1b48d7acf9fb5e9" Jul 24 11:26:17.719990 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.719974 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59106c718c84834bf701d3b49f9c7aaf9108f8b2741e1f68f1b48d7acf9fb5e9"} err="failed to get container status \"59106c718c84834bf701d3b49f9c7aaf9108f8b2741e1f68f1b48d7acf9fb5e9\": rpc error: code = NotFound desc = could not find container \"59106c718c84834bf701d3b49f9c7aaf9108f8b2741e1f68f1b48d7acf9fb5e9\": container with ID starting with 59106c718c84834bf701d3b49f9c7aaf9108f8b2741e1f68f1b48d7acf9fb5e9 not found: ID does not exist" Jul 24 11:26:17.720028 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.719991 2586 scope.go:117] "RemoveContainer" containerID="cffa7eea18101b7071533f73f7fca4d066b906bce0492c9235913d6cddadcbaf" Jul 24 11:26:17.720176 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.720158 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cffa7eea18101b7071533f73f7fca4d066b906bce0492c9235913d6cddadcbaf"} err="failed to get container status \"cffa7eea18101b7071533f73f7fca4d066b906bce0492c9235913d6cddadcbaf\": rpc error: code = NotFound desc = could not find container \"cffa7eea18101b7071533f73f7fca4d066b906bce0492c9235913d6cddadcbaf\": container with ID starting with cffa7eea18101b7071533f73f7fca4d066b906bce0492c9235913d6cddadcbaf not found: ID does not exist" Jul 24 11:26:17.720214 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.720177 2586 scope.go:117] "RemoveContainer" containerID="3a68ef515baad11890f86afd3820c6bd0f45affc60c3e9b1589b61896e62a6a6" Jul 24 11:26:17.720343 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.720329 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a68ef515baad11890f86afd3820c6bd0f45affc60c3e9b1589b61896e62a6a6"} err="failed to get container status \"3a68ef515baad11890f86afd3820c6bd0f45affc60c3e9b1589b61896e62a6a6\": rpc error: code = NotFound desc = could not find container \"3a68ef515baad11890f86afd3820c6bd0f45affc60c3e9b1589b61896e62a6a6\": container with ID starting with 3a68ef515baad11890f86afd3820c6bd0f45affc60c3e9b1589b61896e62a6a6 not found: ID does not exist" Jul 24 11:26:17.720388 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.720343 2586 scope.go:117] "RemoveContainer" containerID="7dd9bfed91e438371f59d12d258331d553a787f1abe26595903834f47ed3f985" Jul 24 11:26:17.720542 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.720526 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7dd9bfed91e438371f59d12d258331d553a787f1abe26595903834f47ed3f985"} err="failed to get container status \"7dd9bfed91e438371f59d12d258331d553a787f1abe26595903834f47ed3f985\": rpc error: code = NotFound desc = could not find container \"7dd9bfed91e438371f59d12d258331d553a787f1abe26595903834f47ed3f985\": container with ID starting with 7dd9bfed91e438371f59d12d258331d553a787f1abe26595903834f47ed3f985 not found: ID does not exist" Jul 24 11:26:17.720606 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.720542 2586 scope.go:117] "RemoveContainer" containerID="876256856ea1cf89a565e0872c4ab9b657c7eb3c4fb10dd2e6e08a417554f7ee" Jul 24 11:26:17.720741 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.720726 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"876256856ea1cf89a565e0872c4ab9b657c7eb3c4fb10dd2e6e08a417554f7ee"} err="failed to get container status \"876256856ea1cf89a565e0872c4ab9b657c7eb3c4fb10dd2e6e08a417554f7ee\": rpc error: code = NotFound desc = could not find container \"876256856ea1cf89a565e0872c4ab9b657c7eb3c4fb10dd2e6e08a417554f7ee\": container with ID starting with 876256856ea1cf89a565e0872c4ab9b657c7eb3c4fb10dd2e6e08a417554f7ee not found: ID does not exist" Jul 24 11:26:17.720777 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.720749 2586 scope.go:117] "RemoveContainer" containerID="0cdd0217baf75e5aa2658f150cc91128534f386928e7e2ffcc1b727c72ee120d" Jul 24 11:26:17.720953 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.720938 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0cdd0217baf75e5aa2658f150cc91128534f386928e7e2ffcc1b727c72ee120d"} err="failed to get container status \"0cdd0217baf75e5aa2658f150cc91128534f386928e7e2ffcc1b727c72ee120d\": rpc error: code = NotFound desc = could not find container \"0cdd0217baf75e5aa2658f150cc91128534f386928e7e2ffcc1b727c72ee120d\": container with ID starting with 0cdd0217baf75e5aa2658f150cc91128534f386928e7e2ffcc1b727c72ee120d not found: ID does not exist" Jul 24 11:26:17.720991 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.720954 2586 scope.go:117] "RemoveContainer" containerID="b980fa9f903440e717f23633eae33df47d8c8d95c5efb1b15a3d4c84b5f1f536" Jul 24 11:26:17.721141 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.721127 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b980fa9f903440e717f23633eae33df47d8c8d95c5efb1b15a3d4c84b5f1f536"} err="failed to get container status \"b980fa9f903440e717f23633eae33df47d8c8d95c5efb1b15a3d4c84b5f1f536\": rpc error: code = NotFound desc = could not find container \"b980fa9f903440e717f23633eae33df47d8c8d95c5efb1b15a3d4c84b5f1f536\": container with ID starting with b980fa9f903440e717f23633eae33df47d8c8d95c5efb1b15a3d4c84b5f1f536 not found: ID does not exist" Jul 24 11:26:17.721186 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.721141 2586 scope.go:117] "RemoveContainer" containerID="59106c718c84834bf701d3b49f9c7aaf9108f8b2741e1f68f1b48d7acf9fb5e9" Jul 24 11:26:17.721324 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.721305 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59106c718c84834bf701d3b49f9c7aaf9108f8b2741e1f68f1b48d7acf9fb5e9"} err="failed to get container status \"59106c718c84834bf701d3b49f9c7aaf9108f8b2741e1f68f1b48d7acf9fb5e9\": rpc error: code = NotFound desc = could not find container \"59106c718c84834bf701d3b49f9c7aaf9108f8b2741e1f68f1b48d7acf9fb5e9\": container with ID starting with 59106c718c84834bf701d3b49f9c7aaf9108f8b2741e1f68f1b48d7acf9fb5e9 not found: ID does not exist" Jul 24 11:26:17.721365 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.721325 2586 scope.go:117] "RemoveContainer" containerID="cffa7eea18101b7071533f73f7fca4d066b906bce0492c9235913d6cddadcbaf" Jul 24 11:26:17.721508 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.721493 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cffa7eea18101b7071533f73f7fca4d066b906bce0492c9235913d6cddadcbaf"} err="failed to get container status \"cffa7eea18101b7071533f73f7fca4d066b906bce0492c9235913d6cddadcbaf\": rpc error: code = NotFound desc = could not find container \"cffa7eea18101b7071533f73f7fca4d066b906bce0492c9235913d6cddadcbaf\": container with ID starting with cffa7eea18101b7071533f73f7fca4d066b906bce0492c9235913d6cddadcbaf not found: ID does not exist" Jul 24 11:26:17.721556 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.721508 2586 scope.go:117] "RemoveContainer" containerID="3a68ef515baad11890f86afd3820c6bd0f45affc60c3e9b1589b61896e62a6a6" Jul 24 11:26:17.721812 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.721787 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a68ef515baad11890f86afd3820c6bd0f45affc60c3e9b1589b61896e62a6a6"} err="failed to get container status \"3a68ef515baad11890f86afd3820c6bd0f45affc60c3e9b1589b61896e62a6a6\": rpc error: code = NotFound desc = could not find container \"3a68ef515baad11890f86afd3820c6bd0f45affc60c3e9b1589b61896e62a6a6\": container with ID starting with 3a68ef515baad11890f86afd3820c6bd0f45affc60c3e9b1589b61896e62a6a6 not found: ID does not exist" Jul 24 11:26:17.721860 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.721812 2586 scope.go:117] "RemoveContainer" containerID="7dd9bfed91e438371f59d12d258331d553a787f1abe26595903834f47ed3f985" Jul 24 11:26:17.722061 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.722023 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7dd9bfed91e438371f59d12d258331d553a787f1abe26595903834f47ed3f985"} err="failed to get container status \"7dd9bfed91e438371f59d12d258331d553a787f1abe26595903834f47ed3f985\": rpc error: code = NotFound desc = could not find container \"7dd9bfed91e438371f59d12d258331d553a787f1abe26595903834f47ed3f985\": container with ID starting with 7dd9bfed91e438371f59d12d258331d553a787f1abe26595903834f47ed3f985 not found: ID does not exist" Jul 24 11:26:17.722143 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.722066 2586 scope.go:117] "RemoveContainer" containerID="876256856ea1cf89a565e0872c4ab9b657c7eb3c4fb10dd2e6e08a417554f7ee" Jul 24 11:26:17.722278 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.722263 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"876256856ea1cf89a565e0872c4ab9b657c7eb3c4fb10dd2e6e08a417554f7ee"} err="failed to get container status \"876256856ea1cf89a565e0872c4ab9b657c7eb3c4fb10dd2e6e08a417554f7ee\": rpc error: code = NotFound desc = could not find container \"876256856ea1cf89a565e0872c4ab9b657c7eb3c4fb10dd2e6e08a417554f7ee\": container with ID starting with 876256856ea1cf89a565e0872c4ab9b657c7eb3c4fb10dd2e6e08a417554f7ee not found: ID does not exist" Jul 24 11:26:17.722320 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.722279 2586 scope.go:117] "RemoveContainer" containerID="0cdd0217baf75e5aa2658f150cc91128534f386928e7e2ffcc1b727c72ee120d" Jul 24 11:26:17.722456 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.722436 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0cdd0217baf75e5aa2658f150cc91128534f386928e7e2ffcc1b727c72ee120d"} err="failed to get container status \"0cdd0217baf75e5aa2658f150cc91128534f386928e7e2ffcc1b727c72ee120d\": rpc error: code = NotFound desc = could not find container \"0cdd0217baf75e5aa2658f150cc91128534f386928e7e2ffcc1b727c72ee120d\": container with ID starting with 0cdd0217baf75e5aa2658f150cc91128534f386928e7e2ffcc1b727c72ee120d not found: ID does not exist" Jul 24 11:26:17.722526 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.722459 2586 scope.go:117] "RemoveContainer" containerID="b980fa9f903440e717f23633eae33df47d8c8d95c5efb1b15a3d4c84b5f1f536" Jul 24 11:26:17.722656 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.722641 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b980fa9f903440e717f23633eae33df47d8c8d95c5efb1b15a3d4c84b5f1f536"} err="failed to get container status \"b980fa9f903440e717f23633eae33df47d8c8d95c5efb1b15a3d4c84b5f1f536\": rpc error: code = NotFound desc = could not find container \"b980fa9f903440e717f23633eae33df47d8c8d95c5efb1b15a3d4c84b5f1f536\": container with ID starting with b980fa9f903440e717f23633eae33df47d8c8d95c5efb1b15a3d4c84b5f1f536 not found: ID does not exist" Jul 24 11:26:17.722699 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.722656 2586 scope.go:117] "RemoveContainer" containerID="59106c718c84834bf701d3b49f9c7aaf9108f8b2741e1f68f1b48d7acf9fb5e9" Jul 24 11:26:17.722847 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.722830 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59106c718c84834bf701d3b49f9c7aaf9108f8b2741e1f68f1b48d7acf9fb5e9"} err="failed to get container status \"59106c718c84834bf701d3b49f9c7aaf9108f8b2741e1f68f1b48d7acf9fb5e9\": rpc error: code = NotFound desc = could not find container \"59106c718c84834bf701d3b49f9c7aaf9108f8b2741e1f68f1b48d7acf9fb5e9\": container with ID starting with 59106c718c84834bf701d3b49f9c7aaf9108f8b2741e1f68f1b48d7acf9fb5e9 not found: ID does not exist" Jul 24 11:26:17.722888 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.722848 2586 scope.go:117] "RemoveContainer" containerID="cffa7eea18101b7071533f73f7fca4d066b906bce0492c9235913d6cddadcbaf" Jul 24 11:26:17.723038 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.723021 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cffa7eea18101b7071533f73f7fca4d066b906bce0492c9235913d6cddadcbaf"} err="failed to get container status \"cffa7eea18101b7071533f73f7fca4d066b906bce0492c9235913d6cddadcbaf\": rpc error: code = NotFound desc = could not find container \"cffa7eea18101b7071533f73f7fca4d066b906bce0492c9235913d6cddadcbaf\": container with ID starting with cffa7eea18101b7071533f73f7fca4d066b906bce0492c9235913d6cddadcbaf not found: ID does not exist" Jul 24 11:26:17.723105 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.723040 2586 scope.go:117] "RemoveContainer" containerID="3a68ef515baad11890f86afd3820c6bd0f45affc60c3e9b1589b61896e62a6a6" Jul 24 11:26:17.723238 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.723219 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a68ef515baad11890f86afd3820c6bd0f45affc60c3e9b1589b61896e62a6a6"} err="failed to get container status \"3a68ef515baad11890f86afd3820c6bd0f45affc60c3e9b1589b61896e62a6a6\": rpc error: code = NotFound desc = could not find container \"3a68ef515baad11890f86afd3820c6bd0f45affc60c3e9b1589b61896e62a6a6\": container with ID starting with 3a68ef515baad11890f86afd3820c6bd0f45affc60c3e9b1589b61896e62a6a6 not found: ID does not exist" Jul 24 11:26:17.723285 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.723240 2586 scope.go:117] "RemoveContainer" containerID="7dd9bfed91e438371f59d12d258331d553a787f1abe26595903834f47ed3f985" Jul 24 11:26:17.723414 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.723396 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7dd9bfed91e438371f59d12d258331d553a787f1abe26595903834f47ed3f985"} err="failed to get container status \"7dd9bfed91e438371f59d12d258331d553a787f1abe26595903834f47ed3f985\": rpc error: code = NotFound desc = could not find container \"7dd9bfed91e438371f59d12d258331d553a787f1abe26595903834f47ed3f985\": container with ID starting with 7dd9bfed91e438371f59d12d258331d553a787f1abe26595903834f47ed3f985 not found: ID does not exist" Jul 24 11:26:17.723480 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.723415 2586 scope.go:117] "RemoveContainer" containerID="876256856ea1cf89a565e0872c4ab9b657c7eb3c4fb10dd2e6e08a417554f7ee" Jul 24 11:26:17.723625 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.723608 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"876256856ea1cf89a565e0872c4ab9b657c7eb3c4fb10dd2e6e08a417554f7ee"} err="failed to get container status \"876256856ea1cf89a565e0872c4ab9b657c7eb3c4fb10dd2e6e08a417554f7ee\": rpc error: code = NotFound desc = could not find container \"876256856ea1cf89a565e0872c4ab9b657c7eb3c4fb10dd2e6e08a417554f7ee\": container with ID starting with 876256856ea1cf89a565e0872c4ab9b657c7eb3c4fb10dd2e6e08a417554f7ee not found: ID does not exist" Jul 24 11:26:17.723676 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.723626 2586 scope.go:117] "RemoveContainer" containerID="0cdd0217baf75e5aa2658f150cc91128534f386928e7e2ffcc1b727c72ee120d" Jul 24 11:26:17.723811 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.723794 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0cdd0217baf75e5aa2658f150cc91128534f386928e7e2ffcc1b727c72ee120d"} err="failed to get container status \"0cdd0217baf75e5aa2658f150cc91128534f386928e7e2ffcc1b727c72ee120d\": rpc error: code = NotFound desc = could not find container \"0cdd0217baf75e5aa2658f150cc91128534f386928e7e2ffcc1b727c72ee120d\": container with ID starting with 0cdd0217baf75e5aa2658f150cc91128534f386928e7e2ffcc1b727c72ee120d not found: ID does not exist" Jul 24 11:26:17.723878 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.723812 2586 scope.go:117] "RemoveContainer" containerID="b980fa9f903440e717f23633eae33df47d8c8d95c5efb1b15a3d4c84b5f1f536" Jul 24 11:26:17.723992 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.723974 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b980fa9f903440e717f23633eae33df47d8c8d95c5efb1b15a3d4c84b5f1f536"} err="failed to get container status \"b980fa9f903440e717f23633eae33df47d8c8d95c5efb1b15a3d4c84b5f1f536\": rpc error: code = NotFound desc = could not find container \"b980fa9f903440e717f23633eae33df47d8c8d95c5efb1b15a3d4c84b5f1f536\": container with ID starting with b980fa9f903440e717f23633eae33df47d8c8d95c5efb1b15a3d4c84b5f1f536 not found: ID does not exist" Jul 24 11:26:17.779670 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.779624 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98015f82-98c5-4490-a292-4be78849ebaa-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"98015f82-98c5-4490-a292-4be78849ebaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:26:17.779670 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.779672 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/98015f82-98c5-4490-a292-4be78849ebaa-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"98015f82-98c5-4490-a292-4be78849ebaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:26:17.779923 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.779736 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/98015f82-98c5-4490-a292-4be78849ebaa-web-config\") pod \"prometheus-k8s-0\" (UID: \"98015f82-98c5-4490-a292-4be78849ebaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:26:17.779923 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.779773 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/98015f82-98c5-4490-a292-4be78849ebaa-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"98015f82-98c5-4490-a292-4be78849ebaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:26:17.779923 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.779811 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/98015f82-98c5-4490-a292-4be78849ebaa-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"98015f82-98c5-4490-a292-4be78849ebaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:26:17.779923 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.779892 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/98015f82-98c5-4490-a292-4be78849ebaa-config-out\") pod \"prometheus-k8s-0\" (UID: \"98015f82-98c5-4490-a292-4be78849ebaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:26:17.780123 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.779935 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/98015f82-98c5-4490-a292-4be78849ebaa-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"98015f82-98c5-4490-a292-4be78849ebaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:26:17.780123 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.779961 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/98015f82-98c5-4490-a292-4be78849ebaa-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"98015f82-98c5-4490-a292-4be78849ebaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:26:17.780123 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.780001 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/98015f82-98c5-4490-a292-4be78849ebaa-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"98015f82-98c5-4490-a292-4be78849ebaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:26:17.780123 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.780055 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/98015f82-98c5-4490-a292-4be78849ebaa-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"98015f82-98c5-4490-a292-4be78849ebaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:26:17.780123 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.780084 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/98015f82-98c5-4490-a292-4be78849ebaa-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"98015f82-98c5-4490-a292-4be78849ebaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:26:17.780123 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.780110 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/98015f82-98c5-4490-a292-4be78849ebaa-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"98015f82-98c5-4490-a292-4be78849ebaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:26:17.780386 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.780153 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/98015f82-98c5-4490-a292-4be78849ebaa-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"98015f82-98c5-4490-a292-4be78849ebaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:26:17.780386 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.780176 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/98015f82-98c5-4490-a292-4be78849ebaa-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"98015f82-98c5-4490-a292-4be78849ebaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:26:17.780386 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.780294 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98015f82-98c5-4490-a292-4be78849ebaa-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"98015f82-98c5-4490-a292-4be78849ebaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:26:17.780386 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.780330 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s54zb\" (UniqueName: \"kubernetes.io/projected/98015f82-98c5-4490-a292-4be78849ebaa-kube-api-access-s54zb\") pod \"prometheus-k8s-0\" (UID: \"98015f82-98c5-4490-a292-4be78849ebaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:26:17.780386 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.780362 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/98015f82-98c5-4490-a292-4be78849ebaa-config\") pod \"prometheus-k8s-0\" (UID: \"98015f82-98c5-4490-a292-4be78849ebaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:26:17.780658 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.780406 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/98015f82-98c5-4490-a292-4be78849ebaa-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"98015f82-98c5-4490-a292-4be78849ebaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:26:17.780658 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.780482 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/98015f82-98c5-4490-a292-4be78849ebaa-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"98015f82-98c5-4490-a292-4be78849ebaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:26:17.780658 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.780510 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98015f82-98c5-4490-a292-4be78849ebaa-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"98015f82-98c5-4490-a292-4be78849ebaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:26:17.881000 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.880965 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/98015f82-98c5-4490-a292-4be78849ebaa-config-out\") pod \"prometheus-k8s-0\" (UID: \"98015f82-98c5-4490-a292-4be78849ebaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:26:17.881110 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.881004 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/98015f82-98c5-4490-a292-4be78849ebaa-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"98015f82-98c5-4490-a292-4be78849ebaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:26:17.881110 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.881024 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/98015f82-98c5-4490-a292-4be78849ebaa-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"98015f82-98c5-4490-a292-4be78849ebaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:26:17.881211 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.881138 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/98015f82-98c5-4490-a292-4be78849ebaa-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"98015f82-98c5-4490-a292-4be78849ebaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:26:17.881211 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.881175 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/98015f82-98c5-4490-a292-4be78849ebaa-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"98015f82-98c5-4490-a292-4be78849ebaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:26:17.881211 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.881201 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/98015f82-98c5-4490-a292-4be78849ebaa-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"98015f82-98c5-4490-a292-4be78849ebaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:26:17.881343 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.881223 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/98015f82-98c5-4490-a292-4be78849ebaa-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"98015f82-98c5-4490-a292-4be78849ebaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:26:17.881343 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.881259 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/98015f82-98c5-4490-a292-4be78849ebaa-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"98015f82-98c5-4490-a292-4be78849ebaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:26:17.881343 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.881281 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/98015f82-98c5-4490-a292-4be78849ebaa-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"98015f82-98c5-4490-a292-4be78849ebaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:26:17.881343 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.881312 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98015f82-98c5-4490-a292-4be78849ebaa-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"98015f82-98c5-4490-a292-4be78849ebaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:26:17.881343 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.881340 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s54zb\" (UniqueName: \"kubernetes.io/projected/98015f82-98c5-4490-a292-4be78849ebaa-kube-api-access-s54zb\") pod \"prometheus-k8s-0\" (UID: \"98015f82-98c5-4490-a292-4be78849ebaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:26:17.881602 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.881365 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/98015f82-98c5-4490-a292-4be78849ebaa-config\") pod \"prometheus-k8s-0\" (UID: \"98015f82-98c5-4490-a292-4be78849ebaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:26:17.881602 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.881391 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/98015f82-98c5-4490-a292-4be78849ebaa-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"98015f82-98c5-4490-a292-4be78849ebaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:26:17.881602 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.881427 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/98015f82-98c5-4490-a292-4be78849ebaa-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"98015f82-98c5-4490-a292-4be78849ebaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:26:17.881602 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.881453 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98015f82-98c5-4490-a292-4be78849ebaa-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"98015f82-98c5-4490-a292-4be78849ebaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:26:17.881602 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.881501 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98015f82-98c5-4490-a292-4be78849ebaa-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"98015f82-98c5-4490-a292-4be78849ebaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:26:17.881602 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.881524 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/98015f82-98c5-4490-a292-4be78849ebaa-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"98015f82-98c5-4490-a292-4be78849ebaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:26:17.881602 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.881566 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/98015f82-98c5-4490-a292-4be78849ebaa-web-config\") pod \"prometheus-k8s-0\" (UID: \"98015f82-98c5-4490-a292-4be78849ebaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:26:17.881968 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.881624 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/98015f82-98c5-4490-a292-4be78849ebaa-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"98015f82-98c5-4490-a292-4be78849ebaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:26:17.881968 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.881663 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/98015f82-98c5-4490-a292-4be78849ebaa-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"98015f82-98c5-4490-a292-4be78849ebaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:26:17.881968 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.881675 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/98015f82-98c5-4490-a292-4be78849ebaa-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"98015f82-98c5-4490-a292-4be78849ebaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:26:17.882280 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.882254 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98015f82-98c5-4490-a292-4be78849ebaa-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"98015f82-98c5-4490-a292-4be78849ebaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:26:17.882944 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.882918 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/98015f82-98c5-4490-a292-4be78849ebaa-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"98015f82-98c5-4490-a292-4be78849ebaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:26:17.883415 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.883391 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/98015f82-98c5-4490-a292-4be78849ebaa-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"98015f82-98c5-4490-a292-4be78849ebaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:26:17.884150 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.884120 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98015f82-98c5-4490-a292-4be78849ebaa-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"98015f82-98c5-4490-a292-4be78849ebaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:26:17.884244 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.884161 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/98015f82-98c5-4490-a292-4be78849ebaa-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"98015f82-98c5-4490-a292-4be78849ebaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:26:17.884244 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.884159 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/98015f82-98c5-4490-a292-4be78849ebaa-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"98015f82-98c5-4490-a292-4be78849ebaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:26:17.884244 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.884223 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/98015f82-98c5-4490-a292-4be78849ebaa-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"98015f82-98c5-4490-a292-4be78849ebaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:26:17.884426 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.884408 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/98015f82-98c5-4490-a292-4be78849ebaa-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"98015f82-98c5-4490-a292-4be78849ebaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:26:17.884617 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.884590 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/98015f82-98c5-4490-a292-4be78849ebaa-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"98015f82-98c5-4490-a292-4be78849ebaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:26:17.884707 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.884689 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/98015f82-98c5-4490-a292-4be78849ebaa-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"98015f82-98c5-4490-a292-4be78849ebaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:26:17.884774 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.884761 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/98015f82-98c5-4490-a292-4be78849ebaa-config-out\") pod \"prometheus-k8s-0\" (UID: \"98015f82-98c5-4490-a292-4be78849ebaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:26:17.884857 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.884831 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/98015f82-98c5-4490-a292-4be78849ebaa-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"98015f82-98c5-4490-a292-4be78849ebaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:26:17.885237 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.885218 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98015f82-98c5-4490-a292-4be78849ebaa-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"98015f82-98c5-4490-a292-4be78849ebaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:26:17.886273 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.886253 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/98015f82-98c5-4490-a292-4be78849ebaa-web-config\") pod \"prometheus-k8s-0\" (UID: \"98015f82-98c5-4490-a292-4be78849ebaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:26:17.887060 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.887037 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/98015f82-98c5-4490-a292-4be78849ebaa-config\") pod \"prometheus-k8s-0\" (UID: \"98015f82-98c5-4490-a292-4be78849ebaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:26:17.887183 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.887166 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/98015f82-98c5-4490-a292-4be78849ebaa-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"98015f82-98c5-4490-a292-4be78849ebaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:26:17.887299 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.887278 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/98015f82-98c5-4490-a292-4be78849ebaa-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"98015f82-98c5-4490-a292-4be78849ebaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:26:17.888042 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.888025 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/98015f82-98c5-4490-a292-4be78849ebaa-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"98015f82-98c5-4490-a292-4be78849ebaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:26:17.892942 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:17.892919 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s54zb\" (UniqueName: \"kubernetes.io/projected/98015f82-98c5-4490-a292-4be78849ebaa-kube-api-access-s54zb\") pod \"prometheus-k8s-0\" (UID: \"98015f82-98c5-4490-a292-4be78849ebaa\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:26:18.001684 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:18.001596 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:26:18.136570 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:18.136546 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 24 11:26:18.138746 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:26:18.138723 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98015f82_98c5_4490_a292_4be78849ebaa.slice/crio-7f6997e2c5ca708aea403ee8af92418279ff3cc7558e01f558148fc981a6e82d WatchSource:0}: Error finding container 7f6997e2c5ca708aea403ee8af92418279ff3cc7558e01f558148fc981a6e82d: Status 404 returned error can't find the container with id 7f6997e2c5ca708aea403ee8af92418279ff3cc7558e01f558148fc981a6e82d Jul 24 11:26:18.629837 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:18.629799 2586 generic.go:356] "Generic (PLEG): container finished" podID="98015f82-98c5-4490-a292-4be78849ebaa" containerID="757154013d9dba8c9389ca4cf91ff0f219b1a07ab9abad210f33b822a751113c" exitCode=0 Jul 24 11:26:18.630356 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:18.629891 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"98015f82-98c5-4490-a292-4be78849ebaa","Type":"ContainerDied","Data":"757154013d9dba8c9389ca4cf91ff0f219b1a07ab9abad210f33b822a751113c"} Jul 24 11:26:18.630356 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:18.629953 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"98015f82-98c5-4490-a292-4be78849ebaa","Type":"ContainerStarted","Data":"7f6997e2c5ca708aea403ee8af92418279ff3cc7558e01f558148fc981a6e82d"} Jul 24 11:26:19.638811 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:19.638776 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"98015f82-98c5-4490-a292-4be78849ebaa","Type":"ContainerStarted","Data":"1dd9c6eb1f3c9766c47089e8aea5299784523f8e6cdd61603163cadbe1a2341f"} Jul 24 11:26:19.639265 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:19.638868 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"98015f82-98c5-4490-a292-4be78849ebaa","Type":"ContainerStarted","Data":"c3dc840d0e9abf35f49cbda8b717befd305308fcc9e041188f5a158e9b1b3f91"} Jul 24 11:26:19.639265 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:19.638894 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"98015f82-98c5-4490-a292-4be78849ebaa","Type":"ContainerStarted","Data":"de5d30f61ba79d788b350e82d9de4d70235c885602a47d124ae7585871d7b9b1"} Jul 24 11:26:19.639265 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:19.638920 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"98015f82-98c5-4490-a292-4be78849ebaa","Type":"ContainerStarted","Data":"12d76825f72d3e6afa06cab7e4c9db6b70c1106976fc21aa69f00db5721b7322"} Jul 24 11:26:19.639265 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:19.638944 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"98015f82-98c5-4490-a292-4be78849ebaa","Type":"ContainerStarted","Data":"fa2f03d40e1b3fbca00e31b88385669f199786748e4a6ccdb83a296fce505a51"} Jul 24 11:26:19.639265 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:19.638967 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"98015f82-98c5-4490-a292-4be78849ebaa","Type":"ContainerStarted","Data":"3205463774dbb649b04395d29d7c5388324ce4054f86931d262526f388eb8e62"} Jul 24 11:26:19.667514 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:19.667455 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.6453112560000003 podStartE2EDuration="2.667440603s" totalImagesPullingTime="0s" totalInitContainerRuntime="22.129347ms" isStatefulPod=false podCreationTimestamp="2026-07-24 11:26:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 11:26:19.665988833 +0000 UTC m=+170.684043398" watchObservedRunningTime="2026-07-24 11:26:19.667440603 +0000 UTC m=+170.685495148" Jul 24 11:26:23.001906 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:26:23.001814 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:27:18.002085 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:27:18.002035 2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:27:18.017682 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:27:18.017649 2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:27:18.892349 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:27:18.892309 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 11:27:31.532649 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:27:31.532615 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-dbbv5"] Jul 24 11:27:31.535636 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:27:31.535619 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-dbbv5" Jul 24 11:27:31.537872 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:27:31.537849 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-g6wjg\"" Jul 24 11:27:31.537997 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:27:31.537918 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 24 11:27:31.538607 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:27:31.538570 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 24 11:27:31.546332 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:27:31.546309 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-dbbv5"] Jul 24 11:27:31.629151 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:27:31.629115 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5n8lq\" (UniqueName: \"kubernetes.io/projected/3602ef8f-dfa2-4292-b822-e97598f9507b-kube-api-access-5n8lq\") pod \"cert-manager-webhook-6486ffd997-dbbv5\" (UID: \"3602ef8f-dfa2-4292-b822-e97598f9507b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-dbbv5" Jul 24 11:27:31.629323 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:27:31.629180 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3602ef8f-dfa2-4292-b822-e97598f9507b-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-dbbv5\" (UID: \"3602ef8f-dfa2-4292-b822-e97598f9507b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-dbbv5" Jul 24 11:27:31.730173 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:27:31.730130 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3602ef8f-dfa2-4292-b822-e97598f9507b-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-dbbv5\" (UID: \"3602ef8f-dfa2-4292-b822-e97598f9507b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-dbbv5" Jul 24 11:27:31.730349 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:27:31.730206 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5n8lq\" (UniqueName: \"kubernetes.io/projected/3602ef8f-dfa2-4292-b822-e97598f9507b-kube-api-access-5n8lq\") pod \"cert-manager-webhook-6486ffd997-dbbv5\" (UID: \"3602ef8f-dfa2-4292-b822-e97598f9507b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-dbbv5" Jul 24 11:27:31.738827 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:27:31.738794 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3602ef8f-dfa2-4292-b822-e97598f9507b-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-dbbv5\" (UID: \"3602ef8f-dfa2-4292-b822-e97598f9507b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-dbbv5" Jul 24 11:27:31.738947 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:27:31.738875 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5n8lq\" (UniqueName: \"kubernetes.io/projected/3602ef8f-dfa2-4292-b822-e97598f9507b-kube-api-access-5n8lq\") pod \"cert-manager-webhook-6486ffd997-dbbv5\" (UID: \"3602ef8f-dfa2-4292-b822-e97598f9507b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-dbbv5" Jul 24 11:27:31.853294 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:27:31.853207 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-dbbv5" Jul 24 11:27:31.995558 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:27:31.995524 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-dbbv5"] Jul 24 11:27:31.998942 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:27:31.998916 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3602ef8f_dfa2_4292_b822_e97598f9507b.slice/crio-bf07f7c2f5ee1be86b4d32bc4aef3ffaee4d8783ad57a9bbd492946884284212 WatchSource:0}: Error finding container bf07f7c2f5ee1be86b4d32bc4aef3ffaee4d8783ad57a9bbd492946884284212: Status 404 returned error can't find the container with id bf07f7c2f5ee1be86b4d32bc4aef3ffaee4d8783ad57a9bbd492946884284212 Jul 24 11:27:32.935944 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:27:32.935903 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-dbbv5" event={"ID":"3602ef8f-dfa2-4292-b822-e97598f9507b","Type":"ContainerStarted","Data":"bf07f7c2f5ee1be86b4d32bc4aef3ffaee4d8783ad57a9bbd492946884284212"} Jul 24 11:27:35.950961 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:27:35.950922 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-dbbv5" event={"ID":"3602ef8f-dfa2-4292-b822-e97598f9507b","Type":"ContainerStarted","Data":"2a3d24b8456462b98fc3b308b3db1d7cbd6b25583ef91484235d2931a93cef59"} Jul 24 11:27:35.951389 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:27:35.951045 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-dbbv5" Jul 24 11:27:35.966274 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:27:35.966221 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-dbbv5" podStartSLOduration=1.944941432 podStartE2EDuration="4.966204666s" totalImagesPullingTime="3.021263234s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 11:27:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 11:27:35.965343711 +0000 UTC m=+246.983398276" watchObservedRunningTime="2026-07-24 11:27:35.966204666 +0000 UTC m=+246.984259211" Jul 24 11:27:41.722901 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:27:41.722865 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-q8lvw"] Jul 24 11:27:41.726384 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:27:41.726366 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-q8lvw" Jul 24 11:27:41.728677 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:27:41.728657 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-z2xr9\"" Jul 24 11:27:41.736011 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:27:41.735990 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-q8lvw"] Jul 24 11:27:41.821960 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:27:41.821922 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3762d421-5b35-4668-a848-c10ff6e5202b-bound-sa-token\") pod \"cert-manager-55b4d954d5-q8lvw\" (UID: \"3762d421-5b35-4668-a848-c10ff6e5202b\") " pod="cert-manager/cert-manager-55b4d954d5-q8lvw" Jul 24 11:27:41.822154 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:27:41.821972 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8729\" (UniqueName: \"kubernetes.io/projected/3762d421-5b35-4668-a848-c10ff6e5202b-kube-api-access-v8729\") pod \"cert-manager-55b4d954d5-q8lvw\" (UID: \"3762d421-5b35-4668-a848-c10ff6e5202b\") " pod="cert-manager/cert-manager-55b4d954d5-q8lvw" Jul 24 11:27:41.922881 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:27:41.922836 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8729\" (UniqueName: \"kubernetes.io/projected/3762d421-5b35-4668-a848-c10ff6e5202b-kube-api-access-v8729\") pod \"cert-manager-55b4d954d5-q8lvw\" (UID: \"3762d421-5b35-4668-a848-c10ff6e5202b\") " pod="cert-manager/cert-manager-55b4d954d5-q8lvw" Jul 24 11:27:41.923067 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:27:41.922944 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3762d421-5b35-4668-a848-c10ff6e5202b-bound-sa-token\") pod \"cert-manager-55b4d954d5-q8lvw\" (UID: \"3762d421-5b35-4668-a848-c10ff6e5202b\") " pod="cert-manager/cert-manager-55b4d954d5-q8lvw" Jul 24 11:27:41.931839 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:27:41.931807 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3762d421-5b35-4668-a848-c10ff6e5202b-bound-sa-token\") pod \"cert-manager-55b4d954d5-q8lvw\" (UID: \"3762d421-5b35-4668-a848-c10ff6e5202b\") " pod="cert-manager/cert-manager-55b4d954d5-q8lvw" Jul 24 11:27:41.931978 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:27:41.931901 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8729\" (UniqueName: \"kubernetes.io/projected/3762d421-5b35-4668-a848-c10ff6e5202b-kube-api-access-v8729\") pod \"cert-manager-55b4d954d5-q8lvw\" (UID: \"3762d421-5b35-4668-a848-c10ff6e5202b\") " pod="cert-manager/cert-manager-55b4d954d5-q8lvw" Jul 24 11:27:41.957721 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:27:41.957693 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-dbbv5" Jul 24 11:27:42.035468 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:27:42.035381 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-q8lvw" Jul 24 11:27:42.166065 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:27:42.166042 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-q8lvw"] Jul 24 11:27:42.168471 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:27:42.168444 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3762d421_5b35_4668_a848_c10ff6e5202b.slice/crio-c01fb2ae3955f4b1129c6084677aac6327eaa60baea0e01b8495d99f34b71d77 WatchSource:0}: Error finding container c01fb2ae3955f4b1129c6084677aac6327eaa60baea0e01b8495d99f34b71d77: Status 404 returned error can't find the container with id c01fb2ae3955f4b1129c6084677aac6327eaa60baea0e01b8495d99f34b71d77 Jul 24 11:27:42.983675 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:27:42.983635 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-q8lvw" event={"ID":"3762d421-5b35-4668-a848-c10ff6e5202b","Type":"ContainerStarted","Data":"48f2e6b05b06d269b26b2169520d3cee2e3914f42e7155805e23c50bd7ea7bfc"} Jul 24 11:27:42.984114 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:27:42.983687 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-q8lvw" event={"ID":"3762d421-5b35-4668-a848-c10ff6e5202b","Type":"ContainerStarted","Data":"c01fb2ae3955f4b1129c6084677aac6327eaa60baea0e01b8495d99f34b71d77"} Jul 24 11:28:29.468372 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:28:29.468342 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n7wb9_55c78980-902f-4c71-9557-a0c6631fdc8b/ovn-acl-logging/0.log" Jul 24 11:28:29.473638 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:28:29.473616 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n7wb9_55c78980-902f-4c71-9557-a0c6631fdc8b/ovn-acl-logging/0.log" Jul 24 11:28:29.475657 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:28:29.475638 2586 kubelet.go:1648] "Image garbage collection succeeded" Jul 24 11:29:04.757967 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:29:04.757887 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-q8lvw" podStartSLOduration=83.757863511 podStartE2EDuration="1m23.757863511s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 11:27:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 11:27:43.000273845 +0000 UTC m=+254.018328401" watchObservedRunningTime="2026-07-24 11:29:04.757863511 +0000 UTC m=+335.775918055" Jul 24 11:29:04.760625 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:29:04.759327 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["trainer-operator-system/trainer-operator-controller-manager-c69cccfc4-rfj26"] Jul 24 11:29:04.763403 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:29:04.763382 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="trainer-operator-system/trainer-operator-controller-manager-c69cccfc4-rfj26" Jul 24 11:29:04.766349 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:29:04.766329 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"trainer-operator-system\"/\"kube-root-ca.crt\"" Jul 24 11:29:04.767307 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:29:04.767285 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"trainer-operator-system\"/\"trainer-operator-controller-manager-dockercfg-w9p95\"" Jul 24 11:29:04.767307 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:29:04.767298 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"trainer-operator-system\"/\"openshift-service-ca.crt\"" Jul 24 11:29:04.775339 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:29:04.775313 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["trainer-operator-system/trainer-operator-controller-manager-c69cccfc4-rfj26"] Jul 24 11:29:04.830497 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:29:04.830459 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlbb4\" (UniqueName: \"kubernetes.io/projected/c9dbff46-7af0-4035-a151-274bfa29ec2a-kube-api-access-zlbb4\") pod \"trainer-operator-controller-manager-c69cccfc4-rfj26\" (UID: \"c9dbff46-7af0-4035-a151-274bfa29ec2a\") " pod="trainer-operator-system/trainer-operator-controller-manager-c69cccfc4-rfj26" Jul 24 11:29:04.830497 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:29:04.830502 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests-work\" (UniqueName: \"kubernetes.io/empty-dir/c9dbff46-7af0-4035-a151-274bfa29ec2a-manifests-work\") pod \"trainer-operator-controller-manager-c69cccfc4-rfj26\" (UID: \"c9dbff46-7af0-4035-a151-274bfa29ec2a\") " pod="trainer-operator-system/trainer-operator-controller-manager-c69cccfc4-rfj26" Jul 24 11:29:04.830761 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:29:04.830565 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c9dbff46-7af0-4035-a151-274bfa29ec2a-tmp\") pod \"trainer-operator-controller-manager-c69cccfc4-rfj26\" (UID: \"c9dbff46-7af0-4035-a151-274bfa29ec2a\") " pod="trainer-operator-system/trainer-operator-controller-manager-c69cccfc4-rfj26" Jul 24 11:29:04.931662 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:29:04.931608 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zlbb4\" (UniqueName: \"kubernetes.io/projected/c9dbff46-7af0-4035-a151-274bfa29ec2a-kube-api-access-zlbb4\") pod \"trainer-operator-controller-manager-c69cccfc4-rfj26\" (UID: \"c9dbff46-7af0-4035-a151-274bfa29ec2a\") " pod="trainer-operator-system/trainer-operator-controller-manager-c69cccfc4-rfj26" Jul 24 11:29:04.931662 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:29:04.931666 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests-work\" (UniqueName: \"kubernetes.io/empty-dir/c9dbff46-7af0-4035-a151-274bfa29ec2a-manifests-work\") pod \"trainer-operator-controller-manager-c69cccfc4-rfj26\" (UID: \"c9dbff46-7af0-4035-a151-274bfa29ec2a\") " pod="trainer-operator-system/trainer-operator-controller-manager-c69cccfc4-rfj26" Jul 24 11:29:04.931925 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:29:04.931698 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c9dbff46-7af0-4035-a151-274bfa29ec2a-tmp\") pod \"trainer-operator-controller-manager-c69cccfc4-rfj26\" (UID: \"c9dbff46-7af0-4035-a151-274bfa29ec2a\") " pod="trainer-operator-system/trainer-operator-controller-manager-c69cccfc4-rfj26" Jul 24 11:29:04.932150 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:29:04.932128 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests-work\" (UniqueName: \"kubernetes.io/empty-dir/c9dbff46-7af0-4035-a151-274bfa29ec2a-manifests-work\") pod \"trainer-operator-controller-manager-c69cccfc4-rfj26\" (UID: \"c9dbff46-7af0-4035-a151-274bfa29ec2a\") " pod="trainer-operator-system/trainer-operator-controller-manager-c69cccfc4-rfj26" Jul 24 11:29:04.932198 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:29:04.932128 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c9dbff46-7af0-4035-a151-274bfa29ec2a-tmp\") pod \"trainer-operator-controller-manager-c69cccfc4-rfj26\" (UID: \"c9dbff46-7af0-4035-a151-274bfa29ec2a\") " pod="trainer-operator-system/trainer-operator-controller-manager-c69cccfc4-rfj26" Jul 24 11:29:04.941444 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:29:04.941415 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlbb4\" (UniqueName: \"kubernetes.io/projected/c9dbff46-7af0-4035-a151-274bfa29ec2a-kube-api-access-zlbb4\") pod \"trainer-operator-controller-manager-c69cccfc4-rfj26\" (UID: \"c9dbff46-7af0-4035-a151-274bfa29ec2a\") " pod="trainer-operator-system/trainer-operator-controller-manager-c69cccfc4-rfj26" Jul 24 11:29:05.073298 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:29:05.073215 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="trainer-operator-system/trainer-operator-controller-manager-c69cccfc4-rfj26" Jul 24 11:29:05.203262 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:29:05.203228 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["trainer-operator-system/trainer-operator-controller-manager-c69cccfc4-rfj26"] Jul 24 11:29:05.206628 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:29:05.206598 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9dbff46_7af0_4035_a151_274bfa29ec2a.slice/crio-ed6c78c08e6131c41a7632eb6e14ea061d500607f617846644425e1cd0ae2be5 WatchSource:0}: Error finding container ed6c78c08e6131c41a7632eb6e14ea061d500607f617846644425e1cd0ae2be5: Status 404 returned error can't find the container with id ed6c78c08e6131c41a7632eb6e14ea061d500607f617846644425e1cd0ae2be5 Jul 24 11:29:05.208457 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:29:05.208429 2586 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 24 11:29:05.327490 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:29:05.327410 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="trainer-operator-system/trainer-operator-controller-manager-c69cccfc4-rfj26" event={"ID":"c9dbff46-7af0-4035-a151-274bfa29ec2a","Type":"ContainerStarted","Data":"ed6c78c08e6131c41a7632eb6e14ea061d500607f617846644425e1cd0ae2be5"} Jul 24 11:29:08.341953 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:29:08.341920 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="trainer-operator-system/trainer-operator-controller-manager-c69cccfc4-rfj26" event={"ID":"c9dbff46-7af0-4035-a151-274bfa29ec2a","Type":"ContainerStarted","Data":"51e42c387cb590fb8c033ed83c06ef491df9fcbd4135ce2230b8e88123e79c29"} Jul 24 11:29:08.342341 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:29:08.342043 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="trainer-operator-system/trainer-operator-controller-manager-c69cccfc4-rfj26" Jul 24 11:29:08.359941 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:29:08.359894 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="trainer-operator-system/trainer-operator-controller-manager-c69cccfc4-rfj26" podStartSLOduration=1.824761541 podStartE2EDuration="4.359877415s" totalImagesPullingTime="2.535115874s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 11:29:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 11:29:08.358663764 +0000 UTC m=+339.376718312" watchObservedRunningTime="2026-07-24 11:29:08.359877415 +0000 UTC m=+339.377931977" Jul 24 11:29:19.354964 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:29:19.354935 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="trainer-operator-system/trainer-operator-controller-manager-c69cccfc4-rfj26" Jul 24 11:30:15.837817 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:30:15.837778 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-tdwng"] Jul 24 11:30:15.843154 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:30:15.843134 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-trainjob-workflow-node-0-0-tdwng" Jul 24 11:30:15.845952 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:30:15.845925 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-7bwc9\"" Jul 24 11:30:15.846086 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:30:15.845969 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 24 11:30:15.846086 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:30:15.845975 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 24 11:30:15.849555 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:30:15.849531 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-tdwng"] Jul 24 11:30:15.934971 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:30:15.934931 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bb6v\" (UniqueName: \"kubernetes.io/projected/7d8654fa-b8e3-448f-be21-bf2fe499e055-kube-api-access-7bb6v\") pod \"test-trainjob-workflow-node-0-0-tdwng\" (UID: \"7d8654fa-b8e3-448f-be21-bf2fe499e055\") " pod="opendatahub/test-trainjob-workflow-node-0-0-tdwng" Jul 24 11:30:16.035995 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:30:16.035953 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bb6v\" (UniqueName: \"kubernetes.io/projected/7d8654fa-b8e3-448f-be21-bf2fe499e055-kube-api-access-7bb6v\") pod \"test-trainjob-workflow-node-0-0-tdwng\" (UID: \"7d8654fa-b8e3-448f-be21-bf2fe499e055\") " pod="opendatahub/test-trainjob-workflow-node-0-0-tdwng" Jul 24 11:30:16.045572 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:30:16.045539 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bb6v\" (UniqueName: \"kubernetes.io/projected/7d8654fa-b8e3-448f-be21-bf2fe499e055-kube-api-access-7bb6v\") pod \"test-trainjob-workflow-node-0-0-tdwng\" (UID: \"7d8654fa-b8e3-448f-be21-bf2fe499e055\") " pod="opendatahub/test-trainjob-workflow-node-0-0-tdwng" Jul 24 11:30:16.154648 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:30:16.154546 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-trainjob-workflow-node-0-0-tdwng" Jul 24 11:30:16.284401 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:30:16.284376 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-tdwng"] Jul 24 11:30:16.286693 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:30:16.286668 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7d8654fa_b8e3_448f_be21_bf2fe499e055.slice/crio-40e5748a3d6f793d7d3abc4cf57bd63c6ada655762110209a0b99572be2c47c4 WatchSource:0}: Error finding container 40e5748a3d6f793d7d3abc4cf57bd63c6ada655762110209a0b99572be2c47c4: Status 404 returned error can't find the container with id 40e5748a3d6f793d7d3abc4cf57bd63c6ada655762110209a0b99572be2c47c4 Jul 24 11:30:16.624752 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:30:16.624720 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-trainjob-workflow-node-0-0-tdwng" event={"ID":"7d8654fa-b8e3-448f-be21-bf2fe499e055","Type":"ContainerStarted","Data":"40e5748a3d6f793d7d3abc4cf57bd63c6ada655762110209a0b99572be2c47c4"} Jul 24 11:31:23.975063 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:31:23.975025 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-trainjob-workflow-node-0-0-tdwng" event={"ID":"7d8654fa-b8e3-448f-be21-bf2fe499e055","Type":"ContainerStarted","Data":"4682a65d9b1218a1699f10b1786aba265f02d900dded6c3a45f1bc1c5562d999"} Jul 24 11:31:23.994058 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:31:23.994008 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-trainjob-workflow-node-0-0-tdwng" podStartSLOduration=2.212031335 podStartE2EDuration="1m8.993992195s" totalImagesPullingTime="1m6.78196086s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 11:30:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 11:31:23.99290603 +0000 UTC m=+475.010960577" watchObservedRunningTime="2026-07-24 11:31:23.993992195 +0000 UTC m=+475.012046739" Jul 24 11:31:25.984957 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:31:25.984882 2586 generic.go:356] "Generic (PLEG): container finished" podID="7d8654fa-b8e3-448f-be21-bf2fe499e055" containerID="4682a65d9b1218a1699f10b1786aba265f02d900dded6c3a45f1bc1c5562d999" exitCode=0 Jul 24 11:31:25.985351 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:31:25.984976 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-trainjob-workflow-node-0-0-tdwng" event={"ID":"7d8654fa-b8e3-448f-be21-bf2fe499e055","Type":"ContainerDied","Data":"4682a65d9b1218a1699f10b1786aba265f02d900dded6c3a45f1bc1c5562d999"} Jul 24 11:31:27.178020 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:31:27.177981 2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-trainjob-workflow-node-0-0-tdwng" Jul 24 11:31:27.332604 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:31:27.332497 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7bb6v\" (UniqueName: \"kubernetes.io/projected/7d8654fa-b8e3-448f-be21-bf2fe499e055-kube-api-access-7bb6v\") pod \"7d8654fa-b8e3-448f-be21-bf2fe499e055\" (UID: \"7d8654fa-b8e3-448f-be21-bf2fe499e055\") " Jul 24 11:31:27.334708 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:31:27.334674 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d8654fa-b8e3-448f-be21-bf2fe499e055-kube-api-access-7bb6v" (OuterVolumeSpecName: "kube-api-access-7bb6v") pod "7d8654fa-b8e3-448f-be21-bf2fe499e055" (UID: "7d8654fa-b8e3-448f-be21-bf2fe499e055"). InnerVolumeSpecName "kube-api-access-7bb6v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 11:31:27.433569 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:31:27.433530 2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7bb6v\" (UniqueName: \"kubernetes.io/projected/7d8654fa-b8e3-448f-be21-bf2fe499e055-kube-api-access-7bb6v\") on node \"ip-10-0-137-219.ec2.internal\" DevicePath \"\"" Jul 24 11:31:27.994634 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:31:27.994543 2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-trainjob-workflow-node-0-0-tdwng" Jul 24 11:31:27.994634 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:31:27.994562 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-trainjob-workflow-node-0-0-tdwng" event={"ID":"7d8654fa-b8e3-448f-be21-bf2fe499e055","Type":"ContainerDied","Data":"40e5748a3d6f793d7d3abc4cf57bd63c6ada655762110209a0b99572be2c47c4"} Jul 24 11:31:27.994634 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:31:27.994615 2586 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="40e5748a3d6f793d7d3abc4cf57bd63c6ada655762110209a0b99572be2c47c4" Jul 24 11:31:29.042858 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:31:29.042827 2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-tdwng"] Jul 24 11:31:29.046106 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:31:29.046081 2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-tdwng"] Jul 24 11:31:29.685188 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:31:29.685153 2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d8654fa-b8e3-448f-be21-bf2fe499e055" path="/var/lib/kubelet/pods/7d8654fa-b8e3-448f-be21-bf2fe499e055/volumes" Jul 24 11:31:29.777910 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:31:29.777877 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-pbrzg/must-gather-6jjdq"] Jul 24 11:31:29.778212 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:31:29.778200 2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d8654fa-b8e3-448f-be21-bf2fe499e055" containerName="node" Jul 24 11:31:29.778212 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:31:29.778213 2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d8654fa-b8e3-448f-be21-bf2fe499e055" containerName="node" Jul 24 11:31:29.778296 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:31:29.778280 2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d8654fa-b8e3-448f-be21-bf2fe499e055" containerName="node" Jul 24 11:31:29.814179 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:31:29.814152 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pbrzg/must-gather-6jjdq"] Jul 24 11:31:29.814324 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:31:29.814240 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pbrzg/must-gather-6jjdq" Jul 24 11:31:29.816736 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:31:29.816714 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-pbrzg\"/\"kube-root-ca.crt\"" Jul 24 11:31:29.817677 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:31:29.817660 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-pbrzg\"/\"default-dockercfg-ncwxl\"" Jul 24 11:31:29.817735 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:31:29.817683 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-pbrzg\"/\"openshift-service-ca.crt\"" Jul 24 11:31:29.953082 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:31:29.953000 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/31010a21-3e94-4505-b191-71d0f7649ebb-must-gather-output\") pod \"must-gather-6jjdq\" (UID: \"31010a21-3e94-4505-b191-71d0f7649ebb\") " pod="openshift-must-gather-pbrzg/must-gather-6jjdq" Jul 24 11:31:29.953231 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:31:29.953114 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxkg7\" (UniqueName: \"kubernetes.io/projected/31010a21-3e94-4505-b191-71d0f7649ebb-kube-api-access-vxkg7\") pod \"must-gather-6jjdq\" (UID: \"31010a21-3e94-4505-b191-71d0f7649ebb\") " pod="openshift-must-gather-pbrzg/must-gather-6jjdq" Jul 24 11:31:30.054209 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:31:30.054176 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxkg7\" (UniqueName: \"kubernetes.io/projected/31010a21-3e94-4505-b191-71d0f7649ebb-kube-api-access-vxkg7\") pod \"must-gather-6jjdq\" (UID: \"31010a21-3e94-4505-b191-71d0f7649ebb\") " pod="openshift-must-gather-pbrzg/must-gather-6jjdq" Jul 24 11:31:30.054636 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:31:30.054224 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/31010a21-3e94-4505-b191-71d0f7649ebb-must-gather-output\") pod \"must-gather-6jjdq\" (UID: \"31010a21-3e94-4505-b191-71d0f7649ebb\") " pod="openshift-must-gather-pbrzg/must-gather-6jjdq" Jul 24 11:31:30.054636 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:31:30.054533 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/31010a21-3e94-4505-b191-71d0f7649ebb-must-gather-output\") pod \"must-gather-6jjdq\" (UID: \"31010a21-3e94-4505-b191-71d0f7649ebb\") " pod="openshift-must-gather-pbrzg/must-gather-6jjdq" Jul 24 11:31:30.061824 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:31:30.061796 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxkg7\" (UniqueName: \"kubernetes.io/projected/31010a21-3e94-4505-b191-71d0f7649ebb-kube-api-access-vxkg7\") pod \"must-gather-6jjdq\" (UID: \"31010a21-3e94-4505-b191-71d0f7649ebb\") " pod="openshift-must-gather-pbrzg/must-gather-6jjdq" Jul 24 11:31:30.123370 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:31:30.123340 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pbrzg/must-gather-6jjdq" Jul 24 11:31:30.272139 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:31:30.272098 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pbrzg/must-gather-6jjdq"] Jul 24 11:31:30.275049 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:31:30.275019 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod31010a21_3e94_4505_b191_71d0f7649ebb.slice/crio-5fbf58567d71877d2e845a5e65faab1da841d02b5c959078c00f2bbe48a7b9b1 WatchSource:0}: Error finding container 5fbf58567d71877d2e845a5e65faab1da841d02b5c959078c00f2bbe48a7b9b1: Status 404 returned error can't find the container with id 5fbf58567d71877d2e845a5e65faab1da841d02b5c959078c00f2bbe48a7b9b1 Jul 24 11:31:31.008020 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:31:31.007983 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pbrzg/must-gather-6jjdq" event={"ID":"31010a21-3e94-4505-b191-71d0f7649ebb","Type":"ContainerStarted","Data":"5fbf58567d71877d2e845a5e65faab1da841d02b5c959078c00f2bbe48a7b9b1"} Jul 24 11:31:38.048074 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:31:38.047988 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pbrzg/must-gather-6jjdq" event={"ID":"31010a21-3e94-4505-b191-71d0f7649ebb","Type":"ContainerStarted","Data":"412531b6890c94a126d62440ff2d6c63652fa7be133922e758dda44e701be85d"} Jul 24 11:31:39.053850 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:31:39.053811 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pbrzg/must-gather-6jjdq" event={"ID":"31010a21-3e94-4505-b191-71d0f7649ebb","Type":"ContainerStarted","Data":"17b0d94e5ff901f0623a7c4a08b09a31a16196a62fae0c42adc1bf30d466e247"} Jul 24 11:31:39.071843 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:31:39.071794 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-pbrzg/must-gather-6jjdq" podStartSLOduration=2.5600809 podStartE2EDuration="10.071778121s" totalImagesPullingTime="7.511697221s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 11:31:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 11:31:39.070347179 +0000 UTC m=+490.088401773" watchObservedRunningTime="2026-07-24 11:31:39.071778121 +0000 UTC m=+490.089832683" Jul 24 11:32:25.269539 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:25.269501 2586 generic.go:356] "Generic (PLEG): container finished" podID="31010a21-3e94-4505-b191-71d0f7649ebb" containerID="412531b6890c94a126d62440ff2d6c63652fa7be133922e758dda44e701be85d" exitCode=0 Jul 24 11:32:25.269979 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:25.269586 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pbrzg/must-gather-6jjdq" event={"ID":"31010a21-3e94-4505-b191-71d0f7649ebb","Type":"ContainerDied","Data":"412531b6890c94a126d62440ff2d6c63652fa7be133922e758dda44e701be85d"} Jul 24 11:32:25.269979 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:25.269923 2586 scope.go:117] "RemoveContainer" containerID="412531b6890c94a126d62440ff2d6c63652fa7be133922e758dda44e701be85d" Jul 24 11:32:25.753596 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:25.753546 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-pbrzg_must-gather-6jjdq_31010a21-3e94-4505-b191-71d0f7649ebb/gather/0.log" Jul 24 11:32:29.138874 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:29.138839 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-6djk7_cc095a00-6820-40bf-a3a4-24c63bf7869b/global-pull-secret-syncer/0.log" Jul 24 11:32:29.351884 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:29.351844 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-wqkd5_284caaf1-7e86-411d-b5c2-1ffd87dd1017/konnectivity-agent/0.log" Jul 24 11:32:29.435671 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:29.435637 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-219.ec2.internal_0a58966c9c9415e0cb0e62662bc78ddb/haproxy/0.log" Jul 24 11:32:31.097252 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:31.097212 2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-pbrzg/must-gather-6jjdq"] Jul 24 11:32:31.097775 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:31.097449 2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-pbrzg/must-gather-6jjdq" podUID="31010a21-3e94-4505-b191-71d0f7649ebb" containerName="copy" containerID="cri-o://17b0d94e5ff901f0623a7c4a08b09a31a16196a62fae0c42adc1bf30d466e247" gracePeriod=2 Jul 24 11:32:31.104217 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:31.104140 2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-pbrzg/must-gather-6jjdq"] Jul 24 11:32:31.104217 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:32:31.104193 2586 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"31010a21-3e94-4505-b191-71d0f7649ebb\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"openshift-must-gather-pbrzg\"/\"must-gather-6jjdq\": pods \"must-gather-6jjdq\" not found" pod="openshift-must-gather-pbrzg/must-gather-6jjdq" Jul 24 11:32:31.296505 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:31.296472 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-pbrzg_must-gather-6jjdq_31010a21-3e94-4505-b191-71d0f7649ebb/copy/0.log" Jul 24 11:32:31.296843 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:31.296820 2586 generic.go:356] "Generic (PLEG): container finished" podID="31010a21-3e94-4505-b191-71d0f7649ebb" containerID="17b0d94e5ff901f0623a7c4a08b09a31a16196a62fae0c42adc1bf30d466e247" exitCode=143 Jul 24 11:32:31.332146 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:31.332126 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-pbrzg_must-gather-6jjdq_31010a21-3e94-4505-b191-71d0f7649ebb/copy/0.log" Jul 24 11:32:31.333667 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:31.333651 2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pbrzg/must-gather-6jjdq" Jul 24 11:32:31.335709 ip-10-0-137-219 kubenswrapper[2586]: E0724 11:32:31.335688 2586 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-6jjdq\" is forbidden: User \"system:node:ip-10-0-137-219.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-pbrzg\": no relationship found between node 'ip-10-0-137-219.ec2.internal' and this object" podUID="31010a21-3e94-4505-b191-71d0f7649ebb" pod="openshift-must-gather-pbrzg/must-gather-6jjdq" Jul 24 11:32:31.407929 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:31.407854 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vxkg7\" (UniqueName: \"kubernetes.io/projected/31010a21-3e94-4505-b191-71d0f7649ebb-kube-api-access-vxkg7\") pod \"31010a21-3e94-4505-b191-71d0f7649ebb\" (UID: \"31010a21-3e94-4505-b191-71d0f7649ebb\") " Jul 24 11:32:31.407929 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:31.407905 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/31010a21-3e94-4505-b191-71d0f7649ebb-must-gather-output\") pod \"31010a21-3e94-4505-b191-71d0f7649ebb\" (UID: \"31010a21-3e94-4505-b191-71d0f7649ebb\") " Jul 24 11:32:31.409222 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:31.409193 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31010a21-3e94-4505-b191-71d0f7649ebb-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "31010a21-3e94-4505-b191-71d0f7649ebb" (UID: "31010a21-3e94-4505-b191-71d0f7649ebb"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 11:32:31.410017 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:31.409988 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31010a21-3e94-4505-b191-71d0f7649ebb-kube-api-access-vxkg7" (OuterVolumeSpecName: "kube-api-access-vxkg7") pod "31010a21-3e94-4505-b191-71d0f7649ebb" (UID: "31010a21-3e94-4505-b191-71d0f7649ebb"). InnerVolumeSpecName "kube-api-access-vxkg7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 11:32:31.508897 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:31.508858 2586 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/31010a21-3e94-4505-b191-71d0f7649ebb-must-gather-output\") on node \"ip-10-0-137-219.ec2.internal\" DevicePath \"\"" Jul 24 11:32:31.508897 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:31.508890 2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vxkg7\" (UniqueName: \"kubernetes.io/projected/31010a21-3e94-4505-b191-71d0f7649ebb-kube-api-access-vxkg7\") on node \"ip-10-0-137-219.ec2.internal\" DevicePath \"\"" Jul 24 11:32:31.684926 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:31.684896 2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31010a21-3e94-4505-b191-71d0f7649ebb" path="/var/lib/kubelet/pods/31010a21-3e94-4505-b191-71d0f7649ebb/volumes" Jul 24 11:32:32.302423 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:32.302395 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-pbrzg_must-gather-6jjdq_31010a21-3e94-4505-b191-71d0f7649ebb/copy/0.log" Jul 24 11:32:32.302848 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:32.302809 2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pbrzg/must-gather-6jjdq" Jul 24 11:32:32.302848 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:32.302832 2586 scope.go:117] "RemoveContainer" containerID="17b0d94e5ff901f0623a7c4a08b09a31a16196a62fae0c42adc1bf30d466e247" Jul 24 11:32:32.310637 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:32.310615 2586 scope.go:117] "RemoveContainer" containerID="412531b6890c94a126d62440ff2d6c63652fa7be133922e758dda44e701be85d" Jul 24 11:32:33.279527 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:33.279444 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_cdc11576-1131-4b70-9303-39286a350051/alertmanager/0.log" Jul 24 11:32:33.306097 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:33.306072 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_cdc11576-1131-4b70-9303-39286a350051/config-reloader/0.log" Jul 24 11:32:33.331017 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:33.330974 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_cdc11576-1131-4b70-9303-39286a350051/kube-rbac-proxy-web/0.log" Jul 24 11:32:33.363411 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:33.363387 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_cdc11576-1131-4b70-9303-39286a350051/kube-rbac-proxy/0.log" Jul 24 11:32:33.389283 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:33.389254 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_cdc11576-1131-4b70-9303-39286a350051/kube-rbac-proxy-metric/0.log" Jul 24 11:32:33.412888 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:33.412868 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_cdc11576-1131-4b70-9303-39286a350051/prom-label-proxy/0.log" Jul 24 11:32:33.436808 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:33.436781 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_cdc11576-1131-4b70-9303-39286a350051/init-config-reloader/0.log" Jul 24 11:32:33.508021 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:33.507982 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-cbtbl_363e784c-5048-43b9-b914-315e86a973f6/kube-state-metrics/0.log" Jul 24 11:32:33.533926 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:33.533840 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-cbtbl_363e784c-5048-43b9-b914-315e86a973f6/kube-rbac-proxy-main/0.log" Jul 24 11:32:33.569227 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:33.569198 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-cbtbl_363e784c-5048-43b9-b914-315e86a973f6/kube-rbac-proxy-self/0.log" Jul 24 11:32:33.606427 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:33.606398 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5f58d9bdd-7gkpt_e5c84ffe-91a4-4aa6-b46e-88296bdc3fa7/metrics-server/0.log" Jul 24 11:32:33.774426 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:33.774400 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ctt42_c2fe5a06-c933-4213-9156-6fa4320dd55b/node-exporter/0.log" Jul 24 11:32:33.807961 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:33.807883 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ctt42_c2fe5a06-c933-4213-9156-6fa4320dd55b/kube-rbac-proxy/0.log" Jul 24 11:32:33.841063 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:33.841042 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ctt42_c2fe5a06-c933-4213-9156-6fa4320dd55b/init-textfile/0.log" Jul 24 11:32:33.998276 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:33.998245 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-rgmjd_fd5b052c-2d49-4970-8d88-ce251beb86f6/kube-rbac-proxy-main/0.log" Jul 24 11:32:34.025368 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:34.025343 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-rgmjd_fd5b052c-2d49-4970-8d88-ce251beb86f6/kube-rbac-proxy-self/0.log" Jul 24 11:32:34.071841 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:34.071741 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-rgmjd_fd5b052c-2d49-4970-8d88-ce251beb86f6/openshift-state-metrics/0.log" Jul 24 11:32:34.137933 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:34.137896 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_98015f82-98c5-4490-a292-4be78849ebaa/prometheus/0.log" Jul 24 11:32:34.201705 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:34.201678 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_98015f82-98c5-4490-a292-4be78849ebaa/config-reloader/0.log" Jul 24 11:32:34.255772 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:34.255748 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_98015f82-98c5-4490-a292-4be78849ebaa/thanos-sidecar/0.log" Jul 24 11:32:34.296720 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:34.296693 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_98015f82-98c5-4490-a292-4be78849ebaa/kube-rbac-proxy-web/0.log" Jul 24 11:32:34.332281 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:34.332190 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_98015f82-98c5-4490-a292-4be78849ebaa/kube-rbac-proxy/0.log" Jul 24 11:32:34.368204 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:34.368172 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_98015f82-98c5-4490-a292-4be78849ebaa/kube-rbac-proxy-thanos/0.log" Jul 24 11:32:34.396261 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:34.396223 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_98015f82-98c5-4490-a292-4be78849ebaa/init-config-reloader/0.log" Jul 24 11:32:34.434045 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:34.434012 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-f7c7k_6917a111-1ee2-4b2f-a507-af521ce3700a/prometheus-operator/0.log" Jul 24 11:32:34.464964 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:34.464931 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-f7c7k_6917a111-1ee2-4b2f-a507-af521ce3700a/kube-rbac-proxy/0.log" Jul 24 11:32:34.503952 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:34.503923 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7f8d78f54b-htzr7_1d3b27cf-8868-4b10-9b51-c5d308119027/prometheus-operator-admission-webhook/0.log" Jul 24 11:32:34.573334 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:34.573302 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-886dfc5d6-xx882_cb9f5b60-94f4-4877-9045-601d9ff76ed2/telemeter-client/0.log" Jul 24 11:32:34.617529 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:34.617504 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-886dfc5d6-xx882_cb9f5b60-94f4-4877-9045-601d9ff76ed2/reload/0.log" Jul 24 11:32:34.652678 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:34.652653 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-886dfc5d6-xx882_cb9f5b60-94f4-4877-9045-601d9ff76ed2/kube-rbac-proxy/0.log" Jul 24 11:32:34.693469 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:34.693446 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-576cbf95bb-qwsgk_13076bfe-fda6-4c26-bb9d-dc48b24e3ed3/thanos-query/0.log" Jul 24 11:32:34.727714 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:34.727688 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-576cbf95bb-qwsgk_13076bfe-fda6-4c26-bb9d-dc48b24e3ed3/kube-rbac-proxy-web/0.log" Jul 24 11:32:34.758943 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:34.758911 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-576cbf95bb-qwsgk_13076bfe-fda6-4c26-bb9d-dc48b24e3ed3/kube-rbac-proxy/0.log" Jul 24 11:32:34.790885 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:34.790857 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-576cbf95bb-qwsgk_13076bfe-fda6-4c26-bb9d-dc48b24e3ed3/prom-label-proxy/0.log" Jul 24 11:32:34.820960 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:34.820935 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-576cbf95bb-qwsgk_13076bfe-fda6-4c26-bb9d-dc48b24e3ed3/kube-rbac-proxy-rules/0.log" Jul 24 11:32:34.849894 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:34.849862 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-576cbf95bb-qwsgk_13076bfe-fda6-4c26-bb9d-dc48b24e3ed3/kube-rbac-proxy-metrics/0.log" Jul 24 11:32:36.284383 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:36.284346 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-t99jp/perf-node-gather-daemonset-grmnh"] Jul 24 11:32:36.284800 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:36.284733 2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31010a21-3e94-4505-b191-71d0f7649ebb" containerName="gather" Jul 24 11:32:36.284800 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:36.284746 2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="31010a21-3e94-4505-b191-71d0f7649ebb" containerName="gather" Jul 24 11:32:36.284800 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:36.284758 2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31010a21-3e94-4505-b191-71d0f7649ebb" containerName="copy" Jul 24 11:32:36.284800 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:36.284766 2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="31010a21-3e94-4505-b191-71d0f7649ebb" containerName="copy" Jul 24 11:32:36.284925 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:36.284841 2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="31010a21-3e94-4505-b191-71d0f7649ebb" containerName="copy" Jul 24 11:32:36.284925 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:36.284855 2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="31010a21-3e94-4505-b191-71d0f7649ebb" containerName="gather" Jul 24 11:32:36.288524 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:36.288501 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-t99jp/perf-node-gather-daemonset-grmnh" Jul 24 11:32:36.298065 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:36.298042 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-t99jp\"/\"kube-root-ca.crt\"" Jul 24 11:32:36.298465 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:36.298447 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-t99jp\"/\"openshift-service-ca.crt\"" Jul 24 11:32:36.298882 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:36.298868 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-t99jp\"/\"default-dockercfg-f2fmq\"" Jul 24 11:32:36.303242 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:36.303221 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-t99jp/perf-node-gather-daemonset-grmnh"] Jul 24 11:32:36.352191 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:36.352150 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/13e429d9-e798-4ea7-80a3-6ab1dc8af21c-sys\") pod \"perf-node-gather-daemonset-grmnh\" (UID: \"13e429d9-e798-4ea7-80a3-6ab1dc8af21c\") " pod="openshift-must-gather-t99jp/perf-node-gather-daemonset-grmnh" Jul 24 11:32:36.352191 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:36.352190 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/13e429d9-e798-4ea7-80a3-6ab1dc8af21c-podres\") pod \"perf-node-gather-daemonset-grmnh\" (UID: \"13e429d9-e798-4ea7-80a3-6ab1dc8af21c\") " pod="openshift-must-gather-t99jp/perf-node-gather-daemonset-grmnh" Jul 24 11:32:36.352404 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:36.352217 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/13e429d9-e798-4ea7-80a3-6ab1dc8af21c-lib-modules\") pod \"perf-node-gather-daemonset-grmnh\" (UID: \"13e429d9-e798-4ea7-80a3-6ab1dc8af21c\") " pod="openshift-must-gather-t99jp/perf-node-gather-daemonset-grmnh" Jul 24 11:32:36.352404 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:36.352292 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9mpb\" (UniqueName: \"kubernetes.io/projected/13e429d9-e798-4ea7-80a3-6ab1dc8af21c-kube-api-access-f9mpb\") pod \"perf-node-gather-daemonset-grmnh\" (UID: \"13e429d9-e798-4ea7-80a3-6ab1dc8af21c\") " pod="openshift-must-gather-t99jp/perf-node-gather-daemonset-grmnh" Jul 24 11:32:36.352404 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:36.352354 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/13e429d9-e798-4ea7-80a3-6ab1dc8af21c-proc\") pod \"perf-node-gather-daemonset-grmnh\" (UID: \"13e429d9-e798-4ea7-80a3-6ab1dc8af21c\") " pod="openshift-must-gather-t99jp/perf-node-gather-daemonset-grmnh" Jul 24 11:32:36.453484 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:36.453444 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/13e429d9-e798-4ea7-80a3-6ab1dc8af21c-proc\") pod \"perf-node-gather-daemonset-grmnh\" (UID: \"13e429d9-e798-4ea7-80a3-6ab1dc8af21c\") " pod="openshift-must-gather-t99jp/perf-node-gather-daemonset-grmnh" Jul 24 11:32:36.453669 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:36.453513 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/13e429d9-e798-4ea7-80a3-6ab1dc8af21c-sys\") pod \"perf-node-gather-daemonset-grmnh\" (UID: \"13e429d9-e798-4ea7-80a3-6ab1dc8af21c\") " pod="openshift-must-gather-t99jp/perf-node-gather-daemonset-grmnh" Jul 24 11:32:36.453669 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:36.453534 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/13e429d9-e798-4ea7-80a3-6ab1dc8af21c-podres\") pod \"perf-node-gather-daemonset-grmnh\" (UID: \"13e429d9-e798-4ea7-80a3-6ab1dc8af21c\") " pod="openshift-must-gather-t99jp/perf-node-gather-daemonset-grmnh" Jul 24 11:32:36.453669 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:36.453558 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/13e429d9-e798-4ea7-80a3-6ab1dc8af21c-lib-modules\") pod \"perf-node-gather-daemonset-grmnh\" (UID: \"13e429d9-e798-4ea7-80a3-6ab1dc8af21c\") " pod="openshift-must-gather-t99jp/perf-node-gather-daemonset-grmnh" Jul 24 11:32:36.453669 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:36.453616 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9mpb\" (UniqueName: \"kubernetes.io/projected/13e429d9-e798-4ea7-80a3-6ab1dc8af21c-kube-api-access-f9mpb\") pod \"perf-node-gather-daemonset-grmnh\" (UID: \"13e429d9-e798-4ea7-80a3-6ab1dc8af21c\") " pod="openshift-must-gather-t99jp/perf-node-gather-daemonset-grmnh" Jul 24 11:32:36.453669 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:36.453620 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/13e429d9-e798-4ea7-80a3-6ab1dc8af21c-proc\") pod \"perf-node-gather-daemonset-grmnh\" (UID: \"13e429d9-e798-4ea7-80a3-6ab1dc8af21c\") " pod="openshift-must-gather-t99jp/perf-node-gather-daemonset-grmnh" Jul 24 11:32:36.453669 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:36.453620 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/13e429d9-e798-4ea7-80a3-6ab1dc8af21c-sys\") pod \"perf-node-gather-daemonset-grmnh\" (UID: \"13e429d9-e798-4ea7-80a3-6ab1dc8af21c\") " pod="openshift-must-gather-t99jp/perf-node-gather-daemonset-grmnh" Jul 24 11:32:36.453886 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:36.453706 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/13e429d9-e798-4ea7-80a3-6ab1dc8af21c-podres\") pod \"perf-node-gather-daemonset-grmnh\" (UID: \"13e429d9-e798-4ea7-80a3-6ab1dc8af21c\") " pod="openshift-must-gather-t99jp/perf-node-gather-daemonset-grmnh" Jul 24 11:32:36.453886 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:36.453731 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/13e429d9-e798-4ea7-80a3-6ab1dc8af21c-lib-modules\") pod \"perf-node-gather-daemonset-grmnh\" (UID: \"13e429d9-e798-4ea7-80a3-6ab1dc8af21c\") " pod="openshift-must-gather-t99jp/perf-node-gather-daemonset-grmnh" Jul 24 11:32:36.462089 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:36.462063 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9mpb\" (UniqueName: \"kubernetes.io/projected/13e429d9-e798-4ea7-80a3-6ab1dc8af21c-kube-api-access-f9mpb\") pod \"perf-node-gather-daemonset-grmnh\" (UID: \"13e429d9-e798-4ea7-80a3-6ab1dc8af21c\") " pod="openshift-must-gather-t99jp/perf-node-gather-daemonset-grmnh" Jul 24 11:32:36.598130 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:36.598027 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-t99jp/perf-node-gather-daemonset-grmnh" Jul 24 11:32:36.725319 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:36.725285 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-t99jp/perf-node-gather-daemonset-grmnh"] Jul 24 11:32:36.728878 ip-10-0-137-219 kubenswrapper[2586]: W0724 11:32:36.728851 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod13e429d9_e798_4ea7_80a3_6ab1dc8af21c.slice/crio-cf262a176c6bfe822df665b5b7c38de7b0ebdfeef8b7f78659d81528db03f974 WatchSource:0}: Error finding container cf262a176c6bfe822df665b5b7c38de7b0ebdfeef8b7f78659d81528db03f974: Status 404 returned error can't find the container with id cf262a176c6bfe822df665b5b7c38de7b0ebdfeef8b7f78659d81528db03f974 Jul 24 11:32:37.332199 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:37.332159 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-t99jp/perf-node-gather-daemonset-grmnh" event={"ID":"13e429d9-e798-4ea7-80a3-6ab1dc8af21c","Type":"ContainerStarted","Data":"b6aad58be6bf19de655fd86d0fb27c06f168f570d764a1c598d258249bfa8bf7"} Jul 24 11:32:37.332605 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:37.332237 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-t99jp/perf-node-gather-daemonset-grmnh" event={"ID":"13e429d9-e798-4ea7-80a3-6ab1dc8af21c","Type":"ContainerStarted","Data":"cf262a176c6bfe822df665b5b7c38de7b0ebdfeef8b7f78659d81528db03f974"} Jul 24 11:32:37.332605 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:37.332302 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-t99jp/perf-node-gather-daemonset-grmnh" Jul 24 11:32:37.349236 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:37.349184 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-t99jp/perf-node-gather-daemonset-grmnh" podStartSLOduration=1.349168 podStartE2EDuration="1.349168s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 11:32:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 11:32:37.348057833 +0000 UTC m=+548.366112416" watchObservedRunningTime="2026-07-24 11:32:37.349168 +0000 UTC m=+548.367222545" Jul 24 11:32:38.011379 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:38.011353 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4kdkj_fa539900-5006-4699-878f-650cf6842b6e/dns/0.log" Jul 24 11:32:38.034811 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:38.034779 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4kdkj_fa539900-5006-4699-878f-650cf6842b6e/kube-rbac-proxy/0.log" Jul 24 11:32:38.152415 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:38.152383 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-82kpg_321eae1c-057a-42e8-85e3-ddb84821b4d6/dns-node-resolver/0.log" Jul 24 11:32:38.703829 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:38.703807 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vdcjb_6d6115b5-67cb-4f64-b157-29872df323bb/node-ca/0.log" Jul 24 11:32:39.692872 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:39.692840 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rv8d4_9699ca38-0cdc-471f-8a03-4d65c1517a9f/serve-healthcheck-canary/0.log" Jul 24 11:32:40.146844 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:40.146765 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jtwpm_20114f28-ad5a-4a2f-9c59-efe90df9b6d3/kube-rbac-proxy/0.log" Jul 24 11:32:40.167775 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:40.167739 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jtwpm_20114f28-ad5a-4a2f-9c59-efe90df9b6d3/exporter/0.log" Jul 24 11:32:40.190656 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:40.190630 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jtwpm_20114f28-ad5a-4a2f-9c59-efe90df9b6d3/extractor/0.log" Jul 24 11:32:43.347603 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:43.347557 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-t99jp/perf-node-gather-daemonset-grmnh" Jul 24 11:32:46.621938 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:46.621913 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cj25f_c92f5312-fb6f-4bd2-9e9a-89363c65621c/kube-multus-additional-cni-plugins/0.log" Jul 24 11:32:46.644008 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:46.643980 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cj25f_c92f5312-fb6f-4bd2-9e9a-89363c65621c/egress-router-binary-copy/0.log" Jul 24 11:32:46.668361 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:46.668335 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cj25f_c92f5312-fb6f-4bd2-9e9a-89363c65621c/cni-plugins/0.log" Jul 24 11:32:46.690920 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:46.690900 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cj25f_c92f5312-fb6f-4bd2-9e9a-89363c65621c/bond-cni-plugin/0.log" Jul 24 11:32:46.714420 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:46.714398 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cj25f_c92f5312-fb6f-4bd2-9e9a-89363c65621c/routeoverride-cni/0.log" Jul 24 11:32:46.739429 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:46.739403 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cj25f_c92f5312-fb6f-4bd2-9e9a-89363c65621c/whereabouts-cni-bincopy/0.log" Jul 24 11:32:46.764294 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:46.764266 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cj25f_c92f5312-fb6f-4bd2-9e9a-89363c65621c/whereabouts-cni/0.log" Jul 24 11:32:47.001725 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:47.001693 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-s7l4r_fec1ec6a-7f13-4dfb-8fdf-dec73487246d/kube-multus/0.log" Jul 24 11:32:47.091013 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:47.090984 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-hmcs7_1e159073-9250-4ffc-aa96-224b8ae48029/network-metrics-daemon/0.log" Jul 24 11:32:47.142069 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:47.142038 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-hmcs7_1e159073-9250-4ffc-aa96-224b8ae48029/kube-rbac-proxy/0.log" Jul 24 11:32:48.377364 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:48.377336 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n7wb9_55c78980-902f-4c71-9557-a0c6631fdc8b/ovn-controller/0.log" Jul 24 11:32:48.395790 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:48.395765 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n7wb9_55c78980-902f-4c71-9557-a0c6631fdc8b/ovn-acl-logging/1.log" Jul 24 11:32:48.395790 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:48.395779 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n7wb9_55c78980-902f-4c71-9557-a0c6631fdc8b/ovn-acl-logging/0.log" Jul 24 11:32:48.412176 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:48.412149 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n7wb9_55c78980-902f-4c71-9557-a0c6631fdc8b/kube-rbac-proxy-node/0.log" Jul 24 11:32:48.433564 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:48.433537 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n7wb9_55c78980-902f-4c71-9557-a0c6631fdc8b/kube-rbac-proxy-ovn-metrics/0.log" Jul 24 11:32:48.452272 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:48.452247 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n7wb9_55c78980-902f-4c71-9557-a0c6631fdc8b/northd/0.log" Jul 24 11:32:48.471195 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:48.471168 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n7wb9_55c78980-902f-4c71-9557-a0c6631fdc8b/nbdb/0.log" Jul 24 11:32:48.493058 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:48.493031 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n7wb9_55c78980-902f-4c71-9557-a0c6631fdc8b/sbdb/0.log" Jul 24 11:32:48.533360 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:48.533329 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n7wb9_55c78980-902f-4c71-9557-a0c6631fdc8b/ovnkube-controller/0.log" Jul 24 11:32:49.549189 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:49.549159 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-7hx7h_a5939932-1706-4bde-9ca9-9e03ae19d047/network-check-target-container/0.log" Jul 24 11:32:50.492678 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:50.492652 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-v9xmz_9c2ffd69-ca76-424a-9a0f-4e606ff4a872/iptables-alerter/0.log" Jul 24 11:32:51.120315 ip-10-0-137-219 kubenswrapper[2586]: I0724 11:32:51.120285 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-smc7z_d66aa4b3-d28b-4a11-a0b0-5e45ec334583/tuned/0.log"